[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:11:45.261423  4409 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.78.126:37937
I20260709 12:11:45.262924  4409 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:11:45.263945  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:45.280253  4416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:45.280711  4418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:45.280718  4415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:45.281541  4409 server_base.cc:1061] running on GCE node
I20260709 12:11:46.382503  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:46.382789  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:46.383003  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599106382975 us; error 0 us; skew 500 ppm
I20260709 12:11:46.383867  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:46.389397  4409 webserver.cc:533] Webserver started at http://127.4.78.126:42563/ using document root <none> and password file <none>
I20260709 12:11:46.390331  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:46.390563  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:46.391007  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:46.396777  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/master-0-root/instance:
uuid: "962b1835fef14eafac2406d8cf943815"
format_stamp: "Formatted at 2026-07-09 12:11:46 on dist-test-slave-9t7s"
I20260709 12:11:46.404356  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:11:46.409389  4424 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:46.410468  4409 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:11:46.410805  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/master-0-root
uuid: "962b1835fef14eafac2406d8cf943815"
format_stamp: "Formatted at 2026-07-09 12:11:46 on dist-test-slave-9t7s"
I20260709 12:11:46.411120  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:46.478753  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:46.480264  4409 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:11:46.480701  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:46.548403  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.126:37937
I20260709 12:11:46.548463  4475 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.126:37937 every 8 connection(s)
I20260709 12:11:46.555686  4476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.576284  4476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815: Bootstrap starting.
I20260709 12:11:46.581869  4476 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.583598  4476 log.cc:826] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815: Log is configured to *not* fsync() on all Append() calls
I20260709 12:11:46.588045  4476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815: No bootstrap required, opened a new log
I20260709 12:11:46.608075  4476 raft_consensus.cc:359] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962b1835fef14eafac2406d8cf943815" member_type: VOTER }
I20260709 12:11:46.608608  4476 raft_consensus.cc:385] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.608803  4476 raft_consensus.cc:740] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 962b1835fef14eafac2406d8cf943815, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.609589  4476 consensus_queue.cc:260] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962b1835fef14eafac2406d8cf943815" member_type: VOTER }
I20260709 12:11:46.610069  4476 raft_consensus.cc:399] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:11:46.610306  4476 raft_consensus.cc:493] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:11:46.610584  4476 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.614449  4476 raft_consensus.cc:515] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962b1835fef14eafac2406d8cf943815" member_type: VOTER }
I20260709 12:11:46.615115  4476 leader_election.cc:304] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 962b1835fef14eafac2406d8cf943815; no voters: 
I20260709 12:11:46.616696  4476 leader_election.cc:290] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:11:46.617000  4479 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:46.618975  4479 raft_consensus.cc:697] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [term 1 LEADER]: Becoming Leader. State: Replica: 962b1835fef14eafac2406d8cf943815, State: Running, Role: LEADER
I20260709 12:11:46.619804  4479 consensus_queue.cc:237] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962b1835fef14eafac2406d8cf943815" member_type: VOTER }
I20260709 12:11:46.620841  4476 sys_catalog.cc:565] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:11:46.629241  4481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "962b1835fef14eafac2406d8cf943815" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962b1835fef14eafac2406d8cf943815" member_type: VOTER } }
I20260709 12:11:46.629931  4481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [sys.catalog]: This master's current role is: LEADER
I20260709 12:11:46.629788  4480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 962b1835fef14eafac2406d8cf943815. Latest consensus state: current_term: 1 leader_uuid: "962b1835fef14eafac2406d8cf943815" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962b1835fef14eafac2406d8cf943815" member_type: VOTER } }
I20260709 12:11:46.630378  4480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [sys.catalog]: This master's current role is: LEADER
I20260709 12:11:46.632959  4488 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:11:46.643864  4488 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:11:46.646071  4409 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:11:46.658665  4488 catalog_manager.cc:1383] Generated new cluster ID: fd4d491774c44d6580a3f10901cb25ee
I20260709 12:11:46.658978  4488 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:11:46.674926  4488 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:11:46.676523  4488 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:11:46.692729  4488 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815: Generated new TSK 0
I20260709 12:11:46.693666  4488 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:11:46.712975  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:46.723261  4499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:46.722468  4498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:46.726498  4409 server_base.cc:1061] running on GCE node
W20260709 12:11:46.726888  4501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:46.727842  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:46.728132  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:46.728338  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599106728322 us; error 0 us; skew 500 ppm
I20260709 12:11:46.729115  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:46.733044  4409 webserver.cc:533] Webserver started at http://127.4.78.65:40315/ using document root <none> and password file <none>
I20260709 12:11:46.733721  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:46.733994  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:46.734385  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:46.735885  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-0-root/instance:
uuid: "40a3126818444d638917b895d7512005"
format_stamp: "Formatted at 2026-07-09 12:11:46 on dist-test-slave-9t7s"
I20260709 12:11:46.742466  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.005s
I20260709 12:11:46.747326  4506 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:46.748129  4409 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:11:46.748452  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-0-root
uuid: "40a3126818444d638917b895d7512005"
format_stamp: "Formatted at 2026-07-09 12:11:46 on dist-test-slave-9t7s"
I20260709 12:11:46.748829  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:46.775359  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:46.777074  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:46.779754  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:46.785009  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:46.785305  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:46.785610  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:46.785853  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:11:46.873629  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.65:41717
I20260709 12:11:46.873780  4568 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.65:41717 every 8 connection(s)
I20260709 12:11:46.881377  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:46.894609  4573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:46.897897  4574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:46.910125  4409 server_base.cc:1061] running on GCE node
W20260709 12:11:46.910671  4576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:46.911696  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:46.912016  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:46.912250  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599106912232 us; error 0 us; skew 500 ppm
I20260709 12:11:46.913069  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:46.916818  4569 heartbeater.cc:344] Connected to a master server at 127.4.78.126:37937
I20260709 12:11:46.917268  4569 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:46.917287  4409 webserver.cc:533] Webserver started at http://127.4.78.66:40981/ using document root <none> and password file <none>
I20260709 12:11:46.918061  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:46.918251  4569 heartbeater.cc:507] Master 127.4.78.126:37937 requested a full tablet report, sending...
I20260709 12:11:46.918306  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:46.918748  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:46.920131  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-1-root/instance:
uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
format_stamp: "Formatted at 2026-07-09 12:11:46 on dist-test-slave-9t7s"
I20260709 12:11:46.920998  4441 ts_manager.cc:194] Registered new tserver with Master: 40a3126818444d638917b895d7512005 (127.4.78.65:41717)
I20260709 12:11:46.923048  4441 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45102
I20260709 12:11:46.926612  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:11:46.931723  4581 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:46.932485  4409 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:11:46.932796  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-1-root
uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
format_stamp: "Formatted at 2026-07-09 12:11:46 on dist-test-slave-9t7s"
I20260709 12:11:46.933131  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:46.963989  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:46.965603  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:46.968051  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:46.971544  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:46.971791  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:46.972064  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:46.972268  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:47.055428  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.66:33347
I20260709 12:11:47.055510  4643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.66:33347 every 8 connection(s)
I20260709 12:11:47.064359  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:47.072252  4647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:47.073724  4648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:47.073935  4644 heartbeater.cc:344] Connected to a master server at 127.4.78.126:37937
I20260709 12:11:47.074304  4644 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:47.075287  4644 heartbeater.cc:507] Master 127.4.78.126:37937 requested a full tablet report, sending...
I20260709 12:11:47.077698  4441 ts_manager.cc:194] Registered new tserver with Master: b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:47.077975  4409 server_base.cc:1061] running on GCE node
W20260709 12:11:47.078569  4650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:47.079504  4441 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45114
I20260709 12:11:47.079681  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:47.079917  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:47.080112  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599107080094 us; error 0 us; skew 500 ppm
I20260709 12:11:47.080816  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:47.083932  4409 webserver.cc:533] Webserver started at http://127.4.78.67:35801/ using document root <none> and password file <none>
I20260709 12:11:47.084442  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:47.084627  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:47.084873  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:47.086120  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-2-root/instance:
uuid: "b964ea673ae7482db901c9180a3ed7ae"
format_stamp: "Formatted at 2026-07-09 12:11:47 on dist-test-slave-9t7s"
I20260709 12:11:47.091018  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:11:47.094386  4655 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:47.095170  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:11:47.095425  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-2-root
uuid: "b964ea673ae7482db901c9180a3ed7ae"
format_stamp: "Formatted at 2026-07-09 12:11:47 on dist-test-slave-9t7s"
I20260709 12:11:47.095687  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599105096696-4409-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:47.116986  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:47.118304  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:47.120273  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:47.123102  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:47.123317  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:47.123535  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:47.123683  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:47.202446  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.67:36555
I20260709 12:11:47.202519  4717 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.67:36555 every 8 connection(s)
I20260709 12:11:47.217984  4718 heartbeater.cc:344] Connected to a master server at 127.4.78.126:37937
I20260709 12:11:47.218315  4718 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:47.219054  4718 heartbeater.cc:507] Master 127.4.78.126:37937 requested a full tablet report, sending...
I20260709 12:11:47.220875  4441 ts_manager.cc:194] Registered new tserver with Master: b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:47.221134  4409 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014254712s
I20260709 12:11:47.222723  4441 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45126
I20260709 12:11:47.269939  4441 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45130:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:11:47.273401  4441 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:11:47.378161  4609 tablet_service.cc:1511] Processing CreateTablet for tablet a50bcb984c7042568f6f37fceeaf795b (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:47.379827  4609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a50bcb984c7042568f6f37fceeaf795b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.381121  4608 tablet_service.cc:1511] Processing CreateTablet for tablet 5e972beb1a9f4707a0699bf2c6bd5bae (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:47.381661  4534 tablet_service.cc:1511] Processing CreateTablet for tablet a50bcb984c7042568f6f37fceeaf795b (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:47.382102  4533 tablet_service.cc:1511] Processing CreateTablet for tablet 5e972beb1a9f4707a0699bf2c6bd5bae (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:47.382964  4607 tablet_service.cc:1511] Processing CreateTablet for tablet b83a3524e9ff48e688454397c1fcd61c (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:47.383304  4532 tablet_service.cc:1511] Processing CreateTablet for tablet b83a3524e9ff48e688454397c1fcd61c (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:47.386686  4534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a50bcb984c7042568f6f37fceeaf795b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.386147  4608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e972beb1a9f4707a0699bf2c6bd5bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.387641  4530 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4637b197f741ac8c9d95f2c0a8b887 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:47.387715  4606 tablet_service.cc:1511] Processing CreateTablet for tablet 641dd43bd8b94c3fb6700d503bf9ed56 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:47.392382  4533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e972beb1a9f4707a0699bf2c6bd5bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.393476  4607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83a3524e9ff48e688454397c1fcd61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.394409  4606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 641dd43bd8b94c3fb6700d503bf9ed56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.394181  4605 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4637b197f741ac8c9d95f2c0a8b887 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:47.395481  4605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4637b197f741ac8c9d95f2c0a8b887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.389055  4531 tablet_service.cc:1511] Processing CreateTablet for tablet 641dd43bd8b94c3fb6700d503bf9ed56 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:47.405805  4682 tablet_service.cc:1511] Processing CreateTablet for tablet 5e972beb1a9f4707a0699bf2c6bd5bae (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:47.407588  4682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e972beb1a9f4707a0699bf2c6bd5bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.408120  4532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83a3524e9ff48e688454397c1fcd61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.409955  4683 tablet_service.cc:1511] Processing CreateTablet for tablet a50bcb984c7042568f6f37fceeaf795b (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:47.411895  4683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a50bcb984c7042568f6f37fceeaf795b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.412525  4531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 641dd43bd8b94c3fb6700d503bf9ed56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.413173  4530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4637b197f741ac8c9d95f2c0a8b887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.451540  4681 tablet_service.cc:1511] Processing CreateTablet for tablet b83a3524e9ff48e688454397c1fcd61c (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:47.451891  4680 tablet_service.cc:1511] Processing CreateTablet for tablet 641dd43bd8b94c3fb6700d503bf9ed56 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:47.452919  4681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83a3524e9ff48e688454397c1fcd61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.453557  4680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 641dd43bd8b94c3fb6700d503bf9ed56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.459656  4736 tablet_bootstrap.cc:492] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88: Bootstrap starting.
I20260709 12:11:47.471566  4736 tablet_bootstrap.cc:654] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.479642  4679 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4637b197f741ac8c9d95f2c0a8b887 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:47.491067  4679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4637b197f741ac8c9d95f2c0a8b887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.496230  4529 tablet_service.cc:1511] Processing CreateTablet for tablet dc3df8060598474480c4c8332b9095e2 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:47.502223  4529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3df8060598474480c4c8332b9095e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.507629  4605 tablet_service.cc:1511] Processing CreateTablet for tablet dc3df8060598474480c4c8332b9095e2 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:47.509091  4605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3df8060598474480c4c8332b9095e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.522347  4737 tablet_bootstrap.cc:492] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005: Bootstrap starting.
I20260709 12:11:47.523862  4738 tablet_bootstrap.cc:492] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae: Bootstrap starting.
I20260709 12:11:47.527755  4681 tablet_service.cc:1511] Processing CreateTablet for tablet dc3df8060598474480c4c8332b9095e2 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:47.527982  4533 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8a21d23a5f4fb5a8a829b2f60e7ee6 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:47.529090  4681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3df8060598474480c4c8332b9095e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.529130  4609 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8a21d23a5f4fb5a8a829b2f60e7ee6 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:47.530573  4609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8a21d23a5f4fb5a8a829b2f60e7ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.529153  4533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8a21d23a5f4fb5a8a829b2f60e7ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.544855  4678 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8a21d23a5f4fb5a8a829b2f60e7ee6 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:47.547690  4678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8a21d23a5f4fb5a8a829b2f60e7ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.552284  4531 tablet_service.cc:1511] Processing CreateTablet for tablet fba63f37db064ed485438cdfe556f990 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:47.553923  4531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba63f37db064ed485438cdfe556f990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.573719  4677 tablet_service.cc:1511] Processing CreateTablet for tablet fba63f37db064ed485438cdfe556f990 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:47.575572  4532 tablet_service.cc:1511] Processing CreateTablet for tablet 97a6d6ea1a6c4632add993edb587f726 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:47.576930  4677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba63f37db064ed485438cdfe556f990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.577075  4532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a6d6ea1a6c4632add993edb587f726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.572971  4607 tablet_service.cc:1511] Processing CreateTablet for tablet fba63f37db064ed485438cdfe556f990 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:47.599494  4738 tablet_bootstrap.cc:654] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.603202  4607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba63f37db064ed485438cdfe556f990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.619374  4736 tablet_bootstrap.cc:492] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88: No bootstrap required, opened a new log
I20260709 12:11:47.619926  4736 ts_tablet_manager.cc:1403] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.034s
I20260709 12:11:47.622473  4738 tablet_bootstrap.cc:492] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae: No bootstrap required, opened a new log
I20260709 12:11:47.622987  4738 ts_tablet_manager.cc:1403] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.013s
I20260709 12:11:47.623210  4605 tablet_service.cc:1511] Processing CreateTablet for tablet 97a6d6ea1a6c4632add993edb587f726 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:47.624706  4605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a6d6ea1a6c4632add993edb587f726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.624878  4682 tablet_service.cc:1511] Processing CreateTablet for tablet 97a6d6ea1a6c4632add993edb587f726 (DEFAULT_TABLE table=test-workload [id=2c12e00f8a2d4260b7a6b52882760577]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:47.625028  4736 raft_consensus.cc:359] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.625830  4736 raft_consensus.cc:385] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.626106  4682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a6d6ea1a6c4632add993edb587f726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:47.626118  4736 raft_consensus.cc:740] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.630410  4736 consensus_queue.cc:260] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
W20260709 12:11:47.638906  4489 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:11:47.646435  4737 tablet_bootstrap.cc:654] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.646183  4738 raft_consensus.cc:359] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.650631  4738 raft_consensus.cc:385] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.650805  4644 heartbeater.cc:499] Master 127.4.78.126:37937 was elected leader, sending a full tablet report...
I20260709 12:11:47.651217  4736 ts_tablet_manager.cc:1434] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.014s
I20260709 12:11:47.651214  4738 raft_consensus.cc:740] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.652757  4736 tablet_bootstrap.cc:492] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88: Bootstrap starting.
I20260709 12:11:47.652843  4738 consensus_queue.cc:260] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.665273  4738 ts_tablet_manager.cc:1434] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae: Time spent starting tablet: real 0.042s	user 0.000s	sys 0.010s
I20260709 12:11:47.665882  4718 heartbeater.cc:499] Master 127.4.78.126:37937 was elected leader, sending a full tablet report...
I20260709 12:11:47.666217  4738 tablet_bootstrap.cc:492] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae: Bootstrap starting.
I20260709 12:11:47.669924  4737 tablet_bootstrap.cc:492] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005: No bootstrap required, opened a new log
I20260709 12:11:47.670445  4737 ts_tablet_manager.cc:1403] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005: Time spent bootstrapping tablet: real 0.161s	user 0.014s	sys 0.008s
I20260709 12:11:47.673309  4737 raft_consensus.cc:359] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.674116  4737 raft_consensus.cc:385] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.674461  4737 raft_consensus.cc:740] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.675331  4737 consensus_queue.cc:260] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.677256  4736 tablet_bootstrap.cc:654] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.685086  4738 tablet_bootstrap.cc:654] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.698516  4738 tablet_bootstrap.cc:492] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae: No bootstrap required, opened a new log
I20260709 12:11:47.699000  4738 ts_tablet_manager.cc:1403] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.007s
I20260709 12:11:47.699774  4741 raft_consensus.cc:493] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.700271  4741 raft_consensus.cc:515] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.703588  4741 leader_election.cc:290] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
W20260709 12:11:47.709784  4719 tablet.cc:2406] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:11:47.715382  4569 heartbeater.cc:499] Master 127.4.78.126:37937 was elected leader, sending a full tablet report...
I20260709 12:11:47.715965  4737 ts_tablet_manager.cc:1434] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005: Time spent starting tablet: real 0.045s	user 0.019s	sys 0.021s
I20260709 12:11:47.715660  4738 raft_consensus.cc:359] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.716459  4738 raft_consensus.cc:385] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.716765  4738 raft_consensus.cc:740] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.716975  4737 tablet_bootstrap.cc:492] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005: Bootstrap starting.
I20260709 12:11:47.724273  4737 tablet_bootstrap.cc:654] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.723661  4736 tablet_bootstrap.cc:492] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88: No bootstrap required, opened a new log
I20260709 12:11:47.727715  4736 ts_tablet_manager.cc:1403] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.026s
I20260709 12:11:47.730574  4736 raft_consensus.cc:359] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.731324  4736 raft_consensus.cc:385] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.731715  4736 raft_consensus.cc:740] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.735771  4736 consensus_queue.cc:260] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.742023  4736 ts_tablet_manager.cc:1434] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:11:47.719380  4738 consensus_queue.cc:260] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.743666  4736 tablet_bootstrap.cc:492] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88: Bootstrap starting.
I20260709 12:11:47.746196  4738 ts_tablet_manager.cc:1434] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.002s
I20260709 12:11:47.747066  4738 tablet_bootstrap.cc:492] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae: Bootstrap starting.
I20260709 12:11:47.778702  4738 tablet_bootstrap.cc:654] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.779161  4737 tablet_bootstrap.cc:492] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005: No bootstrap required, opened a new log
I20260709 12:11:47.779645  4737 ts_tablet_manager.cc:1403] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.025s
I20260709 12:11:47.782435  4737 raft_consensus.cc:359] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.783150  4737 raft_consensus.cc:385] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.783448  4737 raft_consensus.cc:740] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.784119  4737 consensus_queue.cc:260] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.787645  4693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a50bcb984c7042568f6f37fceeaf795b" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae" is_pre_election: true
W20260709 12:11:47.789614  4585 leader_election.cc:343] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:47.791076  4738 tablet_bootstrap.cc:492] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae: No bootstrap required, opened a new log
I20260709 12:11:47.791561  4738 ts_tablet_manager.cc:1403] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.029s
I20260709 12:11:47.791921  4736 tablet_bootstrap.cc:654] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.794451  4738 raft_consensus.cc:359] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.795279  4738 raft_consensus.cc:385] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.795632  4738 raft_consensus.cc:740] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.795933  4737 ts_tablet_manager.cc:1434] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.006s
I20260709 12:11:47.795732  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a50bcb984c7042568f6f37fceeaf795b" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005" is_pre_election: true
I20260709 12:11:47.796875  4737 tablet_bootstrap.cc:492] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005: Bootstrap starting.
I20260709 12:11:47.796494  4738 consensus_queue.cc:260] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
W20260709 12:11:47.797451  4583 leader_election.cc:343] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a3126818444d638917b895d7512005 (127.4.78.65:41717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:47.797879  4583 leader_election.cc:304] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88; no voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae
I20260709 12:11:47.799059  4738 ts_tablet_manager.cc:1434] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:11:47.798995  4741 raft_consensus.cc:2749] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:47.800390  4738 tablet_bootstrap.cc:492] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae: Bootstrap starting.
I20260709 12:11:47.803951  4737 tablet_bootstrap.cc:654] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.807806  4736 tablet_bootstrap.cc:492] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88: No bootstrap required, opened a new log
I20260709 12:11:47.808286  4736 ts_tablet_manager.cc:1403] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.008s
I20260709 12:11:47.811014  4736 raft_consensus.cc:359] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.811748  4736 raft_consensus.cc:385] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.812036  4736 raft_consensus.cc:740] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.812743  4736 consensus_queue.cc:260] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.816831  4738 tablet_bootstrap.cc:654] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.817433  4736 ts_tablet_manager.cc:1434] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 12:11:47.818586  4736 tablet_bootstrap.cc:492] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88: Bootstrap starting.
I20260709 12:11:47.832434  4737 tablet_bootstrap.cc:492] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005: No bootstrap required, opened a new log
I20260709 12:11:47.832828  4737 ts_tablet_manager.cc:1403] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.023s
I20260709 12:11:47.833359  4736 tablet_bootstrap.cc:654] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.835348  4737 raft_consensus.cc:359] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.836123  4737 raft_consensus.cc:385] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.836452  4738 tablet_bootstrap.cc:492] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae: No bootstrap required, opened a new log
I20260709 12:11:47.836419  4737 raft_consensus.cc:740] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.837020  4738 ts_tablet_manager.cc:1403] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae: Time spent bootstrapping tablet: real 0.037s	user 0.003s	sys 0.008s
I20260709 12:11:47.837289  4737 consensus_queue.cc:260] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.839843  4737 ts_tablet_manager.cc:1434] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:11:47.840831  4737 tablet_bootstrap.cc:492] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005: Bootstrap starting.
I20260709 12:11:47.842258  4738 raft_consensus.cc:359] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.843156  4738 raft_consensus.cc:385] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.843483  4738 raft_consensus.cc:740] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.844390  4738 consensus_queue.cc:260] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.846511  4738 ts_tablet_manager.cc:1434] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.007s
I20260709 12:11:47.847626  4737 tablet_bootstrap.cc:654] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.851079  4738 tablet_bootstrap.cc:492] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae: Bootstrap starting.
I20260709 12:11:47.859642  4736 tablet_bootstrap.cc:492] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88: No bootstrap required, opened a new log
I20260709 12:11:47.860045  4736 ts_tablet_manager.cc:1403] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.002s
I20260709 12:11:47.861162  4741 raft_consensus.cc:493] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.861640  4741 raft_consensus.cc:515] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.862428  4736 raft_consensus.cc:359] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.863142  4736 raft_consensus.cc:385] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.863341  4737 tablet_bootstrap.cc:492] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005: No bootstrap required, opened a new log
I20260709 12:11:47.863438  4736 raft_consensus.cc:740] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.863715  4741 leader_election.cc:290] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:47.864183  4736 consensus_queue.cc:260] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.864852  4693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae" is_pre_election: true
I20260709 12:11:47.865257  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005" is_pre_election: true
I20260709 12:11:47.866392  4736 ts_tablet_manager.cc:1434] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
W20260709 12:11:47.866441  4585 leader_election.cc:343] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:47.867166  4737 ts_tablet_manager.cc:1403] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.000s
I20260709 12:11:47.867303  4736 tablet_bootstrap.cc:492] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88: Bootstrap starting.
W20260709 12:11:47.868585  4583 leader_election.cc:343] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a3126818444d638917b895d7512005 (127.4.78.65:41717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:47.871085  4583 leader_election.cc:304] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88; no voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae
I20260709 12:11:47.870879  4737 raft_consensus.cc:359] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.871836  4737 raft_consensus.cc:385] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.872244  4737 raft_consensus.cc:740] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.872361  4741 raft_consensus.cc:2749] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:47.873332  4737 consensus_queue.cc:260] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.875197  4736 tablet_bootstrap.cc:654] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.877135  4738 tablet_bootstrap.cc:654] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.883956  4737 ts_tablet_manager.cc:1434] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:11:47.889719  4737 tablet_bootstrap.cc:492] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005: Bootstrap starting.
I20260709 12:11:47.898061  4737 tablet_bootstrap.cc:654] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.900781  4738 tablet_bootstrap.cc:492] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae: No bootstrap required, opened a new log
I20260709 12:11:47.901275  4738 ts_tablet_manager.cc:1403] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae: Time spent bootstrapping tablet: real 0.050s	user 0.007s	sys 0.003s
I20260709 12:11:47.904199  4738 raft_consensus.cc:359] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.904953  4738 raft_consensus.cc:385] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.905252  4738 raft_consensus.cc:740] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.905990  4738 consensus_queue.cc:260] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.909329  4736 tablet_bootstrap.cc:492] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88: No bootstrap required, opened a new log
I20260709 12:11:47.909462  4738 ts_tablet_manager.cc:1434] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:11:47.909919  4736 ts_tablet_manager.cc:1403] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent bootstrapping tablet: real 0.043s	user 0.028s	sys 0.012s
I20260709 12:11:47.910506  4738 tablet_bootstrap.cc:492] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae: Bootstrap starting.
I20260709 12:11:47.912861  4736 raft_consensus.cc:359] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.913656  4736 raft_consensus.cc:385] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.914034  4736 raft_consensus.cc:740] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.914749  4736 consensus_queue.cc:260] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.916929  4736 ts_tablet_manager.cc:1434] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:11:47.917886  4736 tablet_bootstrap.cc:492] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88: Bootstrap starting.
I20260709 12:11:47.919874  4738 tablet_bootstrap.cc:654] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.924259  4736 tablet_bootstrap.cc:654] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.928253  4737 tablet_bootstrap.cc:492] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005: No bootstrap required, opened a new log
I20260709 12:11:47.928762  4737 ts_tablet_manager.cc:1403] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.010s
I20260709 12:11:47.931502  4737 raft_consensus.cc:359] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.932274  4737 raft_consensus.cc:385] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.932559  4737 raft_consensus.cc:740] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.932600  4756 raft_consensus.cc:493] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.933166  4756 raft_consensus.cc:515] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.933631  4737 consensus_queue.cc:260] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.935230  4756 leader_election.cc:290] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:47.936509  4736 tablet_bootstrap.cc:492] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88: No bootstrap required, opened a new log
I20260709 12:11:47.936935  4736 ts_tablet_manager.cc:1403] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 12:11:47.936808  4693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae" is_pre_election: true
I20260709 12:11:47.937450  4693 raft_consensus.cc:2468] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 0.
I20260709 12:11:47.937955  4737 ts_tablet_manager.cc:1434] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:11:47.938938  4737 tablet_bootstrap.cc:492] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005: Bootstrap starting.
I20260709 12:11:47.938848  4585 leader_election.cc:304] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:47.940840  4738 tablet_bootstrap.cc:492] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae: No bootstrap required, opened a new log
I20260709 12:11:47.940989  4741 raft_consensus.cc:2804] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:47.941315  4741 raft_consensus.cc:493] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.941620  4741 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.943544  4736 raft_consensus.cc:359] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.944248  4736 raft_consensus.cc:385] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.944543  4736 raft_consensus.cc:740] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.945689  4737 tablet_bootstrap.cc:654] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.945871  4738 ts_tablet_manager.cc:1403] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.007s
I20260709 12:11:47.945927  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005" is_pre_election: true
I20260709 12:11:47.946573  4544 raft_consensus.cc:2468] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 0.
I20260709 12:11:47.948863  4738 raft_consensus.cc:359] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.949589  4738 raft_consensus.cc:385] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.949880  4738 raft_consensus.cc:740] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.950572  4738 consensus_queue.cc:260] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.951884  4756 raft_consensus.cc:493] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.952328  4756 raft_consensus.cc:515] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.945258  4736 consensus_queue.cc:260] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.952687  4738 ts_tablet_manager.cc:1434] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:11:47.955071  4738 tablet_bootstrap.cc:492] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae: Bootstrap starting.
I20260709 12:11:47.955117  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005" is_pre_election: true
I20260709 12:11:47.955742  4544 raft_consensus.cc:2468] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 0.
I20260709 12:11:47.958280  4693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae" is_pre_election: true
I20260709 12:11:47.958894  4693 raft_consensus.cc:2468] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 0.
I20260709 12:11:47.960186  4585 leader_election.cc:304] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:47.960531  4737 tablet_bootstrap.cc:492] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005: No bootstrap required, opened a new log
I20260709 12:11:47.961000  4737 ts_tablet_manager.cc:1403] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 12:11:47.962311  4756 leader_election.cc:290] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:47.964334  4763 raft_consensus.cc:2804] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:47.964116  4737 raft_consensus.cc:359] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.964766  4736 ts_tablet_manager.cc:1434] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:11:47.964850  4737 raft_consensus.cc:385] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.965307  4738 tablet_bootstrap.cc:654] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.965289  4737 raft_consensus.cc:740] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.966271  4737 consensus_queue.cc:260] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.968736  4737 ts_tablet_manager.cc:1434] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:11:47.969632  4737 tablet_bootstrap.cc:492] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005: Bootstrap starting.
I20260709 12:11:47.971930  4741 raft_consensus.cc:515] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.981931  4741 leader_election.cc:290] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:47.975787  4737 tablet_bootstrap.cc:654] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.964736  4763 raft_consensus.cc:493] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.979808  4736 tablet_bootstrap.cc:492] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88: Bootstrap starting.
I20260709 12:11:47.983013  4763 raft_consensus.cc:3060] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.989526  4736 tablet_bootstrap.cc:654] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.990340  4763 raft_consensus.cc:515] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:47.992374  4763 leader_election.cc:290] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:47.993331  4543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:47.993999  4543 raft_consensus.cc:3060] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.999240  4693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:47.999506  4692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:48.000020  4693 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.000233  4692 raft_consensus.cc:3060] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.983019  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:48.001037  4544 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.010823  4743 raft_consensus.cc:493] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.011480  4743 raft_consensus.cc:515] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.014608  4743 leader_election.cc:290] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:48.022653  4738 tablet_bootstrap.cc:492] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae: No bootstrap required, opened a new log
I20260709 12:11:48.023216  4738 ts_tablet_manager.cc:1403] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.021s
I20260709 12:11:48.023988  4737 tablet_bootstrap.cc:492] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005: No bootstrap required, opened a new log
I20260709 12:11:48.024451  4737 ts_tablet_manager.cc:1403] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.012s
I20260709 12:11:48.027238  4737 raft_consensus.cc:359] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.026368  4738 raft_consensus.cc:359] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.027968  4737 raft_consensus.cc:385] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:48.028143  4738 raft_consensus.cc:385] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:48.028316  4737 raft_consensus.cc:740] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Initialized, Role: FOLLOWER
I20260709 12:11:48.028585  4738 raft_consensus.cc:740] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Initialized, Role: FOLLOWER
I20260709 12:11:48.029453  4738 consensus_queue.cc:260] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.030387  4543 raft_consensus.cc:2468] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 1.
I20260709 12:11:48.032557  4583 leader_election.cc:304] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b6dafb29932b4e0f8cef57e1a4da8c88; no voters: 
I20260709 12:11:48.033571  4764 raft_consensus.cc:2804] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:48.034117  4764 raft_consensus.cc:697] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 LEADER]: Becoming Leader. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:11:48.034915  4764 consensus_queue.cc:237] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.034770  4738 ts_tablet_manager.cc:1434] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:11:48.038519  4738 tablet_bootstrap.cc:492] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae: Bootstrap starting.
I20260709 12:11:48.049065  4738 tablet_bootstrap.cc:654] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:48.041710  4544 raft_consensus.cc:2468] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 1.
I20260709 12:11:48.055167  4583 leader_election.cc:304] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b6dafb29932b4e0f8cef57e1a4da8c88; no voters: 
I20260709 12:11:48.041874  4737 consensus_queue.cc:260] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.055936  4764 raft_consensus.cc:2804] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:48.056391  4764 raft_consensus.cc:697] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 LEADER]: Becoming Leader. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:11:48.057168  4764 consensus_queue.cc:237] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.057741  4737 ts_tablet_manager.cc:1434] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:11:48.058627  4737 tablet_bootstrap.cc:492] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005: Bootstrap starting.
I20260709 12:11:48.053483  4693 raft_consensus.cc:2468] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 1.
I20260709 12:11:48.068527  4736 tablet_bootstrap.cc:492] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88: No bootstrap required, opened a new log
I20260709 12:11:48.069036  4736 ts_tablet_manager.cc:1403] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent bootstrapping tablet: real 0.089s	user 0.036s	sys 0.009s
I20260709 12:11:48.070874  4737 tablet_bootstrap.cc:654] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:48.073589  4736 raft_consensus.cc:359] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.074347  4736 raft_consensus.cc:385] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:48.074663  4736 raft_consensus.cc:740] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:48.074972  4543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005" is_pre_election: true
I20260709 12:11:48.077440  4543 raft_consensus.cc:2468] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 0.
I20260709 12:11:48.049714  4692 raft_consensus.cc:2468] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 1.
I20260709 12:11:48.075407  4736 consensus_queue.cc:260] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.082226  4619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" is_pre_election: true
I20260709 12:11:48.083360  4657 leader_election.cc:304] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.084041  4619 raft_consensus.cc:2468] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 0.
I20260709 12:11:48.085525  4743 raft_consensus.cc:2804] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:48.085933  4743 raft_consensus.cc:493] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.086273  4743 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.085242  4736 ts_tablet_manager.cc:1434] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.005s
I20260709 12:11:48.088948  4736 tablet_bootstrap.cc:492] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88: Bootstrap starting.
I20260709 12:11:48.091917  4737 tablet_bootstrap.cc:492] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005: No bootstrap required, opened a new log
I20260709 12:11:48.092324  4737 ts_tablet_manager.cc:1403] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.003s
I20260709 12:11:48.094367  4743 raft_consensus.cc:515] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.094889  4737 raft_consensus.cc:359] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.096539  4737 raft_consensus.cc:385] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:48.096818  4737 raft_consensus.cc:740] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Initialized, Role: FOLLOWER
I20260709 12:11:48.098042  4743 leader_election.cc:290] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:48.097744  4737 consensus_queue.cc:260] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.099876  4619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:48.100466  4619 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.099802  4738 tablet_bootstrap.cc:492] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae: No bootstrap required, opened a new log
I20260709 12:11:48.101747  4738 ts_tablet_manager.cc:1403] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.003s
I20260709 12:11:48.102159  4737 ts_tablet_manager.cc:1434] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:11:48.103109  4737 tablet_bootstrap.cc:492] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005: Bootstrap starting.
I20260709 12:11:48.105300  4744 raft_consensus.cc:493] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.106637  4744 raft_consensus.cc:515] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.105978  4543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:48.114897  4738 raft_consensus.cc:359] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.117846  4738 raft_consensus.cc:385] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:48.118163  4738 raft_consensus.cc:740] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Initialized, Role: FOLLOWER
I20260709 12:11:48.111089  4743 raft_consensus.cc:493] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.120059  4743 raft_consensus.cc:515] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.120445  4744 leader_election.cc:290] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.121129  4738 consensus_queue.cc:260] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.122442  4744 raft_consensus.cc:493] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.097494  4441 catalog_manager.cc:5697] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.124243  4744 raft_consensus.cc:515] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.121151  4543 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.126266  4736 tablet_bootstrap.cc:654] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:48.127324  4744 leader_election.cc:290] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.130234  4743 leader_election.cc:290] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:48.131867  4618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a21d23a5f4fb5a8a829b2f60e7ee6" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" is_pre_election: true
I20260709 12:11:48.133082  4618 raft_consensus.cc:2468] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 0.
I20260709 12:11:48.135658  4737 tablet_bootstrap.cc:654] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:48.139043  4738 ts_tablet_manager.cc:1434] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:11:48.140218  4738 tablet_bootstrap.cc:492] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae: Bootstrap starting.
I20260709 12:11:48.142397  4658 leader_election.cc:304] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.148082  4738 tablet_bootstrap.cc:654] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:48.149595  4776 raft_consensus.cc:2804] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:48.150035  4776 raft_consensus.cc:493] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.150369  4776 raft_consensus.cc:3060] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.127359  4441 catalog_manager.cc:5697] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.158109  4619 raft_consensus.cc:2468] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 1.
I20260709 12:11:48.159228  4543 raft_consensus.cc:2468] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 1.
I20260709 12:11:48.159644  4658 leader_election.cc:304] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.160811  4743 raft_consensus.cc:2804] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:48.171408  4775 raft_consensus.cc:493] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.172626  4736 tablet_bootstrap.cc:492] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88: No bootstrap required, opened a new log
I20260709 12:11:48.173077  4736 ts_tablet_manager.cc:1403] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.010s
I20260709 12:11:48.172013  4775 raft_consensus.cc:515] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.179107  4738 tablet_bootstrap.cc:492] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae: No bootstrap required, opened a new log
I20260709 12:11:48.179626  4738 ts_tablet_manager.cc:1403] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.004s
I20260709 12:11:48.182356  4738 raft_consensus.cc:359] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.183068  4738 raft_consensus.cc:385] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:48.183360  4738 raft_consensus.cc:740] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Initialized, Role: FOLLOWER
I20260709 12:11:48.184082  4738 consensus_queue.cc:260] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.187809  4736 raft_consensus.cc:359] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.188757  4736 raft_consensus.cc:385] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:48.189038  4736 raft_consensus.cc:740] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:48.187754  4743 raft_consensus.cc:697] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Becoming Leader. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:11:48.196146  4775 leader_election.cc:290] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.198987  4743 consensus_queue.cc:237] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.203317  4776 raft_consensus.cc:515] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.205994  4692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a21d23a5f4fb5a8a829b2f60e7ee6" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae" is_pre_election: true
I20260709 12:11:48.206269  4693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a50bcb984c7042568f6f37fceeaf795b" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae" is_pre_election: true
I20260709 12:11:48.206879  4693 raft_consensus.cc:2468] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 0.
I20260709 12:11:48.207427  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba63f37db064ed485438cdfe556f990" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae" is_pre_election: true
I20260709 12:11:48.208143  4691 raft_consensus.cc:2468] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 0.
I20260709 12:11:48.207616  4776 leader_election.cc:290] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:48.208279  4510 leader_election.cc:304] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.208617  4619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a21d23a5f4fb5a8a829b2f60e7ee6" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:48.209144  4619 raft_consensus.cc:3060] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.209144  4775 raft_consensus.cc:2804] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:48.209622  4775 raft_consensus.cc:493] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.206853  4692 raft_consensus.cc:2393] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a3126818444d638917b895d7512005 in current term 1: Already voted for candidate b964ea673ae7482db901c9180a3ed7ae in this term.
I20260709 12:11:48.209959  4775 raft_consensus.cc:3060] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.209923  4510 leader_election.cc:304] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.211725  4744 raft_consensus.cc:2804] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:48.212050  4744 raft_consensus.cc:493] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.212375  4744 raft_consensus.cc:3060] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.215687  4619 raft_consensus.cc:2468] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 1.
I20260709 12:11:48.216768  4658 leader_election.cc:304] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.218815  4744 raft_consensus.cc:515] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.220323  4776 raft_consensus.cc:2804] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:48.220778  4776 raft_consensus.cc:697] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Becoming Leader. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:11:48.221583  4744 leader_election.cc:290] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 election: Requested vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.205000  4736 consensus_queue.cc:260] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.218993  4775 raft_consensus.cc:515] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.223443  4692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba63f37db064ed485438cdfe556f990" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:48.224835  4738 ts_tablet_manager.cc:1434] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae: Time spent starting tablet: real 0.045s	user 0.003s	sys 0.007s
I20260709 12:11:48.225682  4692 raft_consensus.cc:3060] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.227717  4736 ts_tablet_manager.cc:1434] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.002s
I20260709 12:11:48.228765  4736 tablet_bootstrap.cc:492] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88: Bootstrap starting.
I20260709 12:11:48.229028  4737 tablet_bootstrap.cc:492] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005: No bootstrap required, opened a new log
I20260709 12:11:48.229408  4737 ts_tablet_manager.cc:1403] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.003s
I20260709 12:11:48.232421  4775 leader_election.cc:290] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 election: Requested vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.227035  4776 consensus_queue.cc:237] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.233577  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a50bcb984c7042568f6f37fceeaf795b" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:48.234272  4691 raft_consensus.cc:3060] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.239391  4737 raft_consensus.cc:359] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.240168  4737 raft_consensus.cc:385] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:48.240440  4737 raft_consensus.cc:740] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Initialized, Role: FOLLOWER
I20260709 12:11:48.241447  4737 consensus_queue.cc:260] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.237738  4743 raft_consensus.cc:493] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.249382  4743 raft_consensus.cc:515] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.253598  4736 tablet_bootstrap.cc:654] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:48.253420  4691 raft_consensus.cc:2468] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 1.
I20260709 12:11:48.254709  4737 ts_tablet_manager.cc:1434] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.003s
I20260709 12:11:48.255257  4510 leader_election.cc:304] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.259377  4543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a21d23a5f4fb5a8a829b2f60e7ee6" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005" is_pre_election: true
I20260709 12:11:48.260046  4543 raft_consensus.cc:2468] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 0.
I20260709 12:11:48.261399  4775 raft_consensus.cc:2804] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:48.261998  4783 raft_consensus.cc:493] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.262310  4775 raft_consensus.cc:697] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Becoming Leader. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:11:48.262444  4783 raft_consensus.cc:515] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.263322  4619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" is_pre_election: true
I20260709 12:11:48.264370  4619 raft_consensus.cc:2468] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 0.
I20260709 12:11:48.265995  4783 leader_election.cc:290] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:48.266033  4543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a21d23a5f4fb5a8a829b2f60e7ee6" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:48.266677  4775 consensus_queue.cc:237] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.267381  4658 leader_election.cc:304] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.266630  4543 raft_consensus.cc:3060] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.268232  4783 raft_consensus.cc:2804] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:48.268570  4783 raft_consensus.cc:493] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.268879  4783 raft_consensus.cc:3060] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.269963  4619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" is_pre_election: true
I20260709 12:11:48.260872  4692 raft_consensus.cc:2468] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 1.
I20260709 12:11:48.270666  4619 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 0.
I20260709 12:11:48.261606  4743 leader_election.cc:290] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:48.272979  4658 leader_election.cc:304] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.273578  4776 raft_consensus.cc:2804] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:48.274003  4776 raft_consensus.cc:493] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.274387  4776 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.275604  4744 raft_consensus.cc:493] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.276662  4744 raft_consensus.cc:515] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.276968  4510 leader_election.cc:304] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.279204  4543 raft_consensus.cc:2468] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 1.
I20260709 12:11:48.294090  4789 raft_consensus.cc:2804] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:48.294768  4692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a6d6ea1a6c4632add993edb587f726" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae" is_pre_election: true
I20260709 12:11:48.295423  4692 raft_consensus.cc:2468] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 0.
I20260709 12:11:48.296362  4736 tablet_bootstrap.cc:492] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88: No bootstrap required, opened a new log
I20260709 12:11:48.296800  4736 ts_tablet_manager.cc:1403] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.010s
I20260709 12:11:48.298359  4510 leader_election.cc:304] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.299701  4776 raft_consensus.cc:515] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.279794  4744 leader_election.cc:290] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.285841  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005" is_pre_election: true
I20260709 12:11:48.299758  4736 raft_consensus.cc:359] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.300798  4736 raft_consensus.cc:385] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:48.301095  4736 raft_consensus.cc:740] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:48.287832  4542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005" is_pre_election: true
I20260709 12:11:48.301879  4544 raft_consensus.cc:2468] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 0.
I20260709 12:11:48.302016  4744 raft_consensus.cc:2804] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:48.302037  4542 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 0.
I20260709 12:11:48.303007  4776 leader_election.cc:290] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:48.302500  4744 raft_consensus.cc:493] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.303755  4744 raft_consensus.cc:3060] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.304342  4619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a21d23a5f4fb5a8a829b2f60e7ee6" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" is_pre_election: true
I20260709 12:11:48.305478  4619 raft_consensus.cc:2393] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a3126818444d638917b895d7512005 in current term 1: Already voted for candidate b964ea673ae7482db901c9180a3ed7ae in this term.
I20260709 12:11:48.306433  4618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:48.307085  4618 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.307612  4783 raft_consensus.cc:515] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.314409  4736 consensus_queue.cc:260] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.318123  4783 leader_election.cc:290] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:48.318044  4617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba63f37db064ed485438cdfe556f990" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" is_pre_election: true
I20260709 12:11:48.318501  4619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a50bcb984c7042568f6f37fceeaf795b" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" is_pre_election: true
I20260709 12:11:48.320668  4617 raft_consensus.cc:2468] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 0.
I20260709 12:11:48.321630  4542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:48.323127  4542 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.324151  4619 raft_consensus.cc:2468] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 0.
I20260709 12:11:48.325811  4736 ts_tablet_manager.cc:1434] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:11:48.322571  4789 raft_consensus.cc:697] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Becoming Leader. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:11:48.324003  4616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba63f37db064ed485438cdfe556f990" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:48.329066  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:48.327055  4617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a50bcb984c7042568f6f37fceeaf795b" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:48.329344  4616 raft_consensus.cc:3060] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.329326  4619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a6d6ea1a6c4632add993edb587f726" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" is_pre_election: true
I20260709 12:11:48.334638  4617 raft_consensus.cc:3060] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.335276  4544 raft_consensus.cc:3060] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.332798  4615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:48.337496  4615 raft_consensus.cc:3060] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.340551  4744 raft_consensus.cc:515] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.334895  4619 raft_consensus.cc:2468] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 0.
I20260709 12:11:48.347978  4615 raft_consensus.cc:2468] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 1.
I20260709 12:11:48.352324  4658 leader_election.cc:304] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.350206  4618 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 1.
I20260709 12:11:48.354748  4658 leader_election.cc:304] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.355145  4617 raft_consensus.cc:2468] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 1.
I20260709 12:11:48.355360  4544 raft_consensus.cc:2468] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 1.
I20260709 12:11:48.355604  4776 raft_consensus.cc:2804] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:48.356106  4776 raft_consensus.cc:697] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Becoming Leader. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:11:48.356894  4776 consensus_queue.cc:237] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.357693  4542 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 1.
I20260709 12:11:48.352454  4744 leader_election.cc:290] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 election: Requested vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.353122  4783 raft_consensus.cc:2804] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:48.353541  4692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a6d6ea1a6c4632add993edb587f726" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:48.350044  4616 raft_consensus.cc:2468] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 1.
I20260709 12:11:48.359143  4783 raft_consensus.cc:697] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Becoming Leader. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:11:48.358361  4509 leader_election.cc:304] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a3126818444d638917b895d7512005; no voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae
I20260709 12:11:48.359052  4692 raft_consensus.cc:3060] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.335805  4789 consensus_queue.cc:237] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.360839  4792 raft_consensus.cc:2749] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:48.360172  4783 consensus_queue.cc:237] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.370105  4692 raft_consensus.cc:2468] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 1.
I20260709 12:11:48.371546  4510 leader_election.cc:304] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.372615  4792 raft_consensus.cc:2804] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:48.373131  4792 raft_consensus.cc:697] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Becoming Leader. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:11:48.374014  4792 consensus_queue.cc:237] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.395714  4440 catalog_manager.cc:5697] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a3126818444d638917b895d7512005 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "40a3126818444d638917b895d7512005" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.397711  4440 catalog_manager.cc:5697] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a3126818444d638917b895d7512005 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "40a3126818444d638917b895d7512005" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.399083  4616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a6d6ea1a6c4632add993edb587f726" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:48.398933  4440 catalog_manager.cc:5697] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a3126818444d638917b895d7512005 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "40a3126818444d638917b895d7512005" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.399708  4616 raft_consensus.cc:3060] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:48.411320  4616 raft_consensus.cc:2468] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 1.
I20260709 12:11:48.411017  4441 catalog_manager.cc:5697] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae reported cstate change: term changed from 0 to 1, leader changed from <none> to b964ea673ae7482db901c9180a3ed7ae (127.4.78.67). New cstate: current_term: 1 leader_uuid: "b964ea673ae7482db901c9180a3ed7ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:48.413952  4441 catalog_manager.cc:5697] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae reported cstate change: term changed from 0 to 1, leader changed from <none> to b964ea673ae7482db901c9180a3ed7ae (127.4.78.67). New cstate: current_term: 1 leader_uuid: "b964ea673ae7482db901c9180a3ed7ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:48.415723  4441 catalog_manager.cc:5697] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae reported cstate change: term changed from 0 to 1, leader changed from <none> to b964ea673ae7482db901c9180a3ed7ae (127.4.78.67). New cstate: current_term: 1 leader_uuid: "b964ea673ae7482db901c9180a3ed7ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:48.417313  4441 catalog_manager.cc:5697] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae reported cstate change: term changed from 0 to 1, leader changed from <none> to b964ea673ae7482db901c9180a3ed7ae (127.4.78.67). New cstate: current_term: 1 leader_uuid: "b964ea673ae7482db901c9180a3ed7ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:48.477375  4764 consensus_queue.cc:1048] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:48.485965  4616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
mode: GRACEFUL
new_leader_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:46990
I20260709 12:11:48.486671  4616 raft_consensus.cc:606] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 LEADER]: Received request to transfer leadership to TS 40a3126818444d638917b895d7512005
I20260709 12:11:48.494536  4616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
mode: GRACEFUL
new_leader_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:46990
I20260709 12:11:48.499426  4616 raft_consensus.cc:606] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 LEADER]: Received request to transfer leadership to TS 40a3126818444d638917b895d7512005
I20260709 12:11:48.501959  4764 consensus_queue.cc:1048] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.519229  4692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56"
dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
mode: GRACEFUL
new_leader_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:44412
I20260709 12:11:48.519739  4692 raft_consensus.cc:606] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Received request to transfer leadership to TS 40a3126818444d638917b895d7512005
I20260709 12:11:48.525878  4692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887"
dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
mode: GRACEFUL
new_leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:44412
I20260709 12:11:48.526770  4692 raft_consensus.cc:606] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Received request to transfer leadership to TS b6dafb29932b4e0f8cef57e1a4da8c88
I20260709 12:11:48.532450  4692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2"
dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
mode: GRACEFUL
new_leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:44412
I20260709 12:11:48.532959  4692 raft_consensus.cc:606] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Received request to transfer leadership to TS b6dafb29932b4e0f8cef57e1a4da8c88
I20260709 12:11:48.538270  4692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e8a21d23a5f4fb5a8a829b2f60e7ee6"
dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
mode: GRACEFUL
new_leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:44412
I20260709 12:11:48.538947  4692 raft_consensus.cc:606] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Received request to transfer leadership to TS b6dafb29932b4e0f8cef57e1a4da8c88
I20260709 12:11:48.551721  4544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fba63f37db064ed485438cdfe556f990"
dest_uuid: "40a3126818444d638917b895d7512005"
mode: GRACEFUL
new_leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:50054
I20260709 12:11:48.552284  4544 raft_consensus.cc:606] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Received request to transfer leadership to TS b6dafb29932b4e0f8cef57e1a4da8c88
I20260709 12:11:48.557191  4544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97a6d6ea1a6c4632add993edb587f726"
dest_uuid: "40a3126818444d638917b895d7512005"
mode: GRACEFUL
new_leader_uuid: "b964ea673ae7482db901c9180a3ed7ae"
 from {username='slave'} at 127.0.0.1:50054
I20260709 12:11:48.557632  4544 raft_consensus.cc:606] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Received request to transfer leadership to TS b964ea673ae7482db901c9180a3ed7ae
I20260709 12:11:48.584671  4763 consensus_queue.cc:1048] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.591804  4764 raft_consensus.cc:993] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88: : Instructing follower 40a3126818444d638917b895d7512005 to start an election
I20260709 12:11:48.592756  4763 raft_consensus.cc:1081] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 LEADER]: Signalling peer 40a3126818444d638917b895d7512005 to start an election
I20260709 12:11:48.594779  4542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae"
dest_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:50044
I20260709 12:11:48.595489  4542 raft_consensus.cc:493] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.595885  4542 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.603518  4764 consensus_queue.cc:1048] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.604216  4542 raft_consensus.cc:515] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.605365  4544 raft_consensus.cc:1240] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Rejecting Update request from peer b6dafb29932b4e0f8cef57e1a4da8c88 for earlier term 1. Current term is 2. Ops: []
I20260709 12:11:48.610376  4542 leader_election.cc:290] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 2 election: Requested vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.610926  4616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:48.610968  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:48.609120  4764 consensus_queue.cc:1059] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:11:48.615284  4616 raft_consensus.cc:3055] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.615690  4616 raft_consensus.cc:740] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:11:48.616523  4616 consensus_queue.cc:260] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.620925  4616 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.627636  4616 raft_consensus.cc:2468] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 2.
W20260709 12:11:48.628198  4764 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:11:48.628717  4509 leader_election.cc:304] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a3126818444d638917b895d7512005, b6dafb29932b4e0f8cef57e1a4da8c88; no voters: b964ea673ae7482db901c9180a3ed7ae
I20260709 12:11:48.629572  4792 raft_consensus.cc:2804] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.630141  4792 raft_consensus.cc:697] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Becoming Leader. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:11:48.630911  4792 consensus_queue.cc:237] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.638485  4441 catalog_manager.cc:5697] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 reported cstate change: term changed from 1 to 2, leader changed from b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66) to 40a3126818444d638917b895d7512005 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "40a3126818444d638917b895d7512005" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.651571  4776 consensus_queue.cc:1048] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.664917  4780 consensus_queue.cc:1048] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.676867  4783 raft_consensus.cc:993] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae: : Instructing follower 40a3126818444d638917b895d7512005 to start an election
I20260709 12:11:48.677295  4780 raft_consensus.cc:1081] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Signalling peer 40a3126818444d638917b895d7512005 to start an election
I20260709 12:11:48.678998  4544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56"
dest_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:50050
I20260709 12:11:48.679582  4544 raft_consensus.cc:493] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.679986  4544 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.686033  4544 raft_consensus.cc:515] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.686383  4792 consensus_queue.cc:1048] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.688328  4544 leader_election.cc:290] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 2 election: Requested vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.688985  4616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:48.689565  4616 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.692060  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:48.692641  4691 raft_consensus.cc:3055] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.692970  4691 raft_consensus.cc:740] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:11:48.693686  4691 consensus_queue.cc:260] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.694976  4691 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.696264  4616 raft_consensus.cc:2468] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 2.
I20260709 12:11:48.698393  4509 leader_election.cc:304] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b6dafb29932b4e0f8cef57e1a4da8c88; no voters: 
I20260709 12:11:48.699478  4789 raft_consensus.cc:2804] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.699950  4789 raft_consensus.cc:697] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Becoming Leader. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:11:48.700814  4789 consensus_queue.cc:237] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.709043  4789 consensus_queue.cc:1048] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.712178  4691 raft_consensus.cc:2468] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 2.
I20260709 12:11:48.716872  4780 consensus_queue.cc:1048] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.720633  4440 catalog_manager.cc:5697] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 reported cstate change: term changed from 1 to 2, leader changed from b964ea673ae7482db901c9180a3ed7ae (127.4.78.67) to 40a3126818444d638917b895d7512005 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "40a3126818444d638917b895d7512005" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.739718  4776 consensus_queue.cc:1048] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.747841  4776 raft_consensus.cc:993] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae: : Instructing follower b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:11:48.748263  4776 raft_consensus.cc:1081] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Signalling peer b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:11:48.749914  4617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e8a21d23a5f4fb5a8a829b2f60e7ee6"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:46972
I20260709 12:11:48.750355  4617 raft_consensus.cc:493] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.750609  4617 raft_consensus.cc:3060] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.755303  4617 raft_consensus.cc:515] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.758562  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a21d23a5f4fb5a8a829b2f60e7ee6" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:48.759142  4691 raft_consensus.cc:3055] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.759464  4691 raft_consensus.cc:740] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:11:48.759455  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8a21d23a5f4fb5a8a829b2f60e7ee6" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:48.760264  4544 raft_consensus.cc:3060] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.760396  4691 consensus_queue.cc:260] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.761667  4691 raft_consensus.cc:3060] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.765213  4544 raft_consensus.cc:2468] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 2.
I20260709 12:11:48.766135  4617 leader_election.cc:290] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 2 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.766181  4583 leader_election.cc:304] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b6dafb29932b4e0f8cef57e1a4da8c88; no voters: 
I20260709 12:11:48.767056  4764 raft_consensus.cc:2804] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.767477  4764 raft_consensus.cc:697] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Becoming Leader. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:11:48.768213  4691 raft_consensus.cc:2468] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 2.
I20260709 12:11:48.768241  4764 consensus_queue.cc:237] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.774144  4441 catalog_manager.cc:5697] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 reported cstate change: term changed from 1 to 2, leader changed from b964ea673ae7482db901c9180a3ed7ae (127.4.78.67) to b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.776568  4783 consensus_queue.cc:1048] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.784066  4789 consensus_queue.cc:1048] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.796408  4780 consensus_queue.cc:1048] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.802639  4789 raft_consensus.cc:993] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005: : Instructing follower b964ea673ae7482db901c9180a3ed7ae to start an election
I20260709 12:11:48.803300  4791 raft_consensus.cc:1081] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Signalling peer b964ea673ae7482db901c9180a3ed7ae to start an election
I20260709 12:11:48.806545  4780 consensus_queue.cc:1048] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.807965  4691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97a6d6ea1a6c4632add993edb587f726"
dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
 from {username='slave'} at 127.0.0.1:44396
I20260709 12:11:48.808553  4691 raft_consensus.cc:493] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.808926  4691 raft_consensus.cc:3060] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.812423  4792 consensus_queue.cc:1048] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.816067  4691 raft_consensus.cc:515] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.819028  4615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a6d6ea1a6c4632add993edb587f726" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:48.820614  4542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97a6d6ea1a6c4632add993edb587f726" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:48.821177  4542 raft_consensus.cc:3055] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.821357  4692 raft_consensus.cc:1240] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Rejecting Update request from peer 40a3126818444d638917b895d7512005 for earlier term 1. Current term is 2. Ops: []
I20260709 12:11:48.821488  4542 raft_consensus.cc:740] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:11:48.822409  4542 consensus_queue.cc:260] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.823272  4542 raft_consensus.cc:3060] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.824004  4780 raft_consensus.cc:993] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae: : Instructing follower b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:11:48.824400  4780 raft_consensus.cc:1081] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Signalling peer b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:11:48.828328  4615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:46972
I20260709 12:11:48.828907  4615 raft_consensus.cc:493] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.829280  4615 raft_consensus.cc:3060] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.832010  4789 consensus_queue.cc:1048] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.834358  4691 leader_election.cc:290] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 2 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:48.844069  4789 consensus_queue.cc:1048] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.852279  4542 raft_consensus.cc:2468] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 2.
I20260709 12:11:48.853293  4657 leader_election.cc:304] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: b6dafb29932b4e0f8cef57e1a4da8c88
I20260709 12:11:48.853435  4615 raft_consensus.cc:515] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.854401  4743 raft_consensus.cc:2804] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.855252  4743 raft_consensus.cc:697] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 2 LEADER]: Becoming Leader. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:11:48.856110  4743 consensus_queue.cc:237] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.861868  4744 raft_consensus.cc:993] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005: : Instructing follower b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:11:48.862322  4744 raft_consensus.cc:1081] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Signalling peer b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:11:48.861938  4743 consensus_queue.cc:1048] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:11:48.878875  4615 leader_election.cc:290] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 2 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.880429  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:48.882028  4691 raft_consensus.cc:3055] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.882437  4691 raft_consensus.cc:740] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:11:48.883244  4691 consensus_queue.cc:260] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.884303  4617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fba63f37db064ed485438cdfe556f990"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:46982
I20260709 12:11:48.884425  4691 raft_consensus.cc:3060] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.884862  4617 raft_consensus.cc:493] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.884817  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:48.885335  4617 raft_consensus.cc:3060] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.885564  4544 raft_consensus.cc:3060] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.876997  4441 catalog_manager.cc:5697] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae reported cstate change: term changed from 1 to 2, leader changed from 40a3126818444d638917b895d7512005 (127.4.78.65) to b964ea673ae7482db901c9180a3ed7ae (127.4.78.67). New cstate: current_term: 2 leader_uuid: "b964ea673ae7482db901c9180a3ed7ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:48.890959  4691 raft_consensus.cc:2468] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 2.
I20260709 12:11:48.891794  4544 raft_consensus.cc:2468] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 2.
I20260709 12:11:48.892138  4585 leader_election.cc:304] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.893106  4805 raft_consensus.cc:2804] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.893580  4805 raft_consensus.cc:697] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Becoming Leader. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:11:48.894395  4805 consensus_queue.cc:237] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.898567  4617 raft_consensus.cc:515] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.900131  4617 leader_election.cc:290] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 2 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.901104  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba63f37db064ed485438cdfe556f990" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:48.902527  4544 raft_consensus.cc:3055] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.902928  4544 raft_consensus.cc:740] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:11:48.903822  4544 consensus_queue.cc:260] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.905109  4544 raft_consensus.cc:3060] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.901927  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba63f37db064ed485438cdfe556f990" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:48.910075  4691 raft_consensus.cc:3060] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.914454  4743 raft_consensus.cc:993] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae: : Instructing follower b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:11:48.914891  4743 raft_consensus.cc:1081] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Signalling peer b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:11:48.916658  4616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:46972
I20260709 12:11:48.917208  4616 raft_consensus.cc:493] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.917554  4616 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.921715  4438 catalog_manager.cc:5697] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 reported cstate change: term changed from 1 to 2, leader changed from b964ea673ae7482db901c9180a3ed7ae (127.4.78.67) to b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.923995  4616 raft_consensus.cc:515] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.916633  4691 raft_consensus.cc:2468] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 2.
I20260709 12:11:48.926823  4542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:48.926855  4585 leader_election.cc:304] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:48.927465  4542 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.929224  4805 raft_consensus.cc:2804] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.929665  4544 raft_consensus.cc:2468] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 2.
I20260709 12:11:48.929675  4805 raft_consensus.cc:697] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Becoming Leader. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:11:48.930774  4805 consensus_queue.cc:237] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.935379  4616 leader_election.cc:290] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 2 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:48.935768  4542 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 2.
I20260709 12:11:48.936877  4583 leader_election.cc:304] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b6dafb29932b4e0f8cef57e1a4da8c88; no voters: 
I20260709 12:11:48.937139  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:48.937674  4691 raft_consensus.cc:3055] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.938017  4805 raft_consensus.cc:2804] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.938024  4691 raft_consensus.cc:740] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:11:48.938547  4805 raft_consensus.cc:697] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Becoming Leader. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:11:48.939164  4691 consensus_queue.cc:260] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.939519  4805 consensus_queue.cc:237] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:48.940434  4691 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.941439  4438 catalog_manager.cc:5697] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 reported cstate change: term changed from 1 to 2, leader changed from 40a3126818444d638917b895d7512005 (127.4.78.65) to b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.946568  4691 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 2.
I20260709 12:11:48.955694  4438 catalog_manager.cc:5697] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 reported cstate change: term changed from 1 to 2, leader changed from b964ea673ae7482db901c9180a3ed7ae (127.4.78.67) to b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.989442  4763 raft_consensus.cc:993] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88: : Instructing follower 40a3126818444d638917b895d7512005 to start an election
I20260709 12:11:48.989938  4805 raft_consensus.cc:1081] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 LEADER]: Signalling peer 40a3126818444d638917b895d7512005 to start an election
I20260709 12:11:48.991340  4542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c"
dest_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:50044
I20260709 12:11:48.991894  4542 raft_consensus.cc:493] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.992264  4542 raft_consensus.cc:3060] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.998749  4542 raft_consensus.cc:515] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:49.001273  4542 leader_election.cc:290] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 2 election: Requested vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:11:49.001567  4616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:49.001827  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:11:49.002663  4616 raft_consensus.cc:3055] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:49.002700  4691 raft_consensus.cc:3060] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:49.003132  4616 raft_consensus.cc:740] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:11:49.003973  4616 consensus_queue.cc:260] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:49.005230  4616 raft_consensus.cc:3060] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:49.009630  4691 raft_consensus.cc:2468] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 2.
I20260709 12:11:49.011046  4510 leader_election.cc:304] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:49.011706  4616 raft_consensus.cc:2468] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 2.
I20260709 12:11:49.011893  4792 raft_consensus.cc:2804] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:49.012437  4792 raft_consensus.cc:697] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Becoming Leader. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:11:49.013273  4792 consensus_queue.cc:237] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:49.020210  4438 catalog_manager.cc:5697] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 reported cstate change: term changed from 1 to 2, leader changed from b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66) to 40a3126818444d638917b895d7512005 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "40a3126818444d638917b895d7512005" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:49.077353  4616 raft_consensus.cc:1275] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.078653  4792 consensus_queue.cc:1048] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.086838  4691 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:49.093708  4691 raft_consensus.cc:1275] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.095160  4792 consensus_queue.cc:1048] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.180742  4542 raft_consensus.cc:1275] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.182076  4805 consensus_queue.cc:1048] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.189433  4691 raft_consensus.cc:1275] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.190830  4805 consensus_queue.cc:1048] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.253561  4616 raft_consensus.cc:1275] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.254851  4792 consensus_queue.cc:1048] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.263291  4691 raft_consensus.cc:1275] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.264909  4789 consensus_queue.cc:1048] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.343035  4691 raft_consensus.cc:1275] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.344588  4805 consensus_queue.cc:1048] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.352797  4542 raft_consensus.cc:1275] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.355062  4764 consensus_queue.cc:1048] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.401902  4542 raft_consensus.cc:1275] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Refusing update from remote peer b964ea673ae7482db901c9180a3ed7ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.403297  4783 consensus_queue.cc:1048] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.412319  4616 raft_consensus.cc:3060] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:49.419534  4616 raft_consensus.cc:1275] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Refusing update from remote peer b964ea673ae7482db901c9180a3ed7ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.420953  4780 consensus_queue.cc:1048] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.434793  4691 raft_consensus.cc:1275] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.436309  4763 consensus_queue.cc:1048] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.446226  4542 raft_consensus.cc:1275] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.449270  4692 raft_consensus.cc:1275] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.447887  4823 consensus_queue.cc:1048] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:11:49.450078  4693 raft_consensus.cc:1275] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.451001  4744 consensus_queue.cc:1048] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.451673  4763 consensus_queue.cc:1048] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.461050  4544 raft_consensus.cc:1275] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.462603  4805 consensus_queue.cc:1048] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.471454  4617 raft_consensus.cc:1275] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.472980  4744 consensus_queue.cc:1048] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:51.584446  4409 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:11:51.585165  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:51.599905  4542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae"
dest_uuid: "40a3126818444d638917b895d7512005"
mode: GRACEFUL
new_leader_uuid: "b964ea673ae7482db901c9180a3ed7ae"
 from {username='slave'} at 127.0.0.1:41766
I20260709 12:11:51.600381  4542 raft_consensus.cc:606] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Received request to transfer leadership to TS b964ea673ae7482db901c9180a3ed7ae
I20260709 12:11:51.610136  4617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
mode: GRACEFUL
new_leader_uuid: "b964ea673ae7482db901c9180a3ed7ae"
 from {username='slave'} at 127.0.0.1:45234
I20260709 12:11:51.610620  4617 raft_consensus.cc:606] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Received request to transfer leadership to TS b964ea673ae7482db901c9180a3ed7ae
I20260709 12:11:51.611685  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:11:51.612120  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:51.935421  4792 raft_consensus.cc:993] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005: : Instructing follower b964ea673ae7482db901c9180a3ed7ae to start an election
I20260709 12:11:51.935842  4829 raft_consensus.cc:1081] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Signalling peer b964ea673ae7482db901c9180a3ed7ae to start an election
I20260709 12:11:51.937187  4693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae"
dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
 from {username='slave'} at 127.0.0.1:44396
I20260709 12:11:51.937587  4693 raft_consensus.cc:493] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:51.937873  4693 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.942152  4693 raft_consensus.cc:515] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:51.943805  4693 leader_election.cc:290] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 3 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:51.944641  4542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:51.944926  4617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:51.945243  4542 raft_consensus.cc:3055] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:11:51.945487  4617 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.945578  4542 raft_consensus.cc:740] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:11:51.946347  4542 consensus_queue.cc:260] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:51.947198  4542 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.950533  4617 raft_consensus.cc:2468] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 3.
I20260709 12:11:51.951815  4658 leader_election.cc:304] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:51.952431  4825 raft_consensus.cc:2804] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:11:51.952396  4542 raft_consensus.cc:2468] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 3.
I20260709 12:11:51.953831  4825 raft_consensus.cc:697] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 3 LEADER]: Becoming Leader. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:11:51.954687  4825 consensus_queue.cc:237] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:51.962752  4438 catalog_manager.cc:5697] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae reported cstate change: term changed from 2 to 3, leader changed from 40a3126818444d638917b895d7512005 (127.4.78.65) to b964ea673ae7482db901c9180a3ed7ae (127.4.78.67). New cstate: current_term: 3 leader_uuid: "b964ea673ae7482db901c9180a3ed7ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:51.983395  4805 raft_consensus.cc:993] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88: : Instructing follower b964ea673ae7482db901c9180a3ed7ae to start an election
I20260709 12:11:51.983773  4836 raft_consensus.cc:1081] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Signalling peer b964ea673ae7482db901c9180a3ed7ae to start an election
I20260709 12:11:51.985212  4693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2"
dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
 from {username='slave'} at 127.0.0.1:44390
I20260709 12:11:51.985637  4693 raft_consensus.cc:493] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:51.985947  4693 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.990067  4693 raft_consensus.cc:515] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:51.991570  4693 leader_election.cc:290] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 3 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:11:51.992439  4542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:11:51.992647  4617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:11:51.993057  4542 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.993136  4617 raft_consensus.cc:3055] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:11:51.993499  4617 raft_consensus.cc:740] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:11:51.994313  4617 consensus_queue.cc:260] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:51.995481  4617 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.999509  4542 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 3.
I20260709 12:11:52.000718  4657 leader_election.cc:304] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:11:52.001437  4825 raft_consensus.cc:2804] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:11:52.001962  4825 raft_consensus.cc:697] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 3 LEADER]: Becoming Leader. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:11:52.001611  4617 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 3.
I20260709 12:11:52.002811  4825 consensus_queue.cc:237] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:11:52.009989  4438 catalog_manager.cc:5697] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae reported cstate change: term changed from 2 to 3, leader changed from b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66) to b964ea673ae7482db901c9180a3ed7ae (127.4.78.67). New cstate: current_term: 3 leader_uuid: "b964ea673ae7482db901c9180a3ed7ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.340758  4542 raft_consensus.cc:1275] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Refusing update from remote peer b964ea673ae7482db901c9180a3ed7ae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:52.341958  4825 consensus_queue.cc:1048] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:52.355152  4617 raft_consensus.cc:1275] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Refusing update from remote peer b964ea673ae7482db901c9180a3ed7ae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:52.356753  4840 consensus_queue.cc:1048] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:52.464108  4542 raft_consensus.cc:1275] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Refusing update from remote peer b964ea673ae7482db901c9180a3ed7ae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:52.465261  4841 consensus_queue.cc:1048] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:52.473223  4617 raft_consensus.cc:1275] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Refusing update from remote peer b964ea673ae7482db901c9180a3ed7ae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:52.474735  4825 consensus_queue.cc:1048] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:52.612948  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:52.617545  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:52.617951  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:53.844565  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:53.852665  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:53.853312  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:54.854931  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:54.859851  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:54.860256  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:11:54.865314  4714 debug-util.cc:398] Leaking SignalData structure 0x7b080008a000 after lost signal to thread 4412
W20260709 12:11:54.866009  4714 debug-util.cc:398] Leaking SignalData structure 0x7b0800093da0 after lost signal to thread 4475
W20260709 12:11:54.866726  4714 debug-util.cc:398] Leaking SignalData structure 0x7b08001180c0 after lost signal to thread 4568
W20260709 12:11:54.867343  4714 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4fc0 after lost signal to thread 4643
W20260709 12:11:54.868049  4714 debug-util.cc:398] Leaking SignalData structure 0x7b08001d9800 after lost signal to thread 4717
I20260709 12:11:55.861531  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:55.866523  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:55.866904  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:56.867843  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:56.872421  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:56.872809  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:57.873728  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:57.878453  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:57.878856  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:58.879712  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:58.884864  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:58.885251  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:59.886065  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:59.890698  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:59.891083  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:00.891927  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:00.896544  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:00.896945  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:01.923974  4409 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:12:01.928148  4542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a50bcb984c7042568f6f37fceeaf795b"
dest_uuid: "40a3126818444d638917b895d7512005"
mode: GRACEFUL
new_leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:50054
I20260709 12:12:01.928947  4542 raft_consensus.cc:606] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Received request to transfer leadership to TS b6dafb29932b4e0f8cef57e1a4da8c88
I20260709 12:12:01.933579  4693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae"
dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
mode: GRACEFUL
new_leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:44412
I20260709 12:12:01.934060  4693 raft_consensus.cc:606] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 3 LEADER]: Received request to transfer leadership to TS b6dafb29932b4e0f8cef57e1a4da8c88
I20260709 12:12:01.938398  4544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c"
dest_uuid: "40a3126818444d638917b895d7512005"
mode: GRACEFUL
new_leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:50054
I20260709 12:12:01.938809  4544 raft_consensus.cc:606] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Received request to transfer leadership to TS b6dafb29932b4e0f8cef57e1a4da8c88
I20260709 12:12:01.942870  4544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56"
dest_uuid: "40a3126818444d638917b895d7512005"
mode: GRACEFUL
new_leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:50054
I20260709 12:12:01.943298  4544 raft_consensus.cc:606] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Received request to transfer leadership to TS b6dafb29932b4e0f8cef57e1a4da8c88
I20260709 12:12:01.950075  4693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2"
dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
mode: GRACEFUL
new_leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:44412
I20260709 12:12:01.950521  4693 raft_consensus.cc:606] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 3 LEADER]: Received request to transfer leadership to TS b6dafb29932b4e0f8cef57e1a4da8c88
I20260709 12:12:02.019471  4861 raft_consensus.cc:993] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005: : Instructing follower b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:12:02.019958  4857 raft_consensus.cc:1081] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Signalling peer b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:12:02.021504  4616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:46982
I20260709 12:12:02.021972  4616 raft_consensus.cc:493] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.022257  4616 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:02.026993  4616 raft_consensus.cc:515] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.028949  4616 leader_election.cc:290] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 3 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:12:02.029697  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:12:02.030517  4544 raft_consensus.cc:3055] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:02.030436  4693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:12:02.030907  4544 raft_consensus.cc:740] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:12:02.031054  4693 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:02.031734  4544 consensus_queue.cc:260] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.032970  4544 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:02.037515  4693 raft_consensus.cc:2468] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 3.
I20260709 12:12:02.038808  4585 leader_election.cc:304] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:12:02.039321  4544 raft_consensus.cc:2468] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 3.
I20260709 12:12:02.039575  4859 raft_consensus.cc:2804] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:02.040673  4859 raft_consensus.cc:697] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 LEADER]: Becoming Leader. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:12:02.041471  4859 consensus_queue.cc:237] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.052042  4441 catalog_manager.cc:5697] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 reported cstate change: term changed from 2 to 3, leader changed from 40a3126818444d638917b895d7512005 (127.4.78.65) to b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66). New cstate: current_term: 3 leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.166354  4857 raft_consensus.cc:993] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005: : Instructing follower b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:12:02.166699  4856 raft_consensus.cc:993] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae: : Instructing follower b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:12:02.166867  4861 raft_consensus.cc:1081] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Signalling peer b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:12:02.167281  4868 raft_consensus.cc:1081] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 3 LEADER]: Signalling peer b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:12:02.168339  4616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a50bcb984c7042568f6f37fceeaf795b"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:46982
I20260709 12:12:02.168744  4617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:46972
I20260709 12:12:02.168826  4616 raft_consensus.cc:493] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.169163  4616 raft_consensus.cc:3060] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:02.169175  4617 raft_consensus.cc:493] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.169598  4617 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:02.172988  4616 raft_consensus.cc:515] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.174091  4617 raft_consensus.cc:515] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.174536  4616 leader_election.cc:290] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 2 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:12:02.175258  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a50bcb984c7042568f6f37fceeaf795b" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:12:02.175586  4693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a50bcb984c7042568f6f37fceeaf795b" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:12:02.175801  4544 raft_consensus.cc:3055] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:02.176059  4693 raft_consensus.cc:3060] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:02.176162  4544 raft_consensus.cc:740] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:12:02.176347  4617 leader_election.cc:290] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 4 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:12:02.177433  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:12:02.177989  4691 raft_consensus.cc:3055] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:02.178318  4691 raft_consensus.cc:740] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:12:02.178113  4542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:12:02.179370  4542 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:02.179081  4691 consensus_queue.cc:260] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.180157  4691 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:02.181825  4693 raft_consensus.cc:2468] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 2.
I20260709 12:12:02.183598  4542 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 4.
I20260709 12:12:02.177033  4544 consensus_queue.cc:260] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.184687  4544 raft_consensus.cc:3060] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:02.184798  4583 leader_election.cc:304] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b6dafb29932b4e0f8cef57e1a4da8c88; no voters: 
I20260709 12:12:02.185575  4691 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 4.
I20260709 12:12:02.185606  4585 leader_election.cc:304] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:12:02.186244  4859 raft_consensus.cc:2804] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:02.186698  4862 raft_consensus.cc:2804] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:02.190115  4859 raft_consensus.cc:697] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 LEADER]: Becoming Leader. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:12:02.191071  4859 consensus_queue.cc:237] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.194270  4862 raft_consensus.cc:697] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Becoming Leader. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:12:02.194808  4544 raft_consensus.cc:2468] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 2.
I20260709 12:12:02.195125  4862 consensus_queue.cc:237] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.200192  4438 catalog_manager.cc:5697] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 reported cstate change: term changed from 3 to 4, leader changed from b964ea673ae7482db901c9180a3ed7ae (127.4.78.67) to b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66). New cstate: current_term: 4 leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.210064  4438 catalog_manager.cc:5697] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 reported cstate change: term changed from 1 to 2, leader changed from 40a3126818444d638917b895d7512005 (127.4.78.65) to b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.219694  4856 raft_consensus.cc:993] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae: : Instructing follower b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:12:02.220075  4868 raft_consensus.cc:1081] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 3 LEADER]: Signalling peer b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:12:02.221364  4617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:46972
I20260709 12:12:02.221812  4617 raft_consensus.cc:493] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.222100  4617 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:02.226524  4617 raft_consensus.cc:515] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.227967  4617 leader_election.cc:290] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 4 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:12:02.228628  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:12:02.228853  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:12:02.229168  4544 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:02.229310  4691 raft_consensus.cc:3055] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:02.229612  4691 raft_consensus.cc:740] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:12:02.230264  4691 consensus_queue.cc:260] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.231135  4691 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:02.233520  4544 raft_consensus.cc:2468] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 4.
I20260709 12:12:02.234366  4583 leader_election.cc:304] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b6dafb29932b4e0f8cef57e1a4da8c88; no voters: 
I20260709 12:12:02.234988  4862 raft_consensus.cc:2804] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:02.235327  4862 raft_consensus.cc:697] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 LEADER]: Becoming Leader. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:12:02.235402  4691 raft_consensus.cc:2468] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 4.
I20260709 12:12:02.235998  4862 consensus_queue.cc:237] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.242271  4438 catalog_manager.cc:5697] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 reported cstate change: term changed from 3 to 4, leader changed from b964ea673ae7482db901c9180a3ed7ae (127.4.78.67) to b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66). New cstate: current_term: 4 leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.404035  4857 raft_consensus.cc:993] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005: : Instructing follower b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:12:02.404431  4861 raft_consensus.cc:1081] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Signalling peer b6dafb29932b4e0f8cef57e1a4da8c88 to start an election
I20260709 12:12:02.405802  4617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
 from {username='slave'} at 127.0.0.1:46982
I20260709 12:12:02.406267  4617 raft_consensus.cc:493] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.406527  4617 raft_consensus.cc:3060] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:02.410765  4617 raft_consensus.cc:515] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.412252  4617 leader_election.cc:290] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 3 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:12:02.413034  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:12:02.413309  4691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83a3524e9ff48e688454397c1fcd61c" candidate_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:12:02.413573  4544 raft_consensus.cc:3055] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:02.413851  4691 raft_consensus.cc:3060] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:02.413914  4544 raft_consensus.cc:740] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:12:02.414778  4544 consensus_queue.cc:260] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.415733  4544 raft_consensus.cc:3060] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:02.418459  4691 raft_consensus.cc:2468] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 3.
I20260709 12:12:02.419692  4585 leader_election.cc:304] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6dafb29932b4e0f8cef57e1a4da8c88, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:12:02.420297  4544 raft_consensus.cc:2468] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6dafb29932b4e0f8cef57e1a4da8c88 in term 3.
I20260709 12:12:02.420578  4862 raft_consensus.cc:2804] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:02.421082  4862 raft_consensus.cc:697] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 LEADER]: Becoming Leader. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:12:02.421962  4862 consensus_queue.cc:237] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:02.428411  4438 catalog_manager.cc:5697] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 reported cstate change: term changed from 2 to 3, leader changed from 40a3126818444d638917b895d7512005 (127.4.78.65) to b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66). New cstate: current_term: 3 leader_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.438222  4544 raft_consensus.cc:1275] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.439407  4862 consensus_queue.cc:1048] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:02.448522  4691 raft_consensus.cc:1275] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.449901  4859 consensus_queue.cc:1048] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:02.593632  4542 raft_consensus.cc:1275] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:02.594828  4859 consensus_queue.cc:1048] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:02.602988  4691 raft_consensus.cc:1275] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:02.604511  4870 consensus_queue.cc:1048] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:02.685575  4542 raft_consensus.cc:1275] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 4 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:02.686790  4870 consensus_queue.cc:1048] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:02.695749  4691 raft_consensus.cc:1275] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 4 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:02.697299  4859 consensus_queue.cc:1048] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:02.701013  4693 raft_consensus.cc:1275] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 4 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:02.702243  4862 consensus_queue.cc:1048] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:02.712268  4542 raft_consensus.cc:1275] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 4 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:02.714044  4870 consensus_queue.cc:1048] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:02.936794  4542 raft_consensus.cc:1275] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.937826  4862 consensus_queue.cc:1048] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:02.946266  4693 raft_consensus.cc:1275] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Refusing update from remote peer b6dafb29932b4e0f8cef57e1a4da8c88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.947738  4869 consensus_queue.cc:1048] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:04.985617  4409 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:12:04.986380  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:04.993021  4617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
mode: GRACEFUL
new_leader_uuid: "b964ea673ae7482db901c9180a3ed7ae"
 from {username='slave'} at 127.0.0.1:45234
I20260709 12:12:04.993474  4617 raft_consensus.cc:606] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 LEADER]: Received request to transfer leadership to TS b964ea673ae7482db901c9180a3ed7ae
I20260709 12:12:04.995518  4617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
mode: GRACEFUL
new_leader_uuid: "b964ea673ae7482db901c9180a3ed7ae"
 from {username='slave'} at 127.0.0.1:45234
I20260709 12:12:04.995913  4617 raft_consensus.cc:606] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 LEADER]: Received request to transfer leadership to TS b964ea673ae7482db901c9180a3ed7ae
I20260709 12:12:04.997697  4617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
mode: GRACEFUL
new_leader_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:45234
I20260709 12:12:04.998096  4617 raft_consensus.cc:606] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Received request to transfer leadership to TS 40a3126818444d638917b895d7512005
I20260709 12:12:04.999809  4617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
mode: GRACEFUL
new_leader_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:45234
I20260709 12:12:05.000168  4617 raft_consensus.cc:606] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 LEADER]: Received request to transfer leadership to TS 40a3126818444d638917b895d7512005
I20260709 12:12:05.001899  4617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fba63f37db064ed485438cdfe556f990"
dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
mode: GRACEFUL
new_leader_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:45234
I20260709 12:12:05.002254  4617 raft_consensus.cc:606] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Received request to transfer leadership to TS 40a3126818444d638917b895d7512005
I20260709 12:12:05.003139  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:05.003505  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:05.042531  4888 raft_consensus.cc:993] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88: : Instructing follower b964ea673ae7482db901c9180a3ed7ae to start an election
I20260709 12:12:05.042994  4889 raft_consensus.cc:1081] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 LEADER]: Signalling peer b964ea673ae7482db901c9180a3ed7ae to start an election
I20260709 12:12:05.044224  4693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae"
dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
 from {username='slave'} at 127.0.0.1:44390
I20260709 12:12:05.044601  4693 raft_consensus.cc:493] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:05.044824  4693 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:05.049038  4693 raft_consensus.cc:515] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.050822  4693 leader_election.cc:290] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 5 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:12:05.051671  4542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:12:05.051784  4617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e972beb1a9f4707a0699bf2c6bd5bae" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:12:05.052244  4542 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:05.052277  4617 raft_consensus.cc:3055] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:05.052711  4617 raft_consensus.cc:740] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:12:05.053385  4617 consensus_queue.cc:260] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.054502  4617 raft_consensus.cc:3060] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:05.058271  4542 raft_consensus.cc:2468] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 5.
I20260709 12:12:05.059599  4657 leader_election.cc:304] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:12:05.059958  4617 raft_consensus.cc:2468] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 5.
I20260709 12:12:05.060417  4868 raft_consensus.cc:2804] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:05.061390  4868 raft_consensus.cc:697] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 5 LEADER]: Becoming Leader. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:12:05.062206  4868 consensus_queue.cc:237] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.068147  4438 catalog_manager.cc:5697] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae reported cstate change: term changed from 4 to 5, leader changed from b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66) to b964ea673ae7482db901c9180a3ed7ae (127.4.78.67). New cstate: current_term: 5 leader_uuid: "b964ea673ae7482db901c9180a3ed7ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:05.217005  4888 raft_consensus.cc:993] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88: : Instructing follower 40a3126818444d638917b895d7512005 to start an election
I20260709 12:12:05.217412  4889 raft_consensus.cc:1081] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Signalling peer 40a3126818444d638917b895d7512005 to start an election
I20260709 12:12:05.218703  4544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fba63f37db064ed485438cdfe556f990"
dest_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:50044
I20260709 12:12:05.219086  4544 raft_consensus.cc:493] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:05.219326  4544 raft_consensus.cc:3060] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:05.222957  4544 raft_consensus.cc:515] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.224828  4544 leader_election.cc:290] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 3 election: Requested vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:12:05.225577  4617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba63f37db064ed485438cdfe556f990" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:12:05.225741  4693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba63f37db064ed485438cdfe556f990" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:12:05.226116  4617 raft_consensus.cc:3055] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:05.226205  4693 raft_consensus.cc:3060] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:05.226437  4617 raft_consensus.cc:740] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:12:05.227291  4617 consensus_queue.cc:260] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.228327  4617 raft_consensus.cc:3060] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:05.232012  4693 raft_consensus.cc:2468] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 3.
I20260709 12:12:05.233282  4510 leader_election.cc:304] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:12:05.234066  4617 raft_consensus.cc:2468] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 3.
I20260709 12:12:05.235038  4896 raft_consensus.cc:2804] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:05.236008  4896 raft_consensus.cc:697] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 3 LEADER]: Becoming Leader. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:12:05.236703  4896 consensus_queue.cc:237] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.242846  4438 catalog_manager.cc:5697] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 reported cstate change: term changed from 2 to 3, leader changed from b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66) to 40a3126818444d638917b895d7512005 (127.4.78.65). New cstate: current_term: 3 leader_uuid: "40a3126818444d638917b895d7512005" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.331341  4889 raft_consensus.cc:993] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88: : Instructing follower 40a3126818444d638917b895d7512005 to start an election
I20260709 12:12:05.332049  4900 raft_consensus.cc:1081] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 LEADER]: Signalling peer 40a3126818444d638917b895d7512005 to start an election
I20260709 12:12:05.333796  4544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2"
dest_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:50044
I20260709 12:12:05.334347  4544 raft_consensus.cc:493] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:05.334627  4544 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:05.339814  4544 raft_consensus.cc:515] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.341395  4544 leader_election.cc:290] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 5 election: Requested vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:12:05.342978  4693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:12:05.343030  4617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3df8060598474480c4c8332b9095e2" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:12:05.343798  4617 raft_consensus.cc:3055] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:05.343806  4693 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:05.344061  4617 raft_consensus.cc:740] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:12:05.344842  4617 consensus_queue.cc:260] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.346024  4617 raft_consensus.cc:3060] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:05.349610  4693 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 5.
I20260709 12:12:05.350445  4889 raft_consensus.cc:993] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88: : Instructing follower b964ea673ae7482db901c9180a3ed7ae to start an election
I20260709 12:12:05.351014  4900 raft_consensus.cc:1081] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 LEADER]: Signalling peer b964ea673ae7482db901c9180a3ed7ae to start an election
I20260709 12:12:05.350939  4510 leader_election.cc:304] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:12:05.351747  4617 raft_consensus.cc:2468] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 5.
I20260709 12:12:05.352059  4896 raft_consensus.cc:2804] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:05.352553  4896 raft_consensus.cc:697] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 5 LEADER]: Becoming Leader. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:12:05.353667  4693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56"
dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
 from {username='slave'} at 127.0.0.1:44390
I20260709 12:12:05.353632  4896 consensus_queue.cc:237] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.354228  4693 raft_consensus.cc:493] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:05.354552  4693 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:05.359205  4693 raft_consensus.cc:515] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.360966  4693 leader_election.cc:290] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 4 election: Requested vote from peers 40a3126818444d638917b895d7512005 (127.4.78.65:41717), b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347)
I20260709 12:12:05.362041  4544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "40a3126818444d638917b895d7512005"
I20260709 12:12:05.362450  4617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641dd43bd8b94c3fb6700d503bf9ed56" candidate_uuid: "b964ea673ae7482db901c9180a3ed7ae" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:12:05.362816  4544 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:05.363047  4617 raft_consensus.cc:3055] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:05.363400  4617 raft_consensus.cc:740] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:12:05.364189  4617 consensus_queue.cc:260] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.364108  4438 catalog_manager.cc:5697] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 reported cstate change: term changed from 4 to 5, leader changed from b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66) to 40a3126818444d638917b895d7512005 (127.4.78.65). New cstate: current_term: 5 leader_uuid: "40a3126818444d638917b895d7512005" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.365639  4617 raft_consensus.cc:3060] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:05.369480  4544 raft_consensus.cc:2468] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 4.
I20260709 12:12:05.371025  4657 leader_election.cc:304] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:12:05.372097  4868 raft_consensus.cc:2804] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:05.372195  4617 raft_consensus.cc:2468] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b964ea673ae7482db901c9180a3ed7ae in term 4.
I20260709 12:12:05.372498  4868 raft_consensus.cc:697] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 4 LEADER]: Becoming Leader. State: Replica: b964ea673ae7482db901c9180a3ed7ae, State: Running, Role: LEADER
I20260709 12:12:05.373482  4868 consensus_queue.cc:237] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.382314  4438 catalog_manager.cc:5697] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae reported cstate change: term changed from 3 to 4, leader changed from b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66) to b964ea673ae7482db901c9180a3ed7ae (127.4.78.67). New cstate: current_term: 4 leader_uuid: "b964ea673ae7482db901c9180a3ed7ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:05.397541  4889 raft_consensus.cc:993] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88: : Instructing follower 40a3126818444d638917b895d7512005 to start an election
I20260709 12:12:05.398037  4900 raft_consensus.cc:1081] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Signalling peer 40a3126818444d638917b895d7512005 to start an election
I20260709 12:12:05.399485  4544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887"
dest_uuid: "40a3126818444d638917b895d7512005"
 from {username='slave'} at 127.0.0.1:50044
I20260709 12:12:05.399920  4544 raft_consensus.cc:493] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:05.400175  4544 raft_consensus.cc:3060] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:05.404160  4544 raft_consensus.cc:515] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.405671  4544 leader_election.cc:290] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 3 election: Requested vote from peers b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66:33347), b964ea673ae7482db901c9180a3ed7ae (127.4.78.67:36555)
I20260709 12:12:05.406553  4617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88"
I20260709 12:12:05.406733  4693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4637b197f741ac8c9d95f2c0a8b887" candidate_uuid: "40a3126818444d638917b895d7512005" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b964ea673ae7482db901c9180a3ed7ae"
I20260709 12:12:05.407013  4617 raft_consensus.cc:3055] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:05.407162  4693 raft_consensus.cc:3060] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:05.407289  4617 raft_consensus.cc:740] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6dafb29932b4e0f8cef57e1a4da8c88, State: Running, Role: LEADER
I20260709 12:12:05.407990  4617 consensus_queue.cc:260] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.408859  4617 raft_consensus.cc:3060] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:05.411556  4693 raft_consensus.cc:2468] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 3.
I20260709 12:12:05.412477  4510 leader_election.cc:304] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a3126818444d638917b895d7512005, b964ea673ae7482db901c9180a3ed7ae; no voters: 
I20260709 12:12:05.412849  4617 raft_consensus.cc:2468] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a3126818444d638917b895d7512005 in term 3.
I20260709 12:12:05.413118  4896 raft_consensus.cc:2804] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:05.413578  4896 raft_consensus.cc:697] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 3 LEADER]: Becoming Leader. State: Replica: 40a3126818444d638917b895d7512005, State: Running, Role: LEADER
I20260709 12:12:05.414391  4896 consensus_queue.cc:237] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } }
I20260709 12:12:05.420713  4438 catalog_manager.cc:5697] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 reported cstate change: term changed from 2 to 3, leader changed from b6dafb29932b4e0f8cef57e1a4da8c88 (127.4.78.66) to 40a3126818444d638917b895d7512005 (127.4.78.65). New cstate: current_term: 3 leader_uuid: "40a3126818444d638917b895d7512005" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.587200  4544 raft_consensus.cc:1275] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 5 FOLLOWER]: Refusing update from remote peer b964ea673ae7482db901c9180a3ed7ae: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:05.588387  4868 consensus_queue.cc:1048] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:05.600065  4617 raft_consensus.cc:1275] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 5 FOLLOWER]: Refusing update from remote peer b964ea673ae7482db901c9180a3ed7ae: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:05.601688  4868 consensus_queue.cc:1048] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:12:05.686519  4693 raft_consensus.cc:1275] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:05.687567  4896 consensus_queue.cc:1048] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:05.696743  4617 raft_consensus.cc:1275] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:05.698454  4897 consensus_queue.cc:1048] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:05.772042  4617 raft_consensus.cc:1275] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 5 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:05.773209  4897 consensus_queue.cc:1048] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:05.781271  4693 raft_consensus.cc:1275] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 5 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:05.785223  4897 consensus_queue.cc:1048] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:05.844210  4693 raft_consensus.cc:1275] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:05.845278  4897 consensus_queue.cc:1048] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b964ea673ae7482db901c9180a3ed7ae" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 36555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:05.854192  4617 raft_consensus.cc:1275] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Refusing update from remote peer 40a3126818444d638917b895d7512005: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:05.855859  4913 consensus_queue.cc:1048] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:05.919363  4544 raft_consensus.cc:1275] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 4 FOLLOWER]: Refusing update from remote peer b964ea673ae7482db901c9180a3ed7ae: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:05.920555  4868 consensus_queue.cc:1048] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a3126818444d638917b895d7512005" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:05.928758  4617 raft_consensus.cc:1275] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 FOLLOWER]: Refusing update from remote peer b964ea673ae7482db901c9180a3ed7ae: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:05.930195  4868 consensus_queue.cc:1048] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dafb29932b4e0f8cef57e1a4da8c88" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:06.004768  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:06.010695  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:06.011327  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:07.013226  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:07.017797  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:07.018203  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:08.019136  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:08.023850  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:08.024236  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:09.025206  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:09.030143  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:09.030652  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:10.031711  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:10.036667  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:10.037055  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:11.037981  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:11.042769  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:11.043237  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:12.044193  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:12.048823  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:12.049198  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:13.050201  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:13.054769  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:13.055124  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:14.056025  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:14.060763  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:14.061170  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:15.087384  4409 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:12:15.087935  4409 tablet_server.cc:179] TabletServer@127.4.78.65:0 shutting down...
I20260709 12:12:15.111824  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:15.112475  4409 tablet_replica.cc:333] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005: stopping tablet replica
I20260709 12:12:15.113181  4409 raft_consensus.cc:2243] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.113667  4409 raft_consensus.cc:2272] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.115880  4409 tablet_replica.cc:333] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005: stopping tablet replica
I20260709 12:12:15.116357  4409 raft_consensus.cc:2243] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.116992  4409 raft_consensus.cc:2272] T dc3df8060598474480c4c8332b9095e2 P 40a3126818444d638917b895d7512005 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.118510  4409 tablet_replica.cc:333] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005: stopping tablet replica
I20260709 12:12:15.118976  4409 raft_consensus.cc:2243] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.119351  4409 raft_consensus.cc:2272] T 97a6d6ea1a6c4632add993edb587f726 P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.120888  4409 tablet_replica.cc:333] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005: stopping tablet replica
I20260709 12:12:15.121347  4409 raft_consensus.cc:2243] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.121999  4409 raft_consensus.cc:2272] T 6f4637b197f741ac8c9d95f2c0a8b887 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.123607  4409 tablet_replica.cc:333] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005: stopping tablet replica
I20260709 12:12:15.124120  4409 raft_consensus.cc:2243] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.124599  4409 raft_consensus.cc:2272] T 641dd43bd8b94c3fb6700d503bf9ed56 P 40a3126818444d638917b895d7512005 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.126439  4409 tablet_replica.cc:333] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005: stopping tablet replica
I20260709 12:12:15.127035  4409 raft_consensus.cc:2243] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.127645  4409 raft_consensus.cc:2272] T fba63f37db064ed485438cdfe556f990 P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.129053  4409 tablet_replica.cc:333] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005: stopping tablet replica
I20260709 12:12:15.129491  4409 raft_consensus.cc:2243] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.129866  4409 raft_consensus.cc:2272] T b83a3524e9ff48e688454397c1fcd61c P 40a3126818444d638917b895d7512005 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.131436  4409 tablet_replica.cc:333] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005: stopping tablet replica
I20260709 12:12:15.131850  4409 raft_consensus.cc:2243] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.132207  4409 raft_consensus.cc:2272] T a50bcb984c7042568f6f37fceeaf795b P 40a3126818444d638917b895d7512005 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.133702  4409 tablet_replica.cc:333] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005: stopping tablet replica
I20260709 12:12:15.134151  4409 raft_consensus.cc:2243] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.134533  4409 raft_consensus.cc:2272] T 5e972beb1a9f4707a0699bf2c6bd5bae P 40a3126818444d638917b895d7512005 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:15.211370  4657 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.78.65:41717: connect: Connection refused (error 111)
I20260709 12:12:15.212855  4409 tablet_server.cc:196] TabletServer@127.4.78.65:0 shutdown complete.
W20260709 12:12:15.215006  4657 consensus_peers.cc:597] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae -> Peer 40a3126818444d638917b895d7512005 (127.4.78.65:41717): Couldn't send request to peer 40a3126818444d638917b895d7512005. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:41717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:15.232100  4409 tablet_server.cc:179] TabletServer@127.4.78.66:0 shutting down...
I20260709 12:12:15.255549  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:15.256295  4409 tablet_replica.cc:333] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88: stopping tablet replica
I20260709 12:12:15.257067  4409 raft_consensus.cc:2243] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.257555  4409 raft_consensus.cc:2272] T fba63f37db064ed485438cdfe556f990 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:15.259718  4657 consensus_peers.cc:597] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae -> Peer 40a3126818444d638917b895d7512005 (127.4.78.65:41717): Couldn't send request to peer 40a3126818444d638917b895d7512005. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:41717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:15.259843  4409 tablet_replica.cc:333] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88: stopping tablet replica
I20260709 12:12:15.260531  4409 raft_consensus.cc:2243] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.260926  4409 raft_consensus.cc:2272] T 97a6d6ea1a6c4632add993edb587f726 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.262547  4409 tablet_replica.cc:333] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88: stopping tablet replica
I20260709 12:12:15.263005  4409 raft_consensus.cc:2243] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.263352  4409 raft_consensus.cc:2272] T dc3df8060598474480c4c8332b9095e2 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.264714  4409 tablet_replica.cc:333] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88: stopping tablet replica
I20260709 12:12:15.265142  4409 raft_consensus.cc:2243] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.265836  4409 raft_consensus.cc:2272] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.267419  4409 tablet_replica.cc:333] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88: stopping tablet replica
I20260709 12:12:15.267846  4409 raft_consensus.cc:2243] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.268509  4409 raft_consensus.cc:2272] T b83a3524e9ff48e688454397c1fcd61c P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.270147  4409 tablet_replica.cc:333] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88: stopping tablet replica
I20260709 12:12:15.270563  4409 raft_consensus.cc:2243] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.270896  4409 raft_consensus.cc:2272] T 641dd43bd8b94c3fb6700d503bf9ed56 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.272349  4409 tablet_replica.cc:333] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88: stopping tablet replica
I20260709 12:12:15.272775  4409 raft_consensus.cc:2243] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.273420  4409 raft_consensus.cc:2272] T a50bcb984c7042568f6f37fceeaf795b P b6dafb29932b4e0f8cef57e1a4da8c88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.275106  4409 tablet_replica.cc:333] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88: stopping tablet replica
I20260709 12:12:15.275509  4409 raft_consensus.cc:2243] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.275856  4409 raft_consensus.cc:2272] T 5e972beb1a9f4707a0699bf2c6bd5bae P b6dafb29932b4e0f8cef57e1a4da8c88 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.277364  4409 tablet_replica.cc:333] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88: stopping tablet replica
I20260709 12:12:15.277740  4409 raft_consensus.cc:2243] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.278117  4409 raft_consensus.cc:2272] T 6f4637b197f741ac8c9d95f2c0a8b887 P b6dafb29932b4e0f8cef57e1a4da8c88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.303692  4409 tablet_server.cc:196] TabletServer@127.4.78.66:0 shutdown complete.
I20260709 12:12:15.320937  4409 tablet_server.cc:179] TabletServer@127.4.78.67:0 shutting down...
W20260709 12:12:15.328799  4657 consensus_peers.cc:597] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae -> Peer 40a3126818444d638917b895d7512005 (127.4.78.65:41717): Couldn't send request to peer 40a3126818444d638917b895d7512005. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:41717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:15.360057  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:15.360975  4409 tablet_replica.cc:333] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae: stopping tablet replica
I20260709 12:12:15.362151  4409 raft_consensus.cc:2243] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.363338  4409 raft_consensus.cc:2272] T 97a6d6ea1a6c4632add993edb587f726 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.365237  4409 tablet_replica.cc:333] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae: stopping tablet replica
I20260709 12:12:15.365814  4409 raft_consensus.cc:2243] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.366360  4409 raft_consensus.cc:2272] T dc3df8060598474480c4c8332b9095e2 P b964ea673ae7482db901c9180a3ed7ae [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.368088  4409 tablet_replica.cc:333] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae: stopping tablet replica
I20260709 12:12:15.368569  4409 raft_consensus.cc:2243] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.369081  4409 raft_consensus.cc:2272] T fba63f37db064ed485438cdfe556f990 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.370802  4409 tablet_replica.cc:333] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae: stopping tablet replica
I20260709 12:12:15.371277  4409 raft_consensus.cc:2243] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.371812  4409 raft_consensus.cc:2272] T 6f4637b197f741ac8c9d95f2c0a8b887 P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.373483  4409 tablet_replica.cc:333] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae: stopping tablet replica
I20260709 12:12:15.373996  4409 raft_consensus.cc:2243] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.374449  4409 raft_consensus.cc:2272] T a50bcb984c7042568f6f37fceeaf795b P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.375962  4409 tablet_replica.cc:333] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae: stopping tablet replica
I20260709 12:12:15.376413  4409 raft_consensus.cc:2243] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.377445  4409 raft_consensus.cc:2272] T 5e972beb1a9f4707a0699bf2c6bd5bae P b964ea673ae7482db901c9180a3ed7ae [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.379120  4409 tablet_replica.cc:333] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae: stopping tablet replica
I20260709 12:12:15.379559  4409 raft_consensus.cc:2243] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.379992  4409 raft_consensus.cc:2272] T 9e8a21d23a5f4fb5a8a829b2f60e7ee6 P b964ea673ae7482db901c9180a3ed7ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.381722  4409 tablet_replica.cc:333] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae: stopping tablet replica
I20260709 12:12:15.382213  4409 raft_consensus.cc:2243] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.383170  4409 raft_consensus.cc:2272] T 641dd43bd8b94c3fb6700d503bf9ed56 P b964ea673ae7482db901c9180a3ed7ae [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.384806  4409 tablet_replica.cc:333] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae: stopping tablet replica
I20260709 12:12:15.385200  4409 raft_consensus.cc:2243] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.385666  4409 raft_consensus.cc:2272] T b83a3524e9ff48e688454397c1fcd61c P b964ea673ae7482db901c9180a3ed7ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.430838  4409 tablet_server.cc:196] TabletServer@127.4.78.67:0 shutdown complete.
I20260709 12:12:15.449308  4409 master.cc:562] Master@127.4.78.126:37937 shutting down...
I20260709 12:12:15.470745  4409 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.471428  4409 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.471745  4409 tablet_replica.cc:333] T 00000000000000000000000000000000 P 962b1835fef14eafac2406d8cf943815: stopping tablet replica
I20260709 12:12:15.490049  4409 master.cc:584] Master@127.4.78.126:37937 shutdown complete.
40a3126818444d638917b895d7512005  4
b6dafb29932b4e0f8cef57e1a4da8c88  4
b964ea673ae7482db901c9180a3ed7ae  1
40a3126818444d638917b895d7512005  3
b6dafb29932b4e0f8cef57e1a4da8c88  3
b964ea673ae7482db901c9180a3ed7ae  3
40a3126818444d638917b895d7512005  0
b6dafb29932b4e0f8cef57e1a4da8c88  8
b964ea673ae7482db901c9180a3ed7ae  1
40a3126818444d638917b895d7512005  3
b6dafb29932b4e0f8cef57e1a4da8c88  3
b964ea673ae7482db901c9180a3ed7ae  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30272 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:12:15.531026  4409 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.78.126:46459
I20260709 12:12:15.532198  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.537835  4929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.538065  4930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.538694  4932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.539386  4409 server_base.cc:1061] running on GCE node
I20260709 12:12:15.540298  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:15.540486  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.540624  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599135540604 us; error 0 us; skew 500 ppm
I20260709 12:12:15.541090  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.543521  4409 webserver.cc:533] Webserver started at http://127.4.78.126:32849/ using document root <none> and password file <none>
I20260709 12:12:15.543987  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.544142  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.544353  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.545823  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/master-0-root/instance:
uuid: "5c2cc851343245e7b513b5370d7ea17a"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9t7s"
I20260709 12:12:15.550215  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:12:15.553471  4937 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.554207  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:12:15.554467  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/master-0-root
uuid: "5c2cc851343245e7b513b5370d7ea17a"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9t7s"
I20260709 12:12:15.554742  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.567410  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.568637  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.607175  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.126:46459
I20260709 12:12:15.607262  4988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.126:46459 every 8 connection(s)
I20260709 12:12:15.611093  4989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.621342  4989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a: Bootstrap starting.
I20260709 12:12:15.625802  4989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.629920  4989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a: No bootstrap required, opened a new log
I20260709 12:12:15.632107  4989 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c2cc851343245e7b513b5370d7ea17a" member_type: VOTER }
I20260709 12:12:15.632547  4989 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.632732  4989 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c2cc851343245e7b513b5370d7ea17a, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.633239  4989 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c2cc851343245e7b513b5370d7ea17a" member_type: VOTER }
I20260709 12:12:15.633658  4989 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:15.633941  4989 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:15.634184  4989 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.638103  4989 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c2cc851343245e7b513b5370d7ea17a" member_type: VOTER }
I20260709 12:12:15.638597  4989 leader_election.cc:304] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c2cc851343245e7b513b5370d7ea17a; no voters: 
I20260709 12:12:15.639642  4989 leader_election.cc:290] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:15.639926  4992 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.641212  4992 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [term 1 LEADER]: Becoming Leader. State: Replica: 5c2cc851343245e7b513b5370d7ea17a, State: Running, Role: LEADER
I20260709 12:12:15.641907  4992 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c2cc851343245e7b513b5370d7ea17a" member_type: VOTER }
I20260709 12:12:15.642612  4989 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:15.648411  4993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c2cc851343245e7b513b5370d7ea17a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c2cc851343245e7b513b5370d7ea17a" member_type: VOTER } }
I20260709 12:12:15.648566  4994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c2cc851343245e7b513b5370d7ea17a. Latest consensus state: current_term: 1 leader_uuid: "5c2cc851343245e7b513b5370d7ea17a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c2cc851343245e7b513b5370d7ea17a" member_type: VOTER } }
I20260709 12:12:15.649140  4993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:15.649219  4994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:15.651127  5001 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:15.656090  5001 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:15.657285  4409 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:15.664588  5001 catalog_manager.cc:1383] Generated new cluster ID: 8d0f917ceabf49ce814c213d50143557
I20260709 12:12:15.664827  5001 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:15.678857  5001 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:15.679989  5001 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:15.693293  5001 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a: Generated new TSK 0
I20260709 12:12:15.693859  5001 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:15.723810  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.729481  5010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.730283  5011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.731978  5013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.732299  4409 server_base.cc:1061] running on GCE node
I20260709 12:12:15.733295  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:15.733477  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.733630  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599135733616 us; error 0 us; skew 500 ppm
I20260709 12:12:15.734170  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.736188  4409 webserver.cc:533] Webserver started at http://127.4.78.65:37907/ using document root <none> and password file <none>
I20260709 12:12:15.736621  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.736783  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.737028  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.738229  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-0-root/instance:
uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9t7s"
I20260709 12:12:15.742322  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:12:15.745359  5018 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.746081  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:12:15.746333  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-0-root
uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9t7s"
I20260709 12:12:15.746593  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.765988  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.767159  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.768549  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:15.770732  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:15.770912  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.771129  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:15.771286  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.808095  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.65:34921
I20260709 12:12:15.808176  5080 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.65:34921 every 8 connection(s)
I20260709 12:12:15.812564  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.818955  5085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.819988  5086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.822548  5088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.824119  4409 server_base.cc:1061] running on GCE node
I20260709 12:12:15.825600  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:15.825704  5081 heartbeater.cc:344] Connected to a master server at 127.4.78.126:46459
W20260709 12:12:15.825815  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.826109  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599135826094 us; error 0 us; skew 500 ppm
I20260709 12:12:15.826166  5081 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:15.826654  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.826972  5081 heartbeater.cc:507] Master 127.4.78.126:46459 requested a full tablet report, sending...
I20260709 12:12:15.829133  4409 webserver.cc:533] Webserver started at http://127.4.78.66:46585/ using document root <none> and password file <none>
I20260709 12:12:15.829253  4954 ts_manager.cc:194] Registered new tserver with Master: 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921)
I20260709 12:12:15.829748  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.830016  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.830310  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.831485  4954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46204
I20260709 12:12:15.831714  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-1-root/instance:
uuid: "e5773af2e0d743e1ad7746dd69212f6b"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9t7s"
I20260709 12:12:15.835970  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:15.838886  5093 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.839530  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:15.839775  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-1-root
uuid: "e5773af2e0d743e1ad7746dd69212f6b"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9t7s"
I20260709 12:12:15.840037  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.853112  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.854383  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.855818  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:15.858057  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:15.858253  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.858466  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:15.858613  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.895885  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.66:39239
I20260709 12:12:15.895990  5155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.66:39239 every 8 connection(s)
I20260709 12:12:15.900198  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.907282  5159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.907819  5160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.910247  4409 server_base.cc:1061] running on GCE node
W20260709 12:12:15.910804  5162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.911790  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:15.912048  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.912247  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599135912231 us; error 0 us; skew 500 ppm
I20260709 12:12:15.912758  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.913029  5156 heartbeater.cc:344] Connected to a master server at 127.4.78.126:46459
I20260709 12:12:15.913369  5156 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:15.914184  5156 heartbeater.cc:507] Master 127.4.78.126:46459 requested a full tablet report, sending...
I20260709 12:12:15.915169  4409 webserver.cc:533] Webserver started at http://127.4.78.67:45669/ using document root <none> and password file <none>
I20260709 12:12:15.915659  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.915843  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.916085  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.916057  4954 ts_manager.cc:194] Registered new tserver with Master: e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:15.917246  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-2-root/instance:
uuid: "bab687085af847b49d61effb86b026a2"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9t7s"
I20260709 12:12:15.917366  4954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46210
I20260709 12:12:15.921496  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:12:15.924711  5167 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.925417  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:15.925683  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-2-root
uuid: "bab687085af847b49d61effb86b026a2"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9t7s"
I20260709 12:12:15.925989  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599105096696-4409-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.945242  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.946452  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.948107  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:15.950393  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:15.950590  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.950831  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:15.950974  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.987810  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.67:45827
I20260709 12:12:15.987907  5229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.67:45827 every 8 connection(s)
I20260709 12:12:16.000578  5230 heartbeater.cc:344] Connected to a master server at 127.4.78.126:46459
I20260709 12:12:16.000921  5230 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:16.001614  5230 heartbeater.cc:507] Master 127.4.78.126:46459 requested a full tablet report, sending...
I20260709 12:12:16.003590  4954 ts_manager.cc:194] Registered new tserver with Master: bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.003676  4409 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013046009s
I20260709 12:12:16.005393  4954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46224
I20260709 12:12:16.028218  4954 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46236:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:16.031050  4954 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:16.098249  5121 tablet_service.cc:1511] Processing CreateTablet for tablet bfc44b5cd60248b2a95965e961dbfbef (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:16.099783  5121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc44b5cd60248b2a95965e961dbfbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.099906  5120 tablet_service.cc:1511] Processing CreateTablet for tablet 2a8d1823692d4e3090236a5404597b89 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:16.101230  5120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a8d1823692d4e3090236a5404597b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.103121  5119 tablet_service.cc:1511] Processing CreateTablet for tablet d1bb79b073474065a800f7fa121347e7 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:16.104561  5119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bb79b073474065a800f7fa121347e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.111161  5118 tablet_service.cc:1511] Processing CreateTablet for tablet b31ef428e65d4da4934de737cc858b03 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:16.112644  5118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31ef428e65d4da4934de737cc858b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.116109  5117 tablet_service.cc:1511] Processing CreateTablet for tablet e1665a3480894be2be78e49aa935a2fc (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:16.121562  5195 tablet_service.cc:1511] Processing CreateTablet for tablet bfc44b5cd60248b2a95965e961dbfbef (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:16.123042  5195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc44b5cd60248b2a95965e961dbfbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.123548  5045 tablet_service.cc:1511] Processing CreateTablet for tablet 2a8d1823692d4e3090236a5404597b89 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:16.123987  5116 tablet_service.cc:1511] Processing CreateTablet for tablet 26ee797c227b41b6b2823506f0cf38ac (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:16.124990  5045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a8d1823692d4e3090236a5404597b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.125703  5194 tablet_service.cc:1511] Processing CreateTablet for tablet 2a8d1823692d4e3090236a5404597b89 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:16.126979  5194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a8d1823692d4e3090236a5404597b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.127090  5044 tablet_service.cc:1511] Processing CreateTablet for tablet d1bb79b073474065a800f7fa121347e7 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:16.128520  5044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bb79b073474065a800f7fa121347e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.128360  5193 tablet_service.cc:1511] Processing CreateTablet for tablet d1bb79b073474065a800f7fa121347e7 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:16.128904  5115 tablet_service.cc:1511] Processing CreateTablet for tablet c9f809d2654d44fd99aabcbb4dc7592f (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:16.130673  5192 tablet_service.cc:1511] Processing CreateTablet for tablet b31ef428e65d4da4934de737cc858b03 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:16.131141  5043 tablet_service.cc:1511] Processing CreateTablet for tablet b31ef428e65d4da4934de737cc858b03 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:16.132730  5043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31ef428e65d4da4934de737cc858b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.133042  5191 tablet_service.cc:1511] Processing CreateTablet for tablet e1665a3480894be2be78e49aa935a2fc (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:16.134001  5114 tablet_service.cc:1511] Processing CreateTablet for tablet 46e73897fba4477dbed1c95661b9ebe6 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:16.135052  5042 tablet_service.cc:1511] Processing CreateTablet for tablet e1665a3480894be2be78e49aa935a2fc (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:16.140012  5041 tablet_service.cc:1511] Processing CreateTablet for tablet 26ee797c227b41b6b2823506f0cf38ac (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:16.140276  5040 tablet_service.cc:1511] Processing CreateTablet for tablet c9f809d2654d44fd99aabcbb4dc7592f (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:16.141187  5190 tablet_service.cc:1511] Processing CreateTablet for tablet 26ee797c227b41b6b2823506f0cf38ac (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:16.142562  5113 tablet_service.cc:1511] Processing CreateTablet for tablet 3867548fc6094889bad1f32ad791c900 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:16.142946  5039 tablet_service.cc:1511] Processing CreateTablet for tablet 46e73897fba4477dbed1c95661b9ebe6 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:16.143589  5189 tablet_service.cc:1511] Processing CreateTablet for tablet c9f809d2654d44fd99aabcbb4dc7592f (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:16.140029  5188 tablet_service.cc:1511] Processing CreateTablet for tablet 46e73897fba4477dbed1c95661b9ebe6 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:16.121460  5046 tablet_service.cc:1511] Processing CreateTablet for tablet bfc44b5cd60248b2a95965e961dbfbef (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:16.147420  5112 tablet_service.cc:1511] Processing CreateTablet for tablet b538cff678e64ce6943efcd861abf232 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:16.148008  5187 tablet_service.cc:1511] Processing CreateTablet for tablet 3867548fc6094889bad1f32ad791c900 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:16.149534  5187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3867548fc6094889bad1f32ad791c900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.152068  5188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e73897fba4477dbed1c95661b9ebe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.152913  5191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1665a3480894be2be78e49aa935a2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.117683  5117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1665a3480894be2be78e49aa935a2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.172369  5193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bb79b073474065a800f7fa121347e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.175609  5115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f809d2654d44fd99aabcbb4dc7592f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.178177  5116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ee797c227b41b6b2823506f0cf38ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.182391  5113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3867548fc6094889bad1f32ad791c900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.186012  5190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ee797c227b41b6b2823506f0cf38ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.187899  5186 tablet_service.cc:1511] Processing CreateTablet for tablet b538cff678e64ce6943efcd861abf232 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:16.189308  5186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b538cff678e64ce6943efcd861abf232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.190169  5040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f809d2654d44fd99aabcbb4dc7592f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.190583  5192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31ef428e65d4da4934de737cc858b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.194090  5039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e73897fba4477dbed1c95661b9ebe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.196754  5189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f809d2654d44fd99aabcbb4dc7592f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.199383  5042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1665a3480894be2be78e49aa935a2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.190127  5114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e73897fba4477dbed1c95661b9ebe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.210171  5041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ee797c227b41b6b2823506f0cf38ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.218196  5112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b538cff678e64ce6943efcd861abf232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.223055  5038 tablet_service.cc:1511] Processing CreateTablet for tablet 3867548fc6094889bad1f32ad791c900 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:16.227180  5037 tablet_service.cc:1511] Processing CreateTablet for tablet b538cff678e64ce6943efcd861abf232 (DEFAULT_TABLE table=test-workload [id=17da9f414f9646d79c44daa7e632e928]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:16.234174  5046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc44b5cd60248b2a95965e961dbfbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.246347  5038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3867548fc6094889bad1f32ad791c900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.260704  5037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b538cff678e64ce6943efcd861abf232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.298530  5246 tablet_bootstrap.cc:492] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2: Bootstrap starting.
I20260709 12:12:16.308267  5245 tablet_bootstrap.cc:492] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b: Bootstrap starting.
I20260709 12:12:16.313275  5246 tablet_bootstrap.cc:654] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.319710  5245 tablet_bootstrap.cc:654] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.332382  5247 tablet_bootstrap.cc:492] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91: Bootstrap starting.
I20260709 12:12:16.349397  5247 tablet_bootstrap.cc:654] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.364204  5245 tablet_bootstrap.cc:492] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b: No bootstrap required, opened a new log
I20260709 12:12:16.364657  5245 ts_tablet_manager.cc:1403] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.005s
I20260709 12:12:16.366549  5246 tablet_bootstrap.cc:492] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2: No bootstrap required, opened a new log
I20260709 12:12:16.367053  5246 ts_tablet_manager.cc:1403] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.006s
I20260709 12:12:16.368140  5245 raft_consensus.cc:359] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.368862  5245 raft_consensus.cc:385] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.369006  5247 tablet_bootstrap.cc:492] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91: No bootstrap required, opened a new log
I20260709 12:12:16.369168  5245 raft_consensus.cc:740] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.369413  5247 ts_tablet_manager.cc:1403] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 12:12:16.369882  5246 raft_consensus.cc:359] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.369997  5245 consensus_queue.cc:260] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.370646  5246 raft_consensus.cc:385] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.370936  5246 raft_consensus.cc:740] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.372116  5156 heartbeater.cc:499] Master 127.4.78.126:46459 was elected leader, sending a full tablet report...
I20260709 12:12:16.371826  5247 raft_consensus.cc:359] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.371825  5246 consensus_queue.cc:260] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.372605  5245 ts_tablet_manager.cc:1434] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:12:16.372709  5247 raft_consensus.cc:385] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.373114  5247 raft_consensus.cc:740] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.373910  5245 tablet_bootstrap.cc:492] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b: Bootstrap starting.
I20260709 12:12:16.373854  5247 consensus_queue.cc:260] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.380950  5245 tablet_bootstrap.cc:654] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.388204  5230 heartbeater.cc:499] Master 127.4.78.126:46459 was elected leader, sending a full tablet report...
I20260709 12:12:16.388895  5246 ts_tablet_manager.cc:1434] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.011s
I20260709 12:12:16.390009  5246 tablet_bootstrap.cc:492] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2: Bootstrap starting.
I20260709 12:12:16.396433  5246 tablet_bootstrap.cc:654] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.405032  5081 heartbeater.cc:499] Master 127.4.78.126:46459 was elected leader, sending a full tablet report...
I20260709 12:12:16.405591  5247 ts_tablet_manager.cc:1434] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.025s
I20260709 12:12:16.406700  5247 tablet_bootstrap.cc:492] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91: Bootstrap starting.
I20260709 12:12:16.407938  5245 tablet_bootstrap.cc:492] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b: No bootstrap required, opened a new log
I20260709 12:12:16.408560  5245 ts_tablet_manager.cc:1403] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.001s
I20260709 12:12:16.411680  5245 raft_consensus.cc:359] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.412495  5245 raft_consensus.cc:385] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.412863  5245 raft_consensus.cc:740] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.413123  5247 tablet_bootstrap.cc:654] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.413877  5245 consensus_queue.cc:260] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.416313  5245 ts_tablet_manager.cc:1434] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:16.417502  5245 tablet_bootstrap.cc:492] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b: Bootstrap starting.
I20260709 12:12:16.424309  5245 tablet_bootstrap.cc:654] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.436285  5245 tablet_bootstrap.cc:492] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b: No bootstrap required, opened a new log
I20260709 12:12:16.436813  5245 ts_tablet_manager.cc:1403] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:12:16.438117  5247 tablet_bootstrap.cc:492] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91: No bootstrap required, opened a new log
I20260709 12:12:16.438702  5247 ts_tablet_manager.cc:1403] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.009s
I20260709 12:12:16.440066  5246 tablet_bootstrap.cc:492] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2: No bootstrap required, opened a new log
I20260709 12:12:16.440522  5246 ts_tablet_manager.cc:1403] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.016s
I20260709 12:12:16.440390  5245 raft_consensus.cc:359] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.441157  5245 raft_consensus.cc:385] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.441463  5245 raft_consensus.cc:740] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.441936  5247 raft_consensus.cc:359] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.442235  5245 consensus_queue.cc:260] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.443470  5246 raft_consensus.cc:359] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.444051  5246 raft_consensus.cc:385] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.442692  5247 raft_consensus.cc:385] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.444293  5246 raft_consensus.cc:740] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.444475  5245 ts_tablet_manager.cc:1434] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.003s
I20260709 12:12:16.444564  5247 raft_consensus.cc:740] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.445071  5246 consensus_queue.cc:260] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.445559  5245 tablet_bootstrap.cc:492] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b: Bootstrap starting.
I20260709 12:12:16.445463  5247 consensus_queue.cc:260] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.447139  5246 ts_tablet_manager.cc:1434] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:16.447621  5247 ts_tablet_manager.cc:1434] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:12:16.448292  5246 tablet_bootstrap.cc:492] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2: Bootstrap starting.
I20260709 12:12:16.448855  5247 tablet_bootstrap.cc:492] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91: Bootstrap starting.
I20260709 12:12:16.455451  5246 tablet_bootstrap.cc:654] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.455574  5245 tablet_bootstrap.cc:654] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.455574  5247 tablet_bootstrap.cc:654] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.469627  5245 tablet_bootstrap.cc:492] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b: No bootstrap required, opened a new log
I20260709 12:12:16.470180  5245 ts_tablet_manager.cc:1403] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b: Time spent bootstrapping tablet: real 0.025s	user 0.001s	sys 0.018s
I20260709 12:12:16.470690  5246 tablet_bootstrap.cc:492] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2: No bootstrap required, opened a new log
I20260709 12:12:16.471107  5246 ts_tablet_manager.cc:1403] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 12:12:16.470719  5247 tablet_bootstrap.cc:492] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91: No bootstrap required, opened a new log
I20260709 12:12:16.471818  5247 ts_tablet_manager.cc:1403] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 12:12:16.472958  5245 raft_consensus.cc:359] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.473690  5245 raft_consensus.cc:385] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.474040  5245 raft_consensus.cc:740] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.473789  5246 raft_consensus.cc:359] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.474543  5246 raft_consensus.cc:385] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.474877  5246 raft_consensus.cc:740] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.474826  5245 consensus_queue.cc:260] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.475113  5247 raft_consensus.cc:359] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.475939  5247 raft_consensus.cc:385] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.475834  5246 consensus_queue.cc:260] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.476364  5247 raft_consensus.cc:740] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.477137  5245 ts_tablet_manager.cc:1434] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:12:16.477447  5247 consensus_queue.cc:260] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.478139  5245 tablet_bootstrap.cc:492] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b: Bootstrap starting.
I20260709 12:12:16.478137  5246 ts_tablet_manager.cc:1434] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:16.479349  5246 tablet_bootstrap.cc:492] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2: Bootstrap starting.
I20260709 12:12:16.479877  5247 ts_tablet_manager.cc:1434] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:16.481071  5247 tablet_bootstrap.cc:492] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91: Bootstrap starting.
I20260709 12:12:16.485528  5246 tablet_bootstrap.cc:654] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.487360  5247 tablet_bootstrap.cc:654] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.487325  5251 raft_consensus.cc:493] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.488533  5245 tablet_bootstrap.cc:654] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.488571  5251 raft_consensus.cc:515] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.499728  5251 leader_election.cc:290] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.508280  5247 tablet_bootstrap.cc:492] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91: No bootstrap required, opened a new log
I20260709 12:12:16.508912  5247 ts_tablet_manager.cc:1403] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 12:12:16.511933  5246 tablet_bootstrap.cc:492] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2: No bootstrap required, opened a new log
I20260709 12:12:16.511840  5247 raft_consensus.cc:359] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.512481  5246 ts_tablet_manager.cc:1403] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.008s
I20260709 12:12:16.512665  5247 raft_consensus.cc:385] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.513022  5247 raft_consensus.cc:740] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.515360  5246 raft_consensus.cc:359] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.515769  5056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" is_pre_election: true
W20260709 12:12:16.517514  5094 leader_election.cc:343] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.514110  5247 consensus_queue.cc:260] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.519541  5245 tablet_bootstrap.cc:492] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b: No bootstrap required, opened a new log
I20260709 12:12:16.516063  5246 raft_consensus.cc:385] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.519968  5246 raft_consensus.cc:740] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.519629  5247 ts_tablet_manager.cc:1434] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:12:16.520074  5245 ts_tablet_manager.cc:1403] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.013s
I20260709 12:12:16.521740  5247 tablet_bootstrap.cc:492] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91: Bootstrap starting.
I20260709 12:12:16.521538  5246 consensus_queue.cc:260] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.525394  5245 raft_consensus.cc:359] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.526173  5245 raft_consensus.cc:385] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.526466  5245 raft_consensus.cc:740] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.527194  5245 consensus_queue.cc:260] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.528326  5247 tablet_bootstrap.cc:654] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.529734  5246 ts_tablet_manager.cc:1434] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:12:16.530730  5246 tablet_bootstrap.cc:492] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2: Bootstrap starting.
I20260709 12:12:16.537042  5246 tablet_bootstrap.cc:654] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.540381  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2" is_pre_election: true
I20260709 12:12:16.540904  5245 ts_tablet_manager.cc:1434] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
W20260709 12:12:16.541857  5095 leader_election.cc:343] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bab687085af847b49d61effb86b026a2 (127.4.78.67:45827): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.542311  5095 leader_election.cc:304] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5773af2e0d743e1ad7746dd69212f6b; no voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2
I20260709 12:12:16.543093  5251 raft_consensus.cc:2749] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.545864  5247 tablet_bootstrap.cc:492] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91: No bootstrap required, opened a new log
I20260709 12:12:16.546205  5245 tablet_bootstrap.cc:492] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b: Bootstrap starting.
I20260709 12:12:16.546489  5247 ts_tablet_manager.cc:1403] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.007s
I20260709 12:12:16.548698  5246 tablet_bootstrap.cc:492] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2: No bootstrap required, opened a new log
I20260709 12:12:16.549153  5246 ts_tablet_manager.cc:1403] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2: Time spent bootstrapping tablet: real 0.019s	user 0.001s	sys 0.010s
I20260709 12:12:16.549750  5247 raft_consensus.cc:359] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.550510  5247 raft_consensus.cc:385] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.550796  5247 raft_consensus.cc:740] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.551568  5247 consensus_queue.cc:260] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.552318  5245 tablet_bootstrap.cc:654] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.552057  5246 raft_consensus.cc:359] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.552752  5246 raft_consensus.cc:385] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.553040  5246 raft_consensus.cc:740] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.553771  5246 consensus_queue.cc:260] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.557273  5246 ts_tablet_manager.cc:1434] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:12:16.558276  5246 tablet_bootstrap.cc:492] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2: Bootstrap starting.
I20260709 12:12:16.560891  5247 ts_tablet_manager.cc:1434] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:12:16.564189  5246 tablet_bootstrap.cc:654] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.566612  5247 tablet_bootstrap.cc:492] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91: Bootstrap starting.
I20260709 12:12:16.568359  5245 tablet_bootstrap.cc:492] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b: No bootstrap required, opened a new log
I20260709 12:12:16.568882  5245 ts_tablet_manager.cc:1403] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.009s
I20260709 12:12:16.571947  5245 raft_consensus.cc:359] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.572718  5245 raft_consensus.cc:385] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.572999  5245 raft_consensus.cc:740] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.573222  5247 tablet_bootstrap.cc:654] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.573796  5245 consensus_queue.cc:260] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.576112  5245 ts_tablet_manager.cc:1434] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:16.576427  5246 tablet_bootstrap.cc:492] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2: No bootstrap required, opened a new log
I20260709 12:12:16.576912  5246 ts_tablet_manager.cc:1403] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 12:12:16.577095  5245 tablet_bootstrap.cc:492] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b: Bootstrap starting.
I20260709 12:12:16.580752  5253 raft_consensus.cc:493] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.581275  5253 raft_consensus.cc:515] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.584882  5245 tablet_bootstrap.cc:654] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.585227  5253 leader_election.cc:290] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.580061  5246 raft_consensus.cc:359] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.588762  5246 raft_consensus.cc:385] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.589140  5246 raft_consensus.cc:740] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.590159  5247 tablet_bootstrap.cc:492] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91: No bootstrap required, opened a new log
I20260709 12:12:16.590632  5247 ts_tablet_manager.cc:1403] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 12:12:16.590013  5246 consensus_queue.cc:260] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.592875  5246 ts_tablet_manager.cc:1434] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:12:16.594103  5246 tablet_bootstrap.cc:492] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2: Bootstrap starting.
I20260709 12:12:16.597782  5247 raft_consensus.cc:359] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.598547  5247 raft_consensus.cc:385] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.598839  5247 raft_consensus.cc:740] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.599601  5247 consensus_queue.cc:260] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.600776  5246 tablet_bootstrap.cc:654] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.601832  5247 ts_tablet_manager.cc:1434] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:12:16.602851  5247 tablet_bootstrap.cc:492] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91: Bootstrap starting.
I20260709 12:12:16.610507  5245 tablet_bootstrap.cc:492] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b: No bootstrap required, opened a new log
I20260709 12:12:16.611063  5245 ts_tablet_manager.cc:1403] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.008s
I20260709 12:12:16.613981  5245 raft_consensus.cc:359] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.614723  5245 raft_consensus.cc:385] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.615016  5245 raft_consensus.cc:740] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.615706  5245 consensus_queue.cc:260] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.618093  5245 ts_tablet_manager.cc:1434] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:12:16.619267  5247 tablet_bootstrap.cc:654] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.624286  5245 tablet_bootstrap.cc:492] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b: Bootstrap starting.
I20260709 12:12:16.631633  5245 tablet_bootstrap.cc:654] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.639094  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b538cff678e64ce6943efcd861abf232" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2" is_pre_election: true
W20260709 12:12:16.640733  5020 leader_election.cc:343] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bab687085af847b49d61effb86b026a2 (127.4.78.67:45827): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.642151  5131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b538cff678e64ce6943efcd861abf232" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
W20260709 12:12:16.643887  5021 leader_election.cc:343] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.644379  5021 leader_election.cc:304] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91; no voters: bab687085af847b49d61effb86b026a2, e5773af2e0d743e1ad7746dd69212f6b
I20260709 12:12:16.645237  5253 raft_consensus.cc:2749] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.645859  5245 tablet_bootstrap.cc:492] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b: No bootstrap required, opened a new log
I20260709 12:12:16.646370  5245 ts_tablet_manager.cc:1403] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.003s
I20260709 12:12:16.648098  5251 raft_consensus.cc:493] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.648319  5246 tablet_bootstrap.cc:492] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2: No bootstrap required, opened a new log
I20260709 12:12:16.648566  5251 raft_consensus.cc:515] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.648685  5245 raft_consensus.cc:359] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.649019  5246 ts_tablet_manager.cc:1403] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.032s
I20260709 12:12:16.649135  5247 tablet_bootstrap.cc:492] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91: No bootstrap required, opened a new log
I20260709 12:12:16.649371  5245 raft_consensus.cc:385] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.649643  5245 raft_consensus.cc:740] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.649744  5247 ts_tablet_manager.cc:1403] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.026s
I20260709 12:12:16.650646  5251 leader_election.cc:290] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.650424  5245 consensus_queue.cc:260] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.652338  5056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1665a3480894be2be78e49aa935a2fc" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" is_pre_election: true
W20260709 12:12:16.652477  5002 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:16.652565  5246 raft_consensus.cc:359] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.653465  5246 raft_consensus.cc:385] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.653834  5246 raft_consensus.cc:740] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.654603  5245 ts_tablet_manager.cc:1434] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:12:16.654624  5247 raft_consensus.cc:359] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.654707  5246 consensus_queue.cc:260] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.655462  5247 raft_consensus.cc:385] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.655552  5245 tablet_bootstrap.cc:492] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b: Bootstrap starting.
I20260709 12:12:16.655893  5247 raft_consensus.cc:740] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.656589  5247 consensus_queue.cc:260] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.656949  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1665a3480894be2be78e49aa935a2fc" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2" is_pre_election: true
I20260709 12:12:16.657349  5246 ts_tablet_manager.cc:1434] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 12:12:16.657546  5205 raft_consensus.cc:2468] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 0.
I20260709 12:12:16.658279  5246 tablet_bootstrap.cc:492] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2: Bootstrap starting.
I20260709 12:12:16.661875  5245 tablet_bootstrap.cc:654] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.662225  5095 leader_election.cc:304] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bab687085af847b49d61effb86b026a2, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:16.663064  5251 raft_consensus.cc:2804] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.663430  5251 raft_consensus.cc:493] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.663774  5251 raft_consensus.cc:3060] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.664259  5246 tablet_bootstrap.cc:654] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.665555  5247 ts_tablet_manager.cc:1434] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:12:16.673236  5245 tablet_bootstrap.cc:492] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b: No bootstrap required, opened a new log
I20260709 12:12:16.673518  5247 tablet_bootstrap.cc:492] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91: Bootstrap starting.
I20260709 12:12:16.673369  5253 raft_consensus.cc:493] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.673807  5245 ts_tablet_manager.cc:1403] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:12:16.674124  5253 raft_consensus.cc:515] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.676230  5253 leader_election.cc:290] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.676764  5245 raft_consensus.cc:359] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.677467  5245 raft_consensus.cc:385] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.677820  5245 raft_consensus.cc:740] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.678642  5245 consensus_queue.cc:260] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.680224  5247 tablet_bootstrap.cc:654] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.682312  5131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
I20260709 12:12:16.683033  5131 raft_consensus.cc:2468] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 0.
I20260709 12:12:16.684355  5021 leader_election.cc:304] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:16.685290  5253 raft_consensus.cc:2804] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.685664  5253 raft_consensus.cc:493] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.686020  5253 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.688642  5245 ts_tablet_manager.cc:1434] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:12:16.689815  5245 tablet_bootstrap.cc:492] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b: Bootstrap starting.
I20260709 12:12:16.691365  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2" is_pre_election: true
W20260709 12:12:16.693033  5020 leader_election.cc:343] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bab687085af847b49d61effb86b026a2 (127.4.78.67:45827): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.696337  5245 tablet_bootstrap.cc:654] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.705371  5056 raft_consensus.cc:2468] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 0.
I20260709 12:12:16.705000  5247 tablet_bootstrap.cc:492] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91: No bootstrap required, opened a new log
I20260709 12:12:16.707324  5247 ts_tablet_manager.cc:1403] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent bootstrapping tablet: real 0.034s	user 0.026s	sys 0.000s
I20260709 12:12:16.710129  5245 tablet_bootstrap.cc:492] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b: No bootstrap required, opened a new log
I20260709 12:12:16.710616  5245 ts_tablet_manager.cc:1403] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:12:16.711422  5253 raft_consensus.cc:515] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.711625  5247 raft_consensus.cc:359] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.712297  5247 raft_consensus.cc:385] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.712556  5247 raft_consensus.cc:740] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.713276  5245 raft_consensus.cc:359] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.714112  5245 raft_consensus.cc:385] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.714425  5245 raft_consensus.cc:740] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.715342  5245 consensus_queue.cc:260] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.714393  5131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:16.716478  5281 raft_consensus.cc:493] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.716893  5131 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.717459  5247 consensus_queue.cc:260] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.716933  5281 raft_consensus.cc:515] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.720495  5245 ts_tablet_manager.cc:1434] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:12:16.721333  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
I20260709 12:12:16.721828  5130 raft_consensus.cc:2468] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 0.
I20260709 12:12:16.722334  5281 leader_election.cc:290] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.726034  5021 leader_election.cc:304] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:16.727612  5247 ts_tablet_manager.cc:1434] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:12:16.727454  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2" is_pre_election: true
I20260709 12:12:16.728143  5205 raft_consensus.cc:2468] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 0.
I20260709 12:12:16.728722  5247 tablet_bootstrap.cc:492] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91: Bootstrap starting.
I20260709 12:12:16.731719  5251 raft_consensus.cc:515] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.734503  5056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1665a3480894be2be78e49aa935a2fc" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:16.734730  5247 tablet_bootstrap.cc:654] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.735078  5056 raft_consensus.cc:3060] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.743814  5283 raft_consensus.cc:2804] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.744325  5283 raft_consensus.cc:493] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.744673  5283 raft_consensus.cc:3060] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.745836  5056 raft_consensus.cc:2468] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 1.
I20260709 12:12:16.747373  5094 leader_election.cc:304] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:16.748636  5279 raft_consensus.cc:2804] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.754518  5283 raft_consensus.cc:515] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.758268  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:16.758931  5130 raft_consensus.cc:3060] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.760136  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1665a3480894be2be78e49aa935a2fc" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:16.760766  5205 raft_consensus.cc:3060] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.766801  5130 raft_consensus.cc:2468] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 1.
I20260709 12:12:16.768167  5205 raft_consensus.cc:2468] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 1.
I20260709 12:12:16.768217  5021 leader_election.cc:304] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:16.769292  5281 raft_consensus.cc:2804] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.771651  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2"
W20260709 12:12:16.773025  5020 leader_election.cc:343] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bab687085af847b49d61effb86b026a2 (127.4.78.67:45827): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.774238  5251 leader_election.cc:290] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.775357  5253 leader_election.cc:290] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.777741  5279 raft_consensus.cc:697] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 1 LEADER]: Becoming Leader. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:16.778565  5283 leader_election.cc:290] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.778767  5279 consensus_queue.cc:237] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.780783  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:16.781440  5205 raft_consensus.cc:3060] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.782599  5131 raft_consensus.cc:2468] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 1.
I20260709 12:12:16.784087  5252 raft_consensus.cc:493] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.784602  5252 raft_consensus.cc:515] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.789521  5281 raft_consensus.cc:697] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:16.784003  5021 leader_election.cc:304] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: bab687085af847b49d61effb86b026a2
I20260709 12:12:16.790539  5281 consensus_queue.cc:237] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.792016  5252 leader_election.cc:290] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921)
I20260709 12:12:16.793061  5286 raft_consensus.cc:2804] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.793563  5286 raft_consensus.cc:697] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:16.794782  5286 consensus_queue.cc:237] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.798224  4952 catalog_manager.cc:5697] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66). New cstate: current_term: 1 leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.799767  5205 raft_consensus.cc:2468] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 1.
I20260709 12:12:16.804867  5246 tablet_bootstrap.cc:492] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2: No bootstrap required, opened a new log
I20260709 12:12:16.805395  5246 ts_tablet_manager.cc:1403] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2: Time spent bootstrapping tablet: real 0.147s	user 0.061s	sys 0.059s
I20260709 12:12:16.808225  5246 raft_consensus.cc:359] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.809038  5246 raft_consensus.cc:385] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.809310  5246 raft_consensus.cc:740] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.809625  5283 raft_consensus.cc:493] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.810109  5246 consensus_queue.cc:260] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.811196  5247 tablet_bootstrap.cc:492] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91: No bootstrap required, opened a new log
I20260709 12:12:16.811708  5247 ts_tablet_manager.cc:1403] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent bootstrapping tablet: real 0.083s	user 0.031s	sys 0.047s
I20260709 12:12:16.812839  4951 catalog_manager.cc:5697] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.814285  5247 raft_consensus.cc:359] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.814962  5247 raft_consensus.cc:385] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.815271  5247 raft_consensus.cc:740] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.810129  5283 raft_consensus.cc:515] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.816126  5246 ts_tablet_manager.cc:1434] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:16.818835  5247 consensus_queue.cc:260] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.819350  5246 tablet_bootstrap.cc:492] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2: Bootstrap starting.
I20260709 12:12:16.819906  5283 leader_election.cc:290] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.820868  5247 ts_tablet_manager.cc:1434] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 12:12:16.821696  5247 tablet_bootstrap.cc:492] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91: Bootstrap starting.
I20260709 12:12:16.822350  5283 raft_consensus.cc:493] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.822794  5283 raft_consensus.cc:515] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.825500  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
I20260709 12:12:16.826190  5246 tablet_bootstrap.cc:654] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.826963  5247 tablet_bootstrap.cc:654] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.828037  5204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2" is_pre_election: true
I20260709 12:12:16.828685  5204 raft_consensus.cc:2468] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 0.
I20260709 12:12:16.829918  5020 leader_election.cc:304] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:16.826102  5130 raft_consensus.cc:2468] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 0.
I20260709 12:12:16.830726  5286 raft_consensus.cc:2804] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.831105  5286 raft_consensus.cc:493] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.831409  5286 raft_consensus.cc:3060] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.831969  5283 leader_election.cc:290] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.833009  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867548fc6094889bad1f32ad791c900" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2" is_pre_election: true
I20260709 12:12:16.833607  5205 raft_consensus.cc:2468] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 0.
I20260709 12:12:16.834759  5020 leader_election.cc:304] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:16.835587  5283 raft_consensus.cc:2804] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.835950  5283 raft_consensus.cc:493] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.836256  5283 raft_consensus.cc:3060] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.838703  5247 tablet_bootstrap.cc:492] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91: No bootstrap required, opened a new log
I20260709 12:12:16.838624  5286 raft_consensus.cc:515] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.839224  5247 ts_tablet_manager.cc:1403] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 12:12:16.840611  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc44b5cd60248b2a95965e961dbfbef" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
I20260709 12:12:16.841223  5130 raft_consensus.cc:2468] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 0.
I20260709 12:12:16.841639  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:16.842232  5129 raft_consensus.cc:3060] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.842414  5286 leader_election.cc:290] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.842710  5170 leader_election.cc:304] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bab687085af847b49d61effb86b026a2, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:16.842929  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:16.843539  5205 raft_consensus.cc:3060] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.843649  5252 raft_consensus.cc:2804] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.844126  5252 raft_consensus.cc:493] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.844466  5252 raft_consensus.cc:3060] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.845870  5131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867548fc6094889bad1f32ad791c900" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
I20260709 12:12:16.846516  5131 raft_consensus.cc:2468] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 0.
I20260709 12:12:16.849210  5129 raft_consensus.cc:2468] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 1.
I20260709 12:12:16.850366  5021 leader_election.cc:304] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:16.851181  5286 raft_consensus.cc:2804] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.851027  5247 raft_consensus.cc:359] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.851641  5286 raft_consensus.cc:697] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:16.851912  5247 raft_consensus.cc:385] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.852192  5247 raft_consensus.cc:740] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.852463  5286 consensus_queue.cc:237] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.853088  5247 consensus_queue.cc:260] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.852183  5252 raft_consensus.cc:515] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.855432  5247 ts_tablet_manager.cc:1434] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:12:16.856752  5252 leader_election.cc:290] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921)
I20260709 12:12:16.857056  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc44b5cd60248b2a95965e961dbfbef" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:16.857656  5129 raft_consensus.cc:3060] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.858088  5056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc44b5cd60248b2a95965e961dbfbef" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" is_pre_election: true
I20260709 12:12:16.858711  5056 raft_consensus.cc:2468] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 0.
I20260709 12:12:16.860302  5205 raft_consensus.cc:2468] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 1.
I20260709 12:12:16.861151  5056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc44b5cd60248b2a95965e961dbfbef" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:16.861734  5056 raft_consensus.cc:3060] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.849509  5283 raft_consensus.cc:515] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.862319  5246 tablet_bootstrap.cc:492] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2: No bootstrap required, opened a new log
I20260709 12:12:16.862830  5246 ts_tablet_manager.cc:1403] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.007s
I20260709 12:12:16.864693  5131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867548fc6094889bad1f32ad791c900" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:16.865326  5131 raft_consensus.cc:3060] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.866750  5204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867548fc6094889bad1f32ad791c900" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:16.867374  5204 raft_consensus.cc:3060] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.868399  5246 raft_consensus.cc:359] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.872402  5246 raft_consensus.cc:385] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.873167  5246 raft_consensus.cc:740] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.873425  5129 raft_consensus.cc:2468] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 1.
I20260709 12:12:16.874439  5204 raft_consensus.cc:2468] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 1.
I20260709 12:12:16.875309  5170 leader_election.cc:304] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bab687085af847b49d61effb86b026a2, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:16.875599  5020 leader_election.cc:304] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:16.876269  5252 raft_consensus.cc:2804] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.876562  5253 raft_consensus.cc:2804] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.877043  5253 raft_consensus.cc:697] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:16.877200  5246 consensus_queue.cc:260] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.877894  5253 consensus_queue.cc:237] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.872478  5131 raft_consensus.cc:2468] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 1.
I20260709 12:12:16.889896  5302 raft_consensus.cc:493] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.890439  5302 raft_consensus.cc:515] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.891867  5283 leader_election.cc:290] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.894374  5302 leader_election.cc:290] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:16.895001  5302 raft_consensus.cc:493] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.895417  5055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" is_pre_election: true
I20260709 12:12:16.896204  5055 raft_consensus.cc:2468] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 0.
I20260709 12:12:16.897234  5246 ts_tablet_manager.cc:1434] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2: Time spent starting tablet: real 0.034s	user 0.015s	sys 0.009s
I20260709 12:12:16.897374  5168 leader_election.cc:304] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:16.898078  5131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
I20260709 12:12:16.898288  5246 tablet_bootstrap.cc:492] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2: Bootstrap starting.
I20260709 12:12:16.898388  5300 raft_consensus.cc:2804] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.898722  5131 raft_consensus.cc:2468] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 0.
I20260709 12:12:16.898814  5300 raft_consensus.cc:493] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.899238  5300 raft_consensus.cc:3060] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.904532  5246 tablet_bootstrap.cc:654] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.907713  5299 raft_consensus.cc:493] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.908237  5299 raft_consensus.cc:515] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.895459  5302 raft_consensus.cc:515] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.912360  5131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
I20260709 12:12:16.913066  5299 leader_election.cc:290] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:16.912993  5055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" is_pre_election: true
I20260709 12:12:16.913529  5054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" is_pre_election: true
I20260709 12:12:16.914322  5055 raft_consensus.cc:2468] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 0.
I20260709 12:12:16.914173  5300 raft_consensus.cc:515] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.912987  5131 raft_consensus.cc:2468] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 0.
I20260709 12:12:16.915942  5170 leader_election.cc:304] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bab687085af847b49d61effb86b026a2, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:16.916380  5300 leader_election.cc:290] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:16.916956  5300 raft_consensus.cc:2804] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.917323  5300 raft_consensus.cc:493] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.917474  5246 tablet_bootstrap.cc:492] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2: No bootstrap required, opened a new log
I20260709 12:12:16.917665  5300 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.918004  5246 ts_tablet_manager.cc:1403] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:12:16.918604  5056 raft_consensus.cc:2468] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 1.
I20260709 12:12:16.920799  5246 raft_consensus.cc:359] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.921923  5131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:16.922132  5246 raft_consensus.cc:385] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.922441  5246 raft_consensus.cc:740] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.922513  5131 raft_consensus.cc:3060] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.923153  5246 consensus_queue.cc:260] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.921028  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
I20260709 12:12:16.924460  5300 raft_consensus.cc:515] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.925135  5246 ts_tablet_manager.cc:1434] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:12:16.926378  5300 leader_election.cc:290] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:16.927627  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:16.927709  5283 raft_consensus.cc:493] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.925122  5129 raft_consensus.cc:2393] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bab687085af847b49d61effb86b026a2 in current term 1: Already voted for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in this term.
I20260709 12:12:16.928326  5283 raft_consensus.cc:515] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.929315  5131 raft_consensus.cc:2468] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 1.
I20260709 12:12:16.928289  5130 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.929857  5302 leader_election.cc:290] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:16.930645  5283 leader_election.cc:290] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.932271  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2" is_pre_election: true
I20260709 12:12:16.932966  5205 raft_consensus.cc:2468] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 0.
I20260709 12:12:16.921231  5055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:16.934036  5055 raft_consensus.cc:3060] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.934406  5020 leader_election.cc:304] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:16.934813  4951 catalog_manager.cc:5697] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.937273  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
I20260709 12:12:16.936755  4951 catalog_manager.cc:5697] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.937922  5129 raft_consensus.cc:2468] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 0.
I20260709 12:12:16.935647  5283 raft_consensus.cc:2804] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.937472  5056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:16.938755  5283 raft_consensus.cc:493] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.938668  4951 catalog_manager.cc:5697] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.940177  5170 leader_election.cc:304] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bab687085af847b49d61effb86b026a2; no voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b
I20260709 12:12:16.934419  5252 raft_consensus.cc:697] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Becoming Leader. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:16.941466  5056 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.941494  5283 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.942296  5252 consensus_queue.cc:237] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.944422  5299 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.948549  5283 raft_consensus.cc:515] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.949108  5056 raft_consensus.cc:2468] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 1.
I20260709 12:12:16.950376  5170 leader_election.cc:304] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bab687085af847b49d61effb86b026a2, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:16.950408  5168 leader_election.cc:304] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:16.951200  5131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:16.951385  5302 raft_consensus.cc:2804] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.951732  5131 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.951897  5302 raft_consensus.cc:697] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Becoming Leader. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:16.952684  5283 leader_election.cc:290] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:16.952847  5302 consensus_queue.cc:237] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.955122  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:16.955670  5205 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.956254  5298 raft_consensus.cc:2804] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.956729  5298 raft_consensus.cc:697] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Becoming Leader. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:16.957623  5299 raft_consensus.cc:2749] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.957484  5298 consensus_queue.cc:237] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.940584  5130 raft_consensus.cc:2468] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 1.
I20260709 12:12:16.959830  5131 raft_consensus.cc:2468] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 1.
I20260709 12:12:16.941175  5055 raft_consensus.cc:2468] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 1.
I20260709 12:12:16.960968  5021 leader_election.cc:304] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:16.961748  5283 raft_consensus.cc:2804] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.963833  5205 raft_consensus.cc:2468] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 1.
I20260709 12:12:16.964187  5283 raft_consensus.cc:697] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:16.964979  5283 consensus_queue.cc:237] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:16.974052  4951 catalog_manager.cc:5697] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bab687085af847b49d61effb86b026a2 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "bab687085af847b49d61effb86b026a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.978214  4953 catalog_manager.cc:5697] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.988214  4953 catalog_manager.cc:5697] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bab687085af847b49d61effb86b026a2 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "bab687085af847b49d61effb86b026a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.989547  4953 catalog_manager.cc:5697] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bab687085af847b49d61effb86b026a2 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "bab687085af847b49d61effb86b026a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.032055  5279 raft_consensus.cc:493] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.032521  5279 raft_consensus.cc:515] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.034222  5279 leader_election.cc:290] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:17.035086  5055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b538cff678e64ce6943efcd861abf232" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" is_pre_election: true
I20260709 12:12:17.035251  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b538cff678e64ce6943efcd861abf232" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2" is_pre_election: true
I20260709 12:12:17.035636  5055 raft_consensus.cc:2468] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 0.
I20260709 12:12:17.035771  5205 raft_consensus.cc:2468] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 0.
I20260709 12:12:17.036638  5094 leader_election.cc:304] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:17.037284  5279 raft_consensus.cc:2804] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:17.037642  5279 raft_consensus.cc:493] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.037968  5279 raft_consensus.cc:3060] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.043200  5279 raft_consensus.cc:515] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.045004  5279 leader_election.cc:290] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:17.045706  5055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b538cff678e64ce6943efcd861abf232" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:17.045964  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b538cff678e64ce6943efcd861abf232" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:17.046322  5055 raft_consensus.cc:3060] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.046458  5205 raft_consensus.cc:3060] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.054014  5205 raft_consensus.cc:2468] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 1.
I20260709 12:12:17.054014  5055 raft_consensus.cc:2468] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 1.
I20260709 12:12:17.055269  5094 leader_election.cc:304] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:17.055956  5279 raft_consensus.cc:2804] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:17.056421  5279 raft_consensus.cc:697] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 1 LEADER]: Becoming Leader. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:17.057235  5279 consensus_queue.cc:237] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.064189  4953 catalog_manager.cc:5697] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66). New cstate: current_term: 1 leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.225610  5283 consensus_queue.cc:1048] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.235821  5283 consensus_queue.cc:1048] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.253587  5279 consensus_queue.cc:1048] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.263242  5285 consensus_queue.cc:1048] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.275519  5283 consensus_queue.cc:1048] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.279393  5283 consensus_queue.cc:1048] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.299304  5281 consensus_queue.cc:1048] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.303205  5203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfc44b5cd60248b2a95965e961dbfbef"
dest_uuid: "bab687085af847b49d61effb86b026a2"
mode: GRACEFUL
new_leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:50460
I20260709 12:12:17.304039  5203 raft_consensus.cc:606] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Received request to transfer leadership to TS 2fee3334a8cb44efbbbd08a99f87ee91
I20260709 12:12:17.315819  5204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7"
dest_uuid: "bab687085af847b49d61effb86b026a2"
mode: GRACEFUL
new_leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:50460
I20260709 12:12:17.316380  5204 raft_consensus.cc:606] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Received request to transfer leadership to TS 2fee3334a8cb44efbbbd08a99f87ee91
I20260709 12:12:17.317133  5286 consensus_queue.cc:1048] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.334888  5130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1665a3480894be2be78e49aa935a2fc"
dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
mode: GRACEFUL
new_leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:52304
I20260709 12:12:17.335392  5130 raft_consensus.cc:606] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 1 LEADER]: Received request to transfer leadership to TS 2fee3334a8cb44efbbbd08a99f87ee91
I20260709 12:12:17.347236  5055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
mode: GRACEFUL
new_leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:34404
I20260709 12:12:17.347757  5055 raft_consensus.cc:606] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Received request to transfer leadership to TS e5773af2e0d743e1ad7746dd69212f6b
I20260709 12:12:17.352581  5204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f"
dest_uuid: "bab687085af847b49d61effb86b026a2"
mode: GRACEFUL
new_leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:50460
I20260709 12:12:17.353031  5204 raft_consensus.cc:606] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Received request to transfer leadership to TS e5773af2e0d743e1ad7746dd69212f6b
I20260709 12:12:17.358052  5055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
mode: GRACEFUL
new_leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:34404
I20260709 12:12:17.358516  5055 raft_consensus.cc:606] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Received request to transfer leadership to TS e5773af2e0d743e1ad7746dd69212f6b
I20260709 12:12:17.363080  5055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3867548fc6094889bad1f32ad791c900"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
mode: GRACEFUL
new_leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:34404
I20260709 12:12:17.363541  5055 raft_consensus.cc:606] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Received request to transfer leadership to TS e5773af2e0d743e1ad7746dd69212f6b
I20260709 12:12:17.367811  5130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b538cff678e64ce6943efcd861abf232"
dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
mode: GRACEFUL
new_leader_uuid: "bab687085af847b49d61effb86b026a2"
 from {username='slave'} at 127.0.0.1:52304
I20260709 12:12:17.368238  5130 raft_consensus.cc:606] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 1 LEADER]: Received request to transfer leadership to TS bab687085af847b49d61effb86b026a2
I20260709 12:12:17.397956  5286 consensus_queue.cc:1048] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.403527  5253 raft_consensus.cc:993] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91: : Instructing follower e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:17.403990  5283 raft_consensus.cc:1081] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Signalling peer e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:17.405616  5131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac"
dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:52286
I20260709 12:12:17.406237  5131 raft_consensus.cc:493] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.406615  5131 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.409390  5286 consensus_queue.cc:1048] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.416596  5131 raft_consensus.cc:515] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.420014  5055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:17.420596  5055 raft_consensus.cc:3055] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.420931  5055 raft_consensus.cc:740] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:17.421332  5131 leader_election.cc:290] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 2 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:17.421717  5055 consensus_queue.cc:260] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.423061  5055 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.423635  5286 consensus_queue.cc:1048] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.425734  5298 consensus_queue.cc:1048] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.426453  5204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:17.427080  5204 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.430706  5252 consensus_queue.cc:1048] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.431581  5055 raft_consensus.cc:2468] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 2.
I20260709 12:12:17.432667  5094 leader_election.cc:304] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:17.433468  5285 raft_consensus.cc:2804] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.441939  5204 raft_consensus.cc:2468] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 2.
I20260709 12:12:17.446791  5286 raft_consensus.cc:993] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91: : Instructing follower e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:17.447214  5286 raft_consensus.cc:1081] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Signalling peer e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:17.452240  5130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3867548fc6094889bad1f32ad791c900"
dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:52286
I20260709 12:12:17.453071  5281 consensus_queue.cc:1048] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.454834  5130 raft_consensus.cc:493] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.455314  5130 raft_consensus.cc:3060] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.456904  5298 consensus_queue.cc:1048] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.459226  5252 consensus_queue.cc:1048] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.462409  5285 raft_consensus.cc:697] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Becoming Leader. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:17.463315  5285 consensus_queue.cc:237] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.467070  5298 consensus_queue.cc:1048] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.473520  5299 consensus_queue.cc:1048] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.467738  5130 raft_consensus.cc:515] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.486393  5055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867548fc6094889bad1f32ad791c900" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:17.487120  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3867548fc6094889bad1f32ad791c900" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:17.487111  5055 raft_consensus.cc:3055] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.488519  5055 raft_consensus.cc:740] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:17.489358  5055 consensus_queue.cc:260] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.490253  5055 raft_consensus.cc:3060] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.487207  5130 leader_election.cc:290] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 2 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:17.491802  5252 raft_consensus.cc:993] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2: : Instructing follower e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:17.492245  5252 raft_consensus.cc:1081] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Signalling peer e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:17.494103  5130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f"
dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:52290
I20260709 12:12:17.494356  4953 catalog_manager.cc:5697] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b reported cstate change: term changed from 1 to 2, leader changed from 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65) to e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66). New cstate: current_term: 2 leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.496460  5130 raft_consensus.cc:493] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.496886  5130 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.503400  5130 raft_consensus.cc:515] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.504416  5129 raft_consensus.cc:1240] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Rejecting Update request from peer bab687085af847b49d61effb86b026a2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:17.507999  5302 raft_consensus.cc:993] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2: : Instructing follower 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:17.508538  5302 raft_consensus.cc:1081] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Signalling peer 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:17.511627  5055 raft_consensus.cc:2468] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 2.
I20260709 12:12:17.511797  5298 raft_consensus.cc:993] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2: : Instructing follower 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:17.512326  5298 raft_consensus.cc:1081] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Signalling peer 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:17.514127  5056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:34398
I20260709 12:12:17.514674  5056 raft_consensus.cc:493] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.512275  5053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfc44b5cd60248b2a95965e961dbfbef"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:34398
I20260709 12:12:17.515038  5056 raft_consensus.cc:3060] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.515914  5094 leader_election.cc:304] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: bab687085af847b49d61effb86b026a2
I20260709 12:12:17.516729  5252 consensus_queue.cc:1059] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.516986  5285 raft_consensus.cc:2804] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.517791  5299 raft_consensus.cc:3055] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.517593  5285 raft_consensus.cc:697] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Becoming Leader. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:17.518150  5299 raft_consensus.cc:740] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:17.518633  5285 consensus_queue.cc:237] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.519829  5130 leader_election.cc:290] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 2 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:17.520951  5204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:17.519064  5299 consensus_queue.cc:260] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.522423  5299 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.522992  5054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:17.523542  5054 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.529198  4953 catalog_manager.cc:5697] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b reported cstate change: term changed from 1 to 2, leader changed from 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65) to e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66). New cstate: current_term: 2 leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.530493  5053 raft_consensus.cc:493] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.530925  5053 raft_consensus.cc:3060] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.533241  5054 raft_consensus.cc:2468] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 2.
I20260709 12:12:17.534539  5094 leader_election.cc:304] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:17.535344  5285 raft_consensus.cc:2804] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.535794  5285 raft_consensus.cc:697] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Becoming Leader. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:17.536536  5285 consensus_queue.cc:237] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.540354  5204 raft_consensus.cc:2468] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 2.
I20260709 12:12:17.543149  5053 raft_consensus.cc:515] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.545909  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc44b5cd60248b2a95965e961dbfbef" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:17.546501  5130 raft_consensus.cc:3060] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.547201  5056 raft_consensus.cc:515] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.548985  5056 leader_election.cc:290] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 2 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:17.549636  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:17.550203  5129 raft_consensus.cc:3060] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.552237  5130 raft_consensus.cc:2468] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 2.
I20260709 12:12:17.551667  4953 catalog_manager.cc:5697] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b reported cstate change: term changed from 1 to 2, leader changed from bab687085af847b49d61effb86b026a2 (127.4.78.67) to e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66). New cstate: current_term: 2 leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.553234  5053 leader_election.cc:290] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 2 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:17.555351  5021 leader_election.cc:304] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:17.555436  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc44b5cd60248b2a95965e961dbfbef" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:17.556089  5205 raft_consensus.cc:3055] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.556437  5204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:17.556624  5129 raft_consensus.cc:2468] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 2.
I20260709 12:12:17.556747  5283 raft_consensus.cc:2804] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.557163  5204 raft_consensus.cc:3055] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.557446  5283 raft_consensus.cc:697] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:17.557504  5204 raft_consensus.cc:740] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:17.558439  5283 consensus_queue.cc:237] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.558892  5021 leader_election.cc:304] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:17.558784  5204 consensus_queue.cc:260] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.559705  5281 raft_consensus.cc:2804] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.556391  5205 raft_consensus.cc:740] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:17.559962  5204 raft_consensus.cc:3060] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.560200  5281 raft_consensus.cc:697] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:17.560510  5205 consensus_queue.cc:260] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.561296  5281 consensus_queue.cc:237] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.561826  5205 raft_consensus.cc:3060] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.567751  5204 raft_consensus.cc:2468] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 2.
I20260709 12:12:17.568758  5205 raft_consensus.cc:2468] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 2.
I20260709 12:12:17.569571  4951 catalog_manager.cc:5697] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 1 to 2, leader changed from bab687085af847b49d61effb86b026a2 (127.4.78.67) to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.570135  5285 consensus_queue.cc:1048] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.579723  5279 consensus_queue.cc:1048] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.583895  4953 catalog_manager.cc:5697] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 1 to 2, leader changed from bab687085af847b49d61effb86b026a2 (127.4.78.67) to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.591004  5325 raft_consensus.cc:993] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b: : Instructing follower bab687085af847b49d61effb86b026a2 to start an election
I20260709 12:12:17.591403  5279 raft_consensus.cc:1081] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 1 LEADER]: Signalling peer bab687085af847b49d61effb86b026a2 to start an election
I20260709 12:12:17.592736  5205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b538cff678e64ce6943efcd861abf232"
dest_uuid: "bab687085af847b49d61effb86b026a2"
 from {username='slave'} at 127.0.0.1:50446
I20260709 12:12:17.595366  5205 raft_consensus.cc:493] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.595727  5205 raft_consensus.cc:3060] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.600732  5205 raft_consensus.cc:515] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.602561  5205 leader_election.cc:290] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 2 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:17.602880  5053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b538cff678e64ce6943efcd861abf232" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:17.603434  5053 raft_consensus.cc:3060] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.603449  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b538cff678e64ce6943efcd861abf232" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:17.604084  5129 raft_consensus.cc:3055] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.604378  5129 raft_consensus.cc:740] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:17.605126  5129 consensus_queue.cc:260] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.606381  5129 raft_consensus.cc:3060] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.609823  5053 raft_consensus.cc:2468] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 2.
I20260709 12:12:17.611055  5168 leader_election.cc:304] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:17.611696  5299 raft_consensus.cc:2804] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.612160  5299 raft_consensus.cc:697] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Becoming Leader. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:17.612440  5129 raft_consensus.cc:2468] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 2.
I20260709 12:12:17.612963  5299 consensus_queue.cc:237] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.618880  4953 catalog_manager.cc:5697] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 reported cstate change: term changed from 1 to 2, leader changed from e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66) to bab687085af847b49d61effb86b026a2 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "bab687085af847b49d61effb86b026a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.748200  5286 raft_consensus.cc:993] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91: : Instructing follower e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:17.748889  5253 raft_consensus.cc:1081] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Signalling peer e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:17.750726  5129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6"
dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:52286
I20260709 12:12:17.751271  5129 raft_consensus.cc:493] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.751641  5129 raft_consensus.cc:3060] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.756320  5129 raft_consensus.cc:515] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.757751  5129 leader_election.cc:290] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 2 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:17.758540  5053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:17.758734  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:17.759076  5053 raft_consensus.cc:3055] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.759251  5205 raft_consensus.cc:3060] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.759423  5053 raft_consensus.cc:740] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:17.760205  5053 consensus_queue.cc:260] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.761049  5053 raft_consensus.cc:3060] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.764027  5205 raft_consensus.cc:2468] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 2.
I20260709 12:12:17.765094  5095 leader_election.cc:304] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bab687085af847b49d61effb86b026a2, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:17.765413  5053 raft_consensus.cc:2468] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 2.
I20260709 12:12:17.765781  5279 raft_consensus.cc:2804] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.766258  5279 raft_consensus.cc:697] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Becoming Leader. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:17.766980  5279 consensus_queue.cc:237] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.772502  4953 catalog_manager.cc:5697] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b reported cstate change: term changed from 1 to 2, leader changed from 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65) to e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66). New cstate: current_term: 2 leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.840778  5251 raft_consensus.cc:993] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b: : Instructing follower 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:17.841197  5279 raft_consensus.cc:1081] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 1 LEADER]: Signalling peer 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:17.842708  5053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1665a3480894be2be78e49aa935a2fc"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:34384
I20260709 12:12:17.843170  5053 raft_consensus.cc:493] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.843453  5053 raft_consensus.cc:3060] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.848335  5053 raft_consensus.cc:515] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.849931  5053 leader_election.cc:290] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 2 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:17.850735  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1665a3480894be2be78e49aa935a2fc" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:17.850914  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1665a3480894be2be78e49aa935a2fc" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:17.851290  5129 raft_consensus.cc:3055] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.851431  5205 raft_consensus.cc:3060] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.851603  5129 raft_consensus.cc:740] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:17.852362  5129 consensus_queue.cc:260] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.853242  5129 raft_consensus.cc:3060] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.856212  5205 raft_consensus.cc:2468] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 2.
I20260709 12:12:17.857234  5020 leader_election.cc:304] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:17.857932  5286 raft_consensus.cc:2804] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.858001  5129 raft_consensus.cc:2468] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 2.
I20260709 12:12:17.858342  5286 raft_consensus.cc:697] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:17.859148  5286 consensus_queue.cc:237] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:17.864835  4953 catalog_manager.cc:5697] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 1 to 2, leader changed from e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66) to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.916743  5053 raft_consensus.cc:1275] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.917987  5279 consensus_queue.cc:1048] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:17.925114  5205 raft_consensus.cc:1275] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.926888  5251 consensus_queue.cc:1048] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:17.960632  5205 raft_consensus.cc:3060] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.965507  5205 raft_consensus.cc:1275] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.966881  5251 consensus_queue.cc:1048] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:17.974367  5053 raft_consensus.cc:1275] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.975839  5325 consensus_queue.cc:1048] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.252377  5205 raft_consensus.cc:1275] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.096640  5336 consensus_queue.cc:1048] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.105314  5205 raft_consensus.cc:1275] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.106148  5204 raft_consensus.cc:1275] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.106937  5339 consensus_queue.cc:1048] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.108678  5339 consensus_queue.cc:1048] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.118512  5129 raft_consensus.cc:1275] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Refusing update from remote peer bab687085af847b49d61effb86b026a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.124811  5203 raft_consensus.cc:1275] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.143903  5344 consensus_queue.cc:1048] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:19.146122  5053 raft_consensus.cc:1275] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Refusing update from remote peer bab687085af847b49d61effb86b026a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.149216  5204 raft_consensus.cc:1275] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.155689  5335 consensus_queue.cc:1048] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.161051  5355 consensus_queue.cc:1048] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.170815  5344 consensus_queue.cc:1048] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.171797  5131 raft_consensus.cc:1275] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.173555  5128 raft_consensus.cc:1275] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.175092  5127 raft_consensus.cc:1275] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.179384  5339 consensus_queue.cc:1048] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.180485  5338 consensus_queue.cc:1048] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.180711  5339 consensus_queue.cc:1048] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.203312  5343 raft_consensus.cc:493] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fee3334a8cb44efbbbd08a99f87ee91)
I20260709 12:12:19.204092  5343 raft_consensus.cc:515] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:19.207291  5056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" is_pre_election: true
I20260709 12:12:19.216006  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
I20260709 12:12:19.247659  5170 leader_election.cc:304] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bab687085af847b49d61effb86b026a2; no voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b
I20260709 12:12:19.248868  5344 raft_consensus.cc:493] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fee3334a8cb44efbbbd08a99f87ee91)
I20260709 12:12:19.249380  5344 raft_consensus.cc:515] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:19.251905  5344 leader_election.cc:290] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:19.252369  5344 raft_consensus.cc:2749] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:19.253978  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
I20260709 12:12:19.266034  5359 raft_consensus.cc:493] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.266549  5359 raft_consensus.cc:515] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:19.268762  5359 leader_election.cc:290] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:19.269794  5056 raft_consensus.cc:1275] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.274247  5053 raft_consensus.cc:1275] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.274121  5336 consensus_queue.cc:1048] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.279071  5128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b" is_pre_election: true
W20260709 12:12:19.292220  5168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 72519.8us
I20260709 12:12:19.297506  5343 leader_election.cc:290] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:19.300338  5053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" is_pre_election: true
W20260709 12:12:19.300530  5020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:45827, user_credentials={real_user=slave}} blocked reactor thread for 149581us
I20260709 12:12:19.302177  5168 leader_election.cc:304] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bab687085af847b49d61effb86b026a2; no voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b
I20260709 12:12:19.303766  5204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bab687085af847b49d61effb86b026a2" is_pre_election: true
I20260709 12:12:19.311305  5343 raft_consensus.cc:2749] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:19.311659  5020 leader_election.cc:304] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91; no voters: bab687085af847b49d61effb86b026a2, e5773af2e0d743e1ad7746dd69212f6b
I20260709 12:12:19.313783  5355 raft_consensus.cc:2749] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:19.326314  5340 consensus_queue.cc:1048] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:20.130827  5226 debug-util.cc:398] Leaking SignalData structure 0x7b08000a2ca0 after lost signal to thread 4412
W20260709 12:12:20.131599  5226 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea380 after lost signal to thread 4988
W20260709 12:12:20.132404  5226 debug-util.cc:398] Leaking SignalData structure 0x7b08000efcc0 after lost signal to thread 5080
W20260709 12:12:20.133086  5226 debug-util.cc:398] Leaking SignalData structure 0x7b08000a00c0 after lost signal to thread 5155
W20260709 12:12:20.133802  5226 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7820 after lost signal to thread 5229
I20260709 12:12:21.380028  4409 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:12:21.380719  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:21.401187  5056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
mode: GRACEFUL
new_leader_uuid: "bab687085af847b49d61effb86b026a2"
 from {username='slave'} at 127.0.0.1:37996
I20260709 12:12:21.401897  5056 raft_consensus.cc:606] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Received request to transfer leadership to TS bab687085af847b49d61effb86b026a2
I20260709 12:12:21.404575  5056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
mode: GRACEFUL
new_leader_uuid: "bab687085af847b49d61effb86b026a2"
 from {username='slave'} at 127.0.0.1:37996
I20260709 12:12:21.405184  5056 raft_consensus.cc:606] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Received request to transfer leadership to TS bab687085af847b49d61effb86b026a2
I20260709 12:12:21.406395  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:21.406944  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:21.632835  5380 raft_consensus.cc:993] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91: : Instructing follower bab687085af847b49d61effb86b026a2 to start an election
I20260709 12:12:21.633344  5378 raft_consensus.cc:1081] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Signalling peer bab687085af847b49d61effb86b026a2 to start an election
I20260709 12:12:21.634888  5205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89"
dest_uuid: "bab687085af847b49d61effb86b026a2"
 from {username='slave'} at 127.0.0.1:50448
I20260709 12:12:21.635353  5205 raft_consensus.cc:493] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:21.635672  5205 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:21.641018  5205 raft_consensus.cc:515] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:21.642758  5205 leader_election.cc:290] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 2 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:21.644016  5056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:21.644596  5056 raft_consensus.cc:3055] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:21.644853  5056 raft_consensus.cc:740] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:21.645479  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:21.645521  5056 consensus_queue.cc:260] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:21.646306  5130 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:21.646709  5056 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:21.651211  5056 raft_consensus.cc:2468] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 2.
I20260709 12:12:21.652247  5168 leader_election.cc:304] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:21.652933  5130 raft_consensus.cc:2468] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 2.
I20260709 12:12:21.653714  5383 raft_consensus.cc:2804] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:21.654253  5383 raft_consensus.cc:697] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Becoming Leader. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:21.655357  5383 consensus_queue.cc:237] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:21.663543  4950 catalog_manager.cc:5697] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 reported cstate change: term changed from 1 to 2, leader changed from 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65) to bab687085af847b49d61effb86b026a2 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "bab687085af847b49d61effb86b026a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.667722  5380 raft_consensus.cc:993] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91: : Instructing follower bab687085af847b49d61effb86b026a2 to start an election
I20260709 12:12:21.668195  5380 raft_consensus.cc:1081] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Signalling peer bab687085af847b49d61effb86b026a2 to start an election
I20260709 12:12:21.669804  5205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03"
dest_uuid: "bab687085af847b49d61effb86b026a2"
 from {username='slave'} at 127.0.0.1:50448
I20260709 12:12:21.670290  5205 raft_consensus.cc:493] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:21.670624  5205 raft_consensus.cc:3060] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:21.675460  5205 raft_consensus.cc:515] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:21.677546  5056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:21.678066  5056 raft_consensus.cc:3055] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:21.678371  5056 raft_consensus.cc:740] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:21.679095  5056 consensus_queue.cc:260] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:21.679502  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:21.679934  5056 raft_consensus.cc:3060] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:21.680136  5130 raft_consensus.cc:3060] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:21.681887  5205 leader_election.cc:290] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 2 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:21.685170  5056 raft_consensus.cc:2468] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 2.
I20260709 12:12:21.686138  5168 leader_election.cc:304] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:21.686796  5383 raft_consensus.cc:2804] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:21.686842  5130 raft_consensus.cc:2468] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 2.
I20260709 12:12:21.687296  5383 raft_consensus.cc:697] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Becoming Leader. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:21.688467  5383 consensus_queue.cc:237] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:21.695716  4950 catalog_manager.cc:5697] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 reported cstate change: term changed from 1 to 2, leader changed from 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65) to bab687085af847b49d61effb86b026a2 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "bab687085af847b49d61effb86b026a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.050773  5130 raft_consensus.cc:1275] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Refusing update from remote peer bab687085af847b49d61effb86b026a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:22.052806  5383 consensus_queue.cc:1048] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:22.068329  5056 raft_consensus.cc:1275] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Refusing update from remote peer bab687085af847b49d61effb86b026a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:22.070147  5362 consensus_queue.cc:1048] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:22.263528  5056 raft_consensus.cc:1275] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Refusing update from remote peer bab687085af847b49d61effb86b026a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:22.264834  5383 consensus_queue.cc:1048] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:22.274107  5130 raft_consensus.cc:1275] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Refusing update from remote peer bab687085af847b49d61effb86b026a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:22.275797  5383 consensus_queue.cc:1048] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:22.408017  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:22.416209  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:22.416738  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:23.417681  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:23.422925  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:23.423301  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:24.424175  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:24.429665  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:24.430095  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:25.431322  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:25.438905  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:25.439332  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:26.440253  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:26.445276  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:26.445663  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:27.446611  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:27.451900  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:27.452328  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:28.453109  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:28.458127  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:28.458590  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:29.459543  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:29.464745  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:29.465158  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:30.466018  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:30.471076  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:30.471477  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:31.499965  4409 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:12:31.506349  5205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89"
dest_uuid: "bab687085af847b49d61effb86b026a2"
mode: GRACEFUL
new_leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:50460
I20260709 12:12:31.506944  5205 raft_consensus.cc:606] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Received request to transfer leadership to TS 2fee3334a8cb44efbbbd08a99f87ee91
I20260709 12:12:31.513414  5205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03"
dest_uuid: "bab687085af847b49d61effb86b026a2"
mode: GRACEFUL
new_leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:50460
I20260709 12:12:31.513856  5205 raft_consensus.cc:606] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Received request to transfer leadership to TS 2fee3334a8cb44efbbbd08a99f87ee91
I20260709 12:12:31.520195  5129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac"
dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
mode: GRACEFUL
new_leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:52304
I20260709 12:12:31.520642  5129 raft_consensus.cc:606] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Received request to transfer leadership to TS 2fee3334a8cb44efbbbd08a99f87ee91
I20260709 12:12:31.524868  5129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f"
dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
mode: GRACEFUL
new_leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:52304
I20260709 12:12:31.525290  5129 raft_consensus.cc:606] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Received request to transfer leadership to TS 2fee3334a8cb44efbbbd08a99f87ee91
I20260709 12:12:31.529212  5129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6"
dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
mode: GRACEFUL
new_leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:52304
I20260709 12:12:31.529629  5129 raft_consensus.cc:606] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Received request to transfer leadership to TS 2fee3334a8cb44efbbbd08a99f87ee91
I20260709 12:12:31.553808  5401 raft_consensus.cc:993] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2: : Instructing follower 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:31.554275  5408 raft_consensus.cc:1081] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Signalling peer 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:31.555670  5056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:34398
I20260709 12:12:31.556078  5056 raft_consensus.cc:493] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:31.556349  5056 raft_consensus.cc:3060] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.561022  5056 raft_consensus.cc:515] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.562592  5056 leader_election.cc:290] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:31.563550  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:31.563459  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31ef428e65d4da4934de737cc858b03" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:31.564229  5205 raft_consensus.cc:3055] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:31.564303  5129 raft_consensus.cc:3060] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.564492  5205 raft_consensus.cc:740] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:31.565256  5205 consensus_queue.cc:260] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.566255  5205 raft_consensus.cc:3060] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.569185  5129 raft_consensus.cc:2468] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 3.
I20260709 12:12:31.570297  5021 leader_election.cc:304] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:31.570574  5205 raft_consensus.cc:2468] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 3.
I20260709 12:12:31.571029  5380 raft_consensus.cc:2804] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:31.572089  5380 raft_consensus.cc:697] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:31.572928  5380 consensus_queue.cc:237] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.579532  4950 catalog_manager.cc:5697] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 2 to 3, leader changed from bab687085af847b49d61effb86b026a2 (127.4.78.67) to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 3 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.758658  5401 raft_consensus.cc:993] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2: : Instructing follower 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:31.759125  5408 raft_consensus.cc:1081] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Signalling peer 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:31.760500  5056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:34398
I20260709 12:12:31.760890  5056 raft_consensus.cc:493] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:31.761210  5056 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.761691  5406 raft_consensus.cc:993] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b: : Instructing follower 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:31.762188  5415 raft_consensus.cc:1081] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Signalling peer 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:31.764760  5053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:34384
I20260709 12:12:31.765259  5053 raft_consensus.cc:493] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:31.765522  5053 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.766711  5056 raft_consensus.cc:515] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.768671  5056 leader_election.cc:290] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:31.769398  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:31.769752  5205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:31.769968  5129 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.770215  5205 raft_consensus.cc:3055] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:31.770525  5205 raft_consensus.cc:740] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:31.771121  5205 consensus_queue.cc:260] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.771131  5053 raft_consensus.cc:515] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.772053  5205 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.774144  5053 leader_election.cc:290] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:31.774116  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:31.774498  5203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:31.774845  5130 raft_consensus.cc:3055] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:31.775157  5130 raft_consensus.cc:740] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:31.775122  5203 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.775969  5130 consensus_queue.cc:260] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.776844  5130 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.778167  5205 raft_consensus.cc:2468] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 3.
I20260709 12:12:31.779464  5020 leader_election.cc:304] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:31.780241  5380 raft_consensus.cc:2804] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:31.780692  5380 raft_consensus.cc:697] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:31.781356  5380 consensus_queue.cc:237] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.781899  5129 raft_consensus.cc:2468] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 3.
I20260709 12:12:31.781908  5203 raft_consensus.cc:2468] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 3.
I20260709 12:12:31.783461  5020 leader_election.cc:304] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:31.784377  5409 raft_consensus.cc:2804] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:31.786749  5130 raft_consensus.cc:2468] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 3.
I20260709 12:12:31.786969  5409 raft_consensus.cc:697] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:31.787843  5409 consensus_queue.cc:237] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.788208  4950 catalog_manager.cc:5697] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 2 to 3, leader changed from bab687085af847b49d61effb86b026a2 (127.4.78.67) to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 3 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.798485  4950 catalog_manager.cc:5697] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 2 to 3, leader changed from e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66) to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 3 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.806950  5406 raft_consensus.cc:993] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b: : Instructing follower 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:31.807364  5415 raft_consensus.cc:1081] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Signalling peer 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:31.808920  5053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:34384
I20260709 12:12:31.809437  5053 raft_consensus.cc:493] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:31.809845  5053 raft_consensus.cc:3060] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.816551  5053 raft_consensus.cc:515] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.818668  5053 leader_election.cc:290] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:31.819316  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:31.819854  5130 raft_consensus.cc:3055] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:31.819962  5203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e73897fba4477dbed1c95661b9ebe6" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:31.820168  5130 raft_consensus.cc:740] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:31.820415  5203 raft_consensus.cc:3060] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.820950  5130 consensus_queue.cc:260] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.822037  5130 raft_consensus.cc:3060] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.825188  5203 raft_consensus.cc:2468] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 3.
I20260709 12:12:31.826385  5020 leader_election.cc:304] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:31.827173  5409 raft_consensus.cc:2804] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:31.827410  5130 raft_consensus.cc:2468] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 3.
I20260709 12:12:31.827620  5409 raft_consensus.cc:697] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:31.828776  5409 consensus_queue.cc:237] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.836038  4950 catalog_manager.cc:5697] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 2 to 3, leader changed from e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66) to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 3 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.894629  5406 raft_consensus.cc:993] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b: : Instructing follower 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:31.895063  5415 raft_consensus.cc:1081] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Signalling peer 2fee3334a8cb44efbbbd08a99f87ee91 to start an election
I20260709 12:12:31.896313  5053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
 from {username='slave'} at 127.0.0.1:34384
I20260709 12:12:31.896745  5053 raft_consensus.cc:493] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:31.897008  5053 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.901782  5053 raft_consensus.cc:515] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.903337  5053 leader_election.cc:290] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 election: Requested vote from peers e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:31.904134  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:31.904290  5203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:31.904670  5130 raft_consensus.cc:3055] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:31.904768  5203 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.904986  5130 raft_consensus.cc:740] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:31.905750  5130 consensus_queue.cc:260] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.907049  5130 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:31.911504  5203 raft_consensus.cc:2468] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 3.
I20260709 12:12:31.912587  5020 leader_election.cc:304] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, bab687085af847b49d61effb86b026a2; no voters: 
I20260709 12:12:31.913013  5130 raft_consensus.cc:2468] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee3334a8cb44efbbbd08a99f87ee91 in term 3.
I20260709 12:12:31.913249  5409 raft_consensus.cc:2804] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:31.913736  5409 raft_consensus.cc:697] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Becoming Leader. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:31.914510  5409 consensus_queue.cc:237] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:31.920969  4950 catalog_manager.cc:5697] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 reported cstate change: term changed from 2 to 3, leader changed from e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66) to 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65). New cstate: current_term: 3 leader_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:32.046651  5203 raft_consensus.cc:1275] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:32.047863  5409 consensus_queue.cc:1048] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:32.058815  5130 raft_consensus.cc:1275] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:32.060009  5409 consensus_queue.cc:1048] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:32.166183  5130 raft_consensus.cc:1275] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:32.167269  5409 consensus_queue.cc:1048] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:32.175444  5203 raft_consensus.cc:1275] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:32.176757  5417 consensus_queue.cc:1048] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:32.235451  5203 raft_consensus.cc:1275] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:32.236596  5417 consensus_queue.cc:1048] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:32.246718  5130 raft_consensus.cc:1275] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:32.247997  5380 consensus_queue.cc:1048] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:32.295104  5203 raft_consensus.cc:1275] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:32.296211  5380 consensus_queue.cc:1048] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:32.304719  5130 raft_consensus.cc:1275] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:32.305897  5380 consensus_queue.cc:1048] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:32.383606  5203 raft_consensus.cc:1275] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:32.384690  5380 consensus_queue.cc:1048] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:32.392601  5130 raft_consensus.cc:1275] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Refusing update from remote peer 2fee3334a8cb44efbbbd08a99f87ee91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:32.395852  5417 consensus_queue.cc:1048] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:12:34.484351  5077 debug-util.cc:398] Leaking SignalData structure 0x7b0800150540 after lost signal to thread 4412
W20260709 12:12:34.485217  5077 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4fe0 after lost signal to thread 4988
W20260709 12:12:34.486174  5077 debug-util.cc:398] Leaking SignalData structure 0x7b080015af60 after lost signal to thread 5080
W20260709 12:12:34.486918  5077 debug-util.cc:398] Leaking SignalData structure 0x7b08001610c0 after lost signal to thread 5155
W20260709 12:12:34.487630  5077 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa140 after lost signal to thread 5229
I20260709 12:12:34.694046  4409 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:12:34.694819  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:34.705248  5053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
mode: GRACEFUL
new_leader_uuid: "bab687085af847b49d61effb86b026a2"
 from {username='slave'} at 127.0.0.1:37996
I20260709 12:12:34.705864  5053 raft_consensus.cc:606] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Received request to transfer leadership to TS bab687085af847b49d61effb86b026a2
I20260709 12:12:34.708453  5053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
mode: GRACEFUL
new_leader_uuid: "bab687085af847b49d61effb86b026a2"
 from {username='slave'} at 127.0.0.1:37996
I20260709 12:12:34.709025  5053 raft_consensus.cc:606] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Received request to transfer leadership to TS bab687085af847b49d61effb86b026a2
I20260709 12:12:34.711191  5053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
mode: GRACEFUL
new_leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:37996
I20260709 12:12:34.711621  5053 raft_consensus.cc:606] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Received request to transfer leadership to TS e5773af2e0d743e1ad7746dd69212f6b
I20260709 12:12:34.713522  5053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7"
dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
mode: GRACEFUL
new_leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:37996
I20260709 12:12:34.713949  5053 raft_consensus.cc:606] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 LEADER]: Received request to transfer leadership to TS e5773af2e0d743e1ad7746dd69212f6b
I20260709 12:12:34.714848  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:34.715245  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:34.804312  5439 raft_consensus.cc:993] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91: : Instructing follower e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:34.804787  5437 raft_consensus.cc:1081] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 LEADER]: Signalling peer e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:34.806561  5128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7"
dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:52286
I20260709 12:12:34.807052  5128 raft_consensus.cc:493] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.807449  5128 raft_consensus.cc:3060] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.812618  5128 raft_consensus.cc:515] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:34.814733  5128 leader_election.cc:290] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 3 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:34.815588  5053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:34.815827  5201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb79b073474065a800f7fa121347e7" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:34.816196  5053 raft_consensus.cc:3055] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:34.816393  5201 raft_consensus.cc:3060] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.816571  5053 raft_consensus.cc:740] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:34.817435  5053 consensus_queue.cc:260] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:34.818651  5053 raft_consensus.cc:3060] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.821317  5201 raft_consensus.cc:2468] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 3.
I20260709 12:12:34.822489  5095 leader_election.cc:304] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bab687085af847b49d61effb86b026a2, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:34.823091  5438 raft_consensus.cc:2804] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:34.824106  5438 raft_consensus.cc:697] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 3 LEADER]: Becoming Leader. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:34.824997  5438 consensus_queue.cc:237] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:34.825969  5053 raft_consensus.cc:2468] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 3.
I20260709 12:12:34.835168  4950 catalog_manager.cc:5697] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b reported cstate change: term changed from 2 to 3, leader changed from 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65) to e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66). New cstate: current_term: 3 leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:34.890143  5439 raft_consensus.cc:993] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91: : Instructing follower bab687085af847b49d61effb86b026a2 to start an election
I20260709 12:12:34.890571  5437 raft_consensus.cc:1081] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Signalling peer bab687085af847b49d61effb86b026a2 to start an election
I20260709 12:12:34.891940  5201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac"
dest_uuid: "bab687085af847b49d61effb86b026a2"
 from {username='slave'} at 127.0.0.1:50448
I20260709 12:12:34.892344  5201 raft_consensus.cc:493] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.892618  5201 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:34.896912  5201 raft_consensus.cc:515] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:34.900067  5128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:34.900000  5053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ee797c227b41b6b2823506f0cf38ac" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:34.900496  5201 leader_election.cc:290] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 4 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:34.900835  5053 raft_consensus.cc:3055] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:34.901117  5053 raft_consensus.cc:740] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:34.900576  5128 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:34.901854  5053 consensus_queue.cc:260] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:34.902954  5053 raft_consensus.cc:3060] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:34.907658  5128 raft_consensus.cc:2468] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 4.
I20260709 12:12:34.909271  5053 raft_consensus.cc:2468] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 4.
I20260709 12:12:34.909305  5170 leader_election.cc:304] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bab687085af847b49d61effb86b026a2, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:34.910224  5401 raft_consensus.cc:2804] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:34.911808  5401 raft_consensus.cc:697] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 4 LEADER]: Becoming Leader. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:34.912650  5401 consensus_queue.cc:237] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:34.919697  4950 catalog_manager.cc:5697] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 reported cstate change: term changed from 3 to 4, leader changed from 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65) to bab687085af847b49d61effb86b026a2 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "bab687085af847b49d61effb86b026a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.016855  5439 raft_consensus.cc:993] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91: : Instructing follower bab687085af847b49d61effb86b026a2 to start an election
I20260709 12:12:35.017282  5437 raft_consensus.cc:1081] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Signalling peer bab687085af847b49d61effb86b026a2 to start an election
I20260709 12:12:35.018762  5201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89"
dest_uuid: "bab687085af847b49d61effb86b026a2"
 from {username='slave'} at 127.0.0.1:50448
I20260709 12:12:35.019348  5201 raft_consensus.cc:493] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:35.019698  5201 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:35.026520  5201 raft_consensus.cc:515] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:35.028620  5201 leader_election.cc:290] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 4 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66:39239)
I20260709 12:12:35.029556  5128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
I20260709 12:12:35.029556  5053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d1823692d4e3090236a5404597b89" candidate_uuid: "bab687085af847b49d61effb86b026a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:35.030256  5128 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:35.030781  5053 raft_consensus.cc:3055] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:35.031078  5053 raft_consensus.cc:740] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:35.031867  5053 consensus_queue.cc:260] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:35.033035  5053 raft_consensus.cc:3060] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:35.034313  5439 raft_consensus.cc:993] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91: : Instructing follower e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:35.037631  5437 raft_consensus.cc:1081] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Signalling peer e5773af2e0d743e1ad7746dd69212f6b to start an election
I20260709 12:12:35.037822  5128 raft_consensus.cc:2468] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 4.
I20260709 12:12:35.039547  5053 raft_consensus.cc:2468] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab687085af847b49d61effb86b026a2 in term 4.
I20260709 12:12:35.039956  5170 leader_election.cc:304] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bab687085af847b49d61effb86b026a2, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:35.040362  5129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f"
dest_uuid: "e5773af2e0d743e1ad7746dd69212f6b"
 from {username='slave'} at 127.0.0.1:52286
I20260709 12:12:35.040773  5401 raft_consensus.cc:2804] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:35.040865  5129 raft_consensus.cc:493] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:35.041220  5129 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:35.041268  5401 raft_consensus.cc:697] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 4 LEADER]: Becoming Leader. State: Replica: bab687085af847b49d61effb86b026a2, State: Running, Role: LEADER
I20260709 12:12:35.042135  5401 consensus_queue.cc:237] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:35.047679  5129 raft_consensus.cc:515] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:35.049779  5129 leader_election.cc:290] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 4 election: Requested vote from peers 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921), bab687085af847b49d61effb86b026a2 (127.4.78.67:45827)
I20260709 12:12:35.050912  5053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2fee3334a8cb44efbbbd08a99f87ee91"
I20260709 12:12:35.050810  5201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f809d2654d44fd99aabcbb4dc7592f" candidate_uuid: "e5773af2e0d743e1ad7746dd69212f6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bab687085af847b49d61effb86b026a2"
I20260709 12:12:35.051805  5053 raft_consensus.cc:3055] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:35.052003  5201 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:35.052217  5053 raft_consensus.cc:740] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fee3334a8cb44efbbbd08a99f87ee91, State: Running, Role: LEADER
I20260709 12:12:35.053061  5053 consensus_queue.cc:260] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:35.054315  5053 raft_consensus.cc:3060] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:35.060684  5201 raft_consensus.cc:2468] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 4.
I20260709 12:12:35.061407  5053 raft_consensus.cc:2468] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5773af2e0d743e1ad7746dd69212f6b in term 4.
I20260709 12:12:35.064013  5094 leader_election.cc:304] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee3334a8cb44efbbbd08a99f87ee91, e5773af2e0d743e1ad7746dd69212f6b; no voters: 
I20260709 12:12:35.064801  5438 raft_consensus.cc:2804] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:35.065224  5438 raft_consensus.cc:697] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 4 LEADER]: Becoming Leader. State: Replica: e5773af2e0d743e1ad7746dd69212f6b, State: Running, Role: LEADER
I20260709 12:12:35.066025  5438 consensus_queue.cc:237] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } }
I20260709 12:12:35.066715  4950 catalog_manager.cc:5697] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 reported cstate change: term changed from 3 to 4, leader changed from 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65) to bab687085af847b49d61effb86b026a2 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "bab687085af847b49d61effb86b026a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.078356  4950 catalog_manager.cc:5697] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b reported cstate change: term changed from 3 to 4, leader changed from 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65) to e5773af2e0d743e1ad7746dd69212f6b (127.4.78.66). New cstate: current_term: 4 leader_uuid: "e5773af2e0d743e1ad7746dd69212f6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:35.310954  5053 raft_consensus.cc:1275] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:35.312141  5438 consensus_queue.cc:1048] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:35.326447  5201 raft_consensus.cc:1275] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:35.327987  5438 consensus_queue.cc:1048] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:35.355134  5129 raft_consensus.cc:1275] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 4 FOLLOWER]: Refusing update from remote peer bab687085af847b49d61effb86b026a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:35.356155  5401 consensus_queue.cc:1048] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:35.365657  5053 raft_consensus.cc:1275] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Refusing update from remote peer bab687085af847b49d61effb86b026a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:35.368898  5401 consensus_queue.cc:1048] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:35.461047  5056 raft_consensus.cc:1275] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Refusing update from remote peer bab687085af847b49d61effb86b026a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:35.463932  5129 raft_consensus.cc:1275] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 4 FOLLOWER]: Refusing update from remote peer bab687085af847b49d61effb86b026a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:35.463457  5446 consensus_queue.cc:1048] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:35.465934  5401 consensus_queue.cc:1048] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5773af2e0d743e1ad7746dd69212f6b" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:35.548736  5201 raft_consensus.cc:1275] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 4 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:35.550173  5438 consensus_queue.cc:1048] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab687085af847b49d61effb86b026a2" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:35.561800  5056 raft_consensus.cc:1275] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Refusing update from remote peer e5773af2e0d743e1ad7746dd69212f6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:35.563585  5438 consensus_queue.cc:1048] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fee3334a8cb44efbbbd08a99f87ee91" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:35.716305  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:35.724737  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:35.725324  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:36.726528  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:36.731758  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:36.732205  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:37.733089  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:37.738579  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:37.738986  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:38.739890  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:38.745654  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:38.746070  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:39.746896  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:39.752748  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:39.753149  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:40.753983  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:40.759006  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:40.759416  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:41.760267  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:41.765618  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:41.766113  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:42.766985  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:42.772123  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:42.772509  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:43.773344  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:43.778630  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:43.779017  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:44.807761  4409 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:12:44.808213  4409 tablet_server.cc:179] TabletServer@127.4.78.65:0 shutting down...
W20260709 12:12:44.814178  5094 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 12:12:44.819278  5094 consensus_peers.cc:597] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b -> Peer 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921): Couldn't send request to peer 2fee3334a8cb44efbbbd08a99f87ee91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.835005  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:44.836014  4409 tablet_replica.cc:333] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91: stopping tablet replica
I20260709 12:12:44.836732  4409 raft_consensus.cc:2243] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.837550  4409 raft_consensus.cc:2272] T bfc44b5cd60248b2a95965e961dbfbef P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.839605  4409 tablet_replica.cc:333] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91: stopping tablet replica
I20260709 12:12:44.840147  4409 raft_consensus.cc:2243] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.840538  4409 raft_consensus.cc:2272] T c9f809d2654d44fd99aabcbb4dc7592f P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.842108  4409 tablet_replica.cc:333] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91: stopping tablet replica
I20260709 12:12:44.842634  4409 raft_consensus.cc:2243] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.843034  4409 raft_consensus.cc:2272] T 26ee797c227b41b6b2823506f0cf38ac P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.844688  4409 tablet_replica.cc:333] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91: stopping tablet replica
I20260709 12:12:44.845147  4409 raft_consensus.cc:2243] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.845520  4409 raft_consensus.cc:2272] T 2a8d1823692d4e3090236a5404597b89 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.847107  4409 tablet_replica.cc:333] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91: stopping tablet replica
I20260709 12:12:44.847555  4409 raft_consensus.cc:2243] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.847952  4409 raft_consensus.cc:2272] T d1bb79b073474065a800f7fa121347e7 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.849426  4409 tablet_replica.cc:333] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91: stopping tablet replica
I20260709 12:12:44.849954  4409 raft_consensus.cc:2243] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.850329  4409 raft_consensus.cc:2272] T b538cff678e64ce6943efcd861abf232 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.851814  4409 tablet_replica.cc:333] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91: stopping tablet replica
I20260709 12:12:44.852233  4409 raft_consensus.cc:2243] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.852927  4409 raft_consensus.cc:2272] T 46e73897fba4477dbed1c95661b9ebe6 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.854482  4409 tablet_replica.cc:333] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91: stopping tablet replica
I20260709 12:12:44.854941  4409 raft_consensus.cc:2243] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.855607  4409 raft_consensus.cc:2272] T e1665a3480894be2be78e49aa935a2fc P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.857012  4409 tablet_replica.cc:333] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91: stopping tablet replica
I20260709 12:12:44.857450  4409 raft_consensus.cc:2243] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.858155  4409 raft_consensus.cc:2272] T b31ef428e65d4da4934de737cc858b03 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.859596  4409 tablet_replica.cc:333] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91: stopping tablet replica
I20260709 12:12:44.860025  4409 raft_consensus.cc:2243] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.860427  4409 raft_consensus.cc:2272] T 3867548fc6094889bad1f32ad791c900 P 2fee3334a8cb44efbbbd08a99f87ee91 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.903400  5168 consensus_peers.cc:597] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 -> Peer 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921): Couldn't send request to peer 2fee3334a8cb44efbbbd08a99f87ee91. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:34921: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.907603  4409 tablet_server.cc:196] TabletServer@127.4.78.65:0 shutdown complete.
I20260709 12:12:44.928469  4409 tablet_server.cc:179] TabletServer@127.4.78.66:0 shutting down...
I20260709 12:12:44.951807  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:44.952387  4409 tablet_replica.cc:333] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b: stopping tablet replica
I20260709 12:12:44.952982  4409 raft_consensus.cc:2243] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.953454  4409 raft_consensus.cc:2272] T 46e73897fba4477dbed1c95661b9ebe6 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.955322  4409 tablet_replica.cc:333] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b: stopping tablet replica
I20260709 12:12:44.955785  4409 raft_consensus.cc:2243] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.956507  4409 raft_consensus.cc:2272] T 3867548fc6094889bad1f32ad791c900 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.958091  4409 tablet_replica.cc:333] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b: stopping tablet replica
I20260709 12:12:44.958537  4409 raft_consensus.cc:2243] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.958930  4409 raft_consensus.cc:2272] T b538cff678e64ce6943efcd861abf232 P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.960412  4409 tablet_replica.cc:333] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b: stopping tablet replica
I20260709 12:12:44.960916  4409 raft_consensus.cc:2243] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.961582  4409 raft_consensus.cc:2272] T d1bb79b073474065a800f7fa121347e7 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.963395  4409 tablet_replica.cc:333] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b: stopping tablet replica
I20260709 12:12:44.963970  4409 raft_consensus.cc:2243] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:12:44.964540  5168 consensus_peers.cc:597] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 -> Peer 2fee3334a8cb44efbbbd08a99f87ee91 (127.4.78.65:34921): Couldn't send request to peer 2fee3334a8cb44efbbbd08a99f87ee91. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:34921: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.964869  4409 raft_consensus.cc:2272] T c9f809d2654d44fd99aabcbb4dc7592f P e5773af2e0d743e1ad7746dd69212f6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.966447  4409 tablet_replica.cc:333] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b: stopping tablet replica
I20260709 12:12:44.966902  4409 raft_consensus.cc:2243] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.967274  4409 raft_consensus.cc:2272] T bfc44b5cd60248b2a95965e961dbfbef P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.968799  4409 tablet_replica.cc:333] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b: stopping tablet replica
I20260709 12:12:44.969241  4409 raft_consensus.cc:2243] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.969591  4409 raft_consensus.cc:2272] T e1665a3480894be2be78e49aa935a2fc P e5773af2e0d743e1ad7746dd69212f6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.971158  4409 tablet_replica.cc:333] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b: stopping tablet replica
I20260709 12:12:44.971597  4409 raft_consensus.cc:2243] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.971942  4409 raft_consensus.cc:2272] T b31ef428e65d4da4934de737cc858b03 P e5773af2e0d743e1ad7746dd69212f6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.973515  4409 tablet_replica.cc:333] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b: stopping tablet replica
I20260709 12:12:44.973999  4409 raft_consensus.cc:2243] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.974422  4409 raft_consensus.cc:2272] T 26ee797c227b41b6b2823506f0cf38ac P e5773af2e0d743e1ad7746dd69212f6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.975941  4409 tablet_replica.cc:333] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b: stopping tablet replica
I20260709 12:12:44.976334  4409 raft_consensus.cc:2243] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.976675  4409 raft_consensus.cc:2272] T 2a8d1823692d4e3090236a5404597b89 P e5773af2e0d743e1ad7746dd69212f6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.004050  4409 tablet_server.cc:196] TabletServer@127.4.78.66:0 shutdown complete.
I20260709 12:12:45.023258  4409 tablet_server.cc:179] TabletServer@127.4.78.67:0 shutting down...
I20260709 12:12:45.044974  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:45.045887  4409 tablet_replica.cc:333] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2: stopping tablet replica
I20260709 12:12:45.046468  4409 raft_consensus.cc:2243] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.047271  4409 raft_consensus.cc:2272] T b538cff678e64ce6943efcd861abf232 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.049096  4409 tablet_replica.cc:333] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2: stopping tablet replica
I20260709 12:12:45.049620  4409 raft_consensus.cc:2243] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.050137  4409 raft_consensus.cc:2272] T d1bb79b073474065a800f7fa121347e7 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.051893  4409 tablet_replica.cc:333] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2: stopping tablet replica
I20260709 12:12:45.052398  4409 raft_consensus.cc:2243] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.053061  4409 raft_consensus.cc:2272] T 2a8d1823692d4e3090236a5404597b89 P bab687085af847b49d61effb86b026a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.054719  4409 tablet_replica.cc:333] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2: stopping tablet replica
I20260709 12:12:45.055183  4409 raft_consensus.cc:2243] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.055826  4409 raft_consensus.cc:2272] T 26ee797c227b41b6b2823506f0cf38ac P bab687085af847b49d61effb86b026a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.057468  4409 tablet_replica.cc:333] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2: stopping tablet replica
I20260709 12:12:45.057960  4409 raft_consensus.cc:2243] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.058341  4409 raft_consensus.cc:2272] T 46e73897fba4477dbed1c95661b9ebe6 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.059895  4409 tablet_replica.cc:333] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2: stopping tablet replica
I20260709 12:12:45.060343  4409 raft_consensus.cc:2243] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.060735  4409 raft_consensus.cc:2272] T c9f809d2654d44fd99aabcbb4dc7592f P bab687085af847b49d61effb86b026a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.062266  4409 tablet_replica.cc:333] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2: stopping tablet replica
I20260709 12:12:45.062695  4409 raft_consensus.cc:2243] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.063033  4409 raft_consensus.cc:2272] T e1665a3480894be2be78e49aa935a2fc P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.064473  4409 tablet_replica.cc:333] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2: stopping tablet replica
I20260709 12:12:45.064900  4409 raft_consensus.cc:2243] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.065263  4409 raft_consensus.cc:2272] T b31ef428e65d4da4934de737cc858b03 P bab687085af847b49d61effb86b026a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.066758  4409 tablet_replica.cc:333] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2: stopping tablet replica
I20260709 12:12:45.067166  4409 raft_consensus.cc:2243] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.067518  4409 raft_consensus.cc:2272] T 3867548fc6094889bad1f32ad791c900 P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.069023  4409 tablet_replica.cc:333] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2: stopping tablet replica
I20260709 12:12:45.069425  4409 raft_consensus.cc:2243] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.069859  4409 raft_consensus.cc:2272] T bfc44b5cd60248b2a95965e961dbfbef P bab687085af847b49d61effb86b026a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.114610  4409 tablet_server.cc:196] TabletServer@127.4.78.67:0 shutdown complete.
I20260709 12:12:45.133462  4409 master.cc:562] Master@127.4.78.126:46459 shutting down...
I20260709 12:12:45.254945  4409 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.255470  4409 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.255736  4409 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5c2cc851343245e7b513b5370d7ea17a: stopping tablet replica
I20260709 12:12:45.274199  4409 master.cc:584] Master@127.4.78.126:46459 shutdown complete.
2fee3334a8cb44efbbbd08a99f87ee91  5
bab687085af847b49d61effb86b026a2  1
e5773af2e0d743e1ad7746dd69212f6b  4
2fee3334a8cb44efbbbd08a99f87ee91  3
bab687085af847b49d61effb86b026a2  3
e5773af2e0d743e1ad7746dd69212f6b  4
2fee3334a8cb44efbbbd08a99f87ee91  8
bab687085af847b49d61effb86b026a2  1
e5773af2e0d743e1ad7746dd69212f6b  1
2fee3334a8cb44efbbbd08a99f87ee91  4
bab687085af847b49d61effb86b026a2  3
e5773af2e0d743e1ad7746dd69212f6b  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29781 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:12:45.312704  4409 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.78.126:44725
I20260709 12:12:45.313832  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:45.318828  5476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:45.318969  5477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:45.321444  4409 server_base.cc:1061] running on GCE node
W20260709 12:12:45.321472  5479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:45.322507  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:45.322692  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:45.322842  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599165322826 us; error 0 us; skew 500 ppm
I20260709 12:12:45.323362  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:45.325676  4409 webserver.cc:533] Webserver started at http://127.4.78.126:44001/ using document root <none> and password file <none>
I20260709 12:12:45.326249  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:45.326422  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:45.326687  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:45.327792  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/master-0-root/instance:
uuid: "ce423f944eb64a23961a8a3bbc019610"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9t7s"
I20260709 12:12:45.332139  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:45.335297  5484 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.335956  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:12:45.336223  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/master-0-root
uuid: "ce423f944eb64a23961a8a3bbc019610"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9t7s"
I20260709 12:12:45.336472  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:45.352337  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:45.353538  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:45.391431  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.126:44725
I20260709 12:12:45.391520  5535 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.126:44725 every 8 connection(s)
I20260709 12:12:45.395140  5536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.404532  5536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Bootstrap starting.
I20260709 12:12:45.409209  5536 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.413264  5536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: No bootstrap required, opened a new log
I20260709 12:12:45.415649  5536 raft_consensus.cc:359] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce423f944eb64a23961a8a3bbc019610" member_type: VOTER }
I20260709 12:12:45.416057  5536 raft_consensus.cc:385] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.416285  5536 raft_consensus.cc:740] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce423f944eb64a23961a8a3bbc019610, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.416874  5536 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce423f944eb64a23961a8a3bbc019610" member_type: VOTER }
I20260709 12:12:45.417330  5536 raft_consensus.cc:399] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:45.417533  5536 raft_consensus.cc:493] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:45.417812  5536 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.421830  5536 raft_consensus.cc:515] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce423f944eb64a23961a8a3bbc019610" member_type: VOTER }
I20260709 12:12:45.422379  5536 leader_election.cc:304] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce423f944eb64a23961a8a3bbc019610; no voters: 
I20260709 12:12:45.423436  5536 leader_election.cc:290] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:45.423825  5539 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:45.425005  5539 raft_consensus.cc:697] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [term 1 LEADER]: Becoming Leader. State: Replica: ce423f944eb64a23961a8a3bbc019610, State: Running, Role: LEADER
I20260709 12:12:45.425684  5539 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce423f944eb64a23961a8a3bbc019610" member_type: VOTER }
I20260709 12:12:45.426306  5536 sys_catalog.cc:565] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:45.430238  5541 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce423f944eb64a23961a8a3bbc019610. Latest consensus state: current_term: 1 leader_uuid: "ce423f944eb64a23961a8a3bbc019610" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce423f944eb64a23961a8a3bbc019610" member_type: VOTER } }
I20260709 12:12:45.430174  5540 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce423f944eb64a23961a8a3bbc019610" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce423f944eb64a23961a8a3bbc019610" member_type: VOTER } }
I20260709 12:12:45.430922  5541 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:45.430997  5540 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:45.449667  5546 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:45.457962  5546 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:45.459203  4409 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:45.467710  5546 catalog_manager.cc:1383] Generated new cluster ID: fe6ed9e51a994ee88cafb352b6d78cad
I20260709 12:12:45.467998  5546 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:45.489724  5546 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:45.491077  5546 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:45.504321  5546 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Generated new TSK 0
I20260709 12:12:45.504958  5546 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:45.525661  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:45.532589  5558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:45.533249  5559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:45.535333  4409 server_base.cc:1061] running on GCE node
W20260709 12:12:45.535497  5561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:45.536564  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:45.536761  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:45.536942  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599165536923 us; error 0 us; skew 500 ppm
I20260709 12:12:45.537528  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:45.540225  4409 webserver.cc:533] Webserver started at http://127.4.78.65:38985/ using document root <none> and password file <none>
I20260709 12:12:45.540776  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:45.540969  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:45.541280  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:45.542671  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/instance:
uuid: "b3083333af3348e4938f905ca4c4819f"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9t7s"
I20260709 12:12:45.547228  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:45.550590  5566 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.551292  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:45.551551  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root
uuid: "b3083333af3348e4938f905ca4c4819f"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9t7s"
I20260709 12:12:45.551808  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:45.574810  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:45.576045  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:45.577466  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:45.579715  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:45.579905  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.580150  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:45.580310  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.619599  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.65:38715
I20260709 12:12:45.619680  5628 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.65:38715 every 8 connection(s)
I20260709 12:12:45.624531  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:45.631886  5633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:45.632851  5634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:45.636554  5636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:45.636914  4409 server_base.cc:1061] running on GCE node
I20260709 12:12:45.637969  5629 heartbeater.cc:344] Connected to a master server at 127.4.78.126:44725
I20260709 12:12:45.638370  5629 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:45.638669  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:45.638866  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:45.639016  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599165639000 us; error 0 us; skew 500 ppm
I20260709 12:12:45.639096  5629 heartbeater.cc:507] Master 127.4.78.126:44725 requested a full tablet report, sending...
I20260709 12:12:45.639554  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:45.641471  5501 ts_manager.cc:194] Registered new tserver with Master: b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:12:45.642318  4409 webserver.cc:533] Webserver started at http://127.4.78.66:40901/ using document root <none> and password file <none>
I20260709 12:12:45.642930  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:45.643157  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:45.643484  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:45.643970  5501 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45214
I20260709 12:12:45.644979  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/instance:
uuid: "a54957145d9647cb89f46531d107120c"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9t7s"
I20260709 12:12:45.649175  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:45.652199  5641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.652915  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:45.653172  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root
uuid: "a54957145d9647cb89f46531d107120c"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9t7s"
I20260709 12:12:45.653462  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:45.669485  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:45.670918  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:45.672295  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:45.674438  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:45.674628  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.674839  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:45.674985  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.712167  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.66:33011
I20260709 12:12:45.712270  5703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.66:33011 every 8 connection(s)
I20260709 12:12:45.716750  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:45.723516  5707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:45.725225  5708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:45.727341  5710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:45.727874  4409 server_base.cc:1061] running on GCE node
I20260709 12:12:45.728564  5704 heartbeater.cc:344] Connected to a master server at 127.4.78.126:44725
I20260709 12:12:45.728781  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:45.728873  5704 heartbeater.cc:461] Registering TS with master...
W20260709 12:12:45.729030  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:45.729238  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599165729222 us; error 0 us; skew 500 ppm
I20260709 12:12:45.729846  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:45.729878  5704 heartbeater.cc:507] Master 127.4.78.126:44725 requested a full tablet report, sending...
I20260709 12:12:45.731997  5501 ts_manager.cc:194] Registered new tserver with Master: a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:45.732625  4409 webserver.cc:533] Webserver started at http://127.4.78.67:43207/ using document root <none> and password file <none>
I20260709 12:12:45.733244  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:45.733467  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:45.733752  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:45.733822  5501 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45220
I20260709 12:12:45.735226  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/instance:
uuid: "831d76c5ee1045f0af923ce24fa4c301"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9t7s"
I20260709 12:12:45.739652  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:45.742794  5715 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.743497  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:12:45.743769  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root
uuid: "831d76c5ee1045f0af923ce24fa4c301"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9t7s"
I20260709 12:12:45.744022  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:45.759878  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:45.761058  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:45.762454  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:45.764518  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:45.764706  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.764917  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:45.765065  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.802474  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.67:38189
I20260709 12:12:45.802563  5777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.67:38189 every 8 connection(s)
I20260709 12:12:45.815438  5778 heartbeater.cc:344] Connected to a master server at 127.4.78.126:44725
I20260709 12:12:45.815773  5778 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:45.816529  5778 heartbeater.cc:507] Master 127.4.78.126:44725 requested a full tablet report, sending...
I20260709 12:12:45.818297  5501 ts_manager.cc:194] Registered new tserver with Master: 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:45.818645  4409 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013126237s
I20260709 12:12:45.819568  5501 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45224
I20260709 12:12:45.844525  5501 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45230:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:45.850807  5501 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:46.038082  5669 tablet_service.cc:1511] Processing CreateTablet for tablet 25119dffb65d40f48346fb5615d100e5 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:46.039575  5669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25119dffb65d40f48346fb5615d100e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.042917  5668 tablet_service.cc:1511] Processing CreateTablet for tablet 7922e49f842f47c09c6aafbf9e70d646 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:46.043179  5667 tablet_service.cc:1511] Processing CreateTablet for tablet c895f37947b04f8c8b0f3a8ac1874b71 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:46.044255  5668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7922e49f842f47c09c6aafbf9e70d646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.044865  5667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c895f37947b04f8c8b0f3a8ac1874b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.065588  5743 tablet_service.cc:1511] Processing CreateTablet for tablet 25119dffb65d40f48346fb5615d100e5 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:46.066977  5743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25119dffb65d40f48346fb5615d100e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.069950  5742 tablet_service.cc:1511] Processing CreateTablet for tablet 7922e49f842f47c09c6aafbf9e70d646 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:46.071667  5742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7922e49f842f47c09c6aafbf9e70d646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.072449  5668 tablet_service.cc:1511] Processing CreateTablet for tablet 228ec6971a66439f85c6b6d788cf939c (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:46.073804  5668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228ec6971a66439f85c6b6d788cf939c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.080080  5741 tablet_service.cc:1511] Processing CreateTablet for tablet c895f37947b04f8c8b0f3a8ac1874b71 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:46.080336  5594 tablet_service.cc:1511] Processing CreateTablet for tablet 25119dffb65d40f48346fb5615d100e5 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:46.080430  5593 tablet_service.cc:1511] Processing CreateTablet for tablet 7922e49f842f47c09c6aafbf9e70d646 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:46.081496  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25119dffb65d40f48346fb5615d100e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.081496  5741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c895f37947b04f8c8b0f3a8ac1874b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.082684  5592 tablet_service.cc:1511] Processing CreateTablet for tablet c895f37947b04f8c8b0f3a8ac1874b71 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:46.084021  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c895f37947b04f8c8b0f3a8ac1874b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.088691  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7922e49f842f47c09c6aafbf9e70d646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.097304  5794 tablet_bootstrap.cc:492] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:46.104058  5794 tablet_bootstrap.cc:654] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.107841  5742 tablet_service.cc:1511] Processing CreateTablet for tablet 228ec6971a66439f85c6b6d788cf939c (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:46.107878  5668 tablet_service.cc:1511] Processing CreateTablet for tablet dabde4847e7648aeb6347e38342d8c3f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:46.109310  5742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228ec6971a66439f85c6b6d788cf939c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.109784  5668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabde4847e7648aeb6347e38342d8c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.110464  5793 tablet_bootstrap.cc:492] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:46.107931  5591 tablet_service.cc:1511] Processing CreateTablet for tablet 228ec6971a66439f85c6b6d788cf939c (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:46.112792  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228ec6971a66439f85c6b6d788cf939c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.115873  5590 tablet_service.cc:1511] Processing CreateTablet for tablet dabde4847e7648aeb6347e38342d8c3f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:46.116286  5740 tablet_service.cc:1511] Processing CreateTablet for tablet dabde4847e7648aeb6347e38342d8c3f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:46.117216  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabde4847e7648aeb6347e38342d8c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.117570  5740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabde4847e7648aeb6347e38342d8c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.118455  5794 tablet_bootstrap.cc:492] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:46.118932  5794 ts_tablet_manager.cc:1403] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.009s
I20260709 12:12:46.121896  5794 raft_consensus.cc:359] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.122795  5794 raft_consensus.cc:385] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.123099  5794 raft_consensus.cc:740] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.123899  5794 consensus_queue.cc:260] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.115489  5795 tablet_bootstrap.cc:492] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:46.132177  5795 tablet_bootstrap.cc:654] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.134842  5778 heartbeater.cc:499] Master 127.4.78.126:44725 was elected leader, sending a full tablet report...
I20260709 12:12:46.136063  5589 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba4203e7f7c4e46bd83c6bdda936a65 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:46.137598  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba4203e7f7c4e46bd83c6bdda936a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.138752  5794 ts_tablet_manager.cc:1434] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:12:46.139678  5794 tablet_bootstrap.cc:492] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:46.143059  5669 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba4203e7f7c4e46bd83c6bdda936a65 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:46.144335  5669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba4203e7f7c4e46bd83c6bdda936a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.144088  5743 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba4203e7f7c4e46bd83c6bdda936a65 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:46.145450  5743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba4203e7f7c4e46bd83c6bdda936a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.157167  5793 tablet_bootstrap.cc:654] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.166453  5742 tablet_service.cc:1511] Processing CreateTablet for tablet 8c29cd1d5fec4ed798574831b98a1c7f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:46.162209  5591 tablet_service.cc:1511] Processing CreateTablet for tablet 8c29cd1d5fec4ed798574831b98a1c7f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:46.176211  5742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c29cd1d5fec4ed798574831b98a1c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.176584  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c29cd1d5fec4ed798574831b98a1c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.165096  5667 tablet_service.cc:1511] Processing CreateTablet for tablet 8c29cd1d5fec4ed798574831b98a1c7f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:46.178685  5667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c29cd1d5fec4ed798574831b98a1c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.179844  5668 tablet_service.cc:1511] Processing CreateTablet for tablet 27e6e6d757f74b3a95066ebc6b0e8589 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:46.181116  5668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e6e6d757f74b3a95066ebc6b0e8589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.155443  5794 tablet_bootstrap.cc:654] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.188537  5741 tablet_service.cc:1511] Processing CreateTablet for tablet 27e6e6d757f74b3a95066ebc6b0e8589 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:46.174965  5589 tablet_service.cc:1511] Processing CreateTablet for tablet 27e6e6d757f74b3a95066ebc6b0e8589 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:46.190646  5669 tablet_service.cc:1511] Processing CreateTablet for tablet e837d59ef1c7437eb44f1563f56086ad (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:46.191655  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e6e6d757f74b3a95066ebc6b0e8589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.191715  5669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e837d59ef1c7437eb44f1563f56086ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.192569  5741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e6e6d757f74b3a95066ebc6b0e8589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.191586  5593 tablet_service.cc:1511] Processing CreateTablet for tablet e837d59ef1c7437eb44f1563f56086ad (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:46.195144  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e837d59ef1c7437eb44f1563f56086ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.202162  5590 tablet_service.cc:1511] Processing CreateTablet for tablet b3ae5385212f45ceb104c78b3c149525 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:46.205576  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ae5385212f45ceb104c78b3c149525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.210754  5666 tablet_service.cc:1511] Processing CreateTablet for tablet b3ae5385212f45ceb104c78b3c149525 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:46.212214  5666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ae5385212f45ceb104c78b3c149525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.214640  5743 tablet_service.cc:1511] Processing CreateTablet for tablet e837d59ef1c7437eb44f1563f56086ad (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:46.219477  5793 tablet_bootstrap.cc:492] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:46.221935  5743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e837d59ef1c7437eb44f1563f56086ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.224614  5793 ts_tablet_manager.cc:1403] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.000s
I20260709 12:12:46.230244  5795 tablet_bootstrap.cc:492] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:46.230775  5795 ts_tablet_manager.cc:1403] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.116s	user 0.013s	sys 0.019s
I20260709 12:12:46.234104  5795 raft_consensus.cc:359] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.234726  5795 raft_consensus.cc:385] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.235019  5795 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.235893  5795 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.237586  5793 raft_consensus.cc:359] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.240271  5794 tablet_bootstrap.cc:492] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:46.243340  5793 raft_consensus.cc:385] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.243965  5794 ts_tablet_manager.cc:1403] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.104s	user 0.021s	sys 0.011s
I20260709 12:12:46.246830  5794 raft_consensus.cc:359] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.247467  5794 raft_consensus.cc:385] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.249529  5793 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.250260  5794 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.251008  5795 ts_tablet_manager.cc:1434] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.005s
I20260709 12:12:46.251077  5793 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.251859  5629 heartbeater.cc:499] Master 127.4.78.126:44725 was elected leader, sending a full tablet report...
I20260709 12:12:46.251120  5794 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.258646  5794 ts_tablet_manager.cc:1434] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:12:46.259419  5794 tablet_bootstrap.cc:492] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:46.263944  5590 tablet_service.cc:1511] Processing CreateTablet for tablet 62908e35e9554ef2af86598ce28bcf21 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:46.264675  5793 ts_tablet_manager.cc:1434] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.007s
I20260709 12:12:46.265173  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62908e35e9554ef2af86598ce28bcf21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.265398  5704 heartbeater.cc:499] Master 127.4.78.126:44725 was elected leader, sending a full tablet report...
I20260709 12:12:46.271215  5666 tablet_service.cc:1511] Processing CreateTablet for tablet 62908e35e9554ef2af86598ce28bcf21 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:46.274559  5666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62908e35e9554ef2af86598ce28bcf21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.275032  5794 tablet_bootstrap.cc:654] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.283160  5593 tablet_service.cc:1511] Processing CreateTablet for tablet 237f59937cc841be8b427e269f4581ae (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:46.284420  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237f59937cc841be8b427e269f4581ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.293982  5802 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.294581  5802 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.297008  5802 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:46.297374  5794 tablet_bootstrap.cc:492] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:46.297974  5794 ts_tablet_manager.cc:1403] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.008s
I20260709 12:12:46.300843  5794 raft_consensus.cc:359] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.301643  5794 raft_consensus.cc:385] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.302023  5794 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.302943  5794 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.305182  5794 ts_tablet_manager.cc:1434] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:46.276078  5742 tablet_service.cc:1511] Processing CreateTablet for tablet b3ae5385212f45ceb104c78b3c149525 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:46.270197  5793 tablet_bootstrap.cc:492] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
W20260709 12:12:46.306408  5779 tablet.cc:2406] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:46.278261  5795 tablet_bootstrap.cc:492] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:46.311554  5741 tablet_service.cc:1511] Processing CreateTablet for tablet 237f59937cc841be8b427e269f4581ae (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:46.306574  5742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ae5385212f45ceb104c78b3c149525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.312876  5741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237f59937cc841be8b427e269f4581ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.313220  5590 tablet_service.cc:1511] Processing CreateTablet for tablet 603cb46af0854d75be95bd9fc4acf254 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:46.314556  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603cb46af0854d75be95bd9fc4acf254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.316756  5795 tablet_bootstrap.cc:654] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.320077  5793 tablet_bootstrap.cc:654] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.323375  5668 tablet_service.cc:1511] Processing CreateTablet for tablet 603cb46af0854d75be95bd9fc4acf254 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:46.324707  5668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603cb46af0854d75be95bd9fc4acf254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.325246  5794 tablet_bootstrap.cc:492] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:46.325587  5740 tablet_service.cc:1511] Processing CreateTablet for tablet 603cb46af0854d75be95bd9fc4acf254 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:46.280258  5743 tablet_service.cc:1511] Processing CreateTablet for tablet 62908e35e9554ef2af86598ce28bcf21 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:46.309823  5669 tablet_service.cc:1511] Processing CreateTablet for tablet 237f59937cc841be8b427e269f4581ae (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:46.326861  5740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603cb46af0854d75be95bd9fc4acf254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.327859  5669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237f59937cc841be8b427e269f4581ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.340516  5743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62908e35e9554ef2af86598ce28bcf21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.340591  5589 tablet_service.cc:1511] Processing CreateTablet for tablet 2645ab47c7304e87afd4e901bcd42fce (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:46.345474  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2645ab47c7304e87afd4e901bcd42fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.355281  5797 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.355805  5797 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.358654  5797 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:46.363452  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:46.364259  5604 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:46.382258  5794 tablet_bootstrap.cc:654] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.386775  5666 tablet_service.cc:1511] Processing CreateTablet for tablet 2645ab47c7304e87afd4e901bcd42fce (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:46.388017  5666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2645ab47c7304e87afd4e901bcd42fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.388443  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:46.389240  5802 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:46.389573  5802 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.389916  5802 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.391650  5667 tablet_service.cc:1511] Processing CreateTablet for tablet 706e5d138a9043668703dd0c4b4ffd89 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:46.392856  5667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706e5d138a9043668703dd0c4b4ffd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.395025  5665 tablet_service.cc:1511] Processing CreateTablet for tablet 6be82dd3c64146fabe5214109a9563f0 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:46.396299  5665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be82dd3c64146fabe5214109a9563f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.396405  5739 tablet_service.cc:1511] Processing CreateTablet for tablet 6be82dd3c64146fabe5214109a9563f0 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:46.398048  5738 tablet_service.cc:1511] Processing CreateTablet for tablet f894158ba41541198a905d0e18553078 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:46.398237  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:46.398918  5753 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:46.400429  5802 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.400571  5591 tablet_service.cc:1511] Processing CreateTablet for tablet f894158ba41541198a905d0e18553078 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:46.397660  5739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be82dd3c64146fabe5214109a9563f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.402479  5592 tablet_service.cc:1511] Processing CreateTablet for tablet 74092c83d74e4b2d92a17b981437ced6 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:46.402815  5664 tablet_service.cc:1511] Processing CreateTablet for tablet f894158ba41541198a905d0e18553078 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:46.404068  5664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f894158ba41541198a905d0e18553078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.402472  5594 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5e338890f843678fd0689c8568ed9c (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:46.406865  5663 tablet_service.cc:1511] Processing CreateTablet for tablet 74092c83d74e4b2d92a17b981437ced6 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:46.408192  5663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74092c83d74e4b2d92a17b981437ced6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.407989  5593 tablet_service.cc:1511] Processing CreateTablet for tablet 6be82dd3c64146fabe5214109a9563f0 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:46.405129  5737 tablet_service.cc:1511] Processing CreateTablet for tablet 74092c83d74e4b2d92a17b981437ced6 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:46.410924  5662 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5e338890f843678fd0689c8568ed9c (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:46.412237  5662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5e338890f843678fd0689c8568ed9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.413821  5587 tablet_service.cc:1511] Processing CreateTablet for tablet 45e8be48ea634f3a922604ba76b16e6a (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:46.414129  5588 tablet_service.cc:1511] Processing CreateTablet for tablet 1642b3c7e6044747893b0e74e79ec49b (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:46.416548  5661 tablet_service.cc:1511] Processing CreateTablet for tablet 1642b3c7e6044747893b0e74e79ec49b (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:46.417306  5660 tablet_service.cc:1511] Processing CreateTablet for tablet 45e8be48ea634f3a922604ba76b16e6a (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:46.416633  5586 tablet_service.cc:1511] Processing CreateTablet for tablet ac5b12e3f8d847ddaa3bcba52b39ba9b (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:46.405076  5738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f894158ba41541198a905d0e18553078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.415087  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f894158ba41541198a905d0e18553078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.421358  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be82dd3c64146fabe5214109a9563f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.421928  5661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1642b3c7e6044747893b0e74e79ec49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.422431  5737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74092c83d74e4b2d92a17b981437ced6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.422662  5660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e8be48ea634f3a922604ba76b16e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.423131  5735 tablet_service.cc:1511] Processing CreateTablet for tablet 1642b3c7e6044747893b0e74e79ec49b (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:46.424422  5735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1642b3c7e6044747893b0e74e79ec49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.421974  5587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e8be48ea634f3a922604ba76b16e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.425694  5586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac5b12e3f8d847ddaa3bcba52b39ba9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.426889  5734 tablet_service.cc:1511] Processing CreateTablet for tablet 45e8be48ea634f3a922604ba76b16e6a (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:46.428156  5734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e8be48ea634f3a922604ba76b16e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.428257  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74092c83d74e4b2d92a17b981437ced6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.422008  5736 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5e338890f843678fd0689c8568ed9c (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:46.429860  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5e338890f843678fd0689c8568ed9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.439352  5743 tablet_service.cc:1511] Processing CreateTablet for tablet 706e5d138a9043668703dd0c4b4ffd89 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:46.440807  5743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706e5d138a9043668703dd0c4b4ffd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.448251  5588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1642b3c7e6044747893b0e74e79ec49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.450613  5590 tablet_service.cc:1511] Processing CreateTablet for tablet 706e5d138a9043668703dd0c4b4ffd89 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:46.451869  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706e5d138a9043668703dd0c4b4ffd89. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:46.455288  5550 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:46.455986  5736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5e338890f843678fd0689c8568ed9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.455895  5587 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac03e19ba8d49feb196035d3b697b69 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:46.461856  5742 tablet_service.cc:1511] Processing CreateTablet for tablet 2645ab47c7304e87afd4e901bcd42fce (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:46.467456  5587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac03e19ba8d49feb196035d3b697b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.467713  5742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2645ab47c7304e87afd4e901bcd42fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.469728  5793 tablet_bootstrap.cc:492] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:46.470176  5795 tablet_bootstrap.cc:492] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:46.470260  5793 ts_tablet_manager.cc:1403] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.200s	user 0.011s	sys 0.004s
I20260709 12:12:46.470680  5795 ts_tablet_manager.cc:1403] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.193s	user 0.019s	sys 0.017s
I20260709 12:12:46.473235  5793 raft_consensus.cc:359] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.473740  5793 raft_consensus.cc:385] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.475805  5793 raft_consensus.cc:740] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.474784  5795 raft_consensus.cc:359] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.476769  5795 raft_consensus.cc:385] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.476521  5585 tablet_service.cc:1511] Processing CreateTablet for tablet e7972b9d3b424d0a82305768187e2573 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:46.477161  5795 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.478552  5585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7972b9d3b424d0a82305768187e2573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.478547  5795 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.489723  5793 consensus_queue.cc:260] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.496937  5739 tablet_service.cc:1511] Processing CreateTablet for tablet ac5b12e3f8d847ddaa3bcba52b39ba9b (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:46.502838  5795 ts_tablet_manager.cc:1434] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:12:46.525185  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:46.527552  5604 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.527947  5797 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.528463  5797 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.530661  5741 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac03e19ba8d49feb196035d3b697b69 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:46.532194  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:46.532907  5679 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:46.534893  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:46.536110  5604 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:46.530650  5797 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:46.539139  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:46.541602  5734 tablet_service.cc:1511] Processing CreateTablet for tablet e7972b9d3b424d0a82305768187e2573 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:46.542237  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:12:46.543830  5716 leader_election.cc:343] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.544723  5669 tablet_service.cc:1511] Processing CreateTablet for tablet e7972b9d3b424d0a82305768187e2573 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:46.545847  5795 tablet_bootstrap.cc:492] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:46.536723  5718 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:46.554392  5797 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:46.554776  5797 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.555212  5797 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:46.554952  5718 leader_election.cc:343] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.555800  5718 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:46.560204  5666 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac03e19ba8d49feb196035d3b697b69 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:46.548646  5739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac5b12e3f8d847ddaa3bcba52b39ba9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.551880  5668 tablet_service.cc:1511] Processing CreateTablet for tablet ac5b12e3f8d847ddaa3bcba52b39ba9b (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:46.570029  5734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7972b9d3b424d0a82305768187e2573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.572325  5591 tablet_service.cc:1511] Processing CreateTablet for tablet 5a65b178e0ee4e48a8e13521e3909d60 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:46.576795  5592 tablet_service.cc:1511] Processing CreateTablet for tablet 33c7eafd1e29492c92176daf22bdbbeb (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:46.554356  5669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7972b9d3b424d0a82305768187e2573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.581664  5668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac5b12e3f8d847ddaa3bcba52b39ba9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.581683  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a65b178e0ee4e48a8e13521e3909d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.579315  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:46.577925  5802 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:46.584712  5741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac03e19ba8d49feb196035d3b697b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.596916  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c7eafd1e29492c92176daf22bdbbeb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:46.585500  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 47290.1us
I20260709 12:12:46.589915  5810 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.590901  5802 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:46.591588  5812 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.581063  5664 tablet_service.cc:1511] Processing CreateTablet for tablet 33c7eafd1e29492c92176daf22bdbbeb (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:46.595232  5666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac03e19ba8d49feb196035d3b697b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.578938  5797 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.606882  5802 raft_consensus.cc:697] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:46.606720  5810 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.617198  5802 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.618162  5810 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:46.609988  5740 tablet_service.cc:1511] Processing CreateTablet for tablet 5a65b178e0ee4e48a8e13521e3909d60 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 12:12:46.610354  5716 leader_election.cc:343] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.611274  5795 tablet_bootstrap.cc:654] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.611665  5593 tablet_service.cc:1511] Processing CreateTablet for tablet be69db606b5844b2ad9d8cdcd608216a (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:46.613114  5735 tablet_service.cc:1511] Processing CreateTablet for tablet 33c7eafd1e29492c92176daf22bdbbeb (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:46.624300  5738 tablet_service.cc:1511] Processing CreateTablet for tablet be69db606b5844b2ad9d8cdcd608216a (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:46.633862  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:46.634400  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be69db606b5844b2ad9d8cdcd608216a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:46.635251  5716 leader_election.cc:343] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.638345  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:46.642839  5667 tablet_service.cc:1511] Processing CreateTablet for tablet be69db606b5844b2ad9d8cdcd608216a (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:46.644330  5667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be69db606b5844b2ad9d8cdcd608216a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.645434  5664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c7eafd1e29492c92176daf22bdbbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.645649  5663 tablet_service.cc:1511] Processing CreateTablet for tablet 5a65b178e0ee4e48a8e13521e3909d60 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:46.646970  5663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a65b178e0ee4e48a8e13521e3909d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.655784  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:46.656387  5679 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.658499  5740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a65b178e0ee4e48a8e13521e3909d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.660068  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:46.660889  5752 raft_consensus.cc:2393] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:46.661577  5660 tablet_service.cc:1511] Processing CreateTablet for tablet e5ac98436c3f4e54af415eb568349c1e (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:46.662055  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:46.662685  5753 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.662986  5660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5ac98436c3f4e54af415eb568349c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.665246  5735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c7eafd1e29492c92176daf22bdbbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.685983  5738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be69db606b5844b2ad9d8cdcd608216a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.680752  5797 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:12:46.642807  5642 leader_election.cc:343] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:46.688696  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 45935.6us
I20260709 12:12:46.692639  5793 ts_tablet_manager.cc:1434] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.222s	user 0.011s	sys 0.007s
I20260709 12:12:46.691468  5585 tablet_service.cc:1511] Processing CreateTablet for tablet e5ac98436c3f4e54af415eb568349c1e (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:46.695138  5585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5ac98436c3f4e54af415eb568349c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.689604  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:12:46.724437  5487 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 63261.4us
W20260709 12:12:46.725921  5485 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 60008.1us
I20260709 12:12:46.743913  5665 tablet_service.cc:1511] Processing CreateTablet for tablet 08b7de4c4716494894a4643e09fb86f0 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:46.745249  5665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b7de4c4716494894a4643e09fb86f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.746814  5587 tablet_service.cc:1511] Processing CreateTablet for tablet af458034860a4f2b8eed91cd35b5b30f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:46.748063  5587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af458034860a4f2b8eed91cd35b5b30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.748440  5793 tablet_bootstrap.cc:492] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:46.749213  5662 tablet_service.cc:1511] Processing CreateTablet for tablet af458034860a4f2b8eed91cd35b5b30f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:46.762475  5662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af458034860a4f2b8eed91cd35b5b30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.733554  5795 tablet_bootstrap.cc:492] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:46.764263  5734 tablet_service.cc:1511] Processing CreateTablet for tablet af458034860a4f2b8eed91cd35b5b30f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:46.753708  5801 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.768548  5801 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.771037  5801 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:46.731199  5794 tablet_bootstrap.cc:492] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:46.771982  5794 ts_tablet_manager.cc:1403] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.447s	user 0.011s	sys 0.021s
I20260709 12:12:46.762786  5588 tablet_service.cc:1511] Processing CreateTablet for tablet 08b7de4c4716494894a4643e09fb86f0 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:46.764743  5795 ts_tablet_manager.cc:1403] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.241s	user 0.010s	sys 0.006s
I20260709 12:12:46.774533  5588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b7de4c4716494894a4643e09fb86f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:46.733853  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 44353.6us
I20260709 12:12:46.779093  5795 raft_consensus.cc:359] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.768951  5734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af458034860a4f2b8eed91cd35b5b30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.776780  5794 raft_consensus.cc:359] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.785975  5794 raft_consensus.cc:385] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.786331  5794 raft_consensus.cc:740] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.787205  5794 consensus_queue.cc:260] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.789733  5667 tablet_service.cc:1511] Processing CreateTablet for tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:46.790942  5667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.763983  5679 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:46.793715  5814 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.796343  5739 tablet_service.cc:1511] Processing CreateTablet for tablet 08b7de4c4716494894a4643e09fb86f0 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:46.787986  5795 raft_consensus.cc:385] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.802012  5795 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.802937  5795 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.805408  5795 ts_tablet_manager.cc:1434] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.031s	user 0.000s	sys 0.005s
I20260709 12:12:46.806417  5795 tablet_bootstrap.cc:492] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:46.807014  5718 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:46.808123  5797 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:46.808636  5797 raft_consensus.cc:697] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:46.802712  5500 catalog_manager.cc:5697] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.732028  5736 tablet_service.cc:1511] Processing CreateTablet for tablet e5ac98436c3f4e54af415eb568349c1e (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:46.810588  5736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5ac98436c3f4e54af415eb568349c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.809482  5797 consensus_queue.cc:237] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.764900  5753 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:46.789709  5794 ts_tablet_manager.cc:1434] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.004s
I20260709 12:12:46.800796  5737 tablet_service.cc:1511] Processing CreateTablet for tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:46.814823  5794 tablet_bootstrap.cc:492] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:46.814833  5737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.818387  5739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b7de4c4716494894a4643e09fb86f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.816951  5661 tablet_service.cc:1511] Processing CreateTablet for tablet 75421a11c1284039a8a17196290f3c16 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:46.820881  5661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75421a11c1284039a8a17196290f3c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.827775  5793 tablet_bootstrap.cc:654] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.852856  5795 tablet_bootstrap.cc:654] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.855906  5742 tablet_service.cc:1511] Processing CreateTablet for tablet 3877dfaf52344867b58b6fa860f49dcb (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:46.857113  5742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3877dfaf52344867b58b6fa860f49dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.852644  5666 tablet_service.cc:1511] Processing CreateTablet for tablet 3877dfaf52344867b58b6fa860f49dcb (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:46.859360  5666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3877dfaf52344867b58b6fa860f49dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.859937  5743 tablet_service.cc:1511] Processing CreateTablet for tablet 75421a11c1284039a8a17196290f3c16 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:46.862825  5743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75421a11c1284039a8a17196290f3c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.876255  5801 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.876950  5801 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.879122  5801 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:46.883796  5794 tablet_bootstrap.cc:654] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.892412  5797 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.892962  5797 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.895888  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:12:46.898923  5716 leader_election.cc:343] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.901080  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:46.902618  5718 leader_election.cc:343] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.903057  5718 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:46.903961  5812 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.905603  5797 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:46.907753  5664 tablet_service.cc:1511] Processing CreateTablet for tablet dd3b2e7e31554c729a4604dbf4abbd29 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:46.908998  5664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd3b2e7e31554c729a4604dbf4abbd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.928402  5738 tablet_service.cc:1511] Processing CreateTablet for tablet dd3b2e7e31554c729a4604dbf4abbd29 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:46.930011  5738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd3b2e7e31554c729a4604dbf4abbd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.940153  5668 tablet_service.cc:1511] Processing CreateTablet for tablet 3590ec2a21d04c1c9948d0b4cba00790 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:46.944300  5591 tablet_service.cc:1511] Processing CreateTablet for tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:46.951766  5668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3590ec2a21d04c1c9948d0b4cba00790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.955093  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.955400  5592 tablet_service.cc:1511] Processing CreateTablet for tablet 75421a11c1284039a8a17196290f3c16 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:46.960426  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:46.960707  5793 tablet_bootstrap.cc:492] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:46.963050  5793 ts_tablet_manager.cc:1403] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.270s	user 0.038s	sys 0.066s
I20260709 12:12:46.963032  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:46.964933  5569 leader_election.cc:343] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:46.965600  5569 leader_election.cc:343] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.966183  5793 raft_consensus.cc:359] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.966946  5793 raft_consensus.cc:385] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.967262  5793 raft_consensus.cc:740] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.968164  5662 tablet_service.cc:1511] Processing CreateTablet for tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:46.968001  5793 consensus_queue.cc:260] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:46.970132  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75421a11c1284039a8a17196290f3c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.971463  5793 ts_tablet_manager.cc:1434] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:12:46.971769  5743 tablet_service.cc:1511] Processing CreateTablet for tablet 9eda5739d0e2404c9dd25b6ebf5f6060 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:46.972450  5793 tablet_bootstrap.cc:492] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:46.972316  5661 tablet_service.cc:1511] Processing CreateTablet for tablet 9eda5739d0e2404c9dd25b6ebf5f6060 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:46.973006  5743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eda5739d0e2404c9dd25b6ebf5f6060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.974563  5736 tablet_service.cc:1511] Processing CreateTablet for tablet 3590ec2a21d04c1c9948d0b4cba00790 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:46.975113  5742 tablet_service.cc:1511] Processing CreateTablet for tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:46.975777  5736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3590ec2a21d04c1c9948d0b4cba00790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.969586  5662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.976907  5588 tablet_service.cc:1511] Processing CreateTablet for tablet 3877dfaf52344867b58b6fa860f49dcb (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:46.977841  5588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3877dfaf52344867b58b6fa860f49dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.982512  5585 tablet_service.cc:1511] Processing CreateTablet for tablet dd3b2e7e31554c729a4604dbf4abbd29 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:46.983738  5585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd3b2e7e31554c729a4604dbf4abbd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.986733  5665 tablet_service.cc:1511] Processing CreateTablet for tablet e8638862e10a473ca889ec2b98a84132 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:46.988658  5741 tablet_service.cc:1511] Processing CreateTablet for tablet e8638862e10a473ca889ec2b98a84132 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:46.990613  5667 tablet_service.cc:1511] Processing CreateTablet for tablet 60b8cda7467d4abb9e997bacb7d063ef (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:46.990577  5735 tablet_service.cc:1511] Processing CreateTablet for tablet 60b8cda7467d4abb9e997bacb7d063ef (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:46.997563  5590 tablet_service.cc:1511] Processing CreateTablet for tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:46.997865  5587 tablet_service.cc:1511] Processing CreateTablet for tablet e8638862e10a473ca889ec2b98a84132 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:46.998878  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.999241  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:46.999816  5593 tablet_service.cc:1511] Processing CreateTablet for tablet 9eda5739d0e2404c9dd25b6ebf5f6060 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:47.000381  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:47.000988  5752 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:47.000998  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eda5739d0e2404c9dd25b6ebf5f6060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.002454  5739 tablet_service.cc:1511] Processing CreateTablet for tablet 67144d943ff44a2c85c35639ca4017fc (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:47.002722  5594 tablet_service.cc:1511] Processing CreateTablet for tablet 60b8cda7467d4abb9e997bacb7d063ef (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:47.003945  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b8cda7467d4abb9e997bacb7d063ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.004662  5663 tablet_service.cc:1511] Processing CreateTablet for tablet 67144d943ff44a2c85c35639ca4017fc (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:12:47.005817  5567 leader_election.cc:343] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.006278  5567 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:47.007047  5801 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.006789  5586 tablet_service.cc:1511] Processing CreateTablet for tablet 67144d943ff44a2c85c35639ca4017fc (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:47.008500  5586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67144d943ff44a2c85c35639ca4017fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.009747  5592 tablet_service.cc:1511] Processing CreateTablet for tablet 3590ec2a21d04c1c9948d0b4cba00790 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:47.011129  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3590ec2a21d04c1c9948d0b4cba00790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.014523  5567 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:47.019338  5801 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.019735  5801 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.020052  5801 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.028158  5801 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.028846  5742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.030230  5587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8638862e10a473ca889ec2b98a84132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.031098  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:12:47.032531  5569 leader_election.cc:343] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.034755  5739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67144d943ff44a2c85c35639ca4017fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.035420  5660 tablet_service.cc:1511] Processing CreateTablet for tablet 0305464a3879473e825bbe12c2df9cd9 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:47.038144  5794 tablet_bootstrap.cc:492] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:47.038645  5794 ts_tablet_manager.cc:1403] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.224s	user 0.019s	sys 0.018s
I20260709 12:12:46.981285  5661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eda5739d0e2404c9dd25b6ebf5f6060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.042533  5737 tablet_service.cc:1511] Processing CreateTablet for tablet 0305464a3879473e825bbe12c2df9cd9 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:47.050010  5740 tablet_service.cc:1511] Processing CreateTablet for tablet ba4aecf80db140ca828a80dc93220fba (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:47.041709  5794 raft_consensus.cc:359] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.054491  5794 raft_consensus.cc:385] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.054813  5794 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.055545  5794 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.057260  5734 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6905b9f5774928a465ac1a443f56a4 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:47.042150  5741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8638862e10a473ca889ec2b98a84132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.058928  5735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b8cda7467d4abb9e997bacb7d063ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.044914  5795 tablet_bootstrap.cc:492] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:47.061484  5795 ts_tablet_manager.cc:1403] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.255s	user 0.010s	sys 0.007s
I20260709 12:12:47.064121  5795 raft_consensus.cc:359] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.064791  5795 raft_consensus.cc:385] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.065061  5795 raft_consensus.cc:740] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.060995  5669 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6905b9f5774928a465ac1a443f56a4 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:47.060932  5737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0305464a3879473e825bbe12c2df9cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.073925  5794 ts_tablet_manager.cc:1434] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.004s
I20260709 12:12:47.075238  5740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4aecf80db140ca828a80dc93220fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.075734  5794 tablet_bootstrap.cc:492] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:47.067801  5664 tablet_service.cc:1511] Processing CreateTablet for tablet ba4aecf80db140ca828a80dc93220fba (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:47.079497  5734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6905b9f5774928a465ac1a443f56a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.081631  5665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8638862e10a473ca889ec2b98a84132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.086062  5663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67144d943ff44a2c85c35639ca4017fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.090054  5664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4aecf80db140ca828a80dc93220fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.091084  5667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b8cda7467d4abb9e997bacb7d063ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.094303  5499 catalog_manager.cc:5697] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.098088  5660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0305464a3879473e825bbe12c2df9cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.102579  5585 tablet_service.cc:1511] Processing CreateTablet for tablet 0305464a3879473e825bbe12c2df9cd9 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:47.103912  5585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0305464a3879473e825bbe12c2df9cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.106110  5801 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:47.106662  5668 tablet_service.cc:1511] Processing CreateTablet for tablet 09cc490802a84093b74474b1decbb6a2 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:47.107910  5668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cc490802a84093b74474b1decbb6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.108662  5669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6905b9f5774928a465ac1a443f56a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.065750  5795 consensus_queue.cc:260] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.125166  5662 tablet_service.cc:1511] Processing CreateTablet for tablet 33b7e33743744392a4b0269b94aa07b3 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:47.125739  5801 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.126506  5662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b7e33743744392a4b0269b94aa07b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.126206  5801 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.126909  5666 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0ad918df054a3080325a8ca6d4aed0 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:47.129498  5666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0ad918df054a3080325a8ca6d4aed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.130626  5743 tablet_service.cc:1511] Processing CreateTablet for tablet 09cc490802a84093b74474b1decbb6a2 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:47.136042  5801 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:47.139679  5588 tablet_service.cc:1511] Processing CreateTablet for tablet ba4aecf80db140ca828a80dc93220fba (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:47.145334  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:47.146142  5678 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:47.147394  5569 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:47.148190  5801 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.148572  5801 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.148900  5801 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.160444  5801 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.163470  5814 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.147564  5741 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0ad918df054a3080325a8ca6d4aed0 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:47.166235  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:47.166920  5678 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.144534  5743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cc490802a84093b74474b1decbb6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.176370  5741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0ad918df054a3080325a8ca6d4aed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.179239  5801 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:47.179848  5588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4aecf80db140ca828a80dc93220fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.182281  5793 tablet_bootstrap.cc:654] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.180776  5678 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:47.161550  5794 tablet_bootstrap.cc:654] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.198146  5814 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.199996  5569 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:47.189095  5740 tablet_service.cc:1511] Processing CreateTablet for tablet 33b7e33743744392a4b0269b94aa07b3 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:47.201424  5740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b7e33743744392a4b0269b94aa07b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.203809  5801 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.229269  5663 tablet_service.cc:1511] Processing CreateTablet for tablet b2ec4e9962d74fb9bbf294f2dc0911cf (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:47.230705  5663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ec4e9962d74fb9bbf294f2dc0911cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.230461  5587 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6905b9f5774928a465ac1a443f56a4 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:47.231760  5587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6905b9f5774928a465ac1a443f56a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.236227  5585 tablet_service.cc:1511] Processing CreateTablet for tablet 09cc490802a84093b74474b1decbb6a2 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:47.237650  5585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cc490802a84093b74474b1decbb6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.243319  5793 tablet_bootstrap.cc:492] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:47.243876  5793 ts_tablet_manager.cc:1403] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.272s	user 0.012s	sys 0.007s
I20260709 12:12:47.246838  5793 raft_consensus.cc:359] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.247004  5666 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc3762193894e76b902a8405a8bd64f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:47.247601  5793 raft_consensus.cc:385] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.247902  5793 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.248277  5666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc3762193894e76b902a8405a8bd64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.248673  5793 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.256768  5664 tablet_service.cc:1511] Processing CreateTablet for tablet 00b08ef158894418988e329c7d49ff9f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:47.267228  5660 tablet_service.cc:1511] Processing CreateTablet for tablet d1010069429f44409ec1f93cc97f31bc (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:47.269506  5801 raft_consensus.cc:697] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:47.270442  5801 consensus_queue.cc:237] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.279395  5737 tablet_service.cc:1511] Processing CreateTablet for tablet 00b08ef158894418988e329c7d49ff9f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:47.280678  5737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b08ef158894418988e329c7d49ff9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.287510  5594 tablet_service.cc:1511] Processing CreateTablet for tablet b2ec4e9962d74fb9bbf294f2dc0911cf (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:47.287797  5593 tablet_service.cc:1511] Processing CreateTablet for tablet 33b7e33743744392a4b0269b94aa07b3 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:47.288885  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ec4e9962d74fb9bbf294f2dc0911cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.288897  5592 tablet_service.cc:1511] Processing CreateTablet for tablet 00b08ef158894418988e329c7d49ff9f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:47.294999  5589 tablet_service.cc:1511] Processing CreateTablet for tablet a74f8f1596b645eead550bee5422dee3 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:47.296721  5794 tablet_bootstrap.cc:492] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:47.297226  5794 ts_tablet_manager.cc:1403] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.222s	user 0.016s	sys 0.015s
I20260709 12:12:47.297125  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:47.297748  5753 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.297580  5591 tablet_service.cc:1511] Processing CreateTablet for tablet d1010069429f44409ec1f93cc97f31bc (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:47.287726  5586 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc3762193894e76b902a8405a8bd64f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:47.299579  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b7e33743744392a4b0269b94aa07b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.300371  5794 raft_consensus.cc:359] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.301160  5794 raft_consensus.cc:385] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.301451  5794 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.308554  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:47.309249  5750 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.311331  5734 tablet_service.cc:1511] Processing CreateTablet for tablet d1010069429f44409ec1f93cc97f31bc (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:47.312716  5734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1010069429f44409ec1f93cc97f31bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.302131  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:47.316375  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b08ef158894418988e329c7d49ff9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.317899  5797 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.330886  5743 tablet_service.cc:1511] Processing CreateTablet for tablet a74f8f1596b645eead550bee5422dee3 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:47.331820  5743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a74f8f1596b645eead550bee5422dee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.332758  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1010069429f44409ec1f93cc97f31bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.335089  5664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b08ef158894418988e329c7d49ff9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.335736  5661 tablet_service.cc:1511] Processing CreateTablet for tablet a74f8f1596b645eead550bee5422dee3 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:47.337100  5661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a74f8f1596b645eead550bee5422dee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.342300  5738 tablet_service.cc:1511] Processing CreateTablet for tablet b2ec4e9962d74fb9bbf294f2dc0911cf (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:47.342747  5793 ts_tablet_manager.cc:1434] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.013s
I20260709 12:12:47.343655  5738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ec4e9962d74fb9bbf294f2dc0911cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.343902  5793 tablet_bootstrap.cc:492] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:47.356042  5750 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:47.359012  5793 tablet_bootstrap.cc:654] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.368975  5667 tablet_service.cc:1511] Processing CreateTablet for tablet 1e88229af5094c9993c0ec228734763c (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:47.370237  5667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e88229af5094c9993c0ec228734763c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.373667  5660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1010069429f44409ec1f93cc97f31bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.374393  5585 tablet_service.cc:1511] Processing CreateTablet for tablet 1e88229af5094c9993c0ec228734763c (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:47.316505  5794 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.375526  5739 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc3762193894e76b902a8405a8bd64f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:47.329607  5753 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:47.377827  5586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc3762193894e76b902a8405a8bd64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.376223  5795 ts_tablet_manager.cc:1434] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.314s	user 0.033s	sys 0.030s
I20260709 12:12:47.385859  5743 tablet_service.cc:1511] Processing CreateTablet for tablet 903a8681cf4244cb90615903ffda5c62 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:47.393429  5590 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0ad918df054a3080325a8ca6d4aed0 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:47.390153  5812 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.394940  5812 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.396076  5588 tablet_service.cc:1511] Processing CreateTablet for tablet 903a8681cf4244cb90615903ffda5c62 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:47.396993  5812 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:47.398177  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:47.399737  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:47.400012  5668 tablet_service.cc:1511] Processing CreateTablet for tablet 903a8681cf4244cb90615903ffda5c62 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:47.400319  5603 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:47.400514  5795 tablet_bootstrap.cc:492] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:47.401733  5668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903a8681cf4244cb90615903ffda5c62. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:47.403053  5718 leader_election.cc:343] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:47.404966  5830 log.cc:927] Time spent T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:47.406401  5716 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:47.408600  5797 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.409051  5797 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.411132  5797 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:47.411862  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:47.412966  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:47.413241  5716 leader_election.cc:343] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.409103  5812 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.414114  5812 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.414510  5812 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:47.416047  5718 leader_election.cc:343] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.413816  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0ad918df054a3080325a8ca6d4aed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.416498  5718 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:47.413436  5794 ts_tablet_manager.cc:1434] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.000s
I20260709 12:12:47.402240  5735 tablet_service.cc:1511] Processing CreateTablet for tablet 1e88229af5094c9993c0ec228734763c (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:47.426211  5669 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb6332de9984fc6a6f24ba3cfc5c947 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:47.427603  5669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb6332de9984fc6a6f24ba3cfc5c947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.429024  5742 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb6332de9984fc6a6f24ba3cfc5c947 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:47.434546  5667 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb3872bc132421d9b9adacd9cf89a22 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:47.438177  5664 tablet_service.cc:1511] Processing CreateTablet for tablet e25e2707f4a0454db308e33ed24bc75f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:47.438750  5667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb3872bc132421d9b9adacd9cf89a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.440174  5739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc3762193894e76b902a8405a8bd64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.439795  5664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25e2707f4a0454db308e33ed24bc75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.447186  5567 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:47.448889  5801 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.449358  5801 raft_consensus.cc:697] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:47.450141  5801 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.452713  5662 tablet_service.cc:1511] Processing CreateTablet for tablet 9f80dc3c97f640cc9ad6761e3aecfd36 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:47.458863  5662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f80dc3c97f640cc9ad6761e3aecfd36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.467054  5793 tablet_bootstrap.cc:492] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:47.469352  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a74f8f1596b645eead550bee5422dee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.494874  5592 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb6332de9984fc6a6f24ba3cfc5c947 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:47.484470  5793 ts_tablet_manager.cc:1403] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.003s
W20260709 12:12:47.503537  5716 consensus_peers.cc:597] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:47.506163  5832 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.506635  5832 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:47.508517  5550 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:47.510812  5668 tablet_service.cc:1511] Processing CreateTablet for tablet 5a87e1fb9c364e85bc7c296e4c7b6642 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:47.511880  5668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a87e1fb9c364e85bc7c296e4c7b6642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.514091  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:47.514976  5742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb6332de9984fc6a6f24ba3cfc5c947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.515079  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:47.515856  5753 raft_consensus.cc:2393] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 1: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:12:47.516551  5794 tablet_bootstrap.cc:492] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:47.490379  5797 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.517638  5642 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:47.519928  5741 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb3872bc132421d9b9adacd9cf89a22 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:47.521270  5814 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.521589  5499 catalog_manager.cc:5697] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.523305  5737 tablet_service.cc:1511] Processing CreateTablet for tablet e25e2707f4a0454db308e33ed24bc75f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:47.524444  5793 raft_consensus.cc:359] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.525152  5793 raft_consensus.cc:385] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.525418  5793 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.526012  5585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e88229af5094c9993c0ec228734763c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.508512  5832 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:47.538038  5814 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.540254  5738 tablet_service.cc:1511] Processing CreateTablet for tablet 9f80dc3c97f640cc9ad6761e3aecfd36 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:47.541566  5738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f80dc3c97f640cc9ad6761e3aecfd36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.551982  5736 tablet_service.cc:1511] Processing CreateTablet for tablet 5a87e1fb9c364e85bc7c296e4c7b6642 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:47.553267  5736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a87e1fb9c364e85bc7c296e4c7b6642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.554431  5663 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4e96a5089046e0ac15a436ca7377c5 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:47.564039  5812 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.567183  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:47.567910  5603 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.570302  5740 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4e96a5089046e0ac15a436ca7377c5 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:47.571501  5793 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.571529  5740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4e96a5089046e0ac15a436ca7377c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.574090  5588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903a8681cf4244cb90615903ffda5c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.573706  5793 ts_tablet_manager.cc:1434] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.071s	user 0.003s	sys 0.001s
I20260709 12:12:47.595887  5663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4e96a5089046e0ac15a436ca7377c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.592280  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb6332de9984fc6a6f24ba3cfc5c947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.597872  5735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e88229af5094c9993c0ec228734763c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.599797  5737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25e2707f4a0454db308e33ed24bc75f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:47.597555  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 181532us
I20260709 12:12:47.602504  5741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb3872bc132421d9b9adacd9cf89a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.603335  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:12:47.613303  5718 leader_election.cc:343] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.614574  5743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903a8681cf4244cb90615903ffda5c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.621500  5603 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:47.622831  5716 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:47.627229  5840 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.627878  5840 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:47.628651  5840 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.635360  5795 tablet_bootstrap.cc:654] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.648164  5794 tablet_bootstrap.cc:654] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.596642  5812 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:47.658481  5793 tablet_bootstrap.cc:492] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:47.676092  5593 tablet_service.cc:1511] Processing CreateTablet for tablet e25e2707f4a0454db308e33ed24bc75f (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:47.677466  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25e2707f4a0454db308e33ed24bc75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.679236  5586 tablet_service.cc:1511] Processing CreateTablet for tablet 9f80dc3c97f640cc9ad6761e3aecfd36 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:47.680233  5590 tablet_service.cc:1511] Processing CreateTablet for tablet 5a87e1fb9c364e85bc7c296e4c7b6642 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:47.681653  5587 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4e96a5089046e0ac15a436ca7377c5 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:47.597021  5594 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb3872bc132421d9b9adacd9cf89a22 (DEFAULT_TABLE table=test-workload [id=2ca675ca795447e4a3909a514111745f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:47.697423  5801 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.692698  5587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4e96a5089046e0ac15a436ca7377c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.698992  5586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f80dc3c97f640cc9ad6761e3aecfd36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.699573  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb3872bc132421d9b9adacd9cf89a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.702447  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a87e1fb9c364e85bc7c296e4c7b6642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.712664  5501 catalog_manager.cc:5697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.716952  5793 tablet_bootstrap.cc:654] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.727975  5500 catalog_manager.cc:5697] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.735213  5795 tablet_bootstrap.cc:492] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:47.735746  5795 ts_tablet_manager.cc:1403] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.335s	user 0.019s	sys 0.000s
I20260709 12:12:47.747916  5794 tablet_bootstrap.cc:492] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:47.748425  5794 ts_tablet_manager.cc:1403] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.232s	user 0.012s	sys 0.016s
I20260709 12:12:47.750959  5794 raft_consensus.cc:359] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.751488  5794 raft_consensus.cc:385] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.751744  5794 raft_consensus.cc:740] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.752404  5794 consensus_queue.cc:260] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.760607  5795 raft_consensus.cc:359] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.761526  5795 raft_consensus.cc:385] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.761906  5795 raft_consensus.cc:740] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.762966  5795 consensus_queue.cc:260] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.768429  5795 ts_tablet_manager.cc:1434] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:12:47.769464  5795 tablet_bootstrap.cc:492] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:47.779537  5794 ts_tablet_manager.cc:1434] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:12:47.780180  5795 tablet_bootstrap.cc:654] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.785742  5795 tablet_bootstrap.cc:492] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:47.786250  5795 ts_tablet_manager.cc:1403] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:12:47.788398  5831 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.788699  5795 raft_consensus.cc:359] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.789301  5795 raft_consensus.cc:385] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.789541  5795 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.790318  5795 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.798772  5794 tablet_bootstrap.cc:492] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:47.799683  5793 tablet_bootstrap.cc:492] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:47.800199  5793 ts_tablet_manager.cc:1403] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.046s
I20260709 12:12:47.801601  5795 ts_tablet_manager.cc:1434] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 12:12:47.802824  5795 tablet_bootstrap.cc:492] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:47.803164  5793 raft_consensus.cc:359] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.803954  5793 raft_consensus.cc:385] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.804306  5793 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.805137  5793 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.815367  5793 ts_tablet_manager.cc:1434] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:12:47.815598  5795 tablet_bootstrap.cc:654] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.821281  5794 tablet_bootstrap.cc:654] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.826010  5793 tablet_bootstrap.cc:492] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:47.828142  5795 tablet_bootstrap.cc:492] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:47.828567  5795 ts_tablet_manager.cc:1403] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.005s
I20260709 12:12:47.831022  5795 raft_consensus.cc:359] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.831750  5795 raft_consensus.cc:385] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.832038  5795 raft_consensus.cc:740] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.832921  5793 tablet_bootstrap.cc:654] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.832939  5795 consensus_queue.cc:260] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.838150  5795 ts_tablet_manager.cc:1434] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 12:12:47.839154  5795 tablet_bootstrap.cc:492] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:47.839898  5794 tablet_bootstrap.cc:492] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:47.840420  5794 ts_tablet_manager.cc:1403] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.060s	user 0.004s	sys 0.012s
I20260709 12:12:47.844481  5795 tablet_bootstrap.cc:654] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.844607  5793 tablet_bootstrap.cc:492] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:47.845122  5793 ts_tablet_manager.cc:1403] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.011s
I20260709 12:12:47.846987  5794 raft_consensus.cc:359] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.847946  5794 raft_consensus.cc:385] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.847985  5793 raft_consensus.cc:359] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.848474  5794 raft_consensus.cc:740] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.848866  5793 raft_consensus.cc:385] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.849226  5793 raft_consensus.cc:740] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.850056  5793 consensus_queue.cc:260] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.852160  5793 ts_tablet_manager.cc:1434] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 12:12:47.852675  5794 consensus_queue.cc:260] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.853616  5793 tablet_bootstrap.cc:492] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:47.857112  5794 ts_tablet_manager.cc:1434] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:12:47.857965  5794 tablet_bootstrap.cc:492] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:47.863166  5794 tablet_bootstrap.cc:654] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.864051  5831 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.865363  5793 tablet_bootstrap.cc:654] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.870507  5795 tablet_bootstrap.cc:492] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:47.871038  5795 ts_tablet_manager.cc:1403] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.008s
I20260709 12:12:47.873700  5794 tablet_bootstrap.cc:492] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:47.874259  5794 ts_tablet_manager.cc:1403] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 12:12:47.873828  5795 raft_consensus.cc:359] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.874641  5795 raft_consensus.cc:385] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.874928  5795 raft_consensus.cc:740] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.875741  5795 consensus_queue.cc:260] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.876878  5794 raft_consensus.cc:359] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.877575  5794 raft_consensus.cc:385] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.877858  5794 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.878530  5794 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.880476  5794 ts_tablet_manager.cc:1434] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:47.881307  5794 tablet_bootstrap.cc:492] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:47.884310  5832 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.884783  5832 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.886267  5795 ts_tablet_manager.cc:1434] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:12:47.886746  5794 tablet_bootstrap.cc:654] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.887276  5832 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:47.889181  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:47.889875  5753 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:47.891791  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:47.892457  5603 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:47.894052  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:47.896492  5814 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.896878  5814 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.897370  5814 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.902084  5832 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.902588  5793 tablet_bootstrap.cc:492] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:47.903057  5793 ts_tablet_manager.cc:1403] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.021s
I20260709 12:12:47.904084  5794 tablet_bootstrap.cc:492] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:47.904536  5794 ts_tablet_manager.cc:1403] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 12:12:47.902601  5832 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.906631  5801 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.906939  5794 raft_consensus.cc:359] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.907657  5794 raft_consensus.cc:385] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.907862  5832 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:47.907956  5794 raft_consensus.cc:740] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.909351  5794 consensus_queue.cc:260] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.909701  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:47.910286  5603 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:47.911458  5794 ts_tablet_manager.cc:1434] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:47.911336  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:47.905625  5793 raft_consensus.cc:359] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.912127  5793 raft_consensus.cc:385] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.912182  5750 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:47.912534  5794 tablet_bootstrap.cc:492] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:47.911370  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:47.912469  5793 raft_consensus.cc:740] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.914124  5793 consensus_queue.cc:260] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.916291  5859 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.916676  5859 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.916999  5859 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.921380  5793 ts_tablet_manager.cc:1434] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:12:47.922456  5793 tablet_bootstrap.cc:492] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:47.896916  5795 tablet_bootstrap.cc:492] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:47.925704  5814 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.930186  5859 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.928280  5794 tablet_bootstrap.cc:654] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.932165  5859 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:47.928716  5793 tablet_bootstrap.cc:654] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.933456  5603 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.935915  5795 tablet_bootstrap.cc:654] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.936246  5814 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:47.941648  5793 tablet_bootstrap.cc:492] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:47.942121  5793 ts_tablet_manager.cc:1403] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:12:47.944672  5793 raft_consensus.cc:359] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.946123  5794 tablet_bootstrap.cc:492] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:47.946621  5794 ts_tablet_manager.cc:1403] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.011s
I20260709 12:12:47.945317  5793 raft_consensus.cc:385] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.949898  5793 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.949499  5794 raft_consensus.cc:359] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.950706  5794 raft_consensus.cc:385] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.950649  5793 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.951072  5794 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.952845  5793 ts_tablet_manager.cc:1434] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:12:47.953872  5793 tablet_bootstrap.cc:492] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:47.954232  5794 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.957674  5794 ts_tablet_manager.cc:1434] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:12:47.959270  5794 tablet_bootstrap.cc:492] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:47.960441  5840 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.962598  5840 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.965440  5840 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:47.966773  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:47.966758  5794 tablet_bootstrap.cc:654] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.967549  5678 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:47.968321  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:47.969938  5793 tablet_bootstrap.cc:654] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:47.972486  5716 leader_election.cc:343] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:47.970067  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 54890.4us
I20260709 12:12:47.970701  5795 tablet_bootstrap.cc:492] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:47.973479  5718 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:47.974833  5840 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.975237  5840 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.975571  5840 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.975939  5795 ts_tablet_manager.cc:1403] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.012s
I20260709 12:12:47.976533  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:47.977216  5753 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.978773  5795 raft_consensus.cc:359] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.979521  5795 raft_consensus.cc:385] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.979800  5795 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.980654  5795 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:47.982622  5795 ts_tablet_manager.cc:1434] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:47.983114  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:47.983729  5752 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.984241  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:47.984794  5604 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.985888  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:47.986398  5603 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.988832  5753 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:47.990847  5752 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:47.999766  5604 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:47.993673  5603 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:47.997527  5840 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.000855  5795 tablet_bootstrap.cc:492] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:48.005725  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:48.006624  5840 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.006830  5603 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.999344  5793 tablet_bootstrap.cc:492] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:47.994135  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:48.006007  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:47.998960  5794 tablet_bootstrap.cc:492] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:48.007804  5678 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.008517  5860 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.008554  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:48.009119  5860 raft_consensus.cc:697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:48.009528  5814 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.010113  5814 raft_consensus.cc:697] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:48.009996  5860 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.010934  5814 consensus_queue.cc:237] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.012847  5794 ts_tablet_manager.cc:1403] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.003s
I20260709 12:12:48.013556  5861 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.014088  5861 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.020416  5793 ts_tablet_manager.cc:1403] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.004s
I20260709 12:12:48.025511  5794 raft_consensus.cc:359] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.026469  5861 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.026696  5795 tablet_bootstrap.cc:654] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.031893  5794 raft_consensus.cc:385] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.032207  5794 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.032373  5678 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:48.032999  5794 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.035070  5794 ts_tablet_manager.cc:1434] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 12:12:48.035275  5840 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.035704  5840 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.037530  5603 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:48.038735  5840 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.038661  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.038874  5794 tablet_bootstrap.cc:492] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:48.038663  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:48.041033  5718 leader_election.cc:343] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.041540  5795 tablet_bootstrap.cc:492] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:48.041978  5795 ts_tablet_manager.cc:1403] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260709 12:12:48.042084  5500 catalog_manager.cc:5697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:48.042012  5716 leader_election.cc:343] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.044135  5716 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:48.029840  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.031243  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:48.045146  5604 raft_consensus.cc:2393] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:48.044697  5795 raft_consensus.cc:359] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.045459  5795 raft_consensus.cc:385] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.045717  5795 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.045789  5716 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:48.046631  5812 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.046480  5795 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.047313  5812 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.043972  5500 catalog_manager.cc:5697] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.047763  5812 raft_consensus.cc:697] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:48.026808  5793 raft_consensus.cc:359] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.048635  5795 ts_tablet_manager.cc:1434] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:48.048588  5812 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.049340  5793 raft_consensus.cc:385] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.049609  5795 tablet_bootstrap.cc:492] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:48.050565  5793 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.051365  5793 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.050300  5794 tablet_bootstrap.cc:654] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.053364  5793 ts_tablet_manager.cc:1434] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 12:12:48.054402  5793 tablet_bootstrap.cc:492] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:48.058136  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:48.059103  5860 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.062849  5795 tablet_bootstrap.cc:654] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.064828  5793 tablet_bootstrap.cc:654] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.067863  5860 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.094177  5500 catalog_manager.cc:5697] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.102756  5794 tablet_bootstrap.cc:492] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:48.103314  5794 ts_tablet_manager.cc:1403] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.065s	user 0.037s	sys 0.016s
I20260709 12:12:48.105437  5794 raft_consensus.cc:359] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.106087  5794 raft_consensus.cc:385] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.106333  5794 raft_consensus.cc:740] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.107067  5794 consensus_queue.cc:260] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.108569  5793 tablet_bootstrap.cc:492] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:48.109009  5794 ts_tablet_manager.cc:1434] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:12:48.109051  5793 ts_tablet_manager.cc:1403] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.031s
I20260709 12:12:48.109527  5795 tablet_bootstrap.cc:492] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:48.110046  5795 ts_tablet_manager.cc:1403] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.023s
I20260709 12:12:48.110158  5794 tablet_bootstrap.cc:492] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:48.112372  5793 raft_consensus.cc:359] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.112584  5795 raft_consensus.cc:359] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.113090  5793 raft_consensus.cc:385] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.113405  5795 raft_consensus.cc:385] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.114190  5795 raft_consensus.cc:740] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.114954  5795 consensus_queue.cc:260] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.113389  5793 raft_consensus.cc:740] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.116487  5812 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.117035  5795 ts_tablet_manager.cc:1434] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:12:48.116582  5793 consensus_queue.cc:260] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.118041  5795 tablet_bootstrap.cc:492] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:48.118705  5793 ts_tablet_manager.cc:1434] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:12:48.119510  5794 tablet_bootstrap.cc:654] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.124030  5793 tablet_bootstrap.cc:492] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:48.124619  5795 tablet_bootstrap.cc:654] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.127912  5812 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.131072  5794 tablet_bootstrap.cc:492] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:48.131521  5794 ts_tablet_manager.cc:1403] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 12:12:48.134182  5793 tablet_bootstrap.cc:654] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.138273  5795 tablet_bootstrap.cc:492] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:48.138787  5795 ts_tablet_manager.cc:1403] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:12:48.141840  5795 raft_consensus.cc:359] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.142701  5795 raft_consensus.cc:385] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.143047  5795 raft_consensus.cc:740] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.143852  5795 consensus_queue.cc:260] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.149873  5795 ts_tablet_manager.cc:1434] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:12:48.150970  5795 tablet_bootstrap.cc:492] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:48.151053  5794 raft_consensus.cc:359] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.151829  5794 raft_consensus.cc:385] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.152109  5794 raft_consensus.cc:740] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.155541  5794 consensus_queue.cc:260] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.158879  5795 tablet_bootstrap.cc:654] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.159219  5841 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.159742  5841 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.162020  5841 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.162832  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.163486  5604 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:48.164065  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:48.164672  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:48.164925  5794 ts_tablet_manager.cc:1434] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.006s
I20260709 12:12:48.165501  5841 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.166644  5841 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.166993  5841 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.167503  5793 tablet_bootstrap.cc:492] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:48.168062  5793 ts_tablet_manager.cc:1403] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.003s
I20260709 12:12:48.169788  5794 tablet_bootstrap.cc:492] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:48.164672  5678 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:48.170961  5793 raft_consensus.cc:359] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.173529  5793 raft_consensus.cc:385] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.173898  5793 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.174774  5793 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.176986  5793 ts_tablet_manager.cc:1434] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:12:48.177389  5812 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.178108  5793 tablet_bootstrap.cc:492] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:48.177891  5812 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.178627  5794 tablet_bootstrap.cc:654] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.180872  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.181608  5604 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:48.183105  5716 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:48.184136  5840 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.184552  5840 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.184911  5840 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.185846  5795 tablet_bootstrap.cc:492] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:48.186131  5793 tablet_bootstrap.cc:654] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.186322  5795 ts_tablet_manager.cc:1403] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.009s
I20260709 12:12:48.188812  5795 raft_consensus.cc:359] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.189461  5795 raft_consensus.cc:385] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.189730  5795 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.192137  5840 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.194139  5812 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.195338  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:48.200649  5718 leader_election.cc:343] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.190552  5795 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.203616  5795 ts_tablet_manager.cc:1434] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:12:48.204648  5795 tablet_bootstrap.cc:492] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:48.206386  5840 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.207456  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:48.208093  5604 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.213294  5841 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.215514  5841 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.216413  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:48.217145  5603 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.218070  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:48.218667  5679 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.219182  5794 tablet_bootstrap.cc:492] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:48.219504  5794 ts_tablet_manager.cc:1403] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.011s
I20260709 12:12:48.216413  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:48.216785  5795 tablet_bootstrap.cc:654] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.221992  5794 raft_consensus.cc:359] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.222802  5794 raft_consensus.cc:385] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.223071  5794 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.224279  5794 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.225173  5603 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:48.226756  5794 ts_tablet_manager.cc:1434] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
W20260709 12:12:48.227378  5718 leader_election.cc:343] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.227821  5794 tablet_bootstrap.cc:492] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:48.228410  5793 tablet_bootstrap.cc:492] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:48.228914  5793 ts_tablet_manager.cc:1403] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.019s
I20260709 12:12:48.231438  5793 raft_consensus.cc:359] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.232141  5793 raft_consensus.cc:385] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.232467  5793 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.233230  5793 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.234151  5794 tablet_bootstrap.cc:654] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.235756  5793 ts_tablet_manager.cc:1434] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:48.236685  5793 tablet_bootstrap.cc:492] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:48.242141  5793 tablet_bootstrap.cc:654] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.244632  5841 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.245133  5841 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.247299  5841 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.248838  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:48.249526  5678 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:48.226959  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:48.250861  5841 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.251590  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.251717  5718 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:48.252225  5603 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:48.252607  5841 raft_consensus.cc:697] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:48.254484  5840 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.254865  5840 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.255198  5840 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.265295  5679 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:48.253495  5841 consensus_queue.cc:237] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.267379  5604 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:48.268821  5716 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:48.269735  5812 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.261718  5840 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.272838  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:48.273551  5604 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.278425  5840 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.278932  5793 tablet_bootstrap.cc:492] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:48.279490  5793 ts_tablet_manager.cc:1403] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.000s
I20260709 12:12:48.283270  5604 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:48.279433  5840 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.283849  5795 tablet_bootstrap.cc:492] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:48.284704  5795 ts_tablet_manager.cc:1403] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.080s	user 0.033s	sys 0.025s
I20260709 12:12:48.283735  5794 tablet_bootstrap.cc:492] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:48.286058  5794 ts_tablet_manager.cc:1403] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.022s
I20260709 12:12:48.287225  5716 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:48.288074  5793 raft_consensus.cc:359] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.288702  5793 raft_consensus.cc:385] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.290455  5794 raft_consensus.cc:359] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.288998  5793 raft_consensus.cc:740] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.291113  5794 raft_consensus.cc:385] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.291388  5794 raft_consensus.cc:740] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.284216  5840 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.293617  5841 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.295480  5841 raft_consensus.cc:697] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:48.296903  5840 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.296784  5794 consensus_queue.cc:260] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.299325  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.299010  5499 catalog_manager.cc:5697] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:48.300917  5716 leader_election.cc:343] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.292399  5793 consensus_queue.cc:260] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.296267  5841 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.302695  5795 raft_consensus.cc:359] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.303442  5795 raft_consensus.cc:385] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.303771  5795 raft_consensus.cc:740] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.304538  5795 consensus_queue.cc:260] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.306556  5795 ts_tablet_manager.cc:1434] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:12:48.307211  5794 ts_tablet_manager.cc:1434] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:12:48.308139  5794 tablet_bootstrap.cc:492] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:48.309075  5795 tablet_bootstrap.cc:492] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:48.316960  5793 ts_tablet_manager.cc:1434] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:12:48.317849  5793 tablet_bootstrap.cc:492] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:48.321498  5860 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.321979  5860 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.318482  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:48.323626  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:48.323823  5679 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.324342  5860 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:12:48.324970  5718 leader_election.cc:343] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.325369  5718 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:48.328688  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:48.329280  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.329316  5753 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:48.329895  5604 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:48.316447  5812 raft_consensus.cc:697] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:48.330886  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:48.331283  5812 consensus_queue.cc:237] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.333316  5860 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.333702  5860 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.334108  5860 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.335757  5679 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:48.338321  5887 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.342715  5793 tablet_bootstrap.cc:654] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.347126  5795 tablet_bootstrap.cc:654] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.351099  5794 tablet_bootstrap.cc:654] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.348760  5860 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.353989  5860 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.354046  5499 catalog_manager.cc:5697] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.355418  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:48.356014  5753 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.355903  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:48.355662  5499 catalog_manager.cc:5697] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.356688  5604 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.360087  5812 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.360636  5812 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.364492  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:48.364519  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:12:48.366115  5718 leader_election.cc:343] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:48.367424  5716 leader_election.cc:343] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.367887  5716 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:48.368690  5887 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.369953  5812 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.375864  5793 tablet_bootstrap.cc:492] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:48.376399  5793 ts_tablet_manager.cc:1403] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.000s
I20260709 12:12:48.377627  5604 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:48.378508  5753 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:48.379523  5793 raft_consensus.cc:359] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.381484  5793 raft_consensus.cc:385] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.381778  5793 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.382400  5793 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.382597  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:48.383690  5860 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.384063  5795 tablet_bootstrap.cc:492] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:48.384166  5860 raft_consensus.cc:697] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:48.384343  5793 ts_tablet_manager.cc:1434] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:12:48.385288  5795 ts_tablet_manager.cc:1403] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.076s	user 0.025s	sys 0.011s
I20260709 12:12:48.386247  5793 tablet_bootstrap.cc:492] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:48.385751  5860 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.388345  5794 tablet_bootstrap.cc:492] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:48.388813  5794 ts_tablet_manager.cc:1403] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.002s
I20260709 12:12:48.388967  5795 raft_consensus.cc:359] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.389593  5795 raft_consensus.cc:385] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.389899  5795 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.390627  5795 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.391878  5794 raft_consensus.cc:359] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.392556  5794 raft_consensus.cc:385] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.392771  5793 tablet_bootstrap.cc:654] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.392877  5794 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.393163  5812 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.393637  5812 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.393883  5794 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.396423  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.397078  5604 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:48.398098  5861 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.398278  5716 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:48.398729  5861 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.399648  5887 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.400039  5887 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.400347  5887 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.400763  5861 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.403234  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:12:48.404884  5642 leader_election.cc:343] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.405467  5812 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.406236  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:48.406555  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:48.407611  5642 leader_election.cc:343] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.407845  5887 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:48.408066  5718 leader_election.cc:343] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.408016  5642 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:48.409271  5861 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.410568  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:48.411128  5604 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.411350  5794 ts_tablet_manager.cc:1434] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:12:48.415391  5793 tablet_bootstrap.cc:492] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:48.415828  5793 ts_tablet_manager.cc:1403] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.011s
I20260709 12:12:48.418538  5793 raft_consensus.cc:359] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.419165  5793 raft_consensus.cc:385] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.419451  5793 raft_consensus.cc:740] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.419767  5794 tablet_bootstrap.cc:492] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:48.420176  5793 consensus_queue.cc:260] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.400331  5795 ts_tablet_manager.cc:1434] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:12:48.422614  5793 ts_tablet_manager.cc:1434] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:48.423740  5793 tablet_bootstrap.cc:492] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:48.424789  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:12:48.426095  5718 leader_election.cc:343] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.426653  5831 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.427153  5831 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.429131  5794 tablet_bootstrap.cc:654] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.429261  5793 tablet_bootstrap.cc:654] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.422832  5795 tablet_bootstrap.cc:492] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:48.430478  5499 catalog_manager.cc:5697] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.429147  5831 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.430979  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:48.432314  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:48.432864  5679 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:48.433144  5753 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:48.434214  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:48.435142  5831 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.435511  5831 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.435675  5795 tablet_bootstrap.cc:654] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.437222  5831 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.445745  5887 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.446398  5604 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:48.451865  5795 tablet_bootstrap.cc:492] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:48.452359  5795 ts_tablet_manager.cc:1403] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.008s
I20260709 12:12:48.454698  5795 raft_consensus.cc:359] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.455351  5795 raft_consensus.cc:385] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.455605  5795 raft_consensus.cc:740] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.456326  5793 tablet_bootstrap.cc:492] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:48.456784  5793 ts_tablet_manager.cc:1403] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.003s
I20260709 12:12:48.456705  5795 consensus_queue.cc:260] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.456808  5716 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:48.458794  5795 ts_tablet_manager.cc:1434] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:12:48.459424  5887 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.459399  5793 raft_consensus.cc:359] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.460098  5793 raft_consensus.cc:385] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.460368  5793 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.460958  5887 raft_consensus.cc:697] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:48.460973  5793 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.462343  5795 tablet_bootstrap.cc:492] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:48.467666  5887 consensus_queue.cc:237] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.445053  5831 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.474511  5793 ts_tablet_manager.cc:1434] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:12:48.473562  5860 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:48.475926  5793 tablet_bootstrap.cc:492] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:48.477396  5831 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.478452  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:48.479069  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:48.479274  5753 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.479602  5679 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.487380  5679 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:48.488478  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:48.489619  5794 tablet_bootstrap.cc:492] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:48.489885  5860 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.489646  5795 tablet_bootstrap.cc:654] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.490135  5794 ts_tablet_manager.cc:1403] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.071s	user 0.027s	sys 0.019s
I20260709 12:12:48.491549  5831 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.491997  5831 raft_consensus.cc:697] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:48.492820  5794 raft_consensus.cc:359] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.493446  5794 raft_consensus.cc:385] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.493719  5794 raft_consensus.cc:740] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.494647  5794 consensus_queue.cc:260] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.492815  5831 consensus_queue.cc:237] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.496793  5753 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:48.497102  5794 ts_tablet_manager.cc:1434] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:48.498169  5794 tablet_bootstrap.cc:492] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:48.495644  5793 tablet_bootstrap.cc:654] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.514202  5794 tablet_bootstrap.cc:654] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.515478  5500 catalog_manager.cc:5697] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.519155  5499 catalog_manager.cc:5697] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.523844  5795 tablet_bootstrap.cc:492] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:48.524216  5795 ts_tablet_manager.cc:1403] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.006s
I20260709 12:12:48.527688  5795 raft_consensus.cc:359] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.528517  5795 raft_consensus.cc:385] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.528796  5795 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.529786  5795 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.531936  5795 ts_tablet_manager.cc:1434] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:48.532135  5887 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.532903  5795 tablet_bootstrap.cc:492] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:48.571290  5812 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.574359  5793 tablet_bootstrap.cc:492] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:48.574837  5793 ts_tablet_manager.cc:1403] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.009s
I20260709 12:12:48.574756  5861 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.579476  5860 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.583666  5795 tablet_bootstrap.cc:654] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.586731  5793 raft_consensus.cc:359] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.587473  5793 raft_consensus.cc:385] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.587728  5793 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.589924  5793 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.597779  5793 ts_tablet_manager.cc:1434] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:12:48.633797  5908 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.634341  5908 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.601593  5793 tablet_bootstrap.cc:492] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:48.647923  5794 tablet_bootstrap.cc:492] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:48.648429  5794 ts_tablet_manager.cc:1403] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.150s	user 0.024s	sys 0.042s
I20260709 12:12:48.648887  5795 tablet_bootstrap.cc:492] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:48.649260  5795 ts_tablet_manager.cc:1403] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.117s	user 0.007s	sys 0.005s
W20260709 12:12:48.658386  5550 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:48.658301  5794 raft_consensus.cc:359] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.659154  5794 raft_consensus.cc:385] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.659430  5794 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.660104  5794 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.661646  5794 ts_tablet_manager.cc:1434] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.001s
I20260709 12:12:48.664388  5794 tablet_bootstrap.cc:492] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:48.663004  5814 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.667248  5814 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.669214  5814 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.671036  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.671778  5603 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:48.671969  5908 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.689990  5814 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.697021  5793 tablet_bootstrap.cc:654] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.697989  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.698773  5603 raft_consensus.cc:2393] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:48.698961  5642 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:48.672897  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:48.700496  5752 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:48.701077  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:48.699734  5908 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.702822  5908 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.703220  5908 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.705214  5888 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.705786  5888 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.706743  5909 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.707437  5909 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.708508  5888 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.709084  5887 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.710155  5909 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.712235  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.712586  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:48.714169  5716 leader_election.cc:343] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.715412  5908 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:48.716038  5718 leader_election.cc:343] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.716490  5718 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:48.717357  5908 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.717923  5840 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.709534  5887 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.715359  5831 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.719338  5840 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.720530  5831 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.721238  5642 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:48.722375  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.723701  5908 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.721273  5887 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:48.724298  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.725039  5604 raft_consensus.cc:2393] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:48.725338  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:48.725462  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:48.725874  5752 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.722568  5831 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.725883  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:48.733991  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:48.734549  5603 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.739722  5908 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.741106  5603 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:48.746934  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:48.747845  5718 leader_election.cc:343] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:48.748410  5716 leader_election.cc:343] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:48.749076  5569 leader_election.cc:343] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.750662  5716 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:48.751466  5887 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.751942  5752 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:48.754261  5642 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:48.757609  5794 tablet_bootstrap.cc:654] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.707847  5814 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.754946  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:48.760429  5795 raft_consensus.cc:359] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.761204  5795 raft_consensus.cc:385] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.761494  5795 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.762055  5752 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:48.762805  5909 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.763232  5642 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:48.764312  5861 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.764778  5861 raft_consensus.cc:697] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:48.765548  5861 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.766218  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:48.767678  5900 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.768051  5900 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.768381  5900 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.769348  5793 tablet_bootstrap.cc:492] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:48.769794  5793 ts_tablet_manager.cc:1403] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.171s	user 0.026s	sys 0.020s
I20260709 12:12:48.772240  5793 raft_consensus.cc:359] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.772730  5793 raft_consensus.cc:385] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.772933  5793 raft_consensus.cc:740] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.773583  5814 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.778101  5909 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.780030  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:48.780030  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.781808  5841 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.785946  5795 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.790701  5900 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.795887  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:48.796100  5793 consensus_queue.cc:260] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.797129  5678 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.800108  5900 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.801321  5795 ts_tablet_manager.cc:1434] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.152s	user 0.012s	sys 0.004s
I20260709 12:12:48.802839  5795 tablet_bootstrap.cc:492] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:48.804065  5793 ts_tablet_manager.cc:1434] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 12:12:48.804790  5793 tablet_bootstrap.cc:492] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:48.803506  5909 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.805405  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:48.805537  5909 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.806003  5752 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.808368  5909 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.810729  5794 tablet_bootstrap.cc:492] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:48.811064  5794 ts_tablet_manager.cc:1403] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.147s	user 0.017s	sys 0.013s
W20260709 12:12:48.812088  5642 leader_election.cc:343] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.813603  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.813897  5678 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:48.814248  5604 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:48.815225  5569 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:48.815982  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:48.816499  5752 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:48.816956  5900 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.818979  5900 raft_consensus.cc:697] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:12:48.819732  5642 leader_election.cc:343] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.819994  5900 consensus_queue.cc:237] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.822114  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:48.824616  5909 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:48.825019  5642 leader_election.cc:343] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.825663  5795 tablet_bootstrap.cc:654] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.826694  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:12:48.827131  5794 raft_consensus.cc:359] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.827526  5909 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.827800  5794 raft_consensus.cc:385] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.828027  5909 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.828576  5909 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.828902  5793 tablet_bootstrap.cc:654] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.828104  5794 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.829968  5794 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.830013  5500 catalog_manager.cc:5697] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.836663  5909 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.837847  5794 ts_tablet_manager.cc:1434] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:12:48.840484  5794 tablet_bootstrap.cc:492] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:48.842900  5909 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:48.848800  5795 tablet_bootstrap.cc:492] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:48.849366  5795 ts_tablet_manager.cc:1403] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.004s
I20260709 12:12:48.852747  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:48.854347  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:48.854633  5841 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:48.854957  5642 leader_election.cc:343] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.855525  5603 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.856436  5794 tablet_bootstrap.cc:654] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.861409  5793 tablet_bootstrap.cc:492] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:48.861860  5793 ts_tablet_manager.cc:1403] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.010s
I20260709 12:12:48.862208  5603 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:48.863883  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:12:48.865047  5909 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.865489  5909 raft_consensus.cc:697] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:48.865878  5793 raft_consensus.cc:359] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.866533  5793 raft_consensus.cc:385] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.866313  5909 consensus_queue.cc:237] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.866802  5793 raft_consensus.cc:740] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.867080  5841 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.867408  5793 consensus_queue.cc:260] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.867762  5861 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.869804  5793 ts_tablet_manager.cc:1434] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:12:48.870795  5793 tablet_bootstrap.cc:492] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:48.870990  5795 raft_consensus.cc:359] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.871644  5795 raft_consensus.cc:385] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.871922  5795 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.874686  5861 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.880689  5888 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.885231  5795 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.886233  5793 tablet_bootstrap.cc:654] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.890880  5795 ts_tablet_manager.cc:1434] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.002s
I20260709 12:12:48.890285  5500 catalog_manager.cc:5697] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.914641  5860 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.915279  5860 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.987123  5794 tablet_bootstrap.cc:492] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:48.987609  5794 ts_tablet_manager.cc:1403] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.147s	user 0.010s	sys 0.000s
I20260709 12:12:48.987722  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:48.988968  5860 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:12:48.989005  5642 leader_election.cc:343] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.990579  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:48.991194  5753 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:48.992193  5642 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:48.992972  5814 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.993350  5814 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.993678  5814 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.992700  5794 raft_consensus.cc:359] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:48.994496  5794 raft_consensus.cc:385] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.994740  5794 raft_consensus.cc:740] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.994928  5899 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.891939  5795 tablet_bootstrap.cc:492] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:48.999565  5794 consensus_queue.cc:260] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.013557  5501 catalog_manager.cc:5697] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.016487  5794 ts_tablet_manager.cc:1434] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:12:49.017488  5794 tablet_bootstrap.cc:492] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:49.022969  5812 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.029235  5812 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.031189  5812 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:49.035697  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.036315  5602 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:49.037529  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.038106  5716 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:49.037667  5812 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:12:49.050472  5841 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:12:49.056300  5814 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.060388  5795 tablet_bootstrap.cc:654] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.064836  5888 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.065634  5793 tablet_bootstrap.cc:492] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:49.066123  5793 ts_tablet_manager.cc:1403] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.196s	user 0.017s	sys 0.019s
I20260709 12:12:49.068354  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:12:49.071601  5642 leader_election.cc:343] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.073412  5814 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.075577  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:49.076175  5753 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.076725  5841 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:49.076176  5718 leader_election.cc:343] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.077139  5841 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.075834  5793 raft_consensus.cc:359] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.078670  5841 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.079058  5793 raft_consensus.cc:385] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.080080  5793 raft_consensus.cc:740] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.089449  5793 consensus_queue.cc:260] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.092324  5899 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.092839  5899 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.094576  5899 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.095686  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.096292  5679 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:49.097443  5569 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:49.100051  5899 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.102240  5899 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.102569  5899 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.103727  5793 ts_tablet_manager.cc:1434] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:12:49.104640  5793 tablet_bootstrap.cc:492] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:49.106014  5794 tablet_bootstrap.cc:654] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.119753  5841 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.121946  5841 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:49.123044  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:49.116150  5831 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 12:12:49.126145  5718 leader_election.cc:343] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.130672  5753 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:49.131979  5642 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:49.133025  5860 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.133464  5860 raft_consensus.cc:697] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:49.134235  5860 consensus_queue.cc:237] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.142629  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:49.150048  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.157975  5603 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.172173  5603 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:49.176738  5793 tablet_bootstrap.cc:654] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.174319  5500 catalog_manager.cc:5697] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.182480  5899 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.183084  5887 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.183565  5887 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.185316  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:49.187753  5716 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:49.189637  5678 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.190169  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.189100  5887 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:49.191109  5887 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.191754  5887 raft_consensus.cc:697] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:49.193598  5887 consensus_queue.cc:237] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.194607  5899 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.196329  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:12:49.197783  5567 leader_election.cc:343] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.198601  5678 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:49.199801  5569 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:49.200699  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.201429  5602 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 1: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:12:49.201965  5831 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.202478  5831 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:49.203295  5831 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.212962  5795 tablet_bootstrap.cc:492] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.213413  5795 ts_tablet_manager.cc:1403] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.322s	user 0.015s	sys 0.019s
I20260709 12:12:49.215679  5795 raft_consensus.cc:359] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.215337  5501 catalog_manager.cc:5697] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.216164  5795 raft_consensus.cc:385] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.216440  5795 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.216953  5795 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:49.218526  5567 leader_election.cc:343] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.220403  5716 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:49.221724  5812 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.226421  5795 ts_tablet_manager.cc:1434] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:12:49.227121  5794 tablet_bootstrap.cc:492] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:49.227626  5794 ts_tablet_manager.cc:1403] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.210s	user 0.039s	sys 0.021s
I20260709 12:12:49.227342  5795 tablet_bootstrap.cc:492] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.229519  5812 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.234670  5795 tablet_bootstrap.cc:654] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.240311  5793 tablet_bootstrap.cc:492] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:49.240772  5793 ts_tablet_manager.cc:1403] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.000s
I20260709 12:12:49.241501  5795 tablet_bootstrap.cc:492] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.241974  5795 ts_tablet_manager.cc:1403] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:12:49.241544  5860 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.244467  5795 raft_consensus.cc:359] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.245141  5795 raft_consensus.cc:385] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.245400  5795 raft_consensus.cc:740] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.246155  5795 consensus_queue.cc:260] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.247498  5793 raft_consensus.cc:359] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.248210  5793 raft_consensus.cc:385] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.248478  5793 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.249095  5793 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.251885  5794 raft_consensus.cc:359] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.252624  5794 raft_consensus.cc:385] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.252900  5794 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.253751  5794 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.256661  5793 ts_tablet_manager.cc:1434] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:12:49.257048  5795 ts_tablet_manager.cc:1434] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:12:49.257572  5793 tablet_bootstrap.cc:492] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:49.257969  5795 tablet_bootstrap.cc:492] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.263705  5795 tablet_bootstrap.cc:654] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.264973  5793 tablet_bootstrap.cc:654] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.269110  5909 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.272266  5501 catalog_manager.cc:5697] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:49.270771  5795 tablet_bootstrap.cc:492] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.279290  5794 ts_tablet_manager.cc:1434] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 12:12:49.277608  5795 ts_tablet_manager.cc:1403] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 12:12:49.279860  5831 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.280221  5794 tablet_bootstrap.cc:492] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:49.286759  5793 tablet_bootstrap.cc:492] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:49.287467  5793 ts_tablet_manager.cc:1403] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.008s
I20260709 12:12:49.288319  5794 tablet_bootstrap.cc:654] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.291106  5814 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.291574  5814 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.292470  5831 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.292917  5831 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.292930  5793 raft_consensus.cc:359] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.294440  5793 raft_consensus.cc:385] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.294680  5793 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.295872  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.296204  5831 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.296397  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.295890  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.297027  5753 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:49.298231  5567 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:49.297427  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.298991  5831 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:49.298337  5642 leader_election.cc:343] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.295274  5793 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:49.299825  5642 leader_election.cc:343] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.300210  5642 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:49.300992  5793 ts_tablet_manager.cc:1434] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.001s
I20260709 12:12:49.301110  5860 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.301234  5795 raft_consensus.cc:359] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.301920  5795 raft_consensus.cc:385] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.302178  5795 raft_consensus.cc:740] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.302732  5795 consensus_queue.cc:260] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.304476  5793 tablet_bootstrap.cc:492] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:49.304606  5795 ts_tablet_manager.cc:1434] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.000s
I20260709 12:12:49.305404  5795 tablet_bootstrap.cc:492] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.299407  5831 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.308014  5831 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:49.308939  5569 leader_election.cc:343] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.310883  5795 tablet_bootstrap.cc:654] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.311355  5793 tablet_bootstrap.cc:654] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.293538  5814 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.315007  5899 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.317034  5831 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.320322  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:49.321038  5750 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.323014  5793 tablet_bootstrap.cc:492] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:49.323514  5793 ts_tablet_manager.cc:1403] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 12:12:49.325999  5793 raft_consensus.cc:359] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.326643  5793 raft_consensus.cc:385] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.326902  5793 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.327231  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:49.327857  5795 tablet_bootstrap.cc:492] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.327521  5793 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.328035  5750 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:49.328500  5795 ts_tablet_manager.cc:1403] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
W20260709 12:12:49.328634  5569 leader_election.cc:343] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.329409  5567 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:49.329838  5793 ts_tablet_manager.cc:1434] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:12:49.330291  5899 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.330718  5793 tablet_bootstrap.cc:492] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:49.330763  5899 raft_consensus.cc:697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:49.331398  5795 raft_consensus.cc:359] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.332172  5795 raft_consensus.cc:385] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.331694  5899 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.336026  5795 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.336941  5831 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.337019  5795 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.339672  5795 ts_tablet_manager.cc:1434] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:12:49.341032  5793 tablet_bootstrap.cc:654] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.341953  5795 tablet_bootstrap.cc:492] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.349192  5795 tablet_bootstrap.cc:654] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.363541  5795 tablet_bootstrap.cc:492] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.364156  5795 ts_tablet_manager.cc:1403] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 12:12:49.366036  5499 catalog_manager.cc:5697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.367460  5795 raft_consensus.cc:359] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.368279  5795 raft_consensus.cc:385] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.367616  5794 tablet_bootstrap.cc:492] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:49.368620  5795 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.368953  5794 ts_tablet_manager.cc:1403] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.002s
I20260709 12:12:49.369537  5795 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.371630  5795 ts_tablet_manager.cc:1434] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:49.371496  5794 raft_consensus.cc:359] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.372185  5794 raft_consensus.cc:385] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.372382  5795 tablet_bootstrap.cc:492] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.372455  5794 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.373522  5899 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.374002  5899 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.375929  5793 tablet_bootstrap.cc:492] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:49.376434  5793 ts_tablet_manager.cc:1403] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.021s
I20260709 12:12:49.376924  5899 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.377718  5795 tablet_bootstrap.cc:654] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.378801  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.379177  5793 raft_consensus.cc:359] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.379503  5678 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:49.379856  5793 raft_consensus.cc:385] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.380127  5793 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.373212  5794 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.380915  5569 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:49.382452  5794 ts_tablet_manager.cc:1434] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:12:49.382627  5939 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.383000  5939 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.380791  5793 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.383396  5939 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.384876  5793 ts_tablet_manager.cc:1434] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:12:49.385848  5793 tablet_bootstrap.cc:492] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:49.387647  5795 tablet_bootstrap.cc:492] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.388011  5795 ts_tablet_manager.cc:1403] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:12:49.389972  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.390470  5795 raft_consensus.cc:359] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.391130  5795 raft_consensus.cc:385] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.391387  5795 raft_consensus.cc:740] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.391835  5794 tablet_bootstrap.cc:492] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:49.391986  5795 consensus_queue.cc:260] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:49.393694  5567 leader_election.cc:343] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.394220  5795 ts_tablet_manager.cc:1434] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:12:49.395093  5795 tablet_bootstrap.cc:492] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.397835  5794 tablet_bootstrap.cc:654] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.397478  5939 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.400713  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:49.401281  5678 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.402542  5939 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.400686  5795 tablet_bootstrap.cc:654] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.407550  5793 tablet_bootstrap.cc:654] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.409116  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:12:49.410674  5567 leader_election.cc:343] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.413272  5814 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.418569  5678 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:49.419948  5909 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.420032  5569 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:12:49.420526  5909 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.422072  5939 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.422622  5939 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:49.423501  5939 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.427441  5795 tablet_bootstrap.cc:492] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.428067  5795 ts_tablet_manager.cc:1403] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.006s
I20260709 12:12:49.431257  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.432771  5603 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:49.438831  5812 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.439648  5812 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.441295  5795 raft_consensus.cc:359] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.441740  5812 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:49.442003  5795 raft_consensus.cc:385] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.442528  5795 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.445369  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.450579  5814 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.450781  5642 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:49.450940  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.451668  5678 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 1: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:12:49.443833  5795 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.453068  5909 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.451680  5860 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.453956  5795 ts_tablet_manager.cc:1434] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:12:49.455081  5795 tablet_bootstrap.cc:492] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.458763  5716 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:49.460421  5812 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.457576  5860 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.460391  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.464350  5860 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.464957  5750 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:49.472705  5860 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.474279  5812 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.478685  5794 tablet_bootstrap.cc:492] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:49.479645  5794 ts_tablet_manager.cc:1403] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.024s
I20260709 12:12:49.481747  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:49.482453  5603 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.483335  5795 tablet_bootstrap.cc:654] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.482311  5794 raft_consensus.cc:359] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.484604  5794 raft_consensus.cc:385] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.484871  5794 raft_consensus.cc:740] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.486490  5794 consensus_queue.cc:260] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.488534  5794 ts_tablet_manager.cc:1434] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:12:49.486595  5860 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.489377  5794 tablet_bootstrap.cc:492] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:49.493795  5603 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:49.494616  5793 tablet_bootstrap.cc:492] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:49.495100  5793 ts_tablet_manager.cc:1403] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.009s
I20260709 12:12:49.496613  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:49.499143  5750 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.500428  5794 tablet_bootstrap.cc:654] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.499374  5793 raft_consensus.cc:359] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.502669  5793 raft_consensus.cc:385] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.500476  5499 catalog_manager.cc:5697] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.503042  5793 raft_consensus.cc:740] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.503850  5793 consensus_queue.cc:260] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.505820  5793 ts_tablet_manager.cc:1434] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:49.497635  5642 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:49.506699  5793 tablet_bootstrap.cc:492] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:49.506927  5750 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:49.507022  5908 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.507630  5908 raft_consensus.cc:697] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:49.508415  5908 consensus_queue.cc:237] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.509811  5795 tablet_bootstrap.cc:492] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.510257  5795 ts_tablet_manager.cc:1403] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.005s
I20260709 12:12:49.512760  5795 raft_consensus.cc:359] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.513440  5795 raft_consensus.cc:385] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.513712  5795 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.514377  5795 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.516611  5795 ts_tablet_manager.cc:1434] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:49.517488  5795 tablet_bootstrap.cc:492] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.522118  5793 tablet_bootstrap.cc:654] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.529165  5795 tablet_bootstrap.cc:654] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.540709  5604 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.543227  5793 tablet_bootstrap.cc:492] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:49.543691  5793 ts_tablet_manager.cc:1403] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.007s
I20260709 12:12:49.546308  5793 raft_consensus.cc:359] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.546693  5794 tablet_bootstrap.cc:492] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:49.547734  5794 ts_tablet_manager.cc:1403] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.001s
I20260709 12:12:49.546993  5793 raft_consensus.cc:385] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.549921  5793 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.550690  5793 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.552862  5793 ts_tablet_manager.cc:1434] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:49.553992  5860 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.554548  5860 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.556121  5795 tablet_bootstrap.cc:492] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.556499  5795 ts_tablet_manager.cc:1403] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.007s
I20260709 12:12:49.556653  5860 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.558198  5860 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:49.560230  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.557423  5794 raft_consensus.cc:359] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.561112  5794 raft_consensus.cc:385] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.559036  5795 raft_consensus.cc:359] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.562510  5795 raft_consensus.cc:385] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.562726  5793 tablet_bootstrap.cc:492] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:49.562870  5795 raft_consensus.cc:740] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.563532  5795 consensus_queue.cc:260] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.565671  5795 ts_tablet_manager.cc:1434] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:49.567094  5795 tablet_bootstrap.cc:492] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.559098  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.568951  5604 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:49.561389  5794 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.569887  5794 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:49.571954  5642 leader_election.cc:343] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.572278  5794 ts_tablet_manager.cc:1434] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:12:49.572625  5795 tablet_bootstrap.cc:654] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.573179  5794 tablet_bootstrap.cc:492] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:49.578999  5794 tablet_bootstrap.cc:654] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.569101  5793 tablet_bootstrap.cc:654] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.582346  5795 tablet_bootstrap.cc:492] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.582716  5795 ts_tablet_manager.cc:1403] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.007s
I20260709 12:12:49.570955  5500 catalog_manager.cc:5697] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.590036  5795 raft_consensus.cc:359] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.591521  5795 raft_consensus.cc:385] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.591837  5795 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.590375  5642 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:12:49.592624  5795 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.593918  5793 tablet_bootstrap.cc:492] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:49.594102  5860 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.594357  5793 ts_tablet_manager.cc:1403] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.003s
I20260709 12:12:49.595182  5795 ts_tablet_manager.cc:1434] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:12:49.595757  5966 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.596024  5795 tablet_bootstrap.cc:492] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.596257  5966 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.596699  5860 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.597121  5860 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.602415  5793 raft_consensus.cc:359] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.603046  5966 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.603166  5793 raft_consensus.cc:385] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.603533  5793 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.604310  5793 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.606300  5793 ts_tablet_manager.cc:1434] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.004s
I20260709 12:12:49.606700  5795 tablet_bootstrap.cc:654] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.607133  5793 tablet_bootstrap.cc:492] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:49.612397  5814 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.612890  5814 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.614787  5814 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.616720  5793 tablet_bootstrap.cc:654] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.618120  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.620297  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.620754  5812 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.592625  5794 tablet_bootstrap.cc:492] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:49.621325  5812 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.622155  5794 ts_tablet_manager.cc:1403] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.003s
I20260709 12:12:49.623656  5812 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:49.625095  5794 raft_consensus.cc:359] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.626179  5939 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.626714  5939 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.626984  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.628944  5939 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.629719  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.630216  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:49.631294  5569 leader_election.cc:343] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:49.631630  5718 leader_election.cc:343] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.632079  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.632745  5750 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:49.635546  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.636145  5604 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:49.636873  5567 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:49.637276  5716 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:49.639016  5831 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.639143  5812 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.639449  5831 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.639846  5831 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.640268  5812 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.640672  5812 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.653925  5939 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.656064  5831 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.660849  5860 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.662824  5812 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.665668  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:12:49.667428  5569 leader_election.cc:343] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.669438  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:49.670327  5602 raft_consensus.cc:2393] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 1: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:12:49.673056  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.677983  5831 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.680454  5860 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.686689  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:49.687589  5752 raft_consensus.cc:2393] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:49.691807  5567 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:49.693148  5831 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:12:49.696919  5550 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:12:49.697820  5642 leader_election.cc:343] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.697682  5860 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:49.698482  5642 leader_election.cc:343] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:49.699319  5642 leader_election.cc:343] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.699652  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:49.700191  5860 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:49.700505  5642 leader_election.cc:343] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.700889  5642 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:49.712989  5860 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.708102  5794 raft_consensus.cc:385] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.709980  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:12:49.714705  5718 leader_election.cc:343] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.715122  5718 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:49.715883  5887 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.716398  5794 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.717013  5812 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:49.717916  5794 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.719907  5794 ts_tablet_manager.cc:1434] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.000s
I20260709 12:12:49.720706  5794 tablet_bootstrap.cc:492] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:49.725142  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:49.725845  5604 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.725854  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:49.727129  5899 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:12:49.729780  5812 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.730365  5812 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.733378  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.734047  5678 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:49.734978  5604 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:49.735152  5718 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:49.736004  5887 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.736325  5887 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.736626  5887 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.745524  5795 tablet_bootstrap.cc:492] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.746068  5795 ts_tablet_manager.cc:1403] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.150s	user 0.049s	sys 0.063s
I20260709 12:12:49.747649  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.748306  5604 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:49.748594  5795 raft_consensus.cc:359] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.749218  5795 raft_consensus.cc:385] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.752954  5795 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.755568  5795 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.740094  5812 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:49.757114  5860 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.761444  5860 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.763365  5642 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:49.764135  5814 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.765336  5814 raft_consensus.cc:697] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:49.766219  5814 consensus_queue.cc:237] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.766237  5831 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.767041  5795 ts_tablet_manager.cc:1434] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 12:12:49.769191  5795 tablet_bootstrap.cc:492] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.769394  5831 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.771621  5831 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.772564  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.764394  5860 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.791538  5795 tablet_bootstrap.cc:654] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:49.789968  5642 leader_election.cc:343] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.794646  5793 tablet_bootstrap.cc:492] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:49.795408  5793 ts_tablet_manager.cc:1403] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.188s	user 0.044s	sys 0.082s
W20260709 12:12:49.794798  5569 leader_election.cc:343] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.796818  5677 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.799232  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.799913  5604 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:49.803922  5793 raft_consensus.cc:359] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.804593  5793 raft_consensus.cc:385] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.804838  5793 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.799857  5887 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.806034  5793 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.813078  5794 tablet_bootstrap.cc:654] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.815291  5887 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:49.815697  5793 ts_tablet_manager.cc:1434] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:12:49.816733  5793 tablet_bootstrap.cc:492] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:49.818034  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:49.818269  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.819063  5678 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.820055  5841 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:49.827661  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:12:49.833575  5642 leader_election.cc:343] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.834014  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:49.834440  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:12:49.834609  5602 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.838963  5795 tablet_bootstrap.cc:492] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:49.838503  5860 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.839423  5795 ts_tablet_manager.cc:1403] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.014s
I20260709 12:12:49.839469  5860 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.841048  5860 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.842617  5795 raft_consensus.cc:359] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.828320  5887 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:49.843287  5795 raft_consensus.cc:385] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.843621  5795 raft_consensus.cc:740] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.832938  5814 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.846131  5679 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.853675  5899 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.860837  5899 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.854358  5831 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.854123  5795 consensus_queue.cc:260] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:49.857414  5567 leader_election.cc:343] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.864385  5567 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:49.865170  5900 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.866184  5795 ts_tablet_manager.cc:1434] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:12:49.867143  5795 tablet_bootstrap.cc:492] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:49.862584  5814 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.868287  5831 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.874886  5794 tablet_bootstrap.cc:492] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:49.875362  5794 ts_tablet_manager.cc:1403] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.005s
I20260709 12:12:49.876685  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.877377  5676 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:49.873662  5899 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.878298  5795 tablet_bootstrap.cc:654] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.878368  5794 raft_consensus.cc:359] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.878687  5569 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:49.879117  5794 raft_consensus.cc:385] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.879395  5794 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.880026  5794 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.883409  5899 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.883822  5899 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.884177  5899 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.884441  5814 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.885098  5794 ts_tablet_manager.cc:1434] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:49.902588  5794 tablet_bootstrap.cc:492] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:49.908171  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.916137  5793 tablet_bootstrap.cc:654] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.908171  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.921164  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.922330  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.922966  5676 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:49.915077  5860 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.924861  5569 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:12:49.924995  5567 consensus_peers.cc:597] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.925724  5900 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.925949  5860 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.926141  5900 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.926479  5900 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.919042  5602 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:49.919760  5753 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:49.932415  5841 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.932866  5841 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.935583  5831 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.936087  5841 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:49.938030  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:49.938651  5676 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:49.939778  5718 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:49.940722  5841 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.941146  5841 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.941485  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:49.941601  5841 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.942225  5678 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:49.942566  5831 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.944070  5642 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:49.944402  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:49.939898  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:49.945627  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:49.945163  5601 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.951867  5860 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:49.952991  5718 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:49.941505  5899 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.964885  5794 tablet_bootstrap.cc:654] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.965627  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:49.966252  5678 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.967288  5982 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.964893  5899 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:49.970887  5982 raft_consensus.cc:697] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:49.986333  5982 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:49.988344  5678 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
W20260709 12:12:49.988734  5642 leader_election.cc:343] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.989452  5569 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:49.990307  5899 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.990958  5899 raft_consensus.cc:697] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:49.992018  5601 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:49.991771  5899 consensus_queue.cc:237] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.017098  5831 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.017664  5831 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.023684  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:12:50.024618  5860 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.025115  5860 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:50.026077  5860 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.076223  5900 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.121037  5603 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 1: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:12:50.128971  5986 log.cc:927] Time spent T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:12:50.158130  5900 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:50.076864  5841 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.202996  5753 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:50.257543  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:50.269299  5841 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:50.270576  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:50.271329  5678 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.318639  5795 tablet_bootstrap.cc:492] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:50.320163  5795 ts_tablet_manager.cc:1403] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.453s	user 0.050s	sys 0.071s
I20260709 12:12:50.323758  5795 raft_consensus.cc:359] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.324311  5795 raft_consensus.cc:385] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.330399  5795 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.331195  5795 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.319080  5831 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:50.325076  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:50.338837  5795 ts_tablet_manager.cc:1434] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.008s
W20260709 12:12:50.318229  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 270593us
I20260709 12:12:50.353631  5795 tablet_bootstrap.cc:492] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:50.364293  5793 tablet_bootstrap.cc:492] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:50.364758  5793 ts_tablet_manager.cc:1403] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.548s	user 0.026s	sys 0.022s
I20260709 12:12:50.362439  5749 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:50.367843  5678 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:50.365747  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:50.370481  5567 leader_election.cc:343] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.383265  5793 raft_consensus.cc:359] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.383982  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:50.384160  5793 raft_consensus.cc:385] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.383486  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:50.385237  5679 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:50.384725  5604 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 1: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:12:50.384485  5793 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.379961  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:50.387372  5750 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.386456  5793 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.394255  5500 catalog_manager.cc:5697] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.402457  5793 ts_tablet_manager.cc:1434] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 12:12:50.417493  5793 tablet_bootstrap.cc:492] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Bootstrap starting.
W20260709 12:12:50.399048  5992 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:50.427387  5795 tablet_bootstrap.cc:654] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.400460  5887 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.399075  5966 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.431576  5966 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:50.434022  5991 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:50.437458  5966 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:12:50.429785  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 68027.2us
I20260709 12:12:50.431720  5887 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.450212  5939 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:50.450639  5569 leader_election.cc:343] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.450006  5794 tablet_bootstrap.cc:492] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:50.451607  5794 ts_tablet_manager.cc:1403] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.549s	user 0.023s	sys 0.035s
I20260709 12:12:50.451067  5569 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:50.454779  5899 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.460466  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:50.497282  5795 tablet_bootstrap.cc:492] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:50.499568  5795 ts_tablet_manager.cc:1403] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.007s
I20260709 12:12:50.499348  5794 raft_consensus.cc:359] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.501129  5794 raft_consensus.cc:385] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.501367  5794 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.501938  5794 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.457916  5993 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 12:12:50.510072  5793 tablet_bootstrap.cc:654] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.511305  5794 ts_tablet_manager.cc:1434] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.003s
I20260709 12:12:50.512077  5750 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:50.462353  5569 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:50.505923  5887 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:50.518811  5794 tablet_bootstrap.cc:492] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:50.520200  5939 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:12:50.521093  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 59518.9us
I20260709 12:12:50.523187  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:50.519587  5795 raft_consensus.cc:359] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.525935  5795 raft_consensus.cc:385] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.526264  5795 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.530900  5860 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.531606  5909 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.528563  5795 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.527284  5498 catalog_manager.cc:5697] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.540449  5718 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:50.541694  5887 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.542214  5887 raft_consensus.cc:697] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:50.542999  5887 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.546435  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:50.547106  5598 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:50.552212  5795 ts_tablet_manager.cc:1434] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:12:50.554164  5795 tablet_bootstrap.cc:492] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:50.558533  5793 tablet_bootstrap.cc:492] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:50.559038  5793 ts_tablet_manager.cc:1403] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.142s	user 0.007s	sys 0.014s
I20260709 12:12:50.566046  5499 catalog_manager.cc:5697] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.571249  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:50.572059  5676 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:50.569538  5793 raft_consensus.cc:359] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.577358  5793 raft_consensus.cc:385] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.577644  5793 raft_consensus.cc:740] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.579615  5793 consensus_queue.cc:260] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.579830  5716 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:50.581919  5998 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.582302  5998 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.582602  5998 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.590720  5793 ts_tablet_manager.cc:1434] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:12:50.591512  5793 tablet_bootstrap.cc:492] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:50.594575  5939 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:50.599704  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 48635.3us
W20260709 12:12:50.601269  5642 consensus_peers.cc:597] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.601053  5814 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.602630  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:50.605579  6008 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:50.613687  5642 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.610107  5998 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.619458  5998 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:50.620302  6008 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:50.625265  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:50.626202  5601 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.630491  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:50.634362  5676 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.641010  5794 tablet_bootstrap.cc:654] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.658957  5795 tablet_bootstrap.cc:654] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.660844  5993 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.664469  5793 tablet_bootstrap.cc:654] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.677174  5676 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:50.678925  5601 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:50.682749  5718 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:50.684069  5998 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.684567  5998 raft_consensus.cc:697] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:50.688807  5998 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.728003  5794 tablet_bootstrap.cc:492] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:50.728492  5794 ts_tablet_manager.cc:1403] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.214s	user 0.017s	sys 0.015s
I20260709 12:12:50.720202  5812 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.732858  5795 tablet_bootstrap.cc:492] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:50.733314  5795 ts_tablet_manager.cc:1403] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.179s	user 0.006s	sys 0.007s
I20260709 12:12:50.735611  5793 tablet_bootstrap.cc:492] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:50.736060  5793 ts_tablet_manager.cc:1403] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.145s	user 0.023s	sys 0.017s
I20260709 12:12:50.738837  5793 raft_consensus.cc:359] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.739437  5793 raft_consensus.cc:385] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.739696  5793 raft_consensus.cc:740] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.736194  5997 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:12:50.742542  5793 consensus_queue.cc:260] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.729100  5812 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.747363  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:50.748126  5601 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:50.758359  5716 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:50.773214  5887 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.782907  5887 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.783317  5887 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.774015  5812 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:50.791787  5793 ts_tablet_manager.cc:1434] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.012s
I20260709 12:12:50.792832  5793 tablet_bootstrap.cc:492] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:50.788512  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:50.794490  5677 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:50.795089  5795 raft_consensus.cc:359] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.795948  5795 raft_consensus.cc:385] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.796160  5795 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.747493  5498 catalog_manager.cc:5697] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.799605  5794 raft_consensus.cc:359] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.800307  5794 raft_consensus.cc:385] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.800570  5794 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.801496  5793 tablet_bootstrap.cc:654] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.801211  5794 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.803277  5794 ts_tablet_manager.cc:1434] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 12:12:50.804085  5794 tablet_bootstrap.cc:492] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:50.807579  5795 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.833400  5993 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.833528  5998 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.834079  5993 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:50.835929  5550 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:50.837183  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:50.837795  5993 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:50.838346  5793 tablet_bootstrap.cc:492] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
W20260709 12:12:50.838617  5567 leader_election.cc:343] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.839951  5794 tablet_bootstrap.cc:654] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.838785  5793 ts_tablet_manager.cc:1403] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.012s
I20260709 12:12:50.838800  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:50.844497  5793 raft_consensus.cc:359] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.845204  5793 raft_consensus.cc:385] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.845471  5793 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
W20260709 12:12:50.844514  5569 leader_election.cc:343] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.850320  5569 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:50.850675  5793 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.795423  5887 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.856904  5887 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:50.858728  5793 ts_tablet_manager.cc:1434] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:12:50.859612  5793 tablet_bootstrap.cc:492] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:50.860294  5795 ts_tablet_manager.cc:1434] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.127s	user 0.003s	sys 0.010s
I20260709 12:12:50.861436  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:50.862059  5598 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.858572  5993 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.864661  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:50.865927  5795 tablet_bootstrap.cc:492] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:50.867319  6008 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.867782  6008 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.866429  5679 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.869726  6008 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:50.874725  5598 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:50.876108  5716 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:50.876749  5812 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.877219  5812 raft_consensus.cc:697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:50.878049  5812 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.878749  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:50.879709  5752 raft_consensus.cc:2393] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:50.888854  5499 catalog_manager.cc:5697] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.892779  5499 catalog_manager.cc:5697] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.889588  5679 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:50.895470  5794 tablet_bootstrap.cc:492] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:50.895989  5794 ts_tablet_manager.cc:1403] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.004s
I20260709 12:12:50.897306  5795 tablet_bootstrap.cc:654] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.898605  5794 raft_consensus.cc:359] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.899327  5794 raft_consensus.cc:385] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.899631  5794 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.900326  5794 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.907793  5794 ts_tablet_manager.cc:1434] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:12:50.908783  5794 tablet_bootstrap.cc:492] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:50.908892  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:50.909741  5598 raft_consensus.cc:2393] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 1: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:12:50.914960  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:50.915776  6008 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.928468  6008 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.940682  5793 tablet_bootstrap.cc:654] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.947918  5795 tablet_bootstrap.cc:492] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:50.948467  5795 ts_tablet_manager.cc:1403] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.003s
I20260709 12:12:50.952199  5794 tablet_bootstrap.cc:654] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.960374  5793 tablet_bootstrap.cc:492] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:50.960863  5793 ts_tablet_manager.cc:1403] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.011s
I20260709 12:12:50.967526  5812 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:50.969296  6008 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.969957  6008 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.972087  6008 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:50.974164  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:12:50.976044  5642 leader_election.cc:343] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.978055  5794 tablet_bootstrap.cc:492] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:50.978509  5794 ts_tablet_manager.cc:1403] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.004s
I20260709 12:12:50.980466  5795 raft_consensus.cc:359] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.980878  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:50.981181  5795 raft_consensus.cc:385] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.981453  5795 raft_consensus.cc:740] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.981472  5597 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:50.982262  5795 consensus_queue.cc:260] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.982702  5794 raft_consensus.cc:359] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.983412  5794 raft_consensus.cc:385] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.983696  5794 raft_consensus.cc:740] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.984361  5795 ts_tablet_manager.cc:1434] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.013s
I20260709 12:12:50.982911  5642 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:12:50.985427  5793 raft_consensus.cc:359] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.985920  5795 tablet_bootstrap.cc:492] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:50.985869  6012 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.986447  6012 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.984414  5794 consensus_queue.cc:260] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:50.986788  6012 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.988236  5794 ts_tablet_manager.cc:1434] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:12:50.989188  5794 tablet_bootstrap.cc:492] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:50.989892  5793 raft_consensus.cc:385] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.990176  5793 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.997227  6012 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.000471  5795 tablet_bootstrap.cc:654] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.002844  6012 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.001011  5794 tablet_bootstrap.cc:654] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.000777  5793 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.005085  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:51.005504  5793 ts_tablet_manager.cc:1434] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.012s
I20260709 12:12:51.003523  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:51.006461  5793 tablet_bootstrap.cc:492] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:51.006512  5597 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.007477  5500 catalog_manager.cc:5697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:51.010484  5642 leader_election.cc:343] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.023290  5597 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:51.024513  5642 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:12:51.025417  6012 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.025959  6012 raft_consensus.cc:697] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:51.026788  6012 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.036530  5794 tablet_bootstrap.cc:492] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.037088  5794 ts_tablet_manager.cc:1403] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.012s
I20260709 12:12:51.039709  5794 raft_consensus.cc:359] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.040398  5794 raft_consensus.cc:385] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.040650  5794 raft_consensus.cc:740] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.040992  5793 tablet_bootstrap.cc:654] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.041290  5794 consensus_queue.cc:260] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.043486  5794 ts_tablet_manager.cc:1434] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:12:51.044405  5794 tablet_bootstrap.cc:492] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.053366  5996 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.055203  5795 tablet_bootstrap.cc:492] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:51.055701  5795 ts_tablet_manager.cc:1403] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.004s
I20260709 12:12:51.057967  5794 tablet_bootstrap.cc:654] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.063774  5795 raft_consensus.cc:359] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.064558  5795 raft_consensus.cc:385] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.064823  5795 raft_consensus.cc:740] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.068838  5794 tablet_bootstrap.cc:492] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.069305  5794 ts_tablet_manager.cc:1403] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.025s	user 0.002s	sys 0.013s
I20260709 12:12:51.065649  5795 consensus_queue.cc:260] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.071911  5794 raft_consensus.cc:359] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.072559  5794 raft_consensus.cc:385] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.072821  5794 raft_consensus.cc:740] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.073452  5794 consensus_queue.cc:260] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.074101  5795 ts_tablet_manager.cc:1434] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:12:51.075001  5795 tablet_bootstrap.cc:492] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:51.076079  5794 ts_tablet_manager.cc:1434] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:51.077716  5794 tablet_bootstrap.cc:492] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.078853  5887 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.087308  5794 tablet_bootstrap.cc:654] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.093026  5498 catalog_manager.cc:5697] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.095213  5793 tablet_bootstrap.cc:492] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:51.095667  5793 ts_tablet_manager.cc:1403] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.008s
I20260709 12:12:51.098134  5793 raft_consensus.cc:359] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.098762  5793 raft_consensus.cc:385] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.099018  5793 raft_consensus.cc:740] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.099067  5795 tablet_bootstrap.cc:654] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.099805  5793 consensus_queue.cc:260] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.104535  5752 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.111382  5794 tablet_bootstrap.cc:492] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.111858  5794 ts_tablet_manager.cc:1403] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.003s
I20260709 12:12:51.112154  5793 ts_tablet_manager.cc:1434] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 12:12:51.114651  5794 raft_consensus.cc:359] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.115403  5794 raft_consensus.cc:385] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.115674  5794 raft_consensus.cc:740] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.116374  5794 consensus_queue.cc:260] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.117961  5794 ts_tablet_manager.cc:1434] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:12:51.121621  5812 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.122824  5793 tablet_bootstrap.cc:492] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:51.132469  6012 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.132767  5794 tablet_bootstrap.cc:492] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.132994  6012 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.135699  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:51.136318  5597 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:51.136641  6012 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.137499  5642 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:51.137728  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:51.138298  6012 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.138499  5750 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:51.138677  6012 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.139040  6012 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.139408  5794 tablet_bootstrap.cc:654] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.145663  6012 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.148276  5793 tablet_bootstrap.cc:654] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.150503  5794 tablet_bootstrap.cc:492] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.150285  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:51.150964  5597 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.152237  5795 tablet_bootstrap.cc:492] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:51.152671  5795 ts_tablet_manager.cc:1403] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.010s
I20260709 12:12:51.155990  5794 ts_tablet_manager.cc:1403] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.008s
I20260709 12:12:51.159142  5795 raft_consensus.cc:359] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.159786  5795 raft_consensus.cc:385] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.160100  5795 raft_consensus.cc:740] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.160694  5795 consensus_queue.cc:260] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.161056  5794 raft_consensus.cc:359] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.161628  5794 raft_consensus.cc:385] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.161916  6012 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.159703  5597 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:51.161931  5794 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.162834  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:51.163087  5642 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:51.163399  5752 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.163232  5794 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.163861  6012 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.164284  6012 raft_consensus.cc:697] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:51.165000  6012 consensus_queue.cc:237] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.168790  5794 ts_tablet_manager.cc:1434] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:12:51.169317  5795 ts_tablet_manager.cc:1434] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:12:51.169592  5794 tablet_bootstrap.cc:492] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.170140  5795 tablet_bootstrap.cc:492] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:51.170149  5752 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:51.174368  5793 tablet_bootstrap.cc:492] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:51.174786  5793 ts_tablet_manager.cc:1403] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.010s
I20260709 12:12:51.176198  5795 tablet_bootstrap.cc:654] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.177264  5793 raft_consensus.cc:359] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.177899  5793 raft_consensus.cc:385] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.178158  5793 raft_consensus.cc:740] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.178929  5793 consensus_queue.cc:260] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.179896  5794 tablet_bootstrap.cc:654] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.185068  5793 ts_tablet_manager.cc:1434] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:51.185956  5793 tablet_bootstrap.cc:492] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:51.190451  5909 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.190960  5909 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.192185  5794 tablet_bootstrap.cc:492] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.192674  5794 ts_tablet_manager.cc:1403] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.010s
I20260709 12:12:51.192917  5909 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.195147  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:51.195274  5794 raft_consensus.cc:359] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.195768  5597 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:51.196066  5794 raft_consensus.cc:385] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.196376  5794 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.197126  5794 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.201692  5996 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.202170  5996 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.203284  5794 ts_tablet_manager.cc:1434] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:12:51.203706  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:51.204381  5794 tablet_bootstrap.cc:492] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.205305  6008 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.205768  6008 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.207533  6008 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.209303  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:51.209544  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:51.210664  5794 tablet_bootstrap.cc:654] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.210039  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:51.204327  5752 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:51.215969  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:51.217118  5812 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.219812  5500 catalog_manager.cc:5697] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.221824  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:51.222023  6012 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.204249  5996 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:51.222411  6012 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.222805  6012 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.223233  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:51.223865  5597 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:51.225930  5794 tablet_bootstrap.cc:492] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.226346  5794 ts_tablet_manager.cc:1403] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 12:12:51.228680  5794 raft_consensus.cc:359] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.229274  5794 raft_consensus.cc:385] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.229514  5794 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.230288  5794 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.230379  6012 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.232504  5794 ts_tablet_manager.cc:1434] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:51.233209  6012 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.233345  5794 tablet_bootstrap.cc:492] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.235455  5793 tablet_bootstrap.cc:654] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.239149  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:51.239419  5794 tablet_bootstrap.cc:654] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.240823  6012 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:51.240940  5642 leader_election.cc:343] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.241183  6012 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.241515  6012 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.247550  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:51.248633  5597 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.252102  6012 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.254848  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:51.254984  6012 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.255434  5598 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.256254  5793 tablet_bootstrap.cc:492] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:51.257778  5793 ts_tablet_manager.cc:1403] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.072s	user 0.002s	sys 0.009s
I20260709 12:12:51.256611  5795 tablet_bootstrap.cc:492] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:51.258606  5795 ts_tablet_manager.cc:1403] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.089s	user 0.022s	sys 0.025s
I20260709 12:12:51.260975  5794 tablet_bootstrap.cc:492] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.261464  5794 ts_tablet_manager.cc:1403] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.003s
I20260709 12:12:51.261806  5795 raft_consensus.cc:359] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.262481  5795 raft_consensus.cc:385] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.262727  5795 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.262909  5996 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.263347  5996 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.263386  5795 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.264168  5794 raft_consensus.cc:359] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.264827  5794 raft_consensus.cc:385] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.265074  5794 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.265471  5795 ts_tablet_manager.cc:1434] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:12:51.265673  5794 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.268010  5793 raft_consensus.cc:359] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.268656  5793 raft_consensus.cc:385] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.268906  5793 raft_consensus.cc:740] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.269019  5794 ts_tablet_manager.cc:1434] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:51.269959  5794 tablet_bootstrap.cc:492] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.270694  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:51.271543  5602 raft_consensus.cc:2393] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 1: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:12:51.273703  5993 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.274037  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:51.274317  5993 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.275697  5794 tablet_bootstrap.cc:654] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.276499  5993 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.269544  5793 consensus_queue.cc:260] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.277545  5812 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.278103  5812 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.279376  5793 ts_tablet_manager.cc:1434] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:12:51.280944  5793 tablet_bootstrap.cc:492] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:51.281333  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:51.282178  5794 tablet_bootstrap.cc:492] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.282593  5794 ts_tablet_manager.cc:1403] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:12:51.283703  6012 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.284256  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:51.284181  6012 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.284878  5676 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:51.286317  6012 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.287693  5793 tablet_bootstrap.cc:654] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.288305  5794 raft_consensus.cc:359] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.290284  5794 raft_consensus.cc:385] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.290205  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:51.290603  5794 raft_consensus.cc:740] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.291287  5794 consensus_queue.cc:260] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.291193  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:51.293198  5752 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:51.293490  5794 ts_tablet_manager.cc:1434] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:12:51.294574  5794 tablet_bootstrap.cc:492] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.295603  5716 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:51.296335  5997 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.298182  5795 tablet_bootstrap.cc:492] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:51.298411  5567 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:51.299127  5899 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:51.299453  5899 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.299751  5899 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.300316  5794 tablet_bootstrap.cc:654] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.302026  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:51.302675  5602 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:51.265421  5996 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:51.305992  5899 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.310513  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:51.311125  5752 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.316145  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:51.316852  5751 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:51.318164  5795 tablet_bootstrap.cc:654] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.319157  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:51.319304  5899 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.319962  6012 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.320297  6012 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.320649  6012 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.327136  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:51.330462  5795 tablet_bootstrap.cc:492] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:51.332675  5795 ts_tablet_manager.cc:1403] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.008s
I20260709 12:12:51.336385  5795 raft_consensus.cc:359] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.337005  5795 raft_consensus.cc:385] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.337284  5795 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.342758  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:51.343590  5676 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.347956  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:51.349817  5997 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.358126  5812 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:51.362041  5598 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
W20260709 12:12:51.367138  5642 leader_election.cc:343] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.385471  5753 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.385751  6012 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.388171  6012 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.414940  5997 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.405675  5752 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:51.424441  5794 tablet_bootstrap.cc:492] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.424973  5794 ts_tablet_manager.cc:1403] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.131s	user 0.056s	sys 0.046s
I20260709 12:12:51.427542  5794 raft_consensus.cc:359] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.428449  5794 raft_consensus.cc:385] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.428856  5793 tablet_bootstrap.cc:492] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:51.428709  5794 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.429298  5793 ts_tablet_manager.cc:1403] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.149s	user 0.027s	sys 0.066s
I20260709 12:12:51.429513  5794 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.432281  5794 ts_tablet_manager.cc:1434] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:51.433223  5794 tablet_bootstrap.cc:492] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.437484  5793 raft_consensus.cc:359] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.438153  5793 raft_consensus.cc:385] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.438501  5794 tablet_bootstrap.cc:654] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.438416  5793 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.439159  5793 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.441249  5793 ts_tablet_manager.cc:1434] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 12:12:51.442262  5793 tablet_bootstrap.cc:492] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:51.446477  5794 tablet_bootstrap.cc:492] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.447063  5794 ts_tablet_manager.cc:1403] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:12:51.447824  5793 tablet_bootstrap.cc:654] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.455705  5794 raft_consensus.cc:359] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.456430  5794 raft_consensus.cc:385] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.456753  5794 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.457311  5794 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.459244  5794 ts_tablet_manager.cc:1434] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:12:51.459964  5794 tablet_bootstrap.cc:492] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.462138  5793 tablet_bootstrap.cc:492] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:51.462608  5793 ts_tablet_manager.cc:1403] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 12:12:51.465188  5794 tablet_bootstrap.cc:654] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.465194  5793 raft_consensus.cc:359] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.466002  5793 raft_consensus.cc:385] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.466269  5793 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.466920  5793 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.469044  5793 ts_tablet_manager.cc:1434] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:51.469728  5794 tablet_bootstrap.cc:492] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.469991  5793 tablet_bootstrap.cc:492] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:51.470240  5794 ts_tablet_manager.cc:1403] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 12:12:51.472887  5794 raft_consensus.cc:359] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.473599  5794 raft_consensus.cc:385] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.473908  5794 raft_consensus.cc:740] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.474602  5794 consensus_queue.cc:260] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.476647  5793 tablet_bootstrap.cc:654] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.477329  5794 ts_tablet_manager.cc:1434] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:51.478331  5794 tablet_bootstrap.cc:492] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.490751  5794 tablet_bootstrap.cc:654] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.503190  5996 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.503865  5996 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.506019  5996 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:51.555986  6012 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.556612  6012 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.563002  6012 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.594952  5997 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.595567  5997 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.598763  5997 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:51.602279  5676 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:12:51.602649  5997 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.604966  5794 tablet_bootstrap.cc:492] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.604686  5997 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.605435  5794 ts_tablet_manager.cc:1403] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.127s	user 0.033s	sys 0.065s
I20260709 12:12:51.606778  5997 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:51.609678  5794 raft_consensus.cc:359] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.610865  5794 raft_consensus.cc:385] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.611152  5794 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.611786  5794 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.613798  5794 ts_tablet_manager.cc:1434] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:51.614601  5794 tablet_bootstrap.cc:492] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.620105  5794 tablet_bootstrap.cc:654] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.623947  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:51.624580  5752 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.624867  5794 tablet_bootstrap.cc:492] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.625294  5794 ts_tablet_manager.cc:1403] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:12:51.627997  5794 raft_consensus.cc:359] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.628634  5794 raft_consensus.cc:385] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.628875  5794 raft_consensus.cc:740] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.629181  5887 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.629431  5794 consensus_queue.cc:260] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.629716  5887 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.631162  5752 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:51.631630  5794 ts_tablet_manager.cc:1434] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:51.631677  5887 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:51.633680  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:51.634310  5794 tablet_bootstrap.cc:492] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.634867  6067 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.635303  6067 raft_consensus.cc:697] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:51.635777  5793 tablet_bootstrap.cc:492] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:51.636183  5793 ts_tablet_manager.cc:1403] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.005s
I20260709 12:12:51.636030  6067 consensus_queue.cc:237] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.638585  6012 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.638649  5793 raft_consensus.cc:359] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.639575  5793 raft_consensus.cc:385] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.639926  5793 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.640551  5794 tablet_bootstrap.cc:654] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.640594  5793 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.643386  5795 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.645540  5793 ts_tablet_manager.cc:1434] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:51.646689  5793 tablet_bootstrap.cc:492] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:51.651067  5887 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.651609  5887 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.654820  5887 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:51.655608  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:51.656352  5748 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:51.658607  5793 tablet_bootstrap.cc:654] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.668111  5794 tablet_bootstrap.cc:492] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.668566  5794 ts_tablet_manager.cc:1403] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.013s
I20260709 12:12:51.669029  5793 tablet_bootstrap.cc:492] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:51.669385  5793 ts_tablet_manager.cc:1403] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:12:51.670984  5794 raft_consensus.cc:359] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.671649  5794 raft_consensus.cc:385] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.671906  5794 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.674412  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:51.676110  6067 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.676759  6067 raft_consensus.cc:697] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:51.676208  5642 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:51.677512  6065 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.677977  6065 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.678330  6065 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.677639  6067 consensus_queue.cc:237] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.685081  6065 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.687162  6065 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.691417  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:51.692124  5748 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.699311  5748 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:51.701476  5642 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:51.702333  6065 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.702840  6065 raft_consensus.cc:697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:51.703711  6065 consensus_queue.cc:237] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.715595  5812 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.716150  5812 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.722365  5812 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:51.725790  5597 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:51.729888  6065 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.730839  6065 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.734297  6065 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.734562  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:51.735018  6065 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.735165  5746 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:51.738363  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:51.738974  5751 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.750746  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:51.755020  6008 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.755453  6008 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.755769  6008 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.755692  5794 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.757258  5794 ts_tablet_manager.cc:1434] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.000s
I20260709 12:12:51.760977  5996 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.761432  5996 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.764711  5996 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:51.776733  6008 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.771458  5751 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:12:51.778241  5794 tablet_bootstrap.cc:492] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.783382  5751 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.784945  5794 tablet_bootstrap.cc:654] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.786091  6008 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.787348  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:51.787489  5793 raft_consensus.cc:359] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.788283  5793 raft_consensus.cc:385] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.788570  5793 raft_consensus.cc:740] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.793833  5993 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.794401  5993 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.796362  5993 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.798657  5899 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.799067  5899 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.799801  5794 tablet_bootstrap.cc:492] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:51.800227  5794 ts_tablet_manager.cc:1403] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.010s
I20260709 12:12:51.800874  5899 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:51.802805  5794 raft_consensus.cc:359] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.803462  5794 raft_consensus.cc:385] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.803741  5794 raft_consensus.cc:740] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.787967  5746 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.813133  5794 consensus_queue.cc:260] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.789273  5793 consensus_queue.cc:260] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.844034  5794 ts_tablet_manager.cc:1434] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 12:12:51.845736  5794 tablet_bootstrap.cc:492] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:51.848678  5793 ts_tablet_manager.cc:1434] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.179s	user 0.005s	sys 0.005s
I20260709 12:12:51.849587  5793 tablet_bootstrap.cc:492] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c: Bootstrap starting.
W20260709 12:12:51.875316  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 511462us
I20260709 12:12:51.876323  5569 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:51.879208  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:51.880139  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:51.880841  5795 ts_tablet_manager.cc:1434] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.548s	user 0.011s	sys 0.000s
W20260709 12:12:51.881143  5795 ts_tablet_manager.cc:1467] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Tablet startup took 548ms
I20260709 12:12:51.881404  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:51.882010  5677 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:51.882102  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:51.883136  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:12:51.886914  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:51.887290  5909 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.888933  5909 raft_consensus.cc:697] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:51.889812  5909 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:51.881425  5795 ts_tablet_manager.cc:1469] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Trace:
0709 12:12:46.996859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.996963 (+   104us) service_pool.cc:224] Handling call
0709 12:12:46.998656 (+  1693us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:12:46.998747 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:12:47.067614 (+ 68867us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:47.166588 (+ 98974us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:47.167052 (+   464us) inbound_call.cc:177] Queueing success response
0709 12:12:51.297370 (+4130318us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:12:51.332950 (+ 35580us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:12:51.333431 (+   481us) tablet_replica.cc:261] Starting instrumentation
0709 12:12:51.335129 (+  1698us) tablet_replica.cc:280] Starting consensus
0709 12:12:51.643093 (+307964us) spinlock_profiling.cc:243] Waited 93.7 ms on lock 0x7b4c00258080. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fbd17a20 00007f44fbd28a29 00007f44fbcee644 00007f44fbd15f2d 00007f44fbd15b93 00007f44fda4618b 00007f44fda46cb5 00007f44fda41f30 00007f44fda40c40 00007f450143db2e 00007f4502a5fd8a
Metrics: {"mutex_wait_us":235795,"raft.queue_time_us":242313,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":118,"spinlock_wait_cycles":215448832,"tablet-open.queue_time_us":4130408}
I20260709 12:12:51.891546  5795 tablet_bootstrap.cc:492] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:51.895870  5794 tablet_bootstrap.cc:654] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.886181  5899 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:51.886150  5670 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:51.896565  5679 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:12:51.908776  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:51.903062  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:51.903873  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:51.951479  5598 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:51.916038  5899 raft_consensus.cc:697] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:51.949887  5996 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.974807  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:51.976804  5996 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:51.992604  5996 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:51.991227  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:51.993106  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:51.993546  5602 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:51.993682  5749 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:51.996711  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:51.993737  6077 log.cc:927] Time spent T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:12:51.993918  5899 consensus_queue.cc:237] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.003803  5793 tablet_bootstrap.cc:654] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.007817  5567 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:52.009048  5993 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.009536  5993 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.010120  5993 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.017335  5996 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.017884  5996 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.021204  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:12:52.022169  6083 log.cc:927] Time spent T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:12:52.026418  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:52.026775  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:52.027364  5597 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:52.031232  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:52.032788  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:52.015797  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:52.039670  5812 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.036365  5603 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.044821  5993 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.046742  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:52.033499  5595 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:52.047690  5993 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:52.047812  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:52.047931  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:52.048578  5748 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:52.050716  5716 leader_election.cc:343] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.052279  5996 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:52.052541  5603 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:52.053432  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:52.050257  5746 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:52.067224  5716 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:52.068004  5812 raft_consensus.cc:2764] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:12:52.071595  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:52.073426  6076 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.073904  6076 raft_consensus.cc:697] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:52.074661  6076 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:52.076316  5716 leader_election.cc:343] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.078893  5716 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:52.079463  5812 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.080104  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:52.079809  5812 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.081491  5812 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:52.083422  5642 leader_election.cc:343] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:52.079710  5716 leader_election.cc:343] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:52.089259  5716 leader_election.cc:343] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.094267  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:52.094394  5909 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:52.095681  5716 leader_election.cc:343] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.095780  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:52.093621  5812 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.096408  5678 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:52.097800  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:52.099052  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:52.081656  5748 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:52.101940  5996 raft_consensus.cc:2764] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:12:52.102023  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:52.102607  5599 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.103353  5569 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:52.105875  6079 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.106173  5567 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:52.100423  5812 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:12:52.107169  5642 leader_election.cc:343] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.116050  5793 tablet_bootstrap.cc:492] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:52.116626  5793 ts_tablet_manager.cc:1403] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.267s	user 0.012s	sys 0.011s
I20260709 12:12:52.117516  6065 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:52.118371  5718 leader_election.cc:343] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.119791  5795 tablet_bootstrap.cc:654] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.121815  5718 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.122061  5793 raft_consensus.cc:359] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.122161  6084 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.123284  5812 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.123670  5812 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.124135  5812 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.122855  5793 raft_consensus.cc:385] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.124722  5793 raft_consensus.cc:740] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
W20260709 12:12:52.120678  5569 leader_election.cc:343] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.125379  5793 consensus_queue.cc:260] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.129473  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:52.130728  5602 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.123199  6084 raft_consensus.cc:697] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:52.133165  5812 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.127710  5793 ts_tablet_manager.cc:1434] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:12:52.134914  5793 tablet_bootstrap.cc:492] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:52.140789  6084 consensus_queue.cc:237] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.141362  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:52.141553  5794 tablet_bootstrap.cc:492] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:52.143847  5794 ts_tablet_manager.cc:1403] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.298s	user 0.010s	sys 0.012s
I20260709 12:12:52.142387  5812 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:52.148033  5599 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:52.150440  5716 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:52.154872  5794 raft_consensus.cc:359] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.155650  5794 raft_consensus.cc:385] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.155990  5794 raft_consensus.cc:740] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.156705  5794 consensus_queue.cc:260] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.163705  5996 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.165242  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:52.164134  6093 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 12:12:52.183291  5793 tablet_bootstrap.cc:654] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.186172  5996 raft_consensus.cc:697] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:52.191633  5996 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.194393  5500 catalog_manager.cc:5697] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 2, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 2 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.199612  6093 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.200111  6093 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.202206  6093 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:52.204419  5794 ts_tablet_manager.cc:1434] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.060s	user 0.016s	sys 0.003s
I20260709 12:12:52.205155  5794 tablet_bootstrap.cc:492] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:52.188498  6012 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 12:12:52.195590  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 63362.1us
W20260709 12:12:52.223657  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 73273.3us
I20260709 12:12:52.227533  5602 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:52.230903  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:12:52.234925  5716 leader_election.cc:343] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:52.235579  5716 leader_election.cc:343] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:52.236117  5716 leader_election.cc:343] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.241286  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:52.241395  5718 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.242012  5677 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.243520  5812 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.243877  5812 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.244186  5812 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:52.249261  5550 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:52.251441  5812 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:52.252279  5718 leader_election.cc:343] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.256474  5812 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:12:52.257985  5718 leader_election.cc:343] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.268630  5677 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:52.273173  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:12:52.275430  5716 leader_election.cc:343] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.277872  5795 tablet_bootstrap.cc:492] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:52.261389  5718 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.291512  5795 ts_tablet_manager.cc:1403] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.400s	user 0.026s	sys 0.027s
I20260709 12:12:52.294893  6097 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.295570  6076 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.295986  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.296932  6097 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.297262  6097 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:52.297504  5718 leader_election.cc:343] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.297587  6097 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.300309  5793 tablet_bootstrap.cc:492] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:52.300657  5793 ts_tablet_manager.cc:1403] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.166s	user 0.016s	sys 0.003s
I20260709 12:12:52.306593  5793 raft_consensus.cc:359] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.307354  5793 raft_consensus.cc:385] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.307611  5793 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.308270  5793 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.298000  5718 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.311088  5793 ts_tablet_manager.cc:1434] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:12:52.312606  5793 tablet_bootstrap.cc:492] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:52.317888  5812 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.320451  6097 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.321905  6012 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.323521  5794 tablet_bootstrap.cc:654] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.335242  5795 raft_consensus.cc:359] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.337203  5795 raft_consensus.cc:385] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.345932  5997 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.346475  5795 raft_consensus.cc:740] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
W20260709 12:12:52.334403  5718 leader_election.cc:343] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.346788  5997 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.347182  5795 consensus_queue.cc:260] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.347445  5718 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.348305  5812 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.348850  5997 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:52.349268  5795 ts_tablet_manager.cc:1434] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.002s
I20260709 12:12:52.337277  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:52.350939  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:52.351297  5795 tablet_bootstrap.cc:492] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
W20260709 12:12:52.352583  5716 leader_election.cc:343] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:52.337858  5642 consensus_peers.cc:597] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:52.353191  5716 leader_election.cc:343] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.354274  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:52.357297  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:52.357880  5677 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.358091  6097 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:52.360917  6012 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.362284  6008 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.362922  6067 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.370289  6065 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.370777  6065 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.371220  5793 tablet_bootstrap.cc:654] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.376299  5677 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:52.377782  6065 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:52.379233  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:52.380348  5751 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:52.382794  5642 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:52.384114  6065 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.384454  6065 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.383049  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:52.387830  5795 tablet_bootstrap.cc:654] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.384775  6065 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.394325  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:52.394984  5674 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.403529  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:52.404304  5793 tablet_bootstrap.cc:492] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:52.404918  5793 ts_tablet_manager.cc:1403] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.004s
W20260709 12:12:52.405434  5642 leader_election.cc:343] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.422024  5677 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:52.425189  5793 raft_consensus.cc:359] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.427292  5793 raft_consensus.cc:385] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.427637  5793 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.429065  5795 tablet_bootstrap.cc:492] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:52.430581  6065 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.433274  5794 tablet_bootstrap.cc:492] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:52.433845  5794 ts_tablet_manager.cc:1403] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.229s	user 0.008s	sys 0.011s
I20260709 12:12:52.434705  5795 ts_tablet_manager.cc:1403] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.007s
W20260709 12:12:52.436554  5642 consensus_peers.cc:597] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:52.438110  5793 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.440829  5795 raft_consensus.cc:359] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.433429  6065 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:52.442220  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:52.442883  5751 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.442505  5795 raft_consensus.cc:385] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.443392  5795 raft_consensus.cc:740] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.443768  5793 ts_tablet_manager.cc:1434] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 12:12:52.444041  5795 consensus_queue.cc:260] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.444811  5674 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:52.445158  5793 tablet_bootstrap.cc:492] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:52.450693  5795 ts_tablet_manager.cc:1434] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:12:52.449985  6084 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.452128  5795 tablet_bootstrap.cc:492] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:52.458423  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:52.466820  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:52.466688  5751 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:52.472867  5642 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:52.473021  5794 raft_consensus.cc:359] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.473861  5794 raft_consensus.cc:385] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.474141  5794 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.474802  6075 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.475286  6075 raft_consensus.cc:697] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:52.476508  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:52.477058  5677 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.477687  5795 tablet_bootstrap.cc:654] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.478098  5794 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:52.479245  5642 leader_election.cc:343] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.476133  6075 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.494735  5909 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.496551  5501 catalog_manager.cc:5697] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:52.498710  5794 ts_tablet_manager.cc:1434] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.064s	user 0.001s	sys 0.005s
I20260709 12:12:52.499544  5794 tablet_bootstrap.cc:492] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:52.500643  5501 catalog_manager.cc:5697] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:12:52.517616  5677 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
W20260709 12:12:52.518486  5718 leader_election.cc:343] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.519928  5718 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.523388  5793 tablet_bootstrap.cc:654] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.529093  5812 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.528666  5498 catalog_manager.cc:5697] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.529551  5812 raft_consensus.cc:697] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:52.530308  5812 consensus_queue.cc:237] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:52.534581  5718 leader_election.cc:343] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.535382  5718 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.538519  6097 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.556830  5751 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:52.557029  5794 tablet_bootstrap.cc:654] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.562223  6084 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.565668  6012 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.566715  5718 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:12:52.567819  5718 leader_election.cc:343] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.567994  6097 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.568243  5718 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.568656  6097 raft_consensus.cc:697] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:52.569119  5500 catalog_manager.cc:5697] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.572487  5500 catalog_manager.cc:5697] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:12:52.575855  6097 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.577044  5795 tablet_bootstrap.cc:492] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:52.577454  5795 ts_tablet_manager.cc:1403] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.126s	user 0.011s	sys 0.009s
I20260709 12:12:52.571049  5997 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.579934  5795 raft_consensus.cc:359] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.580538  5795 raft_consensus.cc:385] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.580796  5795 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.580837  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.587186  5795 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.592332  5501 catalog_manager.cc:5697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:12:52.596448  5795 ts_tablet_manager.cc:1434] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:12:52.597481  5795 tablet_bootstrap.cc:492] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:52.594762  6095 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.610904  6095 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:52.612905  6095 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.635764  5498 catalog_manager.cc:5697] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:12:52.644798  5794 tablet_bootstrap.cc:492] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:52.645253  5794 ts_tablet_manager.cc:1403] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.146s	user 0.016s	sys 0.002s
I20260709 12:12:52.650219  5793 tablet_bootstrap.cc:492] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:52.650646  5793 ts_tablet_manager.cc:1403] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.206s	user 0.012s	sys 0.007s
I20260709 12:12:52.652024  6079 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.652523  6079 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.654754  6126 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.656134  6126 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.666209  6079 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:52.662745  5794 raft_consensus.cc:359] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.670184  5794 raft_consensus.cc:385] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.670420  5794 raft_consensus.cc:740] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.672079  5794 consensus_queue.cc:260] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.676482  5500 catalog_manager.cc:5697] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.677737  5794 ts_tablet_manager.cc:1434] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:12:52.679945  6126 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:52.683620  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:52.689036  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:52.689776  5748 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:12:52.693365  5602 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:52.681661  5774 debug-util.cc:398] Leaking SignalData structure 0x7b080013c900 after lost signal to thread 4412
W20260709 12:12:52.695439  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08001c7660 after lost signal to thread 5535
I20260709 12:12:52.683686  5996 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:52.696508  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08002909a0 after lost signal to thread 5628
I20260709 12:12:52.696791  5996 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:52.697453  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08002901e0 after lost signal to thread 5703
W20260709 12:12:52.698448  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08001a50c0 after lost signal to thread 5777
I20260709 12:12:52.698908  5996 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:52.673843  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:52.700011  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:52.684710  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:52.684962  5793 raft_consensus.cc:359] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.703233  5793 raft_consensus.cc:385] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.703583  5793 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.680827  5794 tablet_bootstrap.cc:492] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:52.700989  5569 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:52.704879  5569 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:52.705022  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:52.706398  5793 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.707634  5795 tablet_bootstrap.cc:654] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.708518  5793 ts_tablet_manager.cc:1434] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.000s
I20260709 12:12:52.708671  5716 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.705801  6079 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.714293  5996 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.703925  5501 catalog_manager.cc:5697] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:52.708240  6084 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:12:52.717581  5718 consensus_peers.cc:597] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:52.709393  5793 tablet_bootstrap.cc:492] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:52.727456  5501 catalog_manager.cc:5697] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:52.728615  5501 catalog_manager.cc:5697] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:52.733939  6084 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.734499  6084 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.736486  6084 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:52.737983  6012 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.738162  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:52.738962  5674 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:52.739521  6012 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.733779  5993 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.742012  6012 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:52.744355  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:52.744601  5795 tablet_bootstrap.cc:492] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:52.745132  5795 ts_tablet_manager.cc:1403] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.002s
W20260709 12:12:52.745775  5642 leader_election.cc:343] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.747119  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:52.746335  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:52.748770  5794 tablet_bootstrap.cc:654] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.749832  5567 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:12:52.750031  5642 leader_election.cc:343] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.750439  5642 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.750882  5993 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.751971  6012 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.751786  5795 raft_consensus.cc:359] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.752450  5795 raft_consensus.cc:385] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.752719  5795 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.753346  5795 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.755661  5795 ts_tablet_manager.cc:1434] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:12:52.756680  5795 tablet_bootstrap.cc:492] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:52.762857  5993 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:52.765614  4414 debug-util.cc:398] Leaking SignalData structure 0x7b080000f8a0 after lost signal to thread 5569
I20260709 12:12:52.768447  6084 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.773677  5795 tablet_bootstrap.cc:654] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.750957  6079 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.780808  5793 tablet_bootstrap.cc:654] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.791736  5996 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.792649  6095 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.793205  6095 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.796554  6095 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:52.797636  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:52.798794  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:12:52.800279  5718 leader_election.cc:343] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:52.801198  5716 leader_election.cc:343] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.801621  5716 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.803090  5996 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.807868  5794 tablet_bootstrap.cc:492] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:52.809178  5794 ts_tablet_manager.cc:1403] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.004s
I20260709 12:12:52.811698  5794 raft_consensus.cc:359] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.812565  5748 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.822777  5795 tablet_bootstrap.cc:492] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:52.823278  5795 ts_tablet_manager.cc:1403] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.005s
I20260709 12:12:52.826037  5794 raft_consensus.cc:385] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.826707  5794 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.828289  5794 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.830317  5793 tablet_bootstrap.cc:492] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:52.836105  5793 ts_tablet_manager.cc:1403] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.002s
I20260709 12:12:52.838701  5793 raft_consensus.cc:359] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.839407  5793 raft_consensus.cc:385] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.839666  5793 raft_consensus.cc:740] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.840309  5793 consensus_queue.cc:260] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.828223  5795 raft_consensus.cc:359] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.841904  5795 raft_consensus.cc:385] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.842535  5795 raft_consensus.cc:740] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.843163  5795 consensus_queue.cc:260] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.845171  5795 ts_tablet_manager.cc:1434] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.004s
I20260709 12:12:52.846077  5795 tablet_bootstrap.cc:492] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:52.851236  5794 ts_tablet_manager.cc:1434] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.041s	user 0.001s	sys 0.003s
I20260709 12:12:52.856530  5793 ts_tablet_manager.cc:1434] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:12:52.857587  5793 tablet_bootstrap.cc:492] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:52.860530  5794 tablet_bootstrap.cc:492] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:52.866492  5794 tablet_bootstrap.cc:654] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.875236  5793 tablet_bootstrap.cc:654] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.878280  5795 tablet_bootstrap.cc:654] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.883726  5794 tablet_bootstrap.cc:492] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:52.884186  5794 ts_tablet_manager.cc:1403] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 12:12:52.891350  5794 raft_consensus.cc:359] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.891949  5794 raft_consensus.cc:385] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.892231  5794 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.892833  5794 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.894752  5794 ts_tablet_manager.cc:1434] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:52.899410  6012 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.907729  5794 tablet_bootstrap.cc:492] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:52.915988  5795 tablet_bootstrap.cc:492] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:52.916581  5795 ts_tablet_manager.cc:1403] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.071s	user 0.006s	sys 0.017s
I20260709 12:12:52.919430  5795 raft_consensus.cc:359] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.920133  5795 raft_consensus.cc:385] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.920442  5795 raft_consensus.cc:740] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.921049  5795 consensus_queue.cc:260] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.923373  5795 ts_tablet_manager.cc:1434] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 12:12:52.924247  5795 tablet_bootstrap.cc:492] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:52.935410  6012 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.939890  5909 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.970031  5993 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.970598  5993 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.972612  5993 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:52.940410  5909 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.975178  5909 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:52.976145  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:12:52.977934  5642 leader_election.cc:343] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.978233  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:52.978135  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:52.978823  6084 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.978972  5751 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:52.979135  5746 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:52.980528  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:52.981383  5567 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:52.981396  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:52.982745  5674 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:52.979405  6084 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:52.985143  6075 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.985570  6075 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.985948  6075 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.988036  6126 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.988468  6126 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.989846  6126 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.990985  5794 tablet_bootstrap.cc:654] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.994338  5996 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.989506  5601 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.995313  5996 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.005540  6095 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.012918  5793 tablet_bootstrap.cc:492] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:53.013552  5793 ts_tablet_manager.cc:1403] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.156s	user 0.033s	sys 0.023s
I20260709 12:12:53.014205  6084 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.014760  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:53.015379  5996 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:53.015547  5674 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:53.016654  6126 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.017009  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:53.019447  5718 leader_election.cc:343] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.021677  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:53.018949  6084 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.029459  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:53.026432  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:53.036891  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:53.039253  5674 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.039960  5795 tablet_bootstrap.cc:654] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.033471  6075 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.042048  5793 raft_consensus.cc:359] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:53.043073  5716 leader_election.cc:343] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.043509  5716 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:53.044927  5793 raft_consensus.cc:385] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.045275  5793 raft_consensus.cc:740] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.044147  6097 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.031965  6084 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:53.048265  6146 log.cc:927] Time spent T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.010s
I20260709 12:12:53.052093  5793 consensus_queue.cc:260] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.041317  6147 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.060796  5793 ts_tablet_manager.cc:1434] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.001s
I20260709 12:12:53.061697  5793 tablet_bootstrap.cc:492] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:53.073664  5674 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:53.089890  5793 tablet_bootstrap.cc:654] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.090490  6084 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.092731  6075 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.096431  5569 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:53.097167  6084 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.097646  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:53.099272  5569 leader_election.cc:343] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:53.100741  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 62538us
I20260709 12:12:53.103498  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:53.098471  6084 raft_consensus.cc:697] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:53.109449  5794 tablet_bootstrap.cc:492] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:53.104499  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:53.109931  5794 ts_tablet_manager.cc:1403] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.202s	user 0.019s	sys 0.008s
I20260709 12:12:53.110031  5748 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.109038  6084 consensus_queue.cc:237] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.107386  5887 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:12:53.111651  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:53.112197  5752 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.114164  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:53.114790  5749 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
W20260709 12:12:53.107347  5642 leader_election.cc:343] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.122093  5794 raft_consensus.cc:359] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.122879  5752 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:53.123627  6095 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.124895  6126 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.126986  5748 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:53.123350  5794 raft_consensus.cc:385] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.130770  5794 raft_consensus.cc:740] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.135098  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:53.131837  5794 consensus_queue.cc:260] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.142148  5567 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:53.141147  5909 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.148450  5909 raft_consensus.cc:697] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:53.148804  6155 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.149247  6155 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.149255  5909 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.141413  5996 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:12:53.149597  6155 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.149576  5794 ts_tablet_manager.cc:1434] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:12:53.167496  5794 tablet_bootstrap.cc:492] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:53.179771  5795 tablet_bootstrap.cc:492] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:53.180307  5795 ts_tablet_manager.cc:1403] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.256s	user 0.013s	sys 0.018s
I20260709 12:12:53.187940  5795 raft_consensus.cc:359] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.190495  5795 raft_consensus.cc:385] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.190794  5795 raft_consensus.cc:740] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.191375  5795 consensus_queue.cc:260] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.180377  6155 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.199054  5794 tablet_bootstrap.cc:654] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.205610  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:53.205902  6155 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.208420  5795 ts_tablet_manager.cc:1434] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.003s
I20260709 12:12:53.209412  5795 tablet_bootstrap.cc:492] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
W20260709 12:12:53.209542  5569 leader_election.cc:343] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.207590  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:53.212999  5748 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.215864  5996 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.220589  5748 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:12:53.220961  5498 catalog_manager.cc:5697] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.232842  5793 tablet_bootstrap.cc:492] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:53.233335  5793 ts_tablet_manager.cc:1403] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.172s	user 0.010s	sys 0.010s
I20260709 12:12:53.240399  5567 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:53.243465  6155 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.303373  6155 raft_consensus.cc:697] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:53.304466  6155 consensus_queue.cc:237] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.321157  5793 raft_consensus.cc:359] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.321966  5793 raft_consensus.cc:385] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.322284  5793 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.330277  5793 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.332851  5793 ts_tablet_manager.cc:1434] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 12:12:53.333962  5793 tablet_bootstrap.cc:492] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:53.336555  5887 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.339450  5887 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.351446  5500 catalog_manager.cc:5697] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.349035  5887 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:53.355242  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:53.356788  5718 leader_election.cc:343] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:53.362375  5716 consensus_peers.cc:597] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.371045  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:53.394567  5793 tablet_bootstrap.cc:654] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:53.402518  5716 leader_election.cc:343] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.403007  5716 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:53.404201  5794 tablet_bootstrap.cc:492] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:53.404645  5887 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.405535  5794 ts_tablet_manager.cc:1403] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.238s	user 0.023s	sys 0.051s
I20260709 12:12:53.406059  5498 catalog_manager.cc:5697] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.424309  5795 tablet_bootstrap.cc:654] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.433142  5793 tablet_bootstrap.cc:492] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:53.437238  5794 raft_consensus.cc:359] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.437996  5794 raft_consensus.cc:385] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.438265  5794 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.433629  5793 ts_tablet_manager.cc:1403] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.008s
I20260709 12:12:53.444000  5793 raft_consensus.cc:359] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.444692  5793 raft_consensus.cc:385] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.444957  5793 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.445796  5794 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.448489  5794 ts_tablet_manager.cc:1434] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.000s
I20260709 12:12:53.453881  5795 tablet_bootstrap.cc:492] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:53.454391  5795 ts_tablet_manager.cc:1403] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.245s	user 0.016s	sys 0.000s
W20260709 12:12:53.456142  5550 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:53.456964  5795 raft_consensus.cc:359] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.457674  5795 raft_consensus.cc:385] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.458014  5795 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.449167  5793 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.458631  5795 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.459046  5887 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.459777  5887 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.461349  5793 ts_tablet_manager.cc:1434] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:12:53.462339  5793 tablet_bootstrap.cc:492] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:53.462466  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:53.462997  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:53.464385  5718 leader_election.cc:343] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.464829  5887 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:12:53.465786  5716 leader_election.cc:343] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.466188  5716 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:53.467715  5887 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.468957  5793 tablet_bootstrap.cc:654] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.459237  5794 tablet_bootstrap.cc:492] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:53.469594  5795 ts_tablet_manager.cc:1434] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:12:53.473007  5795 tablet_bootstrap.cc:492] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:53.482031  5794 tablet_bootstrap.cc:654] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.494213  5795 tablet_bootstrap.cc:654] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.497126  6158 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.497696  6158 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.500288  6158 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.500850  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:53.501533  5601 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:53.503327  5642 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:53.505551  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:53.506228  5749 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:53.508276  6158 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.509507  6158 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.509996  6158 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.516805  5793 tablet_bootstrap.cc:492] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:53.517284  5793 ts_tablet_manager.cc:1403] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.016s
I20260709 12:12:53.517572  5795 tablet_bootstrap.cc:492] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:53.518013  5795 ts_tablet_manager.cc:1403] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 12:12:53.518064  5794 tablet_bootstrap.cc:492] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:53.518532  5794 ts_tablet_manager.cc:1403] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.006s
I20260709 12:12:53.520936  5795 raft_consensus.cc:359] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.521600  5795 raft_consensus.cc:385] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.521867  5795 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.522209  5793 raft_consensus.cc:359] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.522841  5793 raft_consensus.cc:385] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.522436  5795 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.523119  5793 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.523890  5793 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.524978  5795 ts_tablet_manager.cc:1434] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:53.525911  5795 tablet_bootstrap.cc:492] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:53.526146  5793 ts_tablet_manager.cc:1434] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:53.526942  5793 tablet_bootstrap.cc:492] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:53.528033  5794 raft_consensus.cc:359] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.528683  5794 raft_consensus.cc:385] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.528926  5794 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.529489  5794 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.531446  5794 ts_tablet_manager.cc:1434] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:12:53.532357  5794 tablet_bootstrap.cc:492] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:53.535907  5793 tablet_bootstrap.cc:654] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.537041  5795 tablet_bootstrap.cc:654] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.537707  5794 tablet_bootstrap.cc:654] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.539386  6157 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.539853  6157 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.541989  6157 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.553675  5793 tablet_bootstrap.cc:492] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:53.554255  5793 ts_tablet_manager.cc:1403] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 12:12:53.556962  5793 raft_consensus.cc:359] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.557628  5793 raft_consensus.cc:385] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.557906  5793 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.557971  5795 tablet_bootstrap.cc:492] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:53.558455  5795 ts_tablet_manager.cc:1403] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.001s
I20260709 12:12:53.560755  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:53.561491  5795 raft_consensus.cc:359] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.562230  5795 raft_consensus.cc:385] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.562495  5795 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.563458  5795 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.565866  5793 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.566417  5795 ts_tablet_manager.cc:1434] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:53.567727  5795 tablet_bootstrap.cc:492] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:53.567792  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:53.567986  5793 ts_tablet_manager.cc:1434] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:12:53.568506  5749 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:53.569173  5793 tablet_bootstrap.cc:492] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c: Bootstrap starting.
W20260709 12:12:53.574530  5642 leader_election.cc:343] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.574721  5794 tablet_bootstrap.cc:492] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:53.575246  5794 ts_tablet_manager.cc:1403] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.008s
I20260709 12:12:53.576254  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:53.577376  5602 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.581540  5794 raft_consensus.cc:359] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.582285  5794 raft_consensus.cc:385] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.582543  5794 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.583298  5794 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.584748  5794 ts_tablet_manager.cc:1434] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:12:53.585208  6008 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.585593  6008 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.585942  6008 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.595286  6158 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.596491  5794 tablet_bootstrap.cc:492] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:53.596851  5909 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.616864  5795 tablet_bootstrap.cc:654] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.616748  6008 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.620747  6158 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.621940  6084 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.623107  6084 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.626376  6084 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.627038  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:53.627969  5601 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.627859  6084 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.631017  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:53.631671  5751 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.635288  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:53.654918  5601 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:53.657970  5996 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.658483  5996 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.660472  5996 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:53.662825  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:53.664770  6097 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.665241  6097 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.667161  6097 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:53.654023  6158 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.668099  6158 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.669236  5674 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.674268  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:53.676348  5718 leader_election.cc:343] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.668286  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:53.690305  5642 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:53.691620  6084 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.691924  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:53.692154  6158 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.692657  6158 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.693073  6158 raft_consensus.cc:697] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:53.693889  5794 tablet_bootstrap.cc:654] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.698450  5569 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:53.697973  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:12:53.700489  5716 leader_election.cc:343] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.700909  5716 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:53.662837  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:12:53.705785  5718 leader_election.cc:343] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.699602  6084 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.696637  6158 consensus_queue.cc:237] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.703068  5996 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.709321  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:53.716755  5793 tablet_bootstrap.cc:654] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.706564  5601 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:53.707517  5751 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:53.738917  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:53.744515  6157 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:53.734241  5642 leader_election.cc:343] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.755486  6157 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.758965  5716 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:53.760515  5887 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.760901  5887 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.761215  5887 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.751519  6008 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.757637  6157 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.776576  5795 tablet_bootstrap.cc:492] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:53.777423  5795 ts_tablet_manager.cc:1403] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.210s	user 0.021s	sys 0.013s
I20260709 12:12:53.783499  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:53.784096  5794 tablet_bootstrap.cc:492] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:53.784214  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:53.784672  5794 ts_tablet_manager.cc:1403] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.188s	user 0.020s	sys 0.062s
I20260709 12:12:53.784366  5795 raft_consensus.cc:359] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.784829  5746 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.785077  5795 raft_consensus.cc:385] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.802691  5795 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.805876  5795 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:53.807777  5642 leader_election.cc:343] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.813850  5887 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.814356  5597 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.815443  5794 raft_consensus.cc:359] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.816088  5794 raft_consensus.cc:385] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.816329  5794 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.816769  5795 ts_tablet_manager.cc:1434] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:12:53.816892  5794 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.818980  5794 ts_tablet_manager.cc:1434] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.004s
I20260709 12:12:53.819911  5794 tablet_bootstrap.cc:492] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:53.800230  5746 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:53.822899  5642 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:53.817657  5795 tablet_bootstrap.cc:492] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:53.828759  5887 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:53.847688  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:53.831818  6012 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:53.855126  5718 leader_election.cc:343] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.858785  5887 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.859357  5887 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.870430  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:53.872423  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:53.876024  5887 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:12:53.874310  5716 leader_election.cc:343] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.857076  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:53.878418  6012 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.880216  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:53.882817  6158 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.883844  6158 raft_consensus.cc:697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:53.884706  6158 consensus_queue.cc:237] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.885624  5795 tablet_bootstrap.cc:654] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.882977  6126 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:12:53.888067  5601 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.881047  5751 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:53.895449  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:53.908216  5569 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.910759  5793 tablet_bootstrap.cc:492] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:53.911311  5793 ts_tablet_manager.cc:1403] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.342s	user 0.015s	sys 0.022s
I20260709 12:12:53.911262  5794 tablet_bootstrap.cc:654] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.910948  5674 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:53.953609  6012 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.954116  6012 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.957887  6012 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:53.982115  5601 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:53.973740  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:53.988691  5793 raft_consensus.cc:359] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:53.989496  5793 raft_consensus.cc:385] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.990028  5793 raft_consensus.cc:740] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.992801  5716 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:53.993811  5795 tablet_bootstrap.cc:492] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:53.994277  5795 ts_tablet_manager.cc:1403] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.177s	user 0.034s	sys 0.003s
I20260709 12:12:53.994807  5718 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:53.996469  6195 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.996990  6097 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.996969  6195 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:53.998090  6195 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:54.008850  5642 leader_election.cc:343] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.001155  6097 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.040462  5887 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.041018  5887 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.044315  5642 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.046530  5793 consensus_queue.cc:260] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.047494  5887 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:54.048105  5793 ts_tablet_manager.cc:1434] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.000s
I20260709 12:12:54.049069  5793 tablet_bootstrap.cc:492] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:54.049500  6008 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.057468  5501 catalog_manager.cc:5697] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.054705  6008 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.043956  6097 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.061720  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:54.065985  6008 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:54.086560  5718 leader_election.cc:343] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.083102  6008 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.098471  5795 raft_consensus.cc:359] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.099014  5795 raft_consensus.cc:385] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.099272  5795 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.103689  5794 tablet_bootstrap.cc:492] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:54.104247  5794 ts_tablet_manager.cc:1403] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.285s	user 0.017s	sys 0.007s
I20260709 12:12:54.101348  6200 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.102617  5795 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.113893  6200 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.118949  6200 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:54.120466  5795 ts_tablet_manager.cc:1434] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.126s	user 0.006s	sys 0.000s
I20260709 12:12:54.128604  6084 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.129149  6084 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.121992  5794 raft_consensus.cc:359] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.130270  5794 raft_consensus.cc:385] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.130533  5794 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.131147  6084 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:54.132920  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:54.133581  5793 tablet_bootstrap.cc:654] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:54.135221  5569 leader_election.cc:343] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.135365  5795 tablet_bootstrap.cc:492] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:54.131109  5794 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.133898  6097 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.142813  6008 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:54.144644  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:54.148761  5674 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.145707  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:54.153925  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:54.154078  5750 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:54.154616  5749 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:54.156148  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:54.156801  5600 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:54.146311  6097 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:54.164299  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:54.162231  5567 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:54.167560  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:54.170965  6208 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.171478  6208 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.171888  6208 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.177336  6204 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.169319  5794 ts_tablet_manager.cc:1434] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.001s
I20260709 12:12:54.169411  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:54.179294  5794 tablet_bootstrap.cc:492] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:54.177914  6204 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:54.180812  5716 leader_election.cc:343] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.187245  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:54.193676  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.194386  6186 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.194728  6186 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.195034  6186 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.185139  6097 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.202306  6204 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:12:54.204011  5642 leader_election.cc:343] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.206142  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:54.206801  5748 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 0.
I20260709 12:12:54.208880  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:54.211153  5569 leader_election.cc:343] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.197904  6097 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.219448  6097 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.219192  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:54.220077  5748 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.223593  6186 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.217586  5674 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:54.225886  6186 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:54.227843  6208 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.232034  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:54.232257  6097 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.234881  6208 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:54.237257  5793 tablet_bootstrap.cc:492] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:54.237439  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:54.237738  5793 ts_tablet_manager.cc:1403] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.189s	user 0.006s	sys 0.005s
I20260709 12:12:54.238072  5749 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.239951  5794 tablet_bootstrap.cc:654] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.241479  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:54.242297  5642 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.244771  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:54.247116  5795 tablet_bootstrap.cc:654] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.247272  6185 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:54.248751  5642 leader_election.cc:343] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.249325  5749 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
W20260709 12:12:54.250324  5569 leader_election.cc:343] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.247462  6186 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:12:54.253121  5793 raft_consensus.cc:359] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.253829  5793 raft_consensus.cc:385] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.254155  5793 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.253888  5498 catalog_manager.cc:5697] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:54.255995  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 49878.9us
I20260709 12:12:54.256395  5718 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.256783  5567 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:54.257470  5887 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.257797  6204 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.257915  5887 raft_consensus.cc:697] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:54.258330  6204 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.258715  6204 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.245374  5748 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:54.261374  5887 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.254817  5793 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.265116  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.274485  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:54.275310  5750 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:54.275909  6194 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.278820  5793 ts_tablet_manager.cc:1434] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.002s
I20260709 12:12:54.279562  5567 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:54.283958  5795 tablet_bootstrap.cc:492] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:54.284440  5795 ts_tablet_manager.cc:1403] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.149s	user 0.012s	sys 0.006s
I20260709 12:12:54.286024  5793 tablet_bootstrap.cc:492] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:54.292462  5642 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.283879  6187 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.280635  6194 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:54.298130  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:54.300807  6157 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.303285  6157 raft_consensus.cc:697] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:54.304042  6157 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.298007  5674 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.291357  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:54.300364  6097 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:12:54.329811  5718 leader_election.cc:343] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.300858  6200 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:12:54.335852  5795 raft_consensus.cc:359] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.336478  5795 raft_consensus.cc:385] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.336710  5795 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.302769  6194 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.341209  5793 tablet_bootstrap.cc:654] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.338122  5601 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 1: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:12:54.346189  5795 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.351725  5794 tablet_bootstrap.cc:492] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:54.352113  5794 ts_tablet_manager.cc:1403] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.173s	user 0.018s	sys 0.001s
I20260709 12:12:54.344200  6200 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.354310  6200 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.360153  5795 ts_tablet_manager.cc:1434] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 12:12:54.361152  5795 tablet_bootstrap.cc:492] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:54.372949  6204 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.376986  5501 catalog_manager.cc:5697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.382283  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:54.383680  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:54.382622  6200 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:12:54.385612  5642 leader_election.cc:343] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:54.387104  5642 leader_election.cc:343] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.387598  5642 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.382350  5794 raft_consensus.cc:359] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.389825  5794 raft_consensus.cc:385] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.390106  5794 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.390837  5794 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.379133  6204 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:54.394120  6178 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.399600  5794 ts_tablet_manager.cc:1434] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:12:54.401919  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:12:54.407639  5569 leader_election.cc:343] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.406306  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.409466  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:54.432811  5794 tablet_bootstrap.cc:492] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Bootstrap starting.
I20260709 12:12:54.447173  6198 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.430394  5748 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.444553  6208 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.488991  5795 tablet_bootstrap.cc:654] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:54.551666  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 49186.2us
I20260709 12:12:54.505343  5500 catalog_manager.cc:5697] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:54.530614  6222 log.cc:927] Time spent T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:12:54.562680  5887 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.563158  5887 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.565809  5887 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:54.567790  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:12:54.569235  5718 leader_election.cc:343] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.557840  5996 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.575096  5996 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.483791  6208 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.582083  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:54.619431  5793 tablet_bootstrap.cc:492] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:54.619964  5793 ts_tablet_manager.cc:1403] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.334s	user 0.020s	sys 0.023s
I20260709 12:12:54.622044  5996 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:54.626428  5748 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
W20260709 12:12:54.631314  5642 consensus_peers.cc:597] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.641532  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:54.644265  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:54.649883  6208 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:54.650974  5794 tablet_bootstrap.cc:654] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.649904  5793 raft_consensus.cc:359] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:12:54.649935  5718 leader_election.cc:343] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.662942  5793 raft_consensus.cc:385] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.663405  5793 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
W20260709 12:12:54.669306  5550 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:54.669337  5567 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:12:54.664116  5793 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.674700  6208 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.678185  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:54.678885  6208 raft_consensus.cc:697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:12:54.672302  5501 catalog_manager.cc:5697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.679739  6208 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.680644  5501 catalog_manager.cc:5697] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.682838  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:54.686573  5750 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:12:54.686885  6200 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.692083  5795 tablet_bootstrap.cc:492] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
W20260709 12:12:54.692222  5716 leader_election.cc:343] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.692600  5795 ts_tablet_manager.cc:1403] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.332s	user 0.005s	sys 0.027s
I20260709 12:12:54.692754  5716 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.694206  5793 ts_tablet_manager.cc:1434] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.001s
I20260709 12:12:54.695143  5793 tablet_bootstrap.cc:492] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Bootstrap starting.
W20260709 12:12:54.699417  5716 leader_election.cc:343] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.700575  5716 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.700030  5887 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.711036  6198 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.722965  5795 raft_consensus.cc:359] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.725121  5795 raft_consensus.cc:385] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.725544  5795 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.733306  5793 tablet_bootstrap.cc:654] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.736655  5567 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:54.732998  6218 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.739638  5794 tablet_bootstrap.cc:492] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: No bootstrap required, opened a new log
I20260709 12:12:54.754160  5794 ts_tablet_manager.cc:1403] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Time spent bootstrapping tablet: real 0.321s	user 0.015s	sys 0.029s
I20260709 12:12:54.754698  6203 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.764596  6008 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:54.768047  5716 consensus_peers.cc:597] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:54.774227  5718 consensus_peers.cc:597] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.777961  5794 raft_consensus.cc:359] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.778725  6203 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.778972  5794 raft_consensus.cc:385] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.779618  5794 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.780385  5794 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.789340  5793 tablet_bootstrap.cc:492] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:54.790092  5793 ts_tablet_manager.cc:1403] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.006s
I20260709 12:12:54.792533  5794 ts_tablet_manager.cc:1434] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 12:12:54.792841  5793 raft_consensus.cc:359] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.798985  6095 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.794576  5795 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.800714  5793 raft_consensus.cc:385] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.801025  5793 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.801841  5795 ts_tablet_manager.cc:1434] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.109s	user 0.003s	sys 0.012s
I20260709 12:12:54.801656  5793 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.803026  5795 tablet_bootstrap.cc:492] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:54.804981  5793 ts_tablet_manager.cc:1434] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:12:54.805824  5793 tablet_bootstrap.cc:492] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:54.803117  6194 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.807521  6155 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.814299  6155 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.829324  5498 catalog_manager.cc:5697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 0 to 1, leader changed from <none> to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.830829  6155 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:54.832325  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:54.815035  6194 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.836624  6194 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:54.837366  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:54.837926  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:54.838549  5750 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
W20260709 12:12:54.840150  5642 leader_election.cc:343] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.840827  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.841668  6194 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.842096  6194 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.842447  6194 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.864682  5795 tablet_bootstrap.cc:654] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.865676  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:54.866480  5748 raft_consensus.cc:2393] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:12:54.866814  6194 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.877228  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:54.878121  6194 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:54.877903  6185 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.879511  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:54.880098  5748 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.883597  5795 tablet_bootstrap.cc:492] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:54.884094  5795 ts_tablet_manager.cc:1403] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.000s
I20260709 12:12:54.884979  5748 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:54.877897  5793 tablet_bootstrap.cc:654] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.885954  5567 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:54.887444  6155 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.895083  5795 raft_consensus.cc:359] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.895813  5795 raft_consensus.cc:385] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.896065  5795 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.896698  5795 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.897078  6155 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.898793  5795 ts_tablet_manager.cc:1434] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
W20260709 12:12:54.885919  5642 leader_election.cc:343] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.904982  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:54.907099  6200 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.907536  6200 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:54.908286  6200 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.912257  5795 tablet_bootstrap.cc:492] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:54.926498  6155 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.927019  6155 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.929925  6155 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:54.929859  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:54.930635  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:54.931295  5748 raft_consensus.cc:2393] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 1: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:12:54.932152  5567 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:54.933037  6155 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.935575  5795 tablet_bootstrap.cc:654] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.938082  6178 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.945883  6178 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.947525  5793 tablet_bootstrap.cc:492] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:54.948076  5793 ts_tablet_manager.cc:1403] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.013s
I20260709 12:12:54.950670  5793 raft_consensus.cc:359] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.952143  5793 raft_consensus.cc:385] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.952415  5793 raft_consensus.cc:740] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.953518  5793 consensus_queue.cc:260] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:54.955569  5793 ts_tablet_manager.cc:1434] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:54.956385  5793 tablet_bootstrap.cc:492] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:54.962044  5793 tablet_bootstrap.cc:654] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.965137  6155 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.974900  5498 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.006306  5793 tablet_bootstrap.cc:492] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:55.007057  5793 ts_tablet_manager.cc:1403] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.051s	user 0.005s	sys 0.010s
I20260709 12:12:55.009531  5795 tablet_bootstrap.cc:492] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:55.010090  5795 ts_tablet_manager.cc:1403] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.000s
I20260709 12:12:55.012483  5795 raft_consensus.cc:359] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.013099  5795 raft_consensus.cc:385] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.013310  5795 raft_consensus.cc:740] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.013808  5795 consensus_queue.cc:260] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.016036  5795 ts_tablet_manager.cc:1434] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:55.015094  5793 raft_consensus.cc:359] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.017727  5793 raft_consensus.cc:385] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.018072  5793 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.019965  5795 tablet_bootstrap.cc:492] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:55.018771  5793 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.027942  5793 ts_tablet_manager.cc:1434] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.004s
I20260709 12:12:55.034346  5793 tablet_bootstrap.cc:492] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:55.043697  5795 tablet_bootstrap.cc:654] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.046005  5793 tablet_bootstrap.cc:654] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.056738  6095 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.057264  6095 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.059276  6095 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:55.060653  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:12:55.062260  5716 leader_election.cc:343] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.064327  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:55.064944  5675 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:55.068074  5718 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:55.069375  6095 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.069725  6095 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.070086  6095 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.071885  5793 tablet_bootstrap.cc:492] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:55.072409  5793 ts_tablet_manager.cc:1403] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.011s
I20260709 12:12:55.075958  5793 raft_consensus.cc:359] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.076598  5793 raft_consensus.cc:385] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.076859  5793 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.077457  5793 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.078308  5887 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.078754  5887 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.079566  5793 ts_tablet_manager.cc:1434] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:12:55.080503  5793 tablet_bootstrap.cc:492] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: Bootstrap starting.
I20260709 12:12:55.080585  5887 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:55.086205  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:55.086887  5604 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:55.086736  6095 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.088279  5716 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:55.089313  6095 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:55.089975  6095 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.090379  6095 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.091471  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:55.091956  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:55.092531  5677 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:55.093852  5716 leader_election.cc:343] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.098217  5795 tablet_bootstrap.cc:492] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:55.098732  5795 ts_tablet_manager.cc:1403] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.079s	user 0.023s	sys 0.012s
I20260709 12:12:55.099160  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:55.099808  5675 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 0.
I20260709 12:12:55.101362  5795 raft_consensus.cc:359] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.102074  5795 raft_consensus.cc:385] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.102332  5795 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.103017  5795 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.103883  6200 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.104494  5795 ts_tablet_manager.cc:1434] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.002s
I20260709 12:12:55.104382  6200 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.105387  5795 tablet_bootstrap.cc:492] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:55.107836  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:55.111125  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:55.111711  5795 tablet_bootstrap.cc:654] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.112701  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:55.113448  6194 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.115772  5793 tablet_bootstrap.cc:654] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.115914  6155 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.126550  5793 tablet_bootstrap.cc:492] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: No bootstrap required, opened a new log
I20260709 12:12:55.127004  5793 ts_tablet_manager.cc:1403] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.005s
I20260709 12:12:55.129884  5793 raft_consensus.cc:359] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.130537  5793 raft_consensus.cc:385] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.130816  5793 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.131456  5793 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.133122  6200 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:55.133834  5793 ts_tablet_manager.cc:1434] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:55.146121  5677 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:55.147440  5718 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:12:55.148804  6218 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.149289  6218 raft_consensus.cc:697] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:55.150218  6218 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.090752  6095 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.158337  5675 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.163187  6194 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.163726  6194 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.164376  6095 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.165668  6194 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:55.166272  6095 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:55.168576  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:55.169163  5673 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.171967  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:55.172676  5752 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 1: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:12:55.175994  5673 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:55.176059  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:55.176859  5600 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 1: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:12:55.177525  5718 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:12:55.178422  5887 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.178996  5887 raft_consensus.cc:697] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:55.179176  5795 tablet_bootstrap.cc:492] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:55.182369  5601 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.190239  5795 ts_tablet_manager.cc:1403] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.023s
I20260709 12:12:55.192782  5795 raft_consensus.cc:359] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.193420  5795 raft_consensus.cc:385] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.182922  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:55.193691  5795 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.193542  6189 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.193994  5604 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.194389  5795 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.196631  5795 ts_tablet_manager.cc:1434] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:55.197502  5795 tablet_bootstrap.cc:492] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:55.202580  5604 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:55.202942  5795 tablet_bootstrap.cc:654] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.202710  5887 consensus_queue.cc:237] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.182296  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:12:55.206386  6200 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.215169  6200 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.217556  5795 tablet_bootstrap.cc:492] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:55.218176  5795 ts_tablet_manager.cc:1403] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 12:12:55.222055  6200 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.229919  6200 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.231921  6200 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:55.233654  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:55.234323  5600 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:55.236116  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:55.236742  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:55.237324  5752 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 0.
I20260709 12:12:55.237588  6194 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.237957  6194 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.238343  6194 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.221017  5795 raft_consensus.cc:359] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.238677  5795 raft_consensus.cc:385] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.238993  5795 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.239727  5795 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.242028  5795 ts_tablet_manager.cc:1434] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:12:55.242969  5795 tablet_bootstrap.cc:492] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f: Bootstrap starting.
I20260709 12:12:55.245473  6194 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.247397  6194 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:55.249331  5795 tablet_bootstrap.cc:654] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.251514  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:12:55.252095  5750 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.254032  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:55.254561  5604 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.259943  5604 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:55.263736  5498 catalog_manager.cc:5697] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.265312  5498 catalog_manager.cc:5697] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.273497  5750 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:12:55.278019  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:55.283174  6200 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.284855  5795 tablet_bootstrap.cc:492] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f: No bootstrap required, opened a new log
I20260709 12:12:55.285373  5795 ts_tablet_manager.cc:1403] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.010s
I20260709 12:12:55.285866  6200 raft_consensus.cc:697] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:12:55.287572  6200 consensus_queue.cc:237] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.299495  5795 raft_consensus.cc:359] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.300232  5795 raft_consensus.cc:385] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.300503  5795 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.301254  5795 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.303578  5675 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.316926  5795 ts_tablet_manager.cc:1434] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 12:12:55.329941  5501 catalog_manager.cc:5697] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 0 to 1, leader changed from <none> to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.334978  6185 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.369939  6200 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.401925  6189 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.402441  6189 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.404136  6189 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:55.407579  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:55.407825  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:55.410633  5567 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:55.412173  6084 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.456634  5601 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.636906  6218 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.643337  6095 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.689213  6155 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.690178  6155 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:55.692855  6155 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:55.705988  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:12:55.712221  6218 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.716326  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:55.720237  5569 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:12:55.724534  6185 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.726022  6189 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.741464  6185 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:55.754483  5550 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:55.776139  5596 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.830976  6095 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.029073  5996 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.030056  5996 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:56.032823  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:12:56.033547  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:12:56.033663  5597 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:56.034423  5673 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:12:56.035265  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:56.036162  6095 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:56.036216  5996 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:56.036633  6095 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.037002  6095 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.044480  6095 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:56.046528  6095 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:56.047201  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:12:56.047470  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:12:56.047717  5597 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.048094  5673 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.053030  5597 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:12:56.054101  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:12:56.054725  6095 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:56.055131  6095 raft_consensus.cc:697] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:12:56.055163  5673 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:12:56.056455  6095 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:12:56.092306  5501 catalog_manager.cc:5697] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 0 to 2, leader changed from <none> to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.483915  5673 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:56.485248  6095 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.513173  5596 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:56.516009  5996 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.114884  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:58.125604  6282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:58.127933  6283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:58.130421  6285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:58.136186  4409 server_base.cc:1061] running on GCE node
I20260709 12:12:58.137667  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:58.137931  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:58.138114  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599178138097 us; error 0 us; skew 500 ppm
I20260709 12:12:58.138687  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:58.141944  4409 webserver.cc:533] Webserver started at http://127.4.78.68:39843/ using document root <none> and password file <none>
I20260709 12:12:58.142624  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:58.142846  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:58.143662  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:58.145623  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-3-root/instance:
uuid: "c02ed29558db481589fd3db23e43a07f"
format_stamp: "Formatted at 2026-07-09 12:12:58 on dist-test-slave-9t7s"
I20260709 12:12:58.153234  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:12:58.157075  6290 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:58.158531  4409 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:12:58.159968  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-3-root
uuid: "c02ed29558db481589fd3db23e43a07f"
format_stamp: "Formatted at 2026-07-09 12:12:58 on dist-test-slave-9t7s"
I20260709 12:12:58.160389  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:58.176882  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:58.178527  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:58.182304  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:58.185321  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:58.185549  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:58.185942  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:58.186403  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:58.270521  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.68:42181
I20260709 12:12:58.272272  6352 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.68:42181 every 8 connection(s)
I20260709 12:12:58.277426  4409 auto_leader_rebalancer-test.cc:439] add a tserver: c02ed29558db481589fd3db23e43a07f
I20260709 12:12:58.295619  6353 heartbeater.cc:344] Connected to a master server at 127.4.78.126:44725
I20260709 12:12:58.296542  6353 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:58.297286  6353 heartbeater.cc:507] Master 127.4.78.126:44725 requested a full tablet report, sending...
I20260709 12:12:58.299101  5501 ts_manager.cc:194] Registered new tserver with Master: c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:12:58.300431  5501 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44240
I20260709 12:12:58.967582  5750 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:58.977208  5677 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:58.978416  5601 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:58.978701  5996 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:58.981374  6357 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:12:58.990864  5996 raft_consensus.cc:2955] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:58.995716  5673 raft_consensus.cc:2955] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:58.996877  5601 raft_consensus.cc:2955] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:59.008992  5501 catalog_manager.cc:5697] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:59.029259  5719 consensus_peers.cc:597] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be69db606b5844b2ad9d8cdcd608216a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.043021  5673 consensus_queue.cc:237] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:59.065686  5748 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.065688  5597 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.067425  6157 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.068539  6358 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:59.092495  6157 raft_consensus.cc:2955] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:12:59.083846  5645 consensus_peers.cc:597] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5ac98436c3f4e54af415eb568349c1e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.096755  5597 raft_consensus.cc:2955] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:59.094449  5748 raft_consensus.cc:2955] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:59.113631  5673 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:59.113353  5500 catalog_manager.cc:5697] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:59.140232  5645 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0305464a3879473e825bbe12c2df9cd9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.145998  5748 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.150882  6157 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.153123  5601 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.155663  6281 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:59.192238  6376 raft_consensus.cc:2955] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:59.194002  5597 raft_consensus.cc:2955] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:59.213603  5748 raft_consensus.cc:2955] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:59.230068  5498 catalog_manager.cc:5697] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:59.238968  5748 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:59.253890  5673 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.254170  5597 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:12:59.254474  5719 consensus_peers.cc:597] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fb3872bc132421d9b9adacd9cf89a22. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.257119  6357 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.258154  5996 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.273093  6278 raft_consensus.cc:2955] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:59.275353  5596 raft_consensus.cc:2955] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:59.277971  5673 raft_consensus.cc:2955] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:12:59.296010  5500 catalog_manager.cc:5697] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.303076  6353 heartbeater.cc:499] Master 127.4.78.126:44725 was elected leader, sending a full tablet report...
I20260709 12:12:59.445380  6383 ts_tablet_manager.cc:933] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:59.448462  6383 tablet_copy_client.cc:323] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:12:59.469448  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet e5ac98436c3f4e54af415eb568349c1e from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:12:59.470094  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet e5ac98436c3f4e54af415eb568349c1e from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-e5ac98436c3f4e54af415eb568349c1e
I20260709 12:12:59.478328  5689 tablet_copy_source_session.cc:215] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:59.483140  6383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5ac98436c3f4e54af415eb568349c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:59.497344  6383 tablet_copy_client.cc:806] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:59.497967  6383 tablet_copy_client.cc:670] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:59.509299  6383 tablet_copy_client.cc:538] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:59.517064  6383 tablet_bootstrap.cc:492] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:12:59.536911  6383 tablet_bootstrap.cc:492] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:59.538102  6383 tablet_bootstrap.cc:492] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:12:59.538887  6383 ts_tablet_manager.cc:1403] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.022s	user 0.022s	sys 0.001s
I20260709 12:12:59.544415  6383 raft_consensus.cc:359] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:59.545337  6383 raft_consensus.cc:740] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:12:59.546084  6383 consensus_queue.cc:260] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:59.555514  6383 ts_tablet_manager.cc:1434] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:12:59.560009  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-e5ac98436c3f4e54af415eb568349c1e received from {username='slave'} at 127.0.0.1:50284
I20260709 12:12:59.560429  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-e5ac98436c3f4e54af415eb568349c1e on tablet e5ac98436c3f4e54af415eb568349c1e with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:12:59.578836  6388 ts_tablet_manager.cc:933] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:59.581081  6388 tablet_copy_client.cc:323] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:12:59.592583  6383 ts_tablet_manager.cc:933] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:12:59.620217  6383 tablet_copy_client.cc:323] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:12:59.621877  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet 0305464a3879473e825bbe12c2df9cd9 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:12:59.622406  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet 0305464a3879473e825bbe12c2df9cd9 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-0305464a3879473e825bbe12c2df9cd9
I20260709 12:12:59.630838  5689 tablet_copy_source_session.cc:215] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:59.634135  6383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0305464a3879473e825bbe12c2df9cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:59.659958  6383 tablet_copy_client.cc:806] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:59.660692  6383 tablet_copy_client.cc:670] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:59.664840  6383 tablet_copy_client.cc:538] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:59.696090  6383 tablet_bootstrap.cc:492] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:12:59.697657  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet be69db606b5844b2ad9d8cdcd608216a from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:12:59.700205  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet be69db606b5844b2ad9d8cdcd608216a from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-be69db606b5844b2ad9d8cdcd608216a
I20260709 12:12:59.707172  5763 tablet_copy_source_session.cc:215] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:59.710615  6388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be69db606b5844b2ad9d8cdcd608216a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:59.733603  6383 tablet_bootstrap.cc:492] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:59.734655  6383 tablet_bootstrap.cc:492] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:12:59.735390  6383 ts_tablet_manager.cc:1403] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.008s
I20260709 12:12:59.740429  6383 raft_consensus.cc:359] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:59.741971  6383 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:12:59.742717  6383 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:59.751842  6383 ts_tablet_manager.cc:1434] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:12:59.760236  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-0305464a3879473e825bbe12c2df9cd9 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:12:59.760717  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-0305464a3879473e825bbe12c2df9cd9 on tablet 0305464a3879473e825bbe12c2df9cd9 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:12:59.773044  6388 tablet_copy_client.cc:806] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:59.773809  6388 tablet_copy_client.cc:670] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:59.777969  6388 tablet_copy_client.cc:538] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:59.800699  6388 tablet_bootstrap.cc:492] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:12:59.833127  6388 tablet_bootstrap.cc:492] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:59.834174  6388 tablet_bootstrap.cc:492] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:12:59.835369  6388 ts_tablet_manager.cc:1403] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.007s
I20260709 12:12:59.839161  6388 raft_consensus.cc:359] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:59.840173  6388 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:12:59.840881  6388 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:59.843243  6388 ts_tablet_manager.cc:1434] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:12:59.861873  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-be69db606b5844b2ad9d8cdcd608216a received from {username='slave'} at 127.0.0.1:40216
I20260709 12:12:59.862306  6383 ts_tablet_manager.cc:933] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:12:59.862378  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-be69db606b5844b2ad9d8cdcd608216a on tablet be69db606b5844b2ad9d8cdcd608216a with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:12:59.874682  6383 tablet_copy_client.cc:323] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:12:59.876457  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet 1fb3872bc132421d9b9adacd9cf89a22 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:12:59.877012  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet 1fb3872bc132421d9b9adacd9cf89a22 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-1fb3872bc132421d9b9adacd9cf89a22
I20260709 12:12:59.886081  5763 tablet_copy_source_session.cc:215] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:59.890722  6383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb3872bc132421d9b9adacd9cf89a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:59.910354  6383 tablet_copy_client.cc:806] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:59.911197  6383 tablet_copy_client.cc:670] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:59.915302  6383 tablet_copy_client.cc:538] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:59.923986  6383 tablet_bootstrap.cc:492] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:12:59.944610  6328 raft_consensus.cc:1217] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:12:59.962807  6383 tablet_bootstrap.cc:492] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:59.968566  6383 tablet_bootstrap.cc:492] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:12:59.969333  6383 ts_tablet_manager.cc:1403] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.014s
I20260709 12:12:59.973484  6383 raft_consensus.cc:359] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:59.976684  6383 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:12:59.978127  6383 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:12:59.984478  6383 ts_tablet_manager.cc:1434] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:12:59.986579  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-1fb3872bc132421d9b9adacd9cf89a22 received from {username='slave'} at 127.0.0.1:40216
I20260709 12:12:59.987035  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-1fb3872bc132421d9b9adacd9cf89a22 on tablet 1fb3872bc132421d9b9adacd9cf89a22 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:00.140782  6328 raft_consensus.cc:1217] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:00.145056  6327 raft_consensus.cc:1217] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:00.343291  6328 raft_consensus.cc:1217] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:00.392324  6396 raft_consensus.cc:1064] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:00.395185  6396 consensus_queue.cc:237] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:00.402228  5748 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:00.404183  6358 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.402259  6328 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:00.407330  6281 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.411633  5601 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:00.415372  6358 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.454793  6281 raft_consensus.cc:2955] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.459439  5750 raft_consensus.cc:2955] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.492372  5500 catalog_manager.cc:5697] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.503013  6328 raft_consensus.cc:2955] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.504971  5601 raft_consensus.cc:2955] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.522766  6376 raft_consensus.cc:1064] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:00.525141  6376 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:00.634722  5601 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:00.637503  5750 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:00.638018  6407 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.640065  6281 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.646678  6328 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:00.659606  6281 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.662999  5677 consensus_queue.cc:237] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:00.664594  5996 raft_consensus.cc:1064] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:00.667893  5996 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:00.668891  6328 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:00.682935  5750 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:00.685081  6281 raft_consensus.cc:2955] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.691018  6407 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:00.692265  5750 raft_consensus.cc:2955] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.697388  6406 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:00.714032  6376 raft_consensus.cc:2955] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.715335  6327 raft_consensus.cc:2955] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.731315  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e5ac98436c3f4e54af415eb568349c1e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:00.737617  6328 raft_consensus.cc:2955] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.743434  5499 catalog_manager.cc:5697] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.749118  6327 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:00.747318  5501 catalog_manager.cc:5697] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.750382  6278 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.765946  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet e5ac98436c3f4e54af415eb568349c1e with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51894
I20260709 12:13:00.769173  5677 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:00.784164  6413 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:00.790124  5596 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:00.809989  6278 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.821015  5750 raft_consensus.cc:2955] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.823346  5597 raft_consensus.cc:2955] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.827490  6413 raft_consensus.cc:2955] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.831403  5677 raft_consensus.cc:2955] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.839754  6415 tablet_replica.cc:333] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:13:00.841138  6415 raft_consensus.cc:2243] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:00.841928  6415 raft_consensus.cc:2272] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:00.847563  6328 raft_consensus.cc:2955] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.870419  5499 catalog_manager.cc:5697] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.873250  5675 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:00.884171  6328 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:00.890480  5601 raft_consensus.cc:2955] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.895157  6406 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:00.906591  5750 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:00.908190  6376 raft_consensus.cc:2955] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.910216  6328 raft_consensus.cc:2955] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.918208  5597 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:00.920009  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0305464a3879473e825bbe12c2df9cd9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:00.920812  6415 ts_tablet_manager.cc:1916] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:00.932159  6326 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:00.933784  5996 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:00.936940  5597 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:00.940657  6278 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:00.945785  5499 catalog_manager.cc:5697] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.950359  6357 raft_consensus.cc:2955] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.953927  6413 raft_consensus.cc:1064] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:00.955013  6406 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:00.958314  6327 raft_consensus.cc:2955] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.956670  6413 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:00.965401  5604 raft_consensus.cc:2955] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:00.981243  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet 0305464a3879473e825bbe12c2df9cd9 with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:00.997371  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet be69db606b5844b2ad9d8cdcd608216a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:01.000358  5501 catalog_manager.cc:5697] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:01.010533  5597 raft_consensus.cc:2955] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:01.014860  6421 tablet_replica.cc:333] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:13:01.018947  6421 raft_consensus.cc:2243] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.022203  6327 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.023579  5675 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.027969  5996 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.029558  5996 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.042487  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet be69db606b5844b2ad9d8cdcd608216a with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35870
I20260709 12:13:01.052228  5601 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.075766  5996 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.074898  6421 raft_consensus.cc:2272] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.079643  6424 tablet_replica.cc:333] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:13:01.089977  6415 ts_tablet_manager.cc:1929] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:01.106645  6415 log.cc:1199] T e5ac98436c3f4e54af415eb568349c1e P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/e5ac98436c3f4e54af415eb568349c1e
I20260709 12:13:01.108551  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet e5ac98436c3f4e54af415eb568349c1e (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:01.120252  6421 ts_tablet_manager.cc:1916] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:01.140765  6424 raft_consensus.cc:2243] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.143996  6413 raft_consensus.cc:2955] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:01.141527  6424 raft_consensus.cc:2272] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.154558  6327 raft_consensus.cc:2955] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:01.157305  6424 ts_tablet_manager.cc:1916] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:01.179419  5596 raft_consensus.cc:2955] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:01.182868  6421 ts_tablet_manager.cc:1929] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:01.190133  6421 log.cc:1199] T 0305464a3879473e825bbe12c2df9cd9 P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/0305464a3879473e825bbe12c2df9cd9
I20260709 12:13:01.182902  5499 catalog_manager.cc:5697] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:01.193033  5677 raft_consensus.cc:2955] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:01.201617  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet 0305464a3879473e825bbe12c2df9cd9 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:01.211603  6424 ts_tablet_manager.cc:1929] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:01.212139  6424 log.cc:1199] T be69db606b5844b2ad9d8cdcd608216a P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/be69db606b5844b2ad9d8cdcd608216a
I20260709 12:13:01.216361  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet be69db606b5844b2ad9d8cdcd608216a (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:01.220285  5748 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:01.226215  6327 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:01.227766  6357 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:01.232085  5596 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:01.235829  6413 raft_consensus.cc:2955] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:01.240429  6357 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:01.240952  6327 raft_consensus.cc:2955] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:01.257797  5596 raft_consensus.cc:2955] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:01.277168  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1fb3872bc132421d9b9adacd9cf89a22 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:01.290002  5501 catalog_manager.cc:5697] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:01.304396  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fb3872bc132421d9b9adacd9cf89a22 with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35870
I20260709 12:13:01.305338  6424 tablet_replica.cc:333] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:13:01.306759  6424 raft_consensus.cc:2243] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.307462  6424 raft_consensus.cc:2272] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.317747  6424 ts_tablet_manager.cc:1916] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:01.339238  6424 ts_tablet_manager.cc:1929] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:01.340191  6424 log.cc:1199] T 1fb3872bc132421d9b9adacd9cf89a22 P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/1fb3872bc132421d9b9adacd9cf89a22
I20260709 12:13:01.341814  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet 1fb3872bc132421d9b9adacd9cf89a22 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:02.380252  5677 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:02.385984  5750 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:02.386235  5645 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25119dffb65d40f48346fb5615d100e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.387219  5596 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:02.387398  6426 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.388437  6358 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.398226  6426 raft_consensus.cc:2955] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.403505  5750 raft_consensus.cc:2955] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.406102  5597 raft_consensus.cc:2955] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.417505  5498 catalog_manager.cc:5697] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.418715  5677 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:02.430922  5750 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:02.430989  5596 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:02.431722  5645 consensus_peers.cc:597] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd3b2e7e31554c729a4604dbf4abbd29. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.432358  6426 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.433287  6157 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.441913  6426 raft_consensus.cc:2955] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.443909  5748 raft_consensus.cc:2955] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.450661  5597 raft_consensus.cc:2955] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.472797  5498 catalog_manager.cc:5697] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.491596  5597 consensus_queue.cc:237] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:02.498998  5748 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:02.499207  5679 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:02.501209  6155 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.508428  6155 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.515460  6441 raft_consensus.cc:2955] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.517190  5748 raft_consensus.cc:2955] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.524384  5677 raft_consensus.cc:2955] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:13:02.527148  5570 consensus_peers.cc:597] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45e8be48ea634f3a922604ba76b16e6a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.531069  5597 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:02.534648  5501 catalog_manager.cc:5697] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:02.539323  5570 consensus_peers.cc:597] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c895f37947b04f8c8b0f3a8ac1874b71. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.543553  5750 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:02.546738  6155 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.549523  5677 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:02.552196  6155 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.555934  6441 raft_consensus.cc:2955] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.561645  5750 raft_consensus.cc:2955] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.588382  5498 catalog_manager.cc:5697] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.599265  5675 raft_consensus.cc:2955] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:02.798480  6450 ts_tablet_manager.cc:933] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:02.800631  6450 tablet_copy_client.cc:323] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:02.802120  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet 25119dffb65d40f48346fb5615d100e5 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:02.802644  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet 25119dffb65d40f48346fb5615d100e5 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-25119dffb65d40f48346fb5615d100e5
I20260709 12:13:02.809651  5689 tablet_copy_source_session.cc:215] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:02.812462  6450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25119dffb65d40f48346fb5615d100e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.824671  6450 tablet_copy_client.cc:806] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:02.825161  6450 tablet_copy_client.cc:670] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:02.829181  6450 tablet_copy_client.cc:538] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:02.836186  6450 tablet_bootstrap.cc:492] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:02.854086  6450 tablet_bootstrap.cc:492] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:02.854779  6450 tablet_bootstrap.cc:492] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:02.855305  6450 ts_tablet_manager.cc:1403] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 12:13:02.857568  6450 raft_consensus.cc:359] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:02.858381  6450 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:02.859045  6450 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:02.875788  6450 ts_tablet_manager.cc:1434] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 12:13:02.877611  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-25119dffb65d40f48346fb5615d100e5 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:02.878047  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-25119dffb65d40f48346fb5615d100e5 on tablet 25119dffb65d40f48346fb5615d100e5 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:02.924309  6450 ts_tablet_manager.cc:933] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:02.925935  6450 tablet_copy_client.cc:323] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.65:38715
I20260709 12:13:02.936961  5614 tablet_copy_service.cc:140] P b3083333af3348e4938f905ca4c4819f: Received BeginTabletCopySession request for tablet c895f37947b04f8c8b0f3a8ac1874b71 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:34012)
I20260709 12:13:02.937450  5614 tablet_copy_service.cc:161] P b3083333af3348e4938f905ca4c4819f: Beginning new tablet copy session on tablet c895f37947b04f8c8b0f3a8ac1874b71 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:34012: session id = c02ed29558db481589fd3db23e43a07f-c895f37947b04f8c8b0f3a8ac1874b71
I20260709 12:13:02.943401  5614 tablet_copy_source_session.cc:215] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:02.945706  6450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c895f37947b04f8c8b0f3a8ac1874b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.963193  6450 tablet_copy_client.cc:806] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:02.963792  6450 tablet_copy_client.cc:670] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:02.968261  6450 tablet_copy_client.cc:538] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:02.976326  6450 tablet_bootstrap.cc:492] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:02.976775  6456 ts_tablet_manager.cc:933] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:02.976908  6457 ts_tablet_manager.cc:933] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:02.987861  6457 tablet_copy_client.cc:323] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.65:38715
I20260709 12:13:02.990787  5614 tablet_copy_service.cc:140] P b3083333af3348e4938f905ca4c4819f: Received BeginTabletCopySession request for tablet 45e8be48ea634f3a922604ba76b16e6a from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:34012)
I20260709 12:13:02.991336  5614 tablet_copy_service.cc:161] P b3083333af3348e4938f905ca4c4819f: Beginning new tablet copy session on tablet 45e8be48ea634f3a922604ba76b16e6a from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:34012: session id = c02ed29558db481589fd3db23e43a07f-45e8be48ea634f3a922604ba76b16e6a
I20260709 12:13:02.992910  6456 tablet_copy_client.cc:323] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:02.997128  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet dd3b2e7e31554c729a4604dbf4abbd29 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:03.000284  5614 tablet_copy_source_session.cc:215] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:03.003639  6457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e8be48ea634f3a922604ba76b16e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.999157  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet dd3b2e7e31554c729a4604dbf4abbd29 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-dd3b2e7e31554c729a4604dbf4abbd29
I20260709 12:13:03.014017  6450 tablet_bootstrap.cc:492] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:03.014878  6450 tablet_bootstrap.cc:492] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:03.015499  6450 ts_tablet_manager.cc:1403] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.004s
I20260709 12:13:03.018646  6457 tablet_copy_client.cc:806] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:03.018330  6450 raft_consensus.cc:359] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:03.019145  6450 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:03.019461  6457 tablet_copy_client.cc:670] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:03.019848  6450 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:03.022267  6450 ts_tablet_manager.cc:1434] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:03.025491  5614 tablet_copy_service.cc:342] P b3083333af3348e4938f905ca4c4819f: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-c895f37947b04f8c8b0f3a8ac1874b71 received from {username='slave'} at 127.0.0.1:34012
I20260709 12:13:03.025842  5614 tablet_copy_service.cc:434] P b3083333af3348e4938f905ca4c4819f: ending tablet copy session c02ed29558db481589fd3db23e43a07f-c895f37947b04f8c8b0f3a8ac1874b71 on tablet c895f37947b04f8c8b0f3a8ac1874b71 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:03.027966  6457 tablet_copy_client.cc:538] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:03.037695  6457 tablet_bootstrap.cc:492] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:03.043637  5689 tablet_copy_source_session.cc:215] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:03.056360  6456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd3b2e7e31554c729a4604dbf4abbd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.068969  6457 tablet_bootstrap.cc:492] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:03.069916  6457 tablet_bootstrap.cc:492] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:03.070572  6457 ts_tablet_manager.cc:1403] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.007s
I20260709 12:13:03.071666  6456 tablet_copy_client.cc:806] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:03.072247  6456 tablet_copy_client.cc:670] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:03.073436  6457 raft_consensus.cc:359] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:03.074515  6457 raft_consensus.cc:740] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:03.074995  6457 consensus_queue.cc:260] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:03.075675  6456 tablet_copy_client.cc:538] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:03.077219  6457 ts_tablet_manager.cc:1434] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 12:13:03.078795  5614 tablet_copy_service.cc:342] P b3083333af3348e4938f905ca4c4819f: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-45e8be48ea634f3a922604ba76b16e6a received from {username='slave'} at 127.0.0.1:34012
I20260709 12:13:03.079167  5614 tablet_copy_service.cc:434] P b3083333af3348e4938f905ca4c4819f: ending tablet copy session c02ed29558db481589fd3db23e43a07f-45e8be48ea634f3a922604ba76b16e6a on tablet 45e8be48ea634f3a922604ba76b16e6a with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:03.085469  6456 tablet_bootstrap.cc:492] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:03.105733  6456 tablet_bootstrap.cc:492] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:03.106593  6456 tablet_bootstrap.cc:492] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:03.107203  6456 ts_tablet_manager.cc:1403] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.002s
I20260709 12:13:03.110016  6456 raft_consensus.cc:359] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:03.110824  6456 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:03.111434  6456 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:03.113683  6456 ts_tablet_manager.cc:1434] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:03.115299  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-dd3b2e7e31554c729a4604dbf4abbd29 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:03.115640  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-dd3b2e7e31554c729a4604dbf4abbd29 on tablet dd3b2e7e31554c729a4604dbf4abbd29 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:03.224222  6327 raft_consensus.cc:1217] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:03.408105  6327 raft_consensus.cc:1217] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:13:03.458915  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 48858.6us
I20260709 12:13:03.464897  6327 raft_consensus.cc:1217] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:03.529677  6327 raft_consensus.cc:1217] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:03.700958  6358 raft_consensus.cc:1064] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:03.702744  6358 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:03.708279  6327 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:03.708997  5750 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:03.710244  6430 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.714043  6426 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:03.720269  5597 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:03.721927  6157 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.756206  6157 raft_consensus.cc:2955] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.769752  5596 raft_consensus.cc:2955] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.779706  5750 raft_consensus.cc:2955] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.783772  5498 catalog_manager.cc:5697] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.774420  6327 raft_consensus.cc:2955] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.824445  5675 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:03.829510  6327 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:03.830852  6157 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:03.831934  5596 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:03.835079  6157 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:03.837466  6430 raft_consensus.cc:2955] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.844115  6327 raft_consensus.cc:2955] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.861379  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 25119dffb65d40f48346fb5615d100e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:03.863091  5500 catalog_manager.cc:5697] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.872314  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet 25119dffb65d40f48346fb5615d100e5 with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:03.875548  6476 tablet_replica.cc:333] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:13:03.876636  6476 raft_consensus.cc:2243] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:03.877364  6476 raft_consensus.cc:2272] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.880671  6476 ts_tablet_manager.cc:1916] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:03.882938  5596 raft_consensus.cc:2955] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.895917  6476 ts_tablet_manager.cc:1929] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:03.896495  6476 log.cc:1199] T 25119dffb65d40f48346fb5615d100e5 P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/25119dffb65d40f48346fb5615d100e5
I20260709 12:13:03.902762  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet 25119dffb65d40f48346fb5615d100e5 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:03.922256  6463 raft_consensus.cc:1064] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:03.924785  6463 consensus_queue.cc:237] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:03.931412  6327 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:03.931938  5750 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:03.932484  5677 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:03.934257  6464 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.936065  6464 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.938808  6441 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.955116  6463 raft_consensus.cc:1064] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:03.959259  6463 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:03.958997  6464 raft_consensus.cc:2955] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.961305  5677 raft_consensus.cc:2955] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.969022  6327 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:03.969837  5752 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:03.971351  5675 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:03.976320  6466 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.978847  6441 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.983884  5752 raft_consensus.cc:2955] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.984602  5499 catalog_manager.cc:5697] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:03.986450  6465 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.990044  6327 raft_consensus.cc:2955] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.013451  6463 raft_consensus.cc:2955] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.021806  5750 raft_consensus.cc:2955] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.026350  5597 consensus_queue.cc:237] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:04.033660  6327 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:04.035205  5752 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:04.038619  6280 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:04.046841  6465 raft_consensus.cc:2955] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.047986  6466 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:04.050547  6328 raft_consensus.cc:2955] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.043654  6327 raft_consensus.cc:2955] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.058980  5500 catalog_manager.cc:5697] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.082263  6430 raft_consensus.cc:1064] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:04.083736  5675 raft_consensus.cc:2955] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.084245  5750 raft_consensus.cc:2955] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.085738  6430 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:04.106638  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 45e8be48ea634f3a922604ba76b16e6a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:04.117288  5596 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:04.123904  5501 catalog_manager.cc:5697] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.130780  5675 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:04.130992  6328 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:04.132637  6441 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:04.136533  6466 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:04.144867  5750 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.147253  6327 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.147665  6441 raft_consensus.cc:2955] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.151214  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet 45e8be48ea634f3a922604ba76b16e6a with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35870
I20260709 12:13:04.153580  5601 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.151801  6426 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:13:04.164419  6430 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:04.181550  6327 raft_consensus.cc:2955] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.186239  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c895f37947b04f8c8b0f3a8ac1874b71 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:04.184801  6430 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:13:04.199029  5501 catalog_manager.cc:5697] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.201066  6486 tablet_replica.cc:333] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:13:04.212706  6486 raft_consensus.cc:2243] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.213536  6486 raft_consensus.cc:2272] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.218802  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet c895f37947b04f8c8b0f3a8ac1874b71 with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:04.220047  6476 tablet_replica.cc:333] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:13:04.219107  6426 raft_consensus.cc:2955] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.221145  6476 raft_consensus.cc:2243] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.221984  6476 raft_consensus.cc:2272] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.225665  6486 ts_tablet_manager.cc:1916] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:04.226300  5679 raft_consensus.cc:2955] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.229269  6328 raft_consensus.cc:2955] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.236999  5748 raft_consensus.cc:2955] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.242926  6476 ts_tablet_manager.cc:1916] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:04.250483  5596 raft_consensus.cc:2955] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.258769  5500 catalog_manager.cc:5697] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.261713  6486 ts_tablet_manager.cc:1929] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:04.263419  6486 log.cc:1199] T 45e8be48ea634f3a922604ba76b16e6a P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/45e8be48ea634f3a922604ba76b16e6a
I20260709 12:13:04.267091  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet 45e8be48ea634f3a922604ba76b16e6a (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:04.280390  5679 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:04.282742  6476 ts_tablet_manager.cc:1929] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:04.283188  6476 log.cc:1199] T c895f37947b04f8c8b0f3a8ac1874b71 P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/c895f37947b04f8c8b0f3a8ac1874b71
I20260709 12:13:04.284893  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet c895f37947b04f8c8b0f3a8ac1874b71 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:04.287179  6328 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:04.288192  5748 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:04.289196  6426 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:04.290793  6157 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:04.297420  6430 raft_consensus.cc:2955] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.299873  5750 raft_consensus.cc:2955] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.302918  6327 raft_consensus.cc:2955] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.317400  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd3b2e7e31554c729a4604dbf4abbd29 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:04.318420  5500 catalog_manager.cc:5697] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:04.334611  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet dd3b2e7e31554c729a4604dbf4abbd29 with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51894
I20260709 12:13:04.342209  6490 tablet_replica.cc:333] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:13:04.342967  6490 raft_consensus.cc:2243] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.343638  6490 raft_consensus.cc:2272] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.347303  6490 ts_tablet_manager.cc:1916] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:04.358867  6490 ts_tablet_manager.cc:1929] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:04.359270  6490 log.cc:1199] T dd3b2e7e31554c729a4604dbf4abbd29 P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/dd3b2e7e31554c729a4604dbf4abbd29
I20260709 12:13:04.360678  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet dd3b2e7e31554c729a4604dbf4abbd29 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:05.396106  5750 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:05.401970  5679 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:05.402122  5601 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:05.402474  5719 consensus_peers.cc:597] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c0ad918df054a3080325a8ca6d4aed0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:05.403478  6492 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:05.404268  6413 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:05.411289  6413 raft_consensus.cc:2955] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.412887  5679 raft_consensus.cc:2955] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.413024  5601 raft_consensus.cc:2955] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.425729  5601 consensus_queue.cc:237] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:05.428303  5500 catalog_manager.cc:5697] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.433656  5679 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:05.434072  5570 consensus_peers.cc:597] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60b8cda7467d4abb9e997bacb7d063ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:05.435727  5750 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:05.435626  6464 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:05.437408  6441 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:05.447168  6464 raft_consensus.cc:2955] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.450165  5748 raft_consensus.cc:2955] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.467566  5679 raft_consensus.cc:2955] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.476254  5677 consensus_queue.cc:237] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:13:05.488809  5645 consensus_peers.cc:597] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1642b3c7e6044747893b0e74e79ec49b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:05.490782  5748 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:05.499459  5601 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:05.499951  6491 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:05.508432  6491 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:05.511529  5499 catalog_manager.cc:5697] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.522902  6426 raft_consensus.cc:2955] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.526644  5748 raft_consensus.cc:2955] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.532816  5596 raft_consensus.cc:2955] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.544943  5679 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:05.548619  5501 catalog_manager.cc:5697] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:05.555909  5645 consensus_peers.cc:597] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1ba4203e7f7c4e46bd83c6bdda936a65. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:05.557552  5601 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:05.558372  5748 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:05.559324  6426 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:05.561744  6506 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:05.578459  6491 raft_consensus.cc:2955] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.580646  5748 raft_consensus.cc:2955] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.657317  5500 catalog_manager.cc:5697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.674127  5601 raft_consensus.cc:2955] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:05.823871  6514 ts_tablet_manager.cc:933] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:05.826144  6514 tablet_copy_client.cc:323] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.65:38715
I20260709 12:13:05.827909  5614 tablet_copy_service.cc:140] P b3083333af3348e4938f905ca4c4819f: Received BeginTabletCopySession request for tablet 60b8cda7467d4abb9e997bacb7d063ef from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:34012)
I20260709 12:13:05.828369  5614 tablet_copy_service.cc:161] P b3083333af3348e4938f905ca4c4819f: Beginning new tablet copy session on tablet 60b8cda7467d4abb9e997bacb7d063ef from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:34012: session id = c02ed29558db481589fd3db23e43a07f-60b8cda7467d4abb9e997bacb7d063ef
I20260709 12:13:05.835852  5614 tablet_copy_source_session.cc:215] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:05.839202  6514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b8cda7467d4abb9e997bacb7d063ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:05.856760  6514 tablet_copy_client.cc:806] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:05.857445  6514 tablet_copy_client.cc:670] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:05.861405  6514 tablet_copy_client.cc:538] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:05.872201  6514 tablet_bootstrap.cc:492] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:05.894806  6514 tablet_bootstrap.cc:492] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.895607  6514 tablet_bootstrap.cc:492] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:05.896327  6514 ts_tablet_manager.cc:1403] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.014s
I20260709 12:13:05.899535  6514 raft_consensus.cc:359] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:05.900372  6514 raft_consensus.cc:740] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:05.900902  6514 consensus_queue.cc:260] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:05.904300  6514 ts_tablet_manager.cc:1434] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:05.907800  5614 tablet_copy_service.cc:342] P b3083333af3348e4938f905ca4c4819f: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-60b8cda7467d4abb9e997bacb7d063ef received from {username='slave'} at 127.0.0.1:34012
I20260709 12:13:05.908342  5614 tablet_copy_service.cc:434] P b3083333af3348e4938f905ca4c4819f: ending tablet copy session c02ed29558db481589fd3db23e43a07f-60b8cda7467d4abb9e997bacb7d063ef on tablet 60b8cda7467d4abb9e997bacb7d063ef with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:05.955611  6514 ts_tablet_manager.cc:933] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:05.957211  6514 tablet_copy_client.cc:323] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:05.958935  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet 1642b3c7e6044747893b0e74e79ec49b from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:05.959398  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet 1642b3c7e6044747893b0e74e79ec49b from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-1642b3c7e6044747893b0e74e79ec49b
I20260709 12:13:05.965523  5689 tablet_copy_source_session.cc:215] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:05.968393  6514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1642b3c7e6044747893b0e74e79ec49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:05.983916  6514 tablet_copy_client.cc:806] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:05.984472  6514 tablet_copy_client.cc:670] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:05.989343  6514 tablet_copy_client.cc:538] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:05.999168  6514 tablet_bootstrap.cc:492] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:06.019321  6520 ts_tablet_manager.cc:933] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:06.019682  6514 tablet_bootstrap.cc:492] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:06.021020  6514 tablet_bootstrap.cc:492] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:06.021669  6514 ts_tablet_manager.cc:1403] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.001s
I20260709 12:13:06.028407  6514 raft_consensus.cc:359] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:06.029238  6514 raft_consensus.cc:740] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:06.029878  6514 consensus_queue.cc:260] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:06.032388  6514 ts_tablet_manager.cc:1434] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:13:06.040925  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-1642b3c7e6044747893b0e74e79ec49b received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:06.041460  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-1642b3c7e6044747893b0e74e79ec49b on tablet 1642b3c7e6044747893b0e74e79ec49b with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:06.048909  6514 ts_tablet_manager.cc:933] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:06.109474  6514 tablet_copy_client.cc:323] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:06.114042  6520 tablet_copy_client.cc:323] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:13:06.116240  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet 1c0ad918df054a3080325a8ca6d4aed0 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:13:06.116779  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet 1c0ad918df054a3080325a8ca6d4aed0 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-1c0ad918df054a3080325a8ca6d4aed0
I20260709 12:13:06.125274  5763 tablet_copy_source_session.cc:215] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:06.140725  6520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0ad918df054a3080325a8ca6d4aed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.142336  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet 1ba4203e7f7c4e46bd83c6bdda936a65 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:06.142899  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet 1ba4203e7f7c4e46bd83c6bdda936a65 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-1ba4203e7f7c4e46bd83c6bdda936a65
I20260709 12:13:06.159711  5689 tablet_copy_source_session.cc:215] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:06.174083  6514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba4203e7f7c4e46bd83c6bdda936a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.185540  6520 tablet_copy_client.cc:806] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:06.186355  6520 tablet_copy_client.cc:670] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:06.190899  6520 tablet_copy_client.cc:538] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:06.199743  6520 tablet_bootstrap.cc:492] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:06.204006  6514 tablet_copy_client.cc:806] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:06.204689  6514 tablet_copy_client.cc:670] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:06.208448  6514 tablet_copy_client.cc:538] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:06.215667  6514 tablet_bootstrap.cc:492] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:06.224464  6520 tablet_bootstrap.cc:492] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:06.225430  6520 tablet_bootstrap.cc:492] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:06.226138  6520 ts_tablet_manager.cc:1403] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.000s
I20260709 12:13:06.229825  6520 raft_consensus.cc:359] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:06.230682  6520 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:06.231328  6520 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:06.236397  6520 ts_tablet_manager.cc:1434] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:13:06.240747  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-1c0ad918df054a3080325a8ca6d4aed0 received from {username='slave'} at 127.0.0.1:40216
I20260709 12:13:06.241251  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-1c0ad918df054a3080325a8ca6d4aed0 on tablet 1c0ad918df054a3080325a8ca6d4aed0 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:06.257375  6514 tablet_bootstrap.cc:492] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:06.258394  6514 tablet_bootstrap.cc:492] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:06.259083  6514 ts_tablet_manager.cc:1403] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.002s
I20260709 12:13:06.261660  6514 raft_consensus.cc:359] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:06.262506  6514 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:06.263089  6514 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:06.265190  6514 ts_tablet_manager.cc:1434] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:13:06.266780  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-1ba4203e7f7c4e46bd83c6bdda936a65 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:06.267182  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-1ba4203e7f7c4e46bd83c6bdda936a65 on tablet 1ba4203e7f7c4e46bd83c6bdda936a65 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:06.269855  6327 raft_consensus.cc:1217] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:06.346084  6327 raft_consensus.cc:1217] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:06.427137  6327 raft_consensus.cc:1217] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:06.533128  6327 raft_consensus.cc:1217] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:06.824287  6525 raft_consensus.cc:1064] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:06.826984  6525 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:06.834857  6327 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:06.836706  6526 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:06.840503  5748 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:06.843016  6525 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:06.844413  5600 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:06.850096  6526 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:06.860435  6497 raft_consensus.cc:1064] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:06.862085  6525 raft_consensus.cc:2955] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:06.863039  6497 consensus_queue.cc:237] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:06.873392  5748 raft_consensus.cc:2955] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:06.875584  5597 raft_consensus.cc:2955] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:06.869920  6327 raft_consensus.cc:2955] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:06.890110  6328 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:06.894418  5501 catalog_manager.cc:5697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.898543  6441 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:06.913573  5748 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:06.915022  6441 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:06.920967  5679 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:06.922583  6441 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:06.939033  6441 raft_consensus.cc:2955] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:06.943621  5750 raft_consensus.cc:2955] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:06.947139  6426 raft_consensus.cc:1064] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:06.946489  6328 raft_consensus.cc:2955] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:06.949414  6426 consensus_queue.cc:237] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:06.953408  5679 raft_consensus.cc:2955] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:06.973002  6328 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:06.973735  5597 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:06.973882  5750 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:06.974651  6525 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:06.975616  6526 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:06.976544  6531 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.001636  5499 catalog_manager.cc:5697] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.010390  6426 raft_consensus.cc:2955] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.017920  5597 consensus_queue.cc:237] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:07.021062  5679 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:07.024674  6328 raft_consensus.cc:2955] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.035472  6327 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:07.034719  5750 raft_consensus.cc:2955] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.037730  6327 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:07.038909  5601 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:07.047818  6526 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:07.051431  6536 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:07.055262  5499 catalog_manager.cc:5697] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.062808  6497 raft_consensus.cc:2955] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.067605  6326 raft_consensus.cc:2955] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.068507  5600 raft_consensus.cc:2955] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.073181  5750 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:07.091228  6531 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:13:07.110108  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 54200.7us
W20260709 12:13:07.115478  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 45708.2us
I20260709 12:13:07.116781  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 60b8cda7467d4abb9e997bacb7d063ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:07.122236  5673 consensus_queue.cc:237] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:07.127707  6536 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:07.128286  6526 raft_consensus.cc:2955] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.127712  5499 catalog_manager.cc:5697] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.132406  5597 raft_consensus.cc:2955] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.149269  6492 raft_consensus.cc:1064] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:07.149814  5746 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:07.152181  6492 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:07.158898  6426 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:07.159243  5746 raft_consensus.cc:2955] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.167555  6548 raft_consensus.cc:2955] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.169507  5750 raft_consensus.cc:2955] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.179078  6326 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:07.188091  5499 catalog_manager.cc:5697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.199599  6526 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:07.201051  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ba4203e7f7c4e46bd83c6bdda936a65 with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:07.210083  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1ba4203e7f7c4e46bd83c6bdda936a65 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:07.248343  6328 raft_consensus.cc:2955] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.256697  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet 60b8cda7467d4abb9e997bacb7d063ef with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35870
I20260709 12:13:07.275070  6327 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.276562  6550 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:07.276439  6326 raft_consensus.cc:2955] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.278856  6555 tablet_replica.cc:333] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:13:07.282076  5499 catalog_manager.cc:5697] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.285977  5597 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.288241  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1642b3c7e6044747893b0e74e79ec49b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:07.290527  6492 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.309455  5671 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.319741  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet 1642b3c7e6044747893b0e74e79ec49b with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51894
I20260709 12:13:07.340969  6560 tablet_replica.cc:333] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:13:07.341209  6556 tablet_replica.cc:333] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:13:07.342401  6560 raft_consensus.cc:2243] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.343335  6560 raft_consensus.cc:2272] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.352200  6560 ts_tablet_manager.cc:1916] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:07.356691  6492 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.382256  6556 raft_consensus.cc:2243] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.383076  6556 raft_consensus.cc:2272] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.383176  6552 raft_consensus.cc:2955] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.385715  6560 ts_tablet_manager.cc:1929] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:07.386270  6560 log.cc:1199] T 1642b3c7e6044747893b0e74e79ec49b P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/1642b3c7e6044747893b0e74e79ec49b
I20260709 12:13:07.388374  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet 1642b3c7e6044747893b0e74e79ec49b (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:07.389065  6327 raft_consensus.cc:2955] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.390900  5597 raft_consensus.cc:2955] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.395840  6556 ts_tablet_manager.cc:1916] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:07.402530  5499 catalog_manager.cc:5697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.406391  5673 raft_consensus.cc:2955] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.416494  6556 ts_tablet_manager.cc:1929] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:07.417053  6556 log.cc:1199] T 60b8cda7467d4abb9e997bacb7d063ef P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/60b8cda7467d4abb9e997bacb7d063ef
I20260709 12:13:07.417689  5750 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:07.419215  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet 60b8cda7467d4abb9e997bacb7d063ef (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:07.425931  6327 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:07.429209  6551 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:07.437196  5671 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:07.440246  6555 raft_consensus.cc:2243] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.441162  6555 raft_consensus.cc:2272] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.442536  6550 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:07.446008  6327 raft_consensus.cc:2955] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.453219  6555 ts_tablet_manager.cc:1916] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:07.445791  6492 raft_consensus.cc:2955] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.448798  5671 raft_consensus.cc:2955] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.463212  5498 catalog_manager.cc:5697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:07.473496  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c0ad918df054a3080325a8ca6d4aed0 with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51894
I20260709 12:13:07.474622  6560 tablet_replica.cc:333] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:13:07.475679  6560 raft_consensus.cc:2243] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.476507  6560 raft_consensus.cc:2272] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.479784  6560 ts_tablet_manager.cc:1916] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:07.481083  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1c0ad918df054a3080325a8ca6d4aed0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:07.496102  6555 ts_tablet_manager.cc:1929] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:07.496658  6555 log.cc:1199] T 1ba4203e7f7c4e46bd83c6bdda936a65 P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/1ba4203e7f7c4e46bd83c6bdda936a65
I20260709 12:13:07.501633  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet 1ba4203e7f7c4e46bd83c6bdda936a65 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:07.502146  6560 ts_tablet_manager.cc:1929] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:07.502602  6560 log.cc:1199] T 1c0ad918df054a3080325a8ca6d4aed0 P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/1c0ad918df054a3080325a8ca6d4aed0
I20260709 12:13:07.504078  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet 1c0ad918df054a3080325a8ca6d4aed0 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:08.533562  5600 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:08.539624  5752 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:08.540093  5570 consensus_peers.cc:597] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ac03e19ba8d49feb196035d3b697b69. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.540488  5673 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.541021  6569 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.541931  6574 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.551268  6574 raft_consensus.cc:2955] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.553778  5752 raft_consensus.cc:2955] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.558843  5679 raft_consensus.cc:2955] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.566843  5673 consensus_queue.cc:237] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:08.581014  5499 catalog_manager.cc:5697] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:13:08.583820  5645 consensus_peers.cc:597] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b92bb11ba2c8484d8bba9f5e2ac5b9c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.586339  5748 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.588354  6575 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:08.593573  5600 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.595662  6575 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.605890  6563 raft_consensus.cc:2955] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.608603  5748 raft_consensus.cc:2955] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.608582  5600 raft_consensus.cc:2955] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.623924  5748 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:08.631281  5673 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.632784  6579 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:08.635658  5719 consensus_peers.cc:597] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3ae5385212f45ceb104c78b3c149525. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.639550  5498 catalog_manager.cc:5697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.640470  5600 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.641975  6579 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.651566  6550 raft_consensus.cc:2955] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.655733  5679 raft_consensus.cc:2955] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.664757  5597 raft_consensus.cc:2955] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.677352  5499 catalog_manager.cc:5697] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.679389  5673 consensus_queue.cc:237] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:13:08.695044  5645 consensus_peers.cc:597] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a5e338890f843678fd0689c8568ed9c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.695709  5748 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.697145  6575 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.706274  5600 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.707628  6426 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.711102  6563 raft_consensus.cc:2955] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.713514  5750 raft_consensus.cc:2955] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.725433  5600 raft_consensus.cc:2955] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:08.734297  5500 catalog_manager.cc:5697] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:09.143049  6596 ts_tablet_manager.cc:933] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:09.145236  6596 tablet_copy_client.cc:323] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:09.146657  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet 3a5e338890f843678fd0689c8568ed9c from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:09.147060  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet 3a5e338890f843678fd0689c8568ed9c from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-3a5e338890f843678fd0689c8568ed9c
I20260709 12:13:09.152901  5689 tablet_copy_source_session.cc:215] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:09.153877  6598 ts_tablet_manager.cc:933] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:09.157423  6596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5e338890f843678fd0689c8568ed9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:09.176386  6598 tablet_copy_client.cc:323] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:09.178166  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:09.178676  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-b92bb11ba2c8484d8bba9f5e2ac5b9c5
I20260709 12:13:09.186141  5689 tablet_copy_source_session.cc:215] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:09.186843  6596 tablet_copy_client.cc:806] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:09.187475  6596 tablet_copy_client.cc:670] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:09.188910  6601 ts_tablet_manager.cc:933] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:09.189440  6598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:09.202037  6601 tablet_copy_client.cc:323] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.65:38715
I20260709 12:13:09.203986  5614 tablet_copy_service.cc:140] P b3083333af3348e4938f905ca4c4819f: Received BeginTabletCopySession request for tablet 8ac03e19ba8d49feb196035d3b697b69 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:34012)
I20260709 12:13:09.204608  5614 tablet_copy_service.cc:161] P b3083333af3348e4938f905ca4c4819f: Beginning new tablet copy session on tablet 8ac03e19ba8d49feb196035d3b697b69 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:34012: session id = c02ed29558db481589fd3db23e43a07f-8ac03e19ba8d49feb196035d3b697b69
I20260709 12:13:09.211215  6596 tablet_copy_client.cc:538] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:09.215015  5614 tablet_copy_source_session.cc:215] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:09.220643  6596 tablet_bootstrap.cc:492] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:09.222375  6599 ts_tablet_manager.cc:933] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:09.222620  6601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac03e19ba8d49feb196035d3b697b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:09.222680  6598 tablet_copy_client.cc:806] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:09.223753  6598 tablet_copy_client.cc:670] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:09.228111  6598 tablet_copy_client.cc:538] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:09.244030  6601 tablet_copy_client.cc:806] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:09.244772  6601 tablet_copy_client.cc:670] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
W20260709 12:13:09.248315  5700 debug-util.cc:398] Leaking SignalData structure 0x7b0800087000 after lost signal to thread 4412
W20260709 12:13:09.249358  5700 debug-util.cc:398] Leaking SignalData structure 0x7b0800169740 after lost signal to thread 5535
W20260709 12:13:09.250528  5700 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc060 after lost signal to thread 5628
W20260709 12:13:09.251559  5700 debug-util.cc:398] Leaking SignalData structure 0x7b08002443e0 after lost signal to thread 5703
I20260709 12:13:09.255638  6601 tablet_copy_client.cc:538] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:13:09.371774  5700 debug-util.cc:398] Leaking SignalData structure 0x7b0800111000 after lost signal to thread 5777
W20260709 12:13:09.376986  5700 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce920 after lost signal to thread 6352
I20260709 12:13:09.379421  6601 tablet_bootstrap.cc:492] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:09.381817  6596 tablet_bootstrap.cc:492] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.388255  6599 tablet_copy_client.cc:323] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:13:09.390684  6596 tablet_bootstrap.cc:492] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:09.391764  6596 ts_tablet_manager.cc:1403] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.171s	user 0.028s	sys 0.041s
I20260709 12:13:09.394284  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet b3ae5385212f45ceb104c78b3c149525 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:13:09.394891  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet b3ae5385212f45ceb104c78b3c149525 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-b3ae5385212f45ceb104c78b3c149525
I20260709 12:13:09.410588  5763 tablet_copy_source_session.cc:215] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:09.410856  6596 raft_consensus.cc:359] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:09.411765  6596 raft_consensus.cc:740] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:09.412470  6596 consensus_queue.cc:260] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:09.427205  6596 ts_tablet_manager.cc:1434] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.008s
I20260709 12:13:09.429046  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-3a5e338890f843678fd0689c8568ed9c received from {username='slave'} at 127.0.0.1:50284
W20260709 12:13:09.429337  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 70666us
I20260709 12:13:09.429601  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-3a5e338890f843678fd0689c8568ed9c on tablet 3a5e338890f843678fd0689c8568ed9c with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:09.436224  6599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ae5385212f45ceb104c78b3c149525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:09.439450  6598 tablet_bootstrap.cc:492] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:09.471287  6599 tablet_copy_client.cc:806] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:09.471912  6599 tablet_copy_client.cc:670] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:09.480816  6599 tablet_copy_client.cc:538] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:09.490811  6599 tablet_bootstrap.cc:492] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:09.492480  6601 tablet_bootstrap.cc:492] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.496304  6601 tablet_bootstrap.cc:492] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:09.497143  6601 ts_tablet_manager.cc:1403] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.118s	user 0.052s	sys 0.039s
I20260709 12:13:09.500255  6601 raft_consensus.cc:359] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:09.502007  6601 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:09.502751  6601 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:09.508059  6601 ts_tablet_manager.cc:1434] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:13:09.508771  6598 tablet_bootstrap.cc:492] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.510586  6598 tablet_bootstrap.cc:492] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:09.513861  5614 tablet_copy_service.cc:342] P b3083333af3348e4938f905ca4c4819f: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-8ac03e19ba8d49feb196035d3b697b69 received from {username='slave'} at 127.0.0.1:34012
I20260709 12:13:09.514423  5614 tablet_copy_service.cc:434] P b3083333af3348e4938f905ca4c4819f: ending tablet copy session c02ed29558db481589fd3db23e43a07f-8ac03e19ba8d49feb196035d3b697b69 on tablet 8ac03e19ba8d49feb196035d3b697b69 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:09.516281  6598 ts_tablet_manager.cc:1403] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.077s	user 0.025s	sys 0.000s
I20260709 12:13:09.519261  6598 raft_consensus.cc:359] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:09.520828  6598 raft_consensus.cc:740] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:09.521483  6598 consensus_queue.cc:260] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:09.538364  6598 ts_tablet_manager.cc:1434] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:13:09.543311  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-b92bb11ba2c8484d8bba9f5e2ac5b9c5 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:09.543843  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-b92bb11ba2c8484d8bba9f5e2ac5b9c5 on tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:09.548382  6599 tablet_bootstrap.cc:492] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.549571  6599 tablet_bootstrap.cc:492] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:09.550376  6599 ts_tablet_manager.cc:1403] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.016s
I20260709 12:13:09.553583  6599 raft_consensus.cc:359] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:09.554567  6599 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:09.555316  6599 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:09.558256  6599 ts_tablet_manager.cc:1434] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:09.566315  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-b3ae5385212f45ceb104c78b3c149525 received from {username='slave'} at 127.0.0.1:40216
I20260709 12:13:09.566753  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-b3ae5385212f45ceb104c78b3c149525 on tablet b3ae5385212f45ceb104c78b3c149525 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:09.567881  6325 raft_consensus.cc:1217] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:09.592466  6325 raft_consensus.cc:1217] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:09.601366  6325 raft_consensus.cc:1217] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:09.607834  6325 raft_consensus.cc:1217] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:10.006239  6572 raft_consensus.cc:1064] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:10.020237  6572 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:10.024636  6575 raft_consensus.cc:1064] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:10.027201  6575 consensus_queue.cc:237] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:10.050668  6426 raft_consensus.cc:1064] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:10.052855  6426 consensus_queue.cc:237] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:10.059501  5750 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.062892  6325 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.064239  6605 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.071475  6615 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.076427  5748 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.080607  5597 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.081832  6611 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.094765  6566 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.098697  5679 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.111091  6325 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.112675  6611 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.123621  6579 raft_consensus.cc:1064] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:10.127740  6579 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:10.133230  6611 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.174474  6575 raft_consensus.cc:2955] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.186317  6327 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.190590  6623 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.192936  5671 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.202849  5750 raft_consensus.cc:2955] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.212488  6610 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.215219  6328 raft_consensus.cc:2955] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.242412  6325 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.243474  5749 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.244239  5597 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.247373  6610 raft_consensus.cc:2955] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.249374  6605 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:10.257465  6627 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.254122  5671 raft_consensus.cc:2955] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.290081  5499 catalog_manager.cc:5697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:13:10.294001  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 147229us
I20260709 12:13:10.299255  6569 raft_consensus.cc:2955] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:13:10.302192  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 49676.8us
I20260709 12:13:10.310474  5597 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.312589  5679 raft_consensus.cc:2955] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.313838  5750 raft_consensus.cc:2955] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.318670  6325 raft_consensus.cc:2955] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.328094  5597 raft_consensus.cc:2955] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.340512  6635 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:10.346374  6566 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.347705  5498 catalog_manager.cc:5697] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.378000  5600 raft_consensus.cc:2955] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.409188  6615 raft_consensus.cc:2955] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.417285  5601 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:10.418517  6328 raft_consensus.cc:2955] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.425468  6327 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:10.428874  6612 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:10.433724  5501 catalog_manager.cc:5697] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.440824  5749 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:10.444756  6612 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:10.438007  6325 raft_consensus.cc:2955] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.451167  6572 raft_consensus.cc:2955] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.454597  5749 raft_consensus.cc:2955] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.458834  6327 raft_consensus.cc:2955] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.462406  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ac03e19ba8d49feb196035d3b697b69 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:10.481551  5500 catalog_manager.cc:5697] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:10.495761  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 103669us
I20260709 12:13:10.501439  5600 raft_consensus.cc:2955] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.518272  5752 raft_consensus.cc:2955] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.521570  5500 catalog_manager.cc:5697] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.536450  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ac03e19ba8d49feb196035d3b697b69 with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35870
I20260709 12:13:10.546819  6647 tablet_replica.cc:333] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:13:10.549904  5752 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:10.561401  5679 consensus_queue.cc:237] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:10.566644  6327 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:10.567472  6325 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:10.569319  5675 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:10.570946  5673 consensus_queue.cc:237] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:10.573302  6647 raft_consensus.cc:2243] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.573951  6647 raft_consensus.cc:2272] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.576653  6644 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:13:10.579254  6646 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:10.582949  6623 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:10.587496  6647 ts_tablet_manager.cc:1916] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:10.591740  6328 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:10.595541  6631 raft_consensus.cc:2955] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.597469  6623 raft_consensus.cc:2955] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.603447  6426 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:10.603168  5671 raft_consensus.cc:2955] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.611526  6327 raft_consensus.cc:2955] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.629096  6328 raft_consensus.cc:2955] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.617895  6325 raft_consensus.cc:2955] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.620909  5604 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:10.623127  6645 raft_consensus.cc:2955] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.626384  5600 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:10.639070  6627 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:10.639528  6646 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:10.645948  5600 raft_consensus.cc:2955] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.650874  5604 raft_consensus.cc:2955] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.657413  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:10.658588  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3a5e338890f843678fd0689c8568ed9c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:10.663846  6647 ts_tablet_manager.cc:1929] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:10.664346  6647 log.cc:1199] T 8ac03e19ba8d49feb196035d3b697b69 P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/8ac03e19ba8d49feb196035d3b697b69
I20260709 12:13:10.665133  5500 catalog_manager.cc:5697] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.671712  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet 8ac03e19ba8d49feb196035d3b697b69 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:10.672037  5498 catalog_manager.cc:5697] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.683924  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a5e338890f843678fd0689c8568ed9c with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:10.688868  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet b3ae5385212f45ceb104c78b3c149525 with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51894
I20260709 12:13:10.697839  5498 catalog_manager.cc:5697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:10.711146  5740 tablet_service.cc:1558] Processing DeleteTablet for tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5 with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:10.712231  6649 tablet_replica.cc:333] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:13:10.713230  6649 raft_consensus.cc:2243] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.716832  6649 raft_consensus.cc:2272] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.718778  6648 tablet_replica.cc:333] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:13:10.726475  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3ae5385212f45ceb104c78b3c149525 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:10.723659  6649 ts_tablet_manager.cc:1916] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:10.719777  6648 raft_consensus.cc:2243] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.731642  6648 raft_consensus.cc:2272] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.756785  6649 ts_tablet_manager.cc:1929] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:10.757400  6649 log.cc:1199] T b3ae5385212f45ceb104c78b3c149525 P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/b3ae5385212f45ceb104c78b3c149525
I20260709 12:13:10.759244  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet b3ae5385212f45ceb104c78b3c149525 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:10.759663  6648 ts_tablet_manager.cc:1916] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:10.777046  6648 ts_tablet_manager.cc:1929] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:10.777460  6648 log.cc:1199] T 3a5e338890f843678fd0689c8568ed9c P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/3a5e338890f843678fd0689c8568ed9c
I20260709 12:13:10.779098  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet 3a5e338890f843678fd0689c8568ed9c (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:10.779258  6648 tablet_replica.cc:333] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:13:10.780339  6648 raft_consensus.cc:2243] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.781158  6648 raft_consensus.cc:2272] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.784438  6648 ts_tablet_manager.cc:1916] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:10.799039  6648 ts_tablet_manager.cc:1929] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:10.799504  6648 log.cc:1199] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/b92bb11ba2c8484d8bba9f5e2ac5b9c5
I20260709 12:13:10.801074  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet b92bb11ba2c8484d8bba9f5e2ac5b9c5 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:11.808028  5752 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:11.813855  5679 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:11.813995  5719 consensus_peers.cc:597] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8638862e10a473ca889ec2b98a84132. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:11.815428  5604 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:11.815510  6637 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:11.817004  6623 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:11.823149  6637 raft_consensus.cc:2955] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:11.840971  5679 raft_consensus.cc:2955] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:11.850514  5671 consensus_queue.cc:237] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:11.851373  5499 catalog_manager.cc:5697] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:11.864770  5645 consensus_peers.cc:597] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33b7e33743744392a4b0269b94aa07b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:11.865610  5752 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:11.867162  6631 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:11.872120  5604 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:11.874954  6426 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:11.883334  5601 raft_consensus.cc:2955] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:11.914268  6646 raft_consensus.cc:2955] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:11.937000  5752 raft_consensus.cc:2955] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:11.963603  5749 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:11.964309  5601 raft_consensus.cc:2955] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:11.981307  5500 catalog_manager.cc:5697] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:11.992120  5671 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:11.993922  6653 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:11.994935  5601 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:11.997751  5719 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a91e24ad9ae49729bb9bc3ebcc36f9f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:11.998713  6655 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:12.013530  6653 raft_consensus.cc:2955] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:12.017233  5671 raft_consensus.cc:2955] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:12.020733  5601 raft_consensus.cc:2955] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:12.045024  5500 catalog_manager.cc:5697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:12.048004  5679 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:12.079706  5752 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:12.079986  5645 consensus_peers.cc:597] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f894158ba41541198a905d0e18553078. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:12.081259  6426 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:12.086910  5604 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.094349  6646 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:12.096964  6662 raft_consensus.cc:2955] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:12.109325  5752 raft_consensus.cc:2955] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:12.113312  5601 raft_consensus.cc:2955] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:12.132511  5499 catalog_manager.cc:5697] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:12.373456  6671 ts_tablet_manager.cc:933] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:12.378810  6671 tablet_copy_client.cc:323] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:13:12.380625  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:13:12.381177  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-0a91e24ad9ae49729bb9bc3ebcc36f9f
I20260709 12:13:12.393040  5763 tablet_copy_source_session.cc:215] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:12.397301  6671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:12.427130  6671 tablet_copy_client.cc:806] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:12.428131  6671 tablet_copy_client.cc:670] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:12.458472  6671 tablet_copy_client.cc:538] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:12.474830  6674 ts_tablet_manager.cc:933] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:12.483981  6673 ts_tablet_manager.cc:933] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:12.489113  6673 tablet_copy_client.cc:323] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:12.490610  6674 tablet_copy_client.cc:323] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:13:12.490887  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet 33b7e33743744392a4b0269b94aa07b3 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:12.493464  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet e8638862e10a473ca889ec2b98a84132 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:13:12.494035  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet e8638862e10a473ca889ec2b98a84132 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-e8638862e10a473ca889ec2b98a84132
I20260709 12:13:12.491488  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet 33b7e33743744392a4b0269b94aa07b3 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-33b7e33743744392a4b0269b94aa07b3
I20260709 12:13:12.509119  5763 tablet_copy_source_session.cc:215] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:12.511544  6671 tablet_bootstrap.cc:492] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:12.512842  5689 tablet_copy_source_session.cc:215] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:12.512810  6674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8638862e10a473ca889ec2b98a84132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:12.516120  6673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b7e33743744392a4b0269b94aa07b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:12.520033  6677 ts_tablet_manager.cc:933] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:12.531929  6677 tablet_copy_client.cc:323] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:12.534425  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet f894158ba41541198a905d0e18553078 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:12.534974  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet f894158ba41541198a905d0e18553078 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-f894158ba41541198a905d0e18553078
I20260709 12:13:12.543025  5689 tablet_copy_source_session.cc:215] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:12.546267  6677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f894158ba41541198a905d0e18553078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:12.548746  6674 tablet_copy_client.cc:806] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:12.549386  6674 tablet_copy_client.cc:670] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:12.555316  6673 tablet_copy_client.cc:806] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:12.556048  6673 tablet_copy_client.cc:670] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:12.554044  6674 tablet_copy_client.cc:538] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:12.567085  6673 tablet_copy_client.cc:538] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:12.574465  6674 tablet_bootstrap.cc:492] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:12.582458  6677 tablet_copy_client.cc:806] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:12.583132  6677 tablet_copy_client.cc:670] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:12.586198  6671 tablet_bootstrap.cc:492] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:12.587240  6671 tablet_bootstrap.cc:492] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:12.588006  6671 ts_tablet_manager.cc:1403] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.012s
I20260709 12:13:12.587946  6677 tablet_copy_client.cc:538] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:12.592458  6673 tablet_bootstrap.cc:492] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:12.597172  6671 raft_consensus.cc:359] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:12.598049  6671 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:12.609117  6671 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:12.622002  6677 tablet_bootstrap.cc:492] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:12.645632  6674 tablet_bootstrap.cc:492] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:12.656136  6671 ts_tablet_manager.cc:1434] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.007s
I20260709 12:13:12.658306  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-0a91e24ad9ae49729bb9bc3ebcc36f9f received from {username='slave'} at 127.0.0.1:40216
I20260709 12:13:12.658800  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-0a91e24ad9ae49729bb9bc3ebcc36f9f on tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:12.668352  6674 tablet_bootstrap.cc:492] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:12.677250  6674 ts_tablet_manager.cc:1403] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.103s	user 0.025s	sys 0.000s
I20260709 12:13:12.681835  6674 raft_consensus.cc:359] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:12.683072  6674 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:12.683806  6674 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:12.686195  6674 ts_tablet_manager.cc:1434] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:12.688256  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-e8638862e10a473ca889ec2b98a84132 received from {username='slave'} at 127.0.0.1:40216
I20260709 12:13:12.688687  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-e8638862e10a473ca889ec2b98a84132 on tablet e8638862e10a473ca889ec2b98a84132 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:12.690348  6677 tablet_bootstrap.cc:492] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:12.700702  6677 tablet_bootstrap.cc:492] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:12.699198  6673 tablet_bootstrap.cc:492] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:12.704936  6677 ts_tablet_manager.cc:1403] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.095s	user 0.026s	sys 0.004s
I20260709 12:13:12.705332  6673 tablet_bootstrap.cc:492] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:12.706877  6673 ts_tablet_manager.cc:1403] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.027s
I20260709 12:13:12.709323  6673 raft_consensus.cc:359] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:12.710276  6673 raft_consensus.cc:740] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:12.710987  6673 consensus_queue.cc:260] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:12.712497  6677 raft_consensus.cc:359] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:12.713366  6677 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:12.714061  6677 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:12.719430  6673 ts_tablet_manager.cc:1434] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:13:12.725234  6677 ts_tablet_manager.cc:1434] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260709 12:13:12.726209  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-33b7e33743744392a4b0269b94aa07b3 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:12.726706  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-33b7e33743744392a4b0269b94aa07b3 on tablet 33b7e33743744392a4b0269b94aa07b3 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:12.738761  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-f894158ba41541198a905d0e18553078 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:12.739243  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-f894158ba41541198a905d0e18553078 on tablet f894158ba41541198a905d0e18553078 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:12.844049  6328 raft_consensus.cc:1217] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:12.896132  6328 raft_consensus.cc:1217] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:12.977267  6328 raft_consensus.cc:1217] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:13.040421  6328 raft_consensus.cc:1217] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:13.280236  6684 raft_consensus.cc:1064] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:13.282780  6684 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:13.307945  6631 raft_consensus.cc:1064] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:13.315493  6328 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.317278  5679 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.317443  6655 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.318743  6685 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.321969  6631 consensus_queue.cc:237] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:13.331950  5601 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.344309  6684 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.363052  6653 raft_consensus.cc:2955] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.369077  5601 raft_consensus.cc:2955] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.385711  5679 raft_consensus.cc:2955] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.397043  5500 catalog_manager.cc:5697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.430508  6327 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.432076  6646 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:13.440824  6327 raft_consensus.cc:2955] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.461854  5752 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.466419  5601 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.470271  6662 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.488282  6662 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.492461  5749 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:13.500133  6327 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:13.502483  6623 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:13.506533  5601 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:13.513406  6685 raft_consensus.cc:2955] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.519294  6655 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:13.524454  6327 raft_consensus.cc:2955] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.536521  5604 raft_consensus.cc:2955] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.553303  5501 catalog_manager.cc:5697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.571455  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35870
I20260709 12:13:13.549803  6623 raft_consensus.cc:1064] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:13.586488  6623 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:13.630518  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:13.650316  6327 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.651804  5604 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.653489  6653 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.655184  6646 raft_consensus.cc:1064] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:13.657624  6646 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:13.664474  6685 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.670403  5671 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.699728  6653 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:13:13.718443  6701 tablet_replica.cc:333] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:13:13.719636  6701 raft_consensus.cc:2243] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.720454  6701 raft_consensus.cc:2272] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.743623  6701 ts_tablet_manager.cc:1916] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:13.746873  6692 raft_consensus.cc:2955] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.748245  6327 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.751047  6704 raft_consensus.cc:2955] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.752934  6631 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.757393  5752 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.753998  6327 raft_consensus.cc:2955] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.759738  5600 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.769297  6694 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.769112  5600 raft_consensus.cc:2955] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.777482  5597 raft_consensus.cc:2955] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.782084  5679 raft_consensus.cc:2955] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.791249  5752 raft_consensus.cc:2955] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.796932  6701 ts_tablet_manager.cc:1929] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:13.797739  6701 log.cc:1199] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/0a91e24ad9ae49729bb9bc3ebcc36f9f
I20260709 12:13:13.798444  6631 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.802520  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet 0a91e24ad9ae49729bb9bc3ebcc36f9f (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:13.791045  6325 raft_consensus.cc:2955] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.817390  5499 catalog_manager.cc:5697] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:13.815181  5501 catalog_manager.cc:5697] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:13.908239  5748 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:13.908478  6715 raft_consensus.cc:2955] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.913861  5600 raft_consensus.cc:2955] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.931015  6328 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:13.933622  5679 consensus_queue.cc:237] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:13.934183  6623 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:13.936622  5604 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:13.952508  6684 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:13.952699  5748 raft_consensus.cc:2955] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.954056  6704 raft_consensus.cc:2955] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.959100  5498 catalog_manager.cc:5697] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.958250  6327 raft_consensus.cc:2955] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.982453  5498 catalog_manager.cc:5697] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.987357  6328 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:13.986719  5604 raft_consensus.cc:2955] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.991250  6714 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:14.000205  6715 raft_consensus.cc:2955] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:14.007046  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet e8638862e10a473ca889ec2b98a84132 with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35870
I20260709 12:13:14.008103  6701 tablet_replica.cc:333] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:13:14.009979  6328 raft_consensus.cc:2955] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:13.926007  6325 raft_consensus.cc:2955] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:14.030303  6701 raft_consensus.cc:2243] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:14.032289  5750 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.038743  6701 raft_consensus.cc:2272] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:14.042092  6701 ts_tablet_manager.cc:1916] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:14.046120  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8638862e10a473ca889ec2b98a84132 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:14.079761  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 33b7e33743744392a4b0269b94aa07b3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:14.088780  6662 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.098727  5499 catalog_manager.cc:5697] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:14.108089  6701 ts_tablet_manager.cc:1929] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:14.106861  5748 raft_consensus.cc:2955] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:14.119809  6701 log.cc:1199] T e8638862e10a473ca889ec2b98a84132 P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/e8638862e10a473ca889ec2b98a84132
I20260709 12:13:14.121414  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet e8638862e10a473ca889ec2b98a84132 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:14.135870  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet 33b7e33743744392a4b0269b94aa07b3 with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51894
I20260709 12:13:14.139496  5675 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:14.153365  5748 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.154161  6325 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.154860  6694 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.156901  6694 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.162846  6716 tablet_replica.cc:333] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:13:14.164112  6716 raft_consensus.cc:2243] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:14.164918  6716 raft_consensus.cc:2272] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:14.165375  6714 raft_consensus.cc:2955] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:14.167822  5748 raft_consensus.cc:2955] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:14.168520  6325 raft_consensus.cc:2955] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:14.179234  6716 ts_tablet_manager.cc:1916] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:14.179862  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f894158ba41541198a905d0e18553078 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:14.186589  5498 catalog_manager.cc:5697] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.199061  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet f894158ba41541198a905d0e18553078 with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51894
I20260709 12:13:14.209275  6716 ts_tablet_manager.cc:1929] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:14.209844  6716 log.cc:1199] T 33b7e33743744392a4b0269b94aa07b3 P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/33b7e33743744392a4b0269b94aa07b3
I20260709 12:13:14.212453  6716 tablet_replica.cc:333] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:13:14.212625  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet 33b7e33743744392a4b0269b94aa07b3 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:14.213541  6716 raft_consensus.cc:2243] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:14.214293  6716 raft_consensus.cc:2272] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:14.217197  6716 ts_tablet_manager.cc:1916] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:14.231813  6716 ts_tablet_manager.cc:1929] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:14.232257  6716 log.cc:1199] T f894158ba41541198a905d0e18553078 P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/f894158ba41541198a905d0e18553078
I20260709 12:13:14.233503  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet f894158ba41541198a905d0e18553078 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:15.270586  5679 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:13:15.276340  5645 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 09cc490802a84093b74474b1decbb6a2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:15.277310  5748 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:15.277310  5604 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:15.278841  6662 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.280164  6719 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.286906  6662 raft_consensus.cc:2955] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.288926  5748 raft_consensus.cc:2955] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.289520  5600 raft_consensus.cc:2955] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.302529  5600 consensus_queue.cc:237] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:15.304342  5498 catalog_manager.cc:5697] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:13:15.309199  5570 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2ec4e9962d74fb9bbf294f2dc0911cf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:15.309891  5748 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:15.311350  5679 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:15.311216  6611 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.312727  6686 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.326403  6686 raft_consensus.cc:2955] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.332744  5675 raft_consensus.cc:2955] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.363056  5752 raft_consensus.cc:2955] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.363955  5499 catalog_manager.cc:5697] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.368009  5748 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:13:15.394701  5719 consensus_peers.cc:597] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e88229af5094c9993c0ec228734763c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:15.398247  5675 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:15.398237  5600 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:15.399611  6684 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.400324  6655 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.408470  6717 raft_consensus.cc:2955] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.410133  5600 raft_consensus.cc:2955] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.410604  5675 raft_consensus.cc:2955] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.424677  5499 catalog_manager.cc:5697] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.440371  5600 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:13:15.451649  5570 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f80dc3c97f640cc9ad6761e3aecfd36. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:15.452560  5675 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:15.452600  5748 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:15.453706  6727 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.454450  6611 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.461547  6611 raft_consensus.cc:2955] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.463053  5675 raft_consensus.cc:2955] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.470894  5748 raft_consensus.cc:2955] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:15.479681  5501 catalog_manager.cc:5697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.781152  6742 ts_tablet_manager.cc:933] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:15.791056  6743 ts_tablet_manager.cc:933] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:15.793517  6743 tablet_copy_client.cc:323] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:15.794957  6742 tablet_copy_client.cc:323] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.65:38715
I20260709 12:13:15.795570  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet 09cc490802a84093b74474b1decbb6a2 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:15.796205  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet 09cc490802a84093b74474b1decbb6a2 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-09cc490802a84093b74474b1decbb6a2
I20260709 12:13:15.797329  5614 tablet_copy_service.cc:140] P b3083333af3348e4938f905ca4c4819f: Received BeginTabletCopySession request for tablet b2ec4e9962d74fb9bbf294f2dc0911cf from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:34012)
I20260709 12:13:15.798082  5614 tablet_copy_service.cc:161] P b3083333af3348e4938f905ca4c4819f: Beginning new tablet copy session on tablet b2ec4e9962d74fb9bbf294f2dc0911cf from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:34012: session id = c02ed29558db481589fd3db23e43a07f-b2ec4e9962d74fb9bbf294f2dc0911cf
I20260709 12:13:15.807312  5689 tablet_copy_source_session.cc:215] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:15.807945  5614 tablet_copy_source_session.cc:215] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:15.811488  6743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cc490802a84093b74474b1decbb6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:15.816817  6742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ec4e9962d74fb9bbf294f2dc0911cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:15.830060  6743 tablet_copy_client.cc:806] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:15.830745  6743 tablet_copy_client.cc:670] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:15.835664  6743 tablet_copy_client.cc:538] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:15.844381  6743 tablet_bootstrap.cc:492] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:15.844907  6742 tablet_copy_client.cc:806] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:15.845552  6742 tablet_copy_client.cc:670] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:15.853902  6742 tablet_copy_client.cc:538] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:15.872608  6742 tablet_bootstrap.cc:492] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:15.944104  6742 tablet_bootstrap.cc:492] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:15.945175  6742 tablet_bootstrap.cc:492] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:15.946024  6742 ts_tablet_manager.cc:1403] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.074s	user 0.018s	sys 0.021s
I20260709 12:13:15.955659  6743 tablet_bootstrap.cc:492] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:15.956933  6743 tablet_bootstrap.cc:492] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:15.957727  6743 ts_tablet_manager.cc:1403] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.114s	user 0.036s	sys 0.044s
I20260709 12:13:15.962008  6742 raft_consensus.cc:359] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:15.964522  6742 raft_consensus.cc:740] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:15.965318  6742 consensus_queue.cc:260] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:15.968786  6748 ts_tablet_manager.cc:933] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:15.981470  6743 raft_consensus.cc:359] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:15.992422  6743 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:15.997740  6748 tablet_copy_client.cc:323] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:13:15.999938  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet 1e88229af5094c9993c0ec228734763c from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:13:16.000526  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet 1e88229af5094c9993c0ec228734763c from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-1e88229af5094c9993c0ec228734763c
I20260709 12:13:16.000820  6742 ts_tablet_manager.cc:1434] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.054s	user 0.016s	sys 0.002s
I20260709 12:13:16.005414  5614 tablet_copy_service.cc:342] P b3083333af3348e4938f905ca4c4819f: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-b2ec4e9962d74fb9bbf294f2dc0911cf received from {username='slave'} at 127.0.0.1:34012
I20260709 12:13:16.006049  5614 tablet_copy_service.cc:434] P b3083333af3348e4938f905ca4c4819f: ending tablet copy session c02ed29558db481589fd3db23e43a07f-b2ec4e9962d74fb9bbf294f2dc0911cf on tablet b2ec4e9962d74fb9bbf294f2dc0911cf with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:16.002224  6743 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:16.009599  6743 ts_tablet_manager.cc:1434] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.003s
I20260709 12:13:16.012336  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-09cc490802a84093b74474b1decbb6a2 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:16.012787  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-09cc490802a84093b74474b1decbb6a2 on tablet 09cc490802a84093b74474b1decbb6a2 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:16.019001  5763 tablet_copy_source_session.cc:215] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:16.032460  6748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e88229af5094c9993c0ec228734763c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.053860  6748 tablet_copy_client.cc:806] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:16.054474  6748 tablet_copy_client.cc:670] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:16.064700  6742 ts_tablet_manager.cc:933] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:16.066527  6742 tablet_copy_client.cc:323] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.65:38715
I20260709 12:13:16.067919  5614 tablet_copy_service.cc:140] P b3083333af3348e4938f905ca4c4819f: Received BeginTabletCopySession request for tablet 9f80dc3c97f640cc9ad6761e3aecfd36 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:34012)
I20260709 12:13:16.068508  5614 tablet_copy_service.cc:161] P b3083333af3348e4938f905ca4c4819f: Beginning new tablet copy session on tablet 9f80dc3c97f640cc9ad6761e3aecfd36 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:34012: session id = c02ed29558db481589fd3db23e43a07f-9f80dc3c97f640cc9ad6761e3aecfd36
I20260709 12:13:16.079933  5614 tablet_copy_source_session.cc:215] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:16.086342  6748 tablet_copy_client.cc:538] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:16.089622  6742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f80dc3c97f640cc9ad6761e3aecfd36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.096159  6748 tablet_bootstrap.cc:492] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:16.108945  6742 tablet_copy_client.cc:806] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:16.109512  6742 tablet_copy_client.cc:670] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:16.113278  6742 tablet_copy_client.cc:538] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:16.131467  6742 tablet_bootstrap.cc:492] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:16.134249  6748 tablet_bootstrap.cc:492] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:16.135331  6748 tablet_bootstrap.cc:492] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:16.137133  6748 ts_tablet_manager.cc:1403] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.041s	user 0.028s	sys 0.000s
I20260709 12:13:16.140528  6748 raft_consensus.cc:359] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:16.141486  6748 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:16.142246  6748 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:16.144759  6748 ts_tablet_manager.cc:1434] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:13:16.146936  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-1e88229af5094c9993c0ec228734763c received from {username='slave'} at 127.0.0.1:40216
I20260709 12:13:16.147382  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-1e88229af5094c9993c0ec228734763c on tablet 1e88229af5094c9993c0ec228734763c with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:16.152530  6325 raft_consensus.cc:1217] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:16.162768  6742 tablet_bootstrap.cc:492] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:16.163878  6742 tablet_bootstrap.cc:492] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:16.164544  6742 ts_tablet_manager.cc:1403] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.007s
I20260709 12:13:16.167488  6742 raft_consensus.cc:359] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:16.168394  6742 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:16.169003  6742 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:16.171458  6742 ts_tablet_manager.cc:1434] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:16.173236  5614 tablet_copy_service.cc:342] P b3083333af3348e4938f905ca4c4819f: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-9f80dc3c97f640cc9ad6761e3aecfd36 received from {username='slave'} at 127.0.0.1:34012
I20260709 12:13:16.173696  5614 tablet_copy_service.cc:434] P b3083333af3348e4938f905ca4c4819f: ending tablet copy session c02ed29558db481589fd3db23e43a07f-9f80dc3c97f640cc9ad6761e3aecfd36 on tablet 9f80dc3c97f640cc9ad6761e3aecfd36 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:16.325443  6325 raft_consensus.cc:1217] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:16.425707  6325 raft_consensus.cc:1217] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:16.603427  6325 raft_consensus.cc:1217] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:16.642585  6686 raft_consensus.cc:1064] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:16.644871  6686 consensus_queue.cc:237] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:16.656905  5748 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:16.657048  6325 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:16.657514  5679 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:16.658645  6611 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:16.659705  6727 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:16.662901  6686 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:16.683122  6755 raft_consensus.cc:2955] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:16.687067  6325 raft_consensus.cc:2955] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:16.687011  5752 raft_consensus.cc:2955] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:16.703927  5499 catalog_manager.cc:5697] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:16.714555  5679 raft_consensus.cc:2955] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:16.760128  5604 consensus_queue.cc:237] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:16.771350  5752 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:16.771771  6325 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:16.773540  6755 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:16.774941  6761 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:16.782234  6686 raft_consensus.cc:2955] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:16.789784  6325 raft_consensus.cc:2955] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:16.795060  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b2ec4e9962d74fb9bbf294f2dc0911cf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:16.800174  5752 raft_consensus.cc:2955] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:16.815435  5500 catalog_manager.cc:5697] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:16.829895  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet b2ec4e9962d74fb9bbf294f2dc0911cf with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35870
I20260709 12:13:16.832116  6765 tablet_replica.cc:333] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:13:16.833292  6765 raft_consensus.cc:2243] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:16.834035  6765 raft_consensus.cc:2272] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:16.838397  6765 ts_tablet_manager.cc:1916] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:16.854897  6765 ts_tablet_manager.cc:1929] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:16.855435  6765 log.cc:1199] T b2ec4e9962d74fb9bbf294f2dc0911cf P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/b2ec4e9962d74fb9bbf294f2dc0911cf
I20260709 12:13:16.857487  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet b2ec4e9962d74fb9bbf294f2dc0911cf (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:16.920610  6719 raft_consensus.cc:1064] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:16.923614  6719 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:16.930953  6327 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:16.932834  5604 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:16.933353  6733 raft_consensus.cc:1064] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:16.934352  6738 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:16.936017  6741 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:16.936255  6733 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:16.938987  5752 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:16.943681  6741 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:16.961334  6327 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:16.963177  5679 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:16.963915  5600 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:16.965802  6754 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:16.968745  6738 raft_consensus.cc:2955] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:16.978221  5600 raft_consensus.cc:2955] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:16.983029  6684 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:16.986119  6754 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:16.990427  6325 raft_consensus.cc:2955] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:16.980140  5752 raft_consensus.cc:2955] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.018168  5498 catalog_manager.cc:5697] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.031226  6772 raft_consensus.cc:2955] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.033775  5675 raft_consensus.cc:2955] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.051618  5597 raft_consensus.cc:2955] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.054858  6325 raft_consensus.cc:2955] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.066937  5675 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:17.073541  5604 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:17.075066  6738 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:17.074613  6325 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:17.077944  6738 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:17.076458  5500 catalog_manager.cc:5697] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.110083  5752 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:17.165597  6325 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:17.167667  6655 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:17.170943  5675 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:17.170557  6776 raft_consensus.cc:2955] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.173939  6684 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:17.174492  5604 raft_consensus.cc:2955] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.183104  6655 raft_consensus.cc:2955] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.184514  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 09cc490802a84093b74474b1decbb6a2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:17.185590  6761 raft_consensus.cc:1064] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:17.187958  6761 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:17.194710  6327 raft_consensus.cc:2955] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.195313  6328 raft_consensus.cc:2955] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.202998  5501 catalog_manager.cc:5697] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.214432  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet 09cc490802a84093b74474b1decbb6a2 with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:17.236249  5671 raft_consensus.cc:2955] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.242111  6778 tablet_replica.cc:333] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:13:17.243485  6778 raft_consensus.cc:2243] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.244378  6778 raft_consensus.cc:2272] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.246953  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1e88229af5094c9993c0ec228734763c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:17.260725  6778 ts_tablet_manager.cc:1916] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:17.269745  5671 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:17.263599  6328 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:17.272704  5752 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:17.271668  6761 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:13:17.277447  6686 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:17.269876  5500 catalog_manager.cc:5697] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.282116  6761 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:17.296159  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e88229af5094c9993c0ec228734763c with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51894
I20260709 12:13:17.303534  6778 ts_tablet_manager.cc:1929] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:17.304142  6778 log.cc:1199] T 09cc490802a84093b74474b1decbb6a2 P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/09cc490802a84093b74474b1decbb6a2
I20260709 12:13:17.306176  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet 09cc490802a84093b74474b1decbb6a2 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:17.308202  6783 tablet_replica.cc:333] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:13:17.308135  6686 raft_consensus.cc:2955] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.309820  6783 raft_consensus.cc:2243] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.310665  6783 raft_consensus.cc:2272] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.314443  6783 ts_tablet_manager.cc:1916] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:17.314757  6327 raft_consensus.cc:2955] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.329454  5752 raft_consensus.cc:2955] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.322214  5671 raft_consensus.cc:2955] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.341002  6783 ts_tablet_manager.cc:1929] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:17.341537  6783 log.cc:1199] T 1e88229af5094c9993c0ec228734763c P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/1e88229af5094c9993c0ec228734763c
I20260709 12:13:17.344343  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet 1e88229af5094c9993c0ec228734763c (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:17.345525  5500 catalog_manager.cc:5697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.363422  5604 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:17.373895  6327 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:17.375487  6686 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:17.378006  5671 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:17.379597  6686 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:17.382165  6761 raft_consensus.cc:2955] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.385591  6328 raft_consensus.cc:2955] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.387750  5671 raft_consensus.cc:2955] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:17.391757  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f80dc3c97f640cc9ad6761e3aecfd36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:17.400923  5499 catalog_manager.cc:5697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.411379  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f80dc3c97f640cc9ad6761e3aecfd36 with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:17.412397  6778 tablet_replica.cc:333] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:13:17.413475  6778 raft_consensus.cc:2243] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.414230  6778 raft_consensus.cc:2272] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.418637  6778 ts_tablet_manager.cc:1916] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:17.446502  6778 ts_tablet_manager.cc:1929] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:17.446903  6778 log.cc:1199] T 9f80dc3c97f640cc9ad6761e3aecfd36 P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/9f80dc3c97f640cc9ad6761e3aecfd36
I20260709 12:13:17.448340  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet 9f80dc3c97f640cc9ad6761e3aecfd36 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:18.439818  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.529326  5750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:18.529896  5750 raft_consensus.cc:606] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:13:18.532066  5750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:18.532473  5750 raft_consensus.cc:606] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:18.534631  5750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:18.535015  5750 raft_consensus.cc:606] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:18.547238  5597 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:18.551795  5679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:18.552500  5679 raft_consensus.cc:606] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:18.554302  5750 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:18.555541  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
W20260709 12:13:18.555084  5570 consensus_peers.cc:597] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2645ab47c7304e87afd4e901bcd42fce. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.556193  5752 raft_consensus.cc:606] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:13:18.556838  5679 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:18.557343  6784 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.558144  6611 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.558862  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:18.559353  5752 raft_consensus.cc:606] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:13:18.560485  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:18.561707  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:18.562744  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.569887  6611 raft_consensus.cc:2955] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:18.575557  5748 raft_consensus.cc:2955] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:18.587613  5679 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:18.591514  5671 raft_consensus.cc:2955] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:18.592305  5499 catalog_manager.cc:5697] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:13:18.614558  5645 consensus_peers.cc:597] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 903a8681cf4244cb90615903ffda5c62. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.615895  5597 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:18.616086  5748 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:18.617630  6741 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.618772  6787 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.643728  6741 raft_consensus.cc:2955] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:18.645740  6772 raft_consensus.cc:993] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:18.646240  6772 raft_consensus.cc:1081] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:18.647612  5604 raft_consensus.cc:2955] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:18.650759  5600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:13:18.651352  5600 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.651674  5600 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.662693  5600 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:18.666316  5748 raft_consensus.cc:2955] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:18.669376  5600 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:18.668376  5597 consensus_queue.cc:237] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:18.670162  5501 catalog_manager.cc:5697] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:18.672034  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:18.672654  5752 raft_consensus.cc:3055] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.672912  5752 raft_consensus.cc:740] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:18.673552  5752 consensus_queue.cc:260] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:18.674695  5752 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.684412  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:18.684998  5679 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.689713  5752 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:18.691960  5567 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:18.692708  6793 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.693188  6793 raft_consensus.cc:697] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:18.693990  6793 consensus_queue.cc:237] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:18.698869  5570 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62908e35e9554ef2af86598ce28bcf21. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.699342  5679 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:18.700098  5748 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:18.701459  5679 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:18.701568  6792 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.702637  6793 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.709345  5499 catalog_manager.cc:5697] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 2 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.714608  6793 raft_consensus.cc:2955] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:18.716694  5679 raft_consensus.cc:2955] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:18.716315  5748 raft_consensus.cc:2955] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:18.741287  5499 catalog_manager.cc:5697] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:13:18.748039  5550 auto_rebalancer.cc:629] Failed to schedule move for tablet e7972b9d3b424d0a82305768187e2573: Remote error: Service unavailable: leader transfer in progress
I20260709 12:13:18.772401  6779 raft_consensus.cc:993] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:18.772876  6779 raft_consensus.cc:1081] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:18.774538  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58714
I20260709 12:13:18.775035  6327 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.775375  6327 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.784837  6327 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:18.788396  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:18.788661  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:18.788990  5679 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.789206  5752 raft_consensus.cc:3055] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.788179  6327 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:18.789520  5752 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:18.790349  5752 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:18.791505  5752 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.794816  5679 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:18.795939  6293 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:18.796298  5752 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:18.797729  6808 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.799551  6808 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:18.800333  6808 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:18.812500  5501 catalog_manager.cc:5697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.827661  6802 raft_consensus.cc:993] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:18.828143  6802 raft_consensus.cc:1081] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:18.830653  6328 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58720
I20260709 12:13:18.831146  6328 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.831478  6328 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.835465  6328 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:18.838136  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:18.838677  6328 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:18.838675  5679 raft_consensus.cc:3055] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.839430  5679 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:18.840188  5679 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:18.840798  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:18.841310  5597 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.841427  5679 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.848057  5597 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:18.851397  6291 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:18.852468  6808 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.853169  6808 raft_consensus.cc:697] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:18.859052  6772 raft_consensus.cc:993] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:18.860841  6772 raft_consensus.cc:1081] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:18.857859  5679 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:18.862682  5597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:13:18.863292  5597 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.863710  5597 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.863440  6808 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:18.873011  5597 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:18.876935  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:18.877502  5671 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.877679  5597 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:18.879148  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:18.879709  5748 raft_consensus.cc:3055] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.879968  5748 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:18.880744  5748 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:18.882280  5748 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.886216  5671 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:18.889384  5569 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:18.891381  6793 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.891860  6793 raft_consensus.cc:697] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:18.893133  6772 raft_consensus.cc:993] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:18.893582  6772 raft_consensus.cc:1081] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:18.892709  6793 consensus_queue.cc:237] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:18.894618  5748 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:18.890223  5501 catalog_manager.cc:5697] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.899266  5604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:13:18.899799  5604 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.900158  5604 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.917106  5604 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:18.919410  5604 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:18.920452  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:18.920917  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:18.921095  5748 raft_consensus.cc:3055] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.920750  5500 catalog_manager.cc:5697] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 2 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.921537  5671 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.921654  5748 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:18.922631  5748 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:18.923858  5748 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.928396  5671 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:18.994623  5748 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:19.001652  5567 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:19.002933  6794 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.003580  6794 raft_consensus.cc:697] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:13:19.004915  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 75480.8us
I20260709 12:13:19.017562  6794 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:19.060075  6815 ts_tablet_manager.cc:933] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:19.064729  6815 tablet_copy_client.cc:323] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.65:38715
I20260709 12:13:19.066198  5614 tablet_copy_service.cc:140] P b3083333af3348e4938f905ca4c4819f: Received BeginTabletCopySession request for tablet 2645ab47c7304e87afd4e901bcd42fce from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:34012)
I20260709 12:13:19.066749  5614 tablet_copy_service.cc:161] P b3083333af3348e4938f905ca4c4819f: Beginning new tablet copy session on tablet 2645ab47c7304e87afd4e901bcd42fce from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:34012: session id = c02ed29558db481589fd3db23e43a07f-2645ab47c7304e87afd4e901bcd42fce
I20260709 12:13:19.069406  6772 raft_consensus.cc:993] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:19.069875  6772 raft_consensus.cc:1081] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:19.071782  6328 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58714
I20260709 12:13:19.071591  5500 catalog_manager.cc:5697] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 2 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.072301  6328 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.073165  6328 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.076711  5614 tablet_copy_source_session.cc:215] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:19.078855  6328 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:19.079802  6815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2645ab47c7304e87afd4e901bcd42fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:19.081561  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:19.082253  5597 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.082530  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:19.083057  5748 raft_consensus.cc:3055] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.083384  5748 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:19.084056  5748 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:19.085086  5748 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.087540  6328 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:19.091606  5748 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:19.092716  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:19.093817  6808 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.094298  6808 raft_consensus.cc:697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:19.095252  5597 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:19.095129  6808 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:19.098516  6815 tablet_copy_client.cc:806] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:19.099094  6815 tablet_copy_client.cc:670] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:19.106331  6815 tablet_copy_client.cc:538] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:19.106776  5500 catalog_manager.cc:5697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.115537  6815 tablet_bootstrap.cc:492] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:19.136101  6815 tablet_bootstrap.cc:492] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.137036  6815 tablet_bootstrap.cc:492] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:19.137668  6815 ts_tablet_manager.cc:1403] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.022s	user 0.021s	sys 0.000s
I20260709 12:13:19.140527  6815 raft_consensus.cc:359] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:19.141399  6815 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:19.142061  6815 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:19.144629  6815 ts_tablet_manager.cc:1434] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:19.146586  5614 tablet_copy_service.cc:342] P b3083333af3348e4938f905ca4c4819f: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-2645ab47c7304e87afd4e901bcd42fce received from {username='slave'} at 127.0.0.1:34012
I20260709 12:13:19.147030  5614 tablet_copy_service.cc:434] P b3083333af3348e4938f905ca4c4819f: ending tablet copy session c02ed29558db481589fd3db23e43a07f-2645ab47c7304e87afd4e901bcd42fce on tablet 2645ab47c7304e87afd4e901bcd42fce with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:19.149068  5671 raft_consensus.cc:1275] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.150511  6794 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.168597  6820 ts_tablet_manager.cc:933] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:19.178364  6815 ts_tablet_manager.cc:933] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:19.199402  6820 tablet_copy_client.cc:323] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:19.201162  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet 903a8681cf4244cb90615903ffda5c62 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:19.201800  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet 903a8681cf4244cb90615903ffda5c62 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-903a8681cf4244cb90615903ffda5c62
I20260709 12:13:19.202390  6815 tablet_copy_client.cc:323] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.65:38715
I20260709 12:13:19.213897  5614 tablet_copy_service.cc:140] P b3083333af3348e4938f905ca4c4819f: Received BeginTabletCopySession request for tablet 62908e35e9554ef2af86598ce28bcf21 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:34012)
I20260709 12:13:19.214465  5614 tablet_copy_service.cc:161] P b3083333af3348e4938f905ca4c4819f: Beginning new tablet copy session on tablet 62908e35e9554ef2af86598ce28bcf21 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:34012: session id = c02ed29558db481589fd3db23e43a07f-62908e35e9554ef2af86598ce28bcf21
I20260709 12:13:19.222147  5614 tablet_copy_source_session.cc:215] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:19.226236  6815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62908e35e9554ef2af86598ce28bcf21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:19.245283  5689 tablet_copy_source_session.cc:215] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:19.248497  5677 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.251147  6815 tablet_copy_client.cc:806] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:19.251453  6820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903a8681cf4244cb90615903ffda5c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:19.251868  6815 tablet_copy_client.cc:670] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:19.252629  6808 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.253603  5748 raft_consensus.cc:1275] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.255300  6792 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.261674  6815 tablet_copy_client.cc:538] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:19.273814  6815 tablet_bootstrap.cc:492] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:19.300540  6820 tablet_copy_client.cc:806] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:19.301107  5671 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.303022  6808 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.301211  6820 tablet_copy_client.cc:670] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:19.326515  6820 tablet_copy_client.cc:538] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:19.332593  6815 tablet_bootstrap.cc:492] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.333690  6815 tablet_bootstrap.cc:492] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:19.334482  6815 ts_tablet_manager.cc:1403] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.006s
I20260709 12:13:19.336843  6820 tablet_bootstrap.cc:492] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:19.338573  6815 raft_consensus.cc:359] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:19.340740  6815 raft_consensus.cc:740] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:19.342583  6815 consensus_queue.cc:260] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:19.345163  6815 ts_tablet_manager.cc:1434] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:13:19.347363  5614 tablet_copy_service.cc:342] P b3083333af3348e4938f905ca4c4819f: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-62908e35e9554ef2af86598ce28bcf21 received from {username='slave'} at 127.0.0.1:34012
I20260709 12:13:19.347777  5614 tablet_copy_service.cc:434] P b3083333af3348e4938f905ca4c4819f: ending tablet copy session c02ed29558db481589fd3db23e43a07f-62908e35e9554ef2af86598ce28bcf21 on tablet 62908e35e9554ef2af86598ce28bcf21 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:19.372756  5675 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.374090  5604 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.374166  6793 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.375998  6808 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.386384  5752 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.389484  6784 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.390971  5752 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.393131  6808 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.512205  6820 tablet_bootstrap.cc:492] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.513087  6820 tablet_bootstrap.cc:492] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:19.515148  6820 ts_tablet_manager.cc:1403] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.179s	user 0.025s	sys 0.015s
I20260709 12:13:19.523263  6820 raft_consensus.cc:359] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:19.524237  6820 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:19.524924  6820 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:19.529003  6820 ts_tablet_manager.cc:1434] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:13:19.534026  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-903a8681cf4244cb90615903ffda5c62 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:19.534475  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-903a8681cf4244cb90615903ffda5c62 on tablet 903a8681cf4244cb90615903ffda5c62 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:19.542470  5600 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.548269  6327 raft_consensus.cc:1217] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:19.568230  6809 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.576014  5748 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.577589  6809 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.591100  6327 raft_consensus.cc:1217] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:19.592463  5752 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.611261  6793 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.628795  5671 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.637455  6792 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.654583  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:19.658421  6327 raft_consensus.cc:1217] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:19.793270  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:19.793828  5677 raft_consensus.cc:606] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:19.796548  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:19.797032  5677 raft_consensus.cc:606] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:19.799480  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:19.799875  5677 raft_consensus.cc:606] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:19.822362  5597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:46698
I20260709 12:13:19.822937  5597 raft_consensus.cc:606] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:19.826155  5750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:19.826680  5750 raft_consensus.cc:606] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:13:19.829236  5671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:19.829794  5671 raft_consensus.cc:606] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:19.830814  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:19.832340  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:19.832993  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:19.916874  6841 raft_consensus.cc:993] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:19.917670  6837 raft_consensus.cc:1081] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:19.919317  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58720
I20260709 12:13:19.919765  6327 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.920074  6327 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.924150  6327 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:19.926338  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:19.926960  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:19.927299  5597 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.927449  5677 raft_consensus.cc:3055] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.927764  5677 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:19.926518  6327 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:19.928396  5677 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:19.929461  5677 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.935364  5597 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:19.938182  5677 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:19.938298  6291 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:19.939157  6831 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.939587  6831 raft_consensus.cc:697] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:19.940416  6831 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:19.946151  6792 raft_consensus.cc:1064] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:19.948840  6792 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:19.950691  5500 catalog_manager.cc:5697] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.962098  5752 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:19.962378  6327 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:19.963593  5677 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:19.963721  6792 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:19.964860  6784 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:19.966605  6794 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:19.977365  6794 raft_consensus.cc:2955] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:19.984247  5677 raft_consensus.cc:2955] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:19.990670  6328 raft_consensus.cc:2955] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:19.996244  5750 raft_consensus.cc:2955] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:19.999984  5500 catalog_manager.cc:5697] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.037011  5597 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:20.041702  6328 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:20.042081  5752 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:20.043192  6792 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:20.044133  6793 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:20.046561  6839 raft_consensus.cc:1064] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:20.055882  6794 raft_consensus.cc:2955] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.058501  6839 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:20.065212  6787 raft_consensus.cc:993] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:20.066010  6841 raft_consensus.cc:1081] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:20.067616  5748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:13:20.067152  6328 raft_consensus.cc:2955] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.068156  5748 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.068584  5748 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.086546  5499 catalog_manager.cc:5697] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.087262  5748 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:20.094480  5748 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:20.095430  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:20.096058  5677 raft_consensus.cc:3055] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.096383  5677 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:20.096976  5677 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:20.097816  5677 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.099798  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2645ab47c7304e87afd4e901bcd42fce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:20.106204  5752 raft_consensus.cc:2955] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.107867  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet 2645ab47c7304e87afd4e901bcd42fce with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35870
I20260709 12:13:20.109428  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:20.110018  5597 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.121565  6787 raft_consensus.cc:993] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:20.122145  6787 raft_consensus.cc:1081] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:20.125705  5750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:13:20.126232  5750 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.126564  5750 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.122074  5597 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:20.135679  5716 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:20.136888  6838 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.136689  5750 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:20.138963  5750 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:20.140219  5677 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:20.141489  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:20.143414  5597 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.145143  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:20.137372  6838 raft_consensus.cc:697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:20.145705  5675 raft_consensus.cc:3055] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.147114  5675 raft_consensus.cc:740] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:20.146703  6838 consensus_queue.cc:237] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:20.147889  5675 consensus_queue.cc:260] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:20.149130  5675 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.157601  6858 tablet_replica.cc:333] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:13:20.158314  6327 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:20.159801  6839 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:20.160422  5601 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:20.161821  6841 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:20.153741  5597 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:20.163411  5716 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:20.165877  6772 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.166436  5748 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:20.172134  6772 raft_consensus.cc:697] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:20.173913  6856 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:20.176913  6772 consensus_queue.cc:237] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:20.185495  5675 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:20.190572  6837 raft_consensus.cc:2955] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.196017  5499 catalog_manager.cc:5697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.196424  5597 raft_consensus.cc:2955] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.201713  6328 raft_consensus.cc:2955] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.212798  6858 raft_consensus.cc:2243] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:20.213781  6858 raft_consensus.cc:2272] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:20.217510  5749 raft_consensus.cc:2955] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.219010  6858 ts_tablet_manager.cc:1916] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:20.214319  5501 catalog_manager.cc:5697] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.230247  6794 raft_consensus.cc:1064] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
W20260709 12:13:20.230734  6794 raft_consensus.cc:1068] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Service unavailable: leader transfer in progress
I20260709 12:13:20.235873  6858 ts_tablet_manager.cc:1929] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:20.236718  6858 log.cc:1199] T 2645ab47c7304e87afd4e901bcd42fce P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/2645ab47c7304e87afd4e901bcd42fce
I20260709 12:13:20.238371  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet 2645ab47c7304e87afd4e901bcd42fce (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:20.247957  5500 catalog_manager.cc:5697] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.264362  5675 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:20.270856  6328 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:20.272017  5752 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:20.273152  6787 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:20.274006  6866 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:20.281105  6856 raft_consensus.cc:2955] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.283087  5752 raft_consensus.cc:2955] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.290328  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 903a8681cf4244cb90615903ffda5c62 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:20.294174  6328 raft_consensus.cc:2955] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:20.301455  5498 catalog_manager.cc:5697] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.327080  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet 903a8681cf4244cb90615903ffda5c62 with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51894
I20260709 12:13:20.332590  6793 raft_consensus.cc:993] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:20.333479  6793 raft_consensus.cc:1081] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:20.335441  5750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44980
I20260709 12:13:20.335968  5750 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.336309  5750 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.345034  5750 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:20.347796  6867 tablet_replica.cc:333] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:13:20.348981  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:20.348371  5750 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:20.349519  5675 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.350515  6867 raft_consensus.cc:2243] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:20.349541  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:20.351292  6867 raft_consensus.cc:2272] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:20.351632  5597 raft_consensus.cc:3055] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.352272  5597 raft_consensus.cc:740] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:20.352979  5597 consensus_queue.cc:260] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:20.354377  5597 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.356328  6867 ts_tablet_manager.cc:1916] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:20.358017  5675 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:20.359570  6866 raft_consensus.cc:993] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:20.360073  6856 raft_consensus.cc:1081] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:20.360667  5718 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:20.361464  6772 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.361979  6772 raft_consensus.cc:697] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:20.362998  5597 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:20.362860  6772 consensus_queue.cc:237] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:20.367303  6328 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58720
I20260709 12:13:20.367811  6328 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.368157  6328 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.372603  6328 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:20.374725  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:20.375239  5675 raft_consensus.cc:3055] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.377264  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:20.378906  5750 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.375528  6328 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:20.381455  5675 raft_consensus.cc:740] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:20.381335  5500 catalog_manager.cc:5697] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 2, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.382372  5675 consensus_queue.cc:260] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:20.384444  5675 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.385057  6867 ts_tablet_manager.cc:1929] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:20.385493  6867 log.cc:1199] T 903a8681cf4244cb90615903ffda5c62 P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/903a8681cf4244cb90615903ffda5c62
I20260709 12:13:20.385926  6860 raft_consensus.cc:993] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:20.386363  6838 raft_consensus.cc:1081] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:20.387176  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet 903a8681cf4244cb90615903ffda5c62 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:20.391448  5750 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:20.392702  6291 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:20.393555  6831 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.394034  6831 raft_consensus.cc:697] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:20.394344  5597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:13:20.394933  5675 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:20.394872  5597 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.396500  5597 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.401132  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:20.401831  5752 raft_consensus.cc:606] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:13:20.394882  6831 consensus_queue.cc:237] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:20.402724  5597 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:20.404654  5597 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:20.405645  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:20.406173  5677 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.407285  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:20.407797  5750 raft_consensus.cc:3055] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.408192  5750 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:20.408923  5750 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:20.410087  5750 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.410524  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:20.411037  5752 raft_consensus.cc:606] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Received request to transfer leadership
W20260709 12:13:20.411986  5485 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 62908e35e9554ef2af86598ce28bcf21 already in progress [suppressed 2 similar messages]
I20260709 12:13:20.413552  5677 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:20.416136  5750 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:20.417672  5567 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:20.418319  5750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:20.418843  5750 raft_consensus.cc:606] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:13:20.419906  6792 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.420380  6792 raft_consensus.cc:697] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:20.421231  6792 consensus_queue.cc:237] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:20.421811  5500 catalog_manager.cc:5697] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:20.426147  5550 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:13:20.426608  5550 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 62908e35e9554ef2af86598ce28bcf21 already in progress
W20260709 12:13:20.426862  5550 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 62908e35e9554ef2af86598ce28bcf21 already in progress
I20260709 12:13:20.434592  5500 catalog_manager.cc:5697] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 2 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.438815  5597 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.439920  6831 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:20.459748  5677 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.460945  6831 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:20.545507  5597 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.546531  6838 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.556854  5677 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.558252  6772 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.635435  5677 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.636745  6860 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.645972  5597 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.648856  6772 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.747296  5677 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:20.748416  6838 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:20.753238  6772 raft_consensus.cc:993] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:20.753708  6860 raft_consensus.cc:1081] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:20.755573  5675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35874
I20260709 12:13:20.759261  5597 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:20.760509  6838 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:20.763042  6327 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Advancing to term 2
I20260709 12:13:20.766113  5675 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.766525  5675 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:20.770980  6327 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 2 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:20.774524  6838 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:20.775383  5675 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:20.780473  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:20.780753  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:20.781291  5750 raft_consensus.cc:3055] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:20.781458  5597 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:20.781638  5750 raft_consensus.cc:740] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:20.782485  5750 consensus_queue.cc:260] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:20.783694  5750 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:20.788130  5597 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:20.790262  5642 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:20.790720  5750 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:20.791292  6856 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:20.791795  6856 raft_consensus.cc:697] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:20.792538  5675 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:20.792689  6856 consensus_queue.cc:237] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:20.811431  5500 catalog_manager.cc:5697] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 3, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.884696  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.889247  5675 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.890475  6831 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:20.900730  5752 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.902256  6833 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:20.943321  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e88229af5094c9993c0ec228734763c"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:20.943849  5752 raft_consensus.cc:606] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:20.945914  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:20.946333  5677 raft_consensus.cc:606] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:20.948310  5604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:46698
I20260709 12:13:20.948685  5604 raft_consensus.cc:606] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:20.950552  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:20.950909  5677 raft_consensus.cc:606] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:20.952716  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:20.953051  5677 raft_consensus.cc:606] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:20.954993  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:20.955413  5752 raft_consensus.cc:606] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:20.956300  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:20.957690  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:20.958209  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.008006  6838 raft_consensus.cc:993] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:21.008437  6860 raft_consensus.cc:1081] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:21.009902  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e88229af5094c9993c0ec228734763c"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58714
I20260709 12:13:21.010345  6327 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.010604  6327 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.015350  6327 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.016806  6327 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:21.017500  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:21.017688  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:21.018064  5677 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.018260  5752 raft_consensus.cc:3055] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.018566  5752 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:21.019258  5752 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.020370  5752 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.024313  5677 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:21.025372  6293 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:21.026230  6833 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.026316  5752 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:21.026757  6833 raft_consensus.cc:697] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:21.027599  6833 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.035970  5500 catalog_manager.cc:5697] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.036711  5677 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.037899  6792 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.047557  5752 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.052937  6860 raft_consensus.cc:993] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:21.053462  6772 raft_consensus.cc:1081] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:21.055089  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58714
I20260709 12:13:21.055604  6327 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.055936  6327 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.059767  6792 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.062700  6327 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.064571  6327 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:21.065850  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:21.066464  5750 raft_consensus.cc:3055] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.066792  5750 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:21.067538  5750 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.068779  5750 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.076129  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:21.076848  5604 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.077976  5750 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:21.079062  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:21.079885  6833 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.080341  6833 raft_consensus.cc:697] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:21.081133  6833 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.083519  5604 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:21.099777  5498 catalog_manager.cc:5697] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.149972  6787 raft_consensus.cc:993] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:21.150484  6856 raft_consensus.cc:1081] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:21.151943  5750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:13:21.152464  5750 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.152819  5750 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.157475  5750 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:21.159255  5750 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:21.159955  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:21.160243  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:21.160470  5604 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.160729  5677 raft_consensus.cc:3055] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.160990  5677 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:21.161566  5677 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:21.162518  5677 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.165046  5604 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:21.166019  5716 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:21.167198  5677 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:21.169039  6860 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.169544  6860 raft_consensus.cc:697] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:21.170234  6860 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:21.181959  5500 catalog_manager.cc:5697] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.183080  6889 raft_consensus.cc:993] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:21.183548  6890 raft_consensus.cc:1081] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:21.184926  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58722
I20260709 12:13:21.185346  6327 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.185600  6327 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.192268  6327 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.193791  6327 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:21.194438  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:21.194628  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:21.194911  5604 raft_consensus.cc:3055] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.195190  5604 raft_consensus.cc:740] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:21.195199  5750 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.195873  5604 consensus_queue.cc:260] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.196748  5604 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.200018  5750 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:21.201627  6291 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:21.202170  5604 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:21.202729  6833 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.203245  6833 raft_consensus.cc:697] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:21.204092  6833 consensus_queue.cc:237] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.211697  5500 catalog_manager.cc:5697] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.244762  6327 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 2 LEARNER]: Advancing to term 3
I20260709 12:13:21.251405  6327 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:21.252583  6787 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:21.257503  6787 raft_consensus.cc:1064] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
W20260709 12:13:21.258325  6787 raft_consensus.cc:1068] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:21.273605  6856 raft_consensus.cc:993] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:21.274147  6787 raft_consensus.cc:1081] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:21.275758  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58720
I20260709 12:13:21.276211  6327 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.276479  6327 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.280802  6327 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.282228  6327 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:21.282996  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:21.283162  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:21.283595  5675 raft_consensus.cc:3055] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.283653  5750 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.283982  5675 raft_consensus.cc:740] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:21.284744  5675 consensus_queue.cc:260] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.285926  5675 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.290249  5750 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:21.291394  6291 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:21.292178  6833 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.292229  5675 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:21.292765  6833 raft_consensus.cc:697] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:21.293723  6833 consensus_queue.cc:237] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.301822  5498 catalog_manager.cc:5697] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.325534  5750 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:21.326742  6856 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:21.335412  5604 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:21.344138  6898 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:21.358461  6787 raft_consensus.cc:1064] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:21.360800  6787 consensus_queue.cc:237] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.370846  6327 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:21.370846  5750 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:21.373137  5597 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:21.373865  6897 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:21.375092  6895 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.375823  6856 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.385251  6856 raft_consensus.cc:2955] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:21.386983  6327 raft_consensus.cc:2955] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:21.387272  5597 raft_consensus.cc:2955] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:21.403847  5500 catalog_manager.cc:5697] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 2 to 5, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:21.404724  6897 raft_consensus.cc:993] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:21.405190  6895 raft_consensus.cc:1081] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:21.406518  5752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:13:21.406919  5752 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.407195  5752 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.413712  5750 raft_consensus.cc:2955] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:21.418615  5752 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:21.420441  5675 consensus_queue.cc:237] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:21.421558  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:21.421958  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:21.422111  5597 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.422633  5677 raft_consensus.cc:3055] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.422941  5677 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:21.423664  5677 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:21.424609  5677 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.426414  6327 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:21.427757  5597 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:21.427913  5604 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:21.428299  6897 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:21.430269  5716 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:21.433979  6860 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.440658  5752 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:21.439535  5677 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:21.443177  6897 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:21.442186  6860 raft_consensus.cc:697] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:21.445251  6860 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:21.449153  6898 raft_consensus.cc:2955] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:21.450404  6327 raft_consensus.cc:2955] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:21.458184  5604 raft_consensus.cc:2955] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:21.462543  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 62908e35e9554ef2af86598ce28bcf21 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:21.468894  5498 catalog_manager.cc:5697] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.469812  5497 catalog_manager.cc:5697] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 5 to 6, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.485958  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet 62908e35e9554ef2af86598ce28bcf21 with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:21.495376  6901 tablet_replica.cc:333] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:13:21.496425  6901 raft_consensus.cc:2243] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.497239  6901 raft_consensus.cc:2272] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.504144  6901 ts_tablet_manager.cc:1916] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:21.517112  5750 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.520413  6833 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.520895  6901 ts_tablet_manager.cc:1929] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:13:21.521311  6901 log.cc:1199] T 62908e35e9554ef2af86598ce28bcf21 P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/62908e35e9554ef2af86598ce28bcf21
I20260709 12:13:21.523131  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet 62908e35e9554ef2af86598ce28bcf21 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:21.537983  5675 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.539449  6808 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.560951  5677 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:21.569521  5752 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.570021  5604 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:21.570641  5645 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a87e1fb9c364e85bc7c296e4c7b6642. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.571174  6897 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.571990  6898 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.579510  6787 raft_consensus.cc:2955] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.582852  5752 raft_consensus.cc:2955] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.591228  5750 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:21.594902  5498 catalog_manager.cc:5697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.606207  5601 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.606220  5604 raft_consensus.cc:2955] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.608498  6833 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.632822  5748 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.634626  5677 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.636332  6808 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:13:21.638702  5719 consensus_peers.cc:597] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba4aecf80db140ca828a80dc93220fba. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.643260  6772 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.649299  5597 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.652066  6838 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.660346  5752 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.662148  5671 raft_consensus.cc:2955] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.666468  6808 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.675732  5597 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.677659  5600 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.677846  6860 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.657835  6838 raft_consensus.cc:2955] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.680426  5600 raft_consensus.cc:2955] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.689826  6833 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.691277  5677 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.697260  6913 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.699787  5497 catalog_manager.cc:5697] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.714414  5677 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:21.727300  5671 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.741894  6838 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:21.752880  5752 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.754889  6913 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.764392  5750 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:21.764863  5645 consensus_peers.cc:597] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3590ec2a21d04c1c9948d0b4cba00790. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.765410  5601 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.767145  6898 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.771505  6787 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.783591  6897 raft_consensus.cc:2955] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.785629  5597 raft_consensus.cc:2955] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.814822  5750 raft_consensus.cc:2955] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.820835  5677 consensus_queue.cc:237] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:21.829972  5497 catalog_manager.cc:5697] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:21.838357  5645 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75421a11c1284039a8a17196290f3c16. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.838841  5597 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.840133  5750 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.841547  6898 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.843302  6898 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.859944  6897 raft_consensus.cc:2955] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.863698  5748 raft_consensus.cc:2955] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.866312  5597 raft_consensus.cc:2955] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.878369  5500 catalog_manager.cc:5697] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:21.996996  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:22.043241  5671 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.046017  5600 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.049952  6860 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.050486  5671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:22.051033  5671 raft_consensus.cc:606] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:22.054446  6772 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.082648  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:22.083555  5677 raft_consensus.cc:606] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:22.086059  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:22.086560  5677 raft_consensus.cc:606] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:22.090570  6895 raft_consensus.cc:993] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:22.091169  6898 raft_consensus.cc:1081] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:22.093219  6927 ts_tablet_manager.cc:933] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:22.094374  5750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:13:22.094918  5750 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.095224  5750 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.097712  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:22.098299  5752 raft_consensus.cc:606] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:13:22.099558  6927 tablet_copy_client.cc:323] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:13:22.100780  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:22.101301  5752 raft_consensus.cc:606] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:13:22.102450  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:22.103991  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:22.104724  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:22.119071  5750 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.143155  5750 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:22.167915  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet ba4aecf80db140ca828a80dc93220fba from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:13:22.168463  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet ba4aecf80db140ca828a80dc93220fba from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-ba4aecf80db140ca828a80dc93220fba
I20260709 12:13:22.176549  5763 tablet_copy_source_session.cc:215] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:22.194674  6932 ts_tablet_manager.cc:933] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:22.195924  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:22.196533  5600 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.203635  5600 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:22.211757  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:22.218021  5677 raft_consensus.cc:3055] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:22.218438  5677 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:22.219244  5677 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.220613  5677 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.228528  6932 tablet_copy_client.cc:323] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:22.229259  6927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4aecf80db140ca828a80dc93220fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:22.230891  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet 5a87e1fb9c364e85bc7c296e4c7b6642 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:22.231827  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet 5a87e1fb9c364e85bc7c296e4c7b6642 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-5a87e1fb9c364e85bc7c296e4c7b6642
I20260709 12:13:22.242832  5689 tablet_copy_source_session.cc:215] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:22.246029  6932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a87e1fb9c364e85bc7c296e4c7b6642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:22.251856  6838 raft_consensus.cc:993] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:22.252360  6838 raft_consensus.cc:1081] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:22.253683  5716 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:22.254889  6930 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:22.255362  6930 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:22.256161  6930 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.258975  5677 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:22.263630  5597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:13:22.264212  5597 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.264576  5597 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:22.273325  6932 tablet_copy_client.cc:806] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:22.273944  6932 tablet_copy_client.cc:670] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:22.278402  6932 tablet_copy_client.cc:538] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:22.281138  6897 raft_consensus.cc:993] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:22.281646  6898 raft_consensus.cc:1081] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:22.284273  5750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:13:22.284819  5750 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.285143  5750 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.286222  5597 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.289264  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:22.289850  5677 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:22.294677  5500 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:22.296089  5677 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:22.288944  6932 tablet_bootstrap.cc:492] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:22.297940  5673 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:22.300796  5569 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:22.304009  6910 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:22.304490  6910 raft_consensus.cc:697] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:22.305331  6910 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.313613  5597 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:22.316159  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:22.316725  5748 raft_consensus.cc:3055] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:22.316995  5748 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:22.317688  5748 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.318372  6927 tablet_copy_client.cc:806] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:22.318677  5748 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:22.318922  6927 tablet_copy_client.cc:670] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:22.332610  5748 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:22.313445  5750 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.335285  6927 tablet_copy_client.cc:538] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:22.337220  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:22.337993  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:22.338500  5673 raft_consensus.cc:3055] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:22.338614  5597 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.338913  5673 raft_consensus.cc:740] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:22.339764  5673 consensus_queue.cc:260] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.340718  6932 tablet_bootstrap.cc:492] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.340839  5673 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.341640  6932 tablet_bootstrap.cc:492] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:22.342340  6932 ts_tablet_manager.cc:1403] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.054s	user 0.027s	sys 0.007s
I20260709 12:13:22.345214  6932 raft_consensus.cc:359] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:22.346030  6932 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:22.346165  5750 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:22.346704  6932 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:22.351855  5597 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:22.353466  5716 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:22.358402  6932 ts_tablet_manager.cc:1434] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:13:22.360080  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-5a87e1fb9c364e85bc7c296e4c7b6642 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:22.360492  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-5a87e1fb9c364e85bc7c296e4c7b6642 on tablet 5a87e1fb9c364e85bc7c296e4c7b6642 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:22.366534  6932 ts_tablet_manager.cc:933] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:22.377439  6930 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:22.378072  6930 raft_consensus.cc:697] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:22.378957  6930 consensus_queue.cc:237] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.382171  5673 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:22.398646  6932 tablet_copy_client.cc:323] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:22.400167  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet 3590ec2a21d04c1c9948d0b4cba00790 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:22.400686  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet 3590ec2a21d04c1c9948d0b4cba00790 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-3590ec2a21d04c1c9948d0b4cba00790
I20260709 12:13:22.401315  5500 catalog_manager.cc:5697] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:22.395964  6927 tablet_bootstrap.cc:492] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:22.407039  5498 catalog_manager.cc:5697] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 2 to 3, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 3 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:22.408214  5689 tablet_copy_source_session.cc:215] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:22.421350  6932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3590ec2a21d04c1c9948d0b4cba00790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:22.435372  6927 tablet_bootstrap.cc:492] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.436982  6927 tablet_bootstrap.cc:492] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:22.437614  6927 ts_tablet_manager.cc:1403] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.042s	user 0.028s	sys 0.001s
I20260709 12:13:22.438331  6932 tablet_copy_client.cc:806] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:22.438879  6932 tablet_copy_client.cc:670] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:22.440224  6927 raft_consensus.cc:359] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:22.440928  6927 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:22.441411  6927 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:22.444473  6932 tablet_copy_client.cc:538] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:22.450125  6930 raft_consensus.cc:993] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:22.450920  6927 ts_tablet_manager.cc:1434] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.003s
I20260709 12:13:22.451535  6772 raft_consensus.cc:1081] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:22.452739  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-ba4aecf80db140ca828a80dc93220fba received from {username='slave'} at 127.0.0.1:40216
I20260709 12:13:22.454056  5600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:13:22.455667  6932 tablet_bootstrap.cc:492] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:22.456494  6937 ts_tablet_manager.cc:933] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:22.457355  5600 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.457820  5600 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.457271  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-ba4aecf80db140ca828a80dc93220fba on tablet ba4aecf80db140ca828a80dc93220fba with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:22.469508  5600 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.472312  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:22.472790  5600 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:22.472865  5673 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.473587  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:22.474196  5750 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:22.474485  5750 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:22.475199  5750 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.476250  5750 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.479888  5673 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:22.481151  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:22.481966  6910 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:22.482425  6910 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:22.483235  6910 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:22.490631  5750 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:22.492847  6937 tablet_copy_client.cc:323] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:13:22.494817  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet 75421a11c1284039a8a17196290f3c16 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:13:22.495321  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet 75421a11c1284039a8a17196290f3c16 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-75421a11c1284039a8a17196290f3c16
I20260709 12:13:22.495955  5498 catalog_manager.cc:5697] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 2 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:22.503032  6898 raft_consensus.cc:993] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:22.503520  6898 raft_consensus.cc:1081] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:22.504992  5689 tablet_copy_source_session.cc:215] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:22.508328  6937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75421a11c1284039a8a17196290f3c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:22.508196  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58720
I20260709 12:13:22.508776  6327 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.508844  6932 tablet_bootstrap.cc:492] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.509136  6327 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.509775  6932 tablet_bootstrap.cc:492] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:22.510447  6932 ts_tablet_manager.cc:1403] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.005s
I20260709 12:13:22.526244  6327 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:22.528995  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:22.529449  5673 raft_consensus.cc:3055] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:22.529693  5673 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:22.529994  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:22.530545  5600 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.530344  5673 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:22.531383  5673 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.529148  6932 raft_consensus.cc:359] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:22.533310  6932 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:22.536209  6932 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:22.536712  5673 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:22.537662  6327 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:22.537974  6293 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:22.541030  6913 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:22.541534  6913 raft_consensus.cc:697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:22.542665  6913 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:22.554265  6937 tablet_copy_client.cc:806] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:22.554838  6937 tablet_copy_client.cc:670] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:22.558470  6937 tablet_copy_client.cc:538] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:22.558599  5600 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:22.557297  6932 ts_tablet_manager.cc:1434] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 12:13:22.564327  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-3590ec2a21d04c1c9948d0b4cba00790 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:22.564711  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-3590ec2a21d04c1c9948d0b4cba00790 on tablet 3590ec2a21d04c1c9948d0b4cba00790 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:22.568936  6937 tablet_bootstrap.cc:492] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:22.568574  5498 catalog_manager.cc:5697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:22.599349  6937 tablet_bootstrap.cc:492] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.600283  6937 tablet_bootstrap.cc:492] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:22.600948  6937 ts_tablet_manager.cc:1403] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.012s
I20260709 12:13:22.602044  6327 raft_consensus.cc:1217] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:22.604049  6937 raft_consensus.cc:359] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:22.604919  6937 raft_consensus.cc:740] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:22.605804  6937 consensus_queue.cc:260] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:22.610781  6937 ts_tablet_manager.cc:1434] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 12:13:22.612797  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-75421a11c1284039a8a17196290f3c16 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:13:22.613209  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-75421a11c1284039a8a17196290f3c16 on tablet 75421a11c1284039a8a17196290f3c16 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:22.626955  6327 raft_consensus.cc:1217] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:22.662055  5673 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.663161  6838 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.691337  5600 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.694269  6772 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.806022  6327 raft_consensus.cc:1217] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:22.849427  5677 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.850675  6930 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.859184  5600 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.860483  6948 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.870460  6327 raft_consensus.cc:1217] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:22.914667  5673 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:22.917802  6910 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.920692  5748 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:22.923772  6910 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.999076  5600 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:23.000499  6833 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:23.013029  5673 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:23.016523  6913 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:23.018815  5673 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:23.020175  6956 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.032054  5750 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:23.033823  6956 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.081041  6897 raft_consensus.cc:1064] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:23.083591  6772 raft_consensus.cc:1064] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:23.085793  6772 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.085474  6897 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.102077  5750 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.103358  5600 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.105613  6787 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.106031  6327 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.106369  6328 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.107407  6787 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:23.110782  6895 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.111101  5673 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.112316  6838 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.114283  5600 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.114100  6838 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.117921  6948 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.157792  6838 raft_consensus.cc:2955] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.158161  6328 raft_consensus.cc:2955] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.162312  5675 raft_consensus.cc:2955] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.181463  6895 raft_consensus.cc:2955] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.198844  5498 catalog_manager.cc:5697] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.203214  6327 raft_consensus.cc:2955] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.213912  5597 raft_consensus.cc:2955] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.219748  5750 raft_consensus.cc:2955] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.228513  5600 raft_consensus.cc:2955] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.233403  5500 catalog_manager.cc:5697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.234546  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.287016  5750 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.297237  6327 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.298302  5600 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.301678  5675 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.298777  6772 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.308085  6838 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.315094  6772 raft_consensus.cc:2955] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.320501  6327 raft_consensus.cc:2955] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.325482  5597 raft_consensus.cc:2955] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.333611  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba4aecf80db140ca828a80dc93220fba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:23.336915  6328 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.337498  5600 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.346475  6895 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:23.350227  6895 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.353466  5497 catalog_manager.cc:5697] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 4, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.359004  6972 raft_consensus.cc:2955] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.369978  6787 raft_consensus.cc:1064] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:23.372545  6787 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.373368  5601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:46698
I20260709 12:13:23.373976  5601 raft_consensus.cc:606] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:23.375063  5597 raft_consensus.cc:2955] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.376351  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5a87e1fb9c364e85bc7c296e4c7b6642 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:23.377130  5750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:23.377691  5750 raft_consensus.cc:606] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:13:23.383687  5601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:46698
I20260709 12:13:23.384361  5601 raft_consensus.cc:606] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:13:23.386801  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet ba4aecf80db140ca828a80dc93220fba with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35870
I20260709 12:13:23.387063  5750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:23.387637  5750 raft_consensus.cc:606] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:13:23.389209  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:23.390717  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:23.391412  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.404274  6977 tablet_replica.cc:333] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:13:23.405428  6977 raft_consensus.cc:2243] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.408583  5498 catalog_manager.cc:5697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.409741  6327 raft_consensus.cc:2955] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.418118  5750 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.422587  6977 raft_consensus.cc:2272] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.424805  6895 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.425585  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a87e1fb9c364e85bc7c296e4c7b6642 with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:23.429097  6977 ts_tablet_manager.cc:1916] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:23.430691  6325 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.436733  5597 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.437997  6972 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.440577  6897 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.468073  6895 raft_consensus.cc:1064] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:23.472417  6895 consensus_queue.cc:237] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.464665  6979 tablet_replica.cc:333] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:13:23.488659  6979 raft_consensus.cc:2243] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.489507  6979 raft_consensus.cc:2272] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.493348  6979 ts_tablet_manager.cc:1916] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:23.508981  6977 ts_tablet_manager.cc:1929] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:23.514505  6977 log.cc:1199] T ba4aecf80db140ca828a80dc93220fba P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/ba4aecf80db140ca828a80dc93220fba
I20260709 12:13:23.522224  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet ba4aecf80db140ca828a80dc93220fba (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:23.526273  6897 raft_consensus.cc:2955] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.536556  6979 ts_tablet_manager.cc:1929] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:23.540987  6979 log.cc:1199] T 5a87e1fb9c364e85bc7c296e4c7b6642 P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/5a87e1fb9c364e85bc7c296e4c7b6642
I20260709 12:13:23.543670  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet 5a87e1fb9c364e85bc7c296e4c7b6642 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:23.544692  5748 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.545872  5752 raft_consensus.cc:2955] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.547562  6787 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.549293  5601 raft_consensus.cc:2955] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.557337  5600 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.559439  6327 raft_consensus.cc:2955] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.564857  5498 catalog_manager.cc:5697] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.565821  6895 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.570132  6325 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.580574  6895 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.584285  6956 raft_consensus.cc:993] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:23.584826  6956 raft_consensus.cc:1081] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:23.590171  5752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44980
I20260709 12:13:23.590732  5752 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.591149  5752 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:23.595201  5597 raft_consensus.cc:2955] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.597857  5752 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:23.592674  6895 raft_consensus.cc:2955] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.601002  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:23.601581  5677 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:23.606432  5752 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:23.608953  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:23.609483  5604 raft_consensus.cc:3055] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:23.609791  5604 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:23.610284  5677 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:23.610383  5604 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:23.611466  5604 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:23.612075  5718 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:23.612846  6772 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:23.614603  6772 raft_consensus.cc:697] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:23.616293  6772 consensus_queue.cc:237] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:23.619833  5604 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:23.623440  6325 raft_consensus.cc:2955] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.627270  5748 raft_consensus.cc:2955] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.639577  5497 catalog_manager.cc:5697] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 2 to 3, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.643486  5677 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.661681  6327 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.664227  6897 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.667984  5677 consensus_queue.cc:237] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.676488  5748 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.681015  5501 catalog_manager.cc:5697] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 2 to 3, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.683491  6787 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.684882  5600 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.687019  6895 raft_consensus.cc:2955] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.688614  5750 raft_consensus.cc:2955] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.691121  6787 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.699586  6327 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.698719  6972 raft_consensus.cc:2955] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.701244  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3590ec2a21d04c1c9948d0b4cba00790 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:23.710348  5497 catalog_manager.cc:5697] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:23.719142  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75421a11c1284039a8a17196290f3c16 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:23.708364  5600 raft_consensus.cc:2955] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.725346  6895 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:23.730885  6327 raft_consensus.cc:2955] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.734449  6890 raft_consensus.cc:993] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:23.713184  6772 raft_consensus.cc:993] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:23.735188  6890 raft_consensus.cc:1081] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:23.735327  6772 raft_consensus.cc:1081] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:23.737178  5675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35874
I20260709 12:13:23.737687  5675 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.738039  5675 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.741693  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet 3590ec2a21d04c1c9948d0b4cba00790 with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51894
I20260709 12:13:23.744184  6325 raft_consensus.cc:2955] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.745064  5675 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.751569  5677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35876
I20260709 12:13:23.752199  5677 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.752552  5677 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.754220  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:23.758023  5752 raft_consensus.cc:3055] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.758313  5752 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:23.759006  5752 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.759766  6991 tablet_replica.cc:333] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:13:23.760063  5752 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.764202  6991 raft_consensus.cc:2243] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.764895  6991 raft_consensus.cc:2272] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.754998  5675 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:23.757426  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:23.770020  6327 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.773475  5501 catalog_manager.cc:5697] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 3 to 4, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 1 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:23.774648  5752 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:23.779942  5642 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:23.780757  6897 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.775882  6991 ts_tablet_manager.cc:1916] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:23.781215  6897 raft_consensus.cc:697] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:23.782130  6897 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.791806  5677 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.794361  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:23.794910  5597 raft_consensus.cc:3055] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.795186  5597 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:23.795908  5597 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.796919  5597 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.800174  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet 75421a11c1284039a8a17196290f3c16 with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44956
I20260709 12:13:23.801126  6979 tablet_replica.cc:333] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:13:23.802102  6979 raft_consensus.cc:2243] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.802868  6979 raft_consensus.cc:2272] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.799484  6991 ts_tablet_manager.cc:1929] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:23.806697  6991 log.cc:1199] T 3590ec2a21d04c1c9948d0b4cba00790 P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/3590ec2a21d04c1c9948d0b4cba00790
I20260709 12:13:23.804850  5597 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:23.806252  6979 ts_tablet_manager.cc:1916] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:23.809343  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet 3590ec2a21d04c1c9948d0b4cba00790 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:23.788580  6327 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:23.813802  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:23.814415  6324 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.814559  5677 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:23.819690  5642 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:23.820524  6990 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.819926  5497 catalog_manager.cc:5697] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 2 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:23.820971  6990 raft_consensus.cc:697] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:23.821866  6990 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:23.826846  6324 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:23.841708  6979 ts_tablet_manager.cc:1929] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:23.842258  6979 log.cc:1199] T 75421a11c1284039a8a17196290f3c16 P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/75421a11c1284039a8a17196290f3c16
I20260709 12:13:23.844018  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet 75421a11c1284039a8a17196290f3c16 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:13:23.841634  5501 catalog_manager.cc:5697] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 2, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 2 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:23.900315  6838 raft_consensus.cc:993] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:23.900738  6948 raft_consensus.cc:1081] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:23.902055  5675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35874
I20260709 12:13:23.902526  5675 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.902768  5675 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.907136  5675 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:23.908406  5675 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:23.909854  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:23.909950  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:23.910507  5597 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.910576  5752 raft_consensus.cc:3055] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.910975  5752 raft_consensus.cc:740] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:23.911617  5752 consensus_queue.cc:260] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:23.913122  5752 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.915712  5597 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:23.916785  5642 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:23.917537  5752 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:23.917584  6990 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.918325  6990 raft_consensus.cc:697] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:23.919137  6990 consensus_queue.cc:237] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:23.929535  5501 catalog_manager.cc:5697] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 2 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.053217  5597 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:24.054368  6948 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:24.062162  5675 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:24.063539  6948 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:24.180699  5752 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:24.181770  6897 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:24.191362  6324 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:24.193917  6989 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:24.275432  5597 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:24.276902  6897 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:24.289134  6325 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:24.290328  6895 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:24.420455  5597 raft_consensus.cc:1275] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.421713  6895 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.430377  5752 raft_consensus.cc:1275] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.432039  6989 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.511179  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:24.545498  5675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:24.546082  5675 raft_consensus.cc:606] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:24.548352  5675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:24.548849  5675 raft_consensus.cc:606] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:13:24.550833  5675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:24.551250  5675 raft_consensus.cc:606] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:24.553259  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:24.553683  5752 raft_consensus.cc:606] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:13:24.554950  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:24.556129  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:24.556859  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:24.589515  6990 raft_consensus.cc:993] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:24.589975  6989 raft_consensus.cc:1081] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:24.591158  5597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51908
I20260709 12:13:24.591611  5597 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:24.591851  5597 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.595976  5597 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:24.598500  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:24.598977  5597 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:24.599021  5675 raft_consensus.cc:3055] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:24.599499  5675 raft_consensus.cc:740] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:24.600951  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:24.601361  5752 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.600188  5675 consensus_queue.cc:260] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:24.602212  5675 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.606312  5752 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:24.607324  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:24.608378  5675 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:24.608407  6955 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:24.609256  6955 raft_consensus.cc:697] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:24.610062  6955 consensus_queue.cc:237] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:24.619522  5501 catalog_manager.cc:5697] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 2 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.720033  6953 raft_consensus.cc:993] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:24.720424  7011 raft_consensus.cc:1081] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:13:24.721554  5600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:13:24.721964  5600 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:24.722203  5600 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.726712  5600 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:24.728097  5600 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:24.728637  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:24.728895  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:24.729156  5675 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.729350  5748 raft_consensus.cc:3055] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:24.729631  5748 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:24.730247  5748 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:24.731289  5748 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.735590  5675 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:24.736670  5569 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:24.736820  6895 raft_consensus.cc:993] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:24.736822  5748 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:24.737447  6990 raft_consensus.cc:1081] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:13:24.737534  6955 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:24.738649  6955 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:24.739035  5748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:13:24.739351  6955 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:24.739800  5748 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:24.740172  5748 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.744608  5748 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:24.746923  5748 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:24.747359  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:24.747819  5600 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.749115  5501 catalog_manager.cc:5697] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 2 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.752301  5600 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:24.753268  5716 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:24.753469  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:24.753834  7011 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:24.754815  7011 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:24.754041  5675 raft_consensus.cc:3055] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:24.755630  7011 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:24.755576  5675 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:24.757468  5675 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:24.758373  5675 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.771528  5501 catalog_manager.cc:5697] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.775668  5675 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:24.780694  6895 raft_consensus.cc:993] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:24.781140  6989 raft_consensus.cc:1081] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:13:24.782450  6324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58720
I20260709 12:13:24.782891  6324 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:24.783161  6324 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.788816  6324 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:24.790633  6324 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:24.791060  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:24.791457  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:24.791548  5600 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.792006  5675 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:24.792309  5675 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:24.792984  5675 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:24.794091  5675 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.797834  5600 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:24.798996  6291 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:24.799701  6831 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:24.800078  6831 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:24.800709  6831 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:24.809456  5675 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:24.811357  5501 catalog_manager.cc:5697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.882573  5597 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:24.888805  5752 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:13:24.888847  5570 consensus_peers.cc:597] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08b7de4c4716494894a4643e09fb86f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.889523  5673 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:24.890107  6955 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:24.890874  6890 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:24.897346  6955 raft_consensus.cc:2955] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:24.898885  5752 raft_consensus.cc:2955] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:24.899005  5673 raft_consensus.cc:2955] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:24.916390  5501 catalog_manager.cc:5697] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 3, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 2 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:24.930860  5748 consensus_queue.cc:237] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:13:24.939525  5719 consensus_peers.cc:597] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27e6e6d757f74b3a95066ebc6b0e8589. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.942765  5673 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:24.943754  5604 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:24.944134  6953 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.944907  7011 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.960245  6948 raft_consensus.cc:2955] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:24.961519  5673 raft_consensus.cc:2955] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:24.972517  5604 raft_consensus.cc:2955] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:13:24.974017  5550 auto_rebalancer.cc:629] Failed to schedule move for tablet 6cc3762193894e76b902a8405a8bd64f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:24.979768  5597 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:24.980557  5497 catalog_manager.cc:5697] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.996448  5748 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:24.996502  5570 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac5b12e3f8d847ddaa3bcba52b39ba9b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.997745  7019 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.999059  5673 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:25.000047  7019 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.005304  6890 raft_consensus.cc:2955] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:25.006942  5748 raft_consensus.cc:2955] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:25.013507  5673 raft_consensus.cc:2955] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:13:25.026367  5498 catalog_manager.cc:5697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index -1 to 2, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 1 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.088515  5748 raft_consensus.cc:1275] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:25.089476  6955 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.111765  5673 raft_consensus.cc:1275] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:25.113237  6955 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.136631  5675 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:25.140785  6890 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.155319  5748 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:25.156816  7016 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.290464  5597 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:25.292353  6913 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:25.310787  5673 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:25.311503  5677 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:25.313122  7011 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.313046  6831 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:25.324266  5604 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:25.331987  7011 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.398236  7043 ts_tablet_manager.cc:933] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:25.408965  7043 tablet_copy_client.cc:323] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:13:25.410461  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet 27e6e6d757f74b3a95066ebc6b0e8589 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:13:25.410998  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet 27e6e6d757f74b3a95066ebc6b0e8589 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-27e6e6d757f74b3a95066ebc6b0e8589
I20260709 12:13:25.419160  5763 tablet_copy_source_session.cc:215] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:25.422943  7043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e6e6d757f74b3a95066ebc6b0e8589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.441267  7043 tablet_copy_client.cc:806] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:25.441923  7043 tablet_copy_client.cc:670] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:25.445566  7043 tablet_copy_client.cc:538] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:25.447547  7045 ts_tablet_manager.cc:933] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:25.449141  7045 tablet_copy_client.cc:323] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.65:38715
I20260709 12:13:25.450846  5614 tablet_copy_service.cc:140] P b3083333af3348e4938f905ca4c4819f: Received BeginTabletCopySession request for tablet ac5b12e3f8d847ddaa3bcba52b39ba9b from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:34012)
I20260709 12:13:25.451381  5614 tablet_copy_service.cc:161] P b3083333af3348e4938f905ca4c4819f: Beginning new tablet copy session on tablet ac5b12e3f8d847ddaa3bcba52b39ba9b from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:34012: session id = c02ed29558db481589fd3db23e43a07f-ac5b12e3f8d847ddaa3bcba52b39ba9b
I20260709 12:13:25.455814  7043 tablet_bootstrap.cc:492] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:25.458624  5614 tablet_copy_source_session.cc:215] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:25.462764  7045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac5b12e3f8d847ddaa3bcba52b39ba9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.498900  7045 tablet_copy_client.cc:806] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:25.499627  7045 tablet_copy_client.cc:670] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:25.503432  7047 ts_tablet_manager.cc:933] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:25.505158  7045 tablet_copy_client.cc:538] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:25.510116  7047 tablet_copy_client.cc:323] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.65:38715
I20260709 12:13:25.511942  5614 tablet_copy_service.cc:140] P b3083333af3348e4938f905ca4c4819f: Received BeginTabletCopySession request for tablet 08b7de4c4716494894a4643e09fb86f0 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:34012)
I20260709 12:13:25.512506  5614 tablet_copy_service.cc:161] P b3083333af3348e4938f905ca4c4819f: Beginning new tablet copy session on tablet 08b7de4c4716494894a4643e09fb86f0 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:34012: session id = c02ed29558db481589fd3db23e43a07f-08b7de4c4716494894a4643e09fb86f0
I20260709 12:13:25.515918  7045 tablet_bootstrap.cc:492] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:25.520860  5614 tablet_copy_source_session.cc:215] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:25.525604  7047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b7de4c4716494894a4643e09fb86f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.534924  7043 tablet_bootstrap.cc:492] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:25.535877  7043 tablet_bootstrap.cc:492] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:25.536541  7043 ts_tablet_manager.cc:1403] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.081s	user 0.033s	sys 0.003s
I20260709 12:13:25.540156  7043 raft_consensus.cc:359] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:25.541155  7043 raft_consensus.cc:740] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:25.541921  7043 consensus_queue.cc:260] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:25.544698  7043 ts_tablet_manager.cc:1434] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:25.553421  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-27e6e6d757f74b3a95066ebc6b0e8589 received from {username='slave'} at 127.0.0.1:40216
I20260709 12:13:25.553897  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-27e6e6d757f74b3a95066ebc6b0e8589 on tablet 27e6e6d757f74b3a95066ebc6b0e8589 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:25.556757  7047 tablet_copy_client.cc:806] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:25.557312  7047 tablet_copy_client.cc:670] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:25.560915  7047 tablet_copy_client.cc:538] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:25.569002  7045 tablet_bootstrap.cc:492] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:25.569727  7047 tablet_bootstrap.cc:492] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:13:25.569977  7045 tablet_bootstrap.cc:492] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:25.570683  7045 ts_tablet_manager.cc:1403] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.007s
I20260709 12:13:25.573648  7045 raft_consensus.cc:359] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:25.574457  7045 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:25.575078  7045 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:25.577466  7045 ts_tablet_manager.cc:1434] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:25.579669  5614 tablet_copy_service.cc:342] P b3083333af3348e4938f905ca4c4819f: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-ac5b12e3f8d847ddaa3bcba52b39ba9b received from {username='slave'} at 127.0.0.1:34012
I20260709 12:13:25.580054  5614 tablet_copy_service.cc:434] P b3083333af3348e4938f905ca4c4819f: ending tablet copy session c02ed29558db481589fd3db23e43a07f-ac5b12e3f8d847ddaa3bcba52b39ba9b on tablet ac5b12e3f8d847ddaa3bcba52b39ba9b with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:25.591699  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:25.594116  7047 tablet_bootstrap.cc:492] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:25.595001  7047 tablet_bootstrap.cc:492] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:13:25.595583  7047 ts_tablet_manager.cc:1403] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.005s
I20260709 12:13:25.597994  7047 raft_consensus.cc:359] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:25.598754  7047 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:13:25.599370  7047 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:25.601686  7047 ts_tablet_manager.cc:1434] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:13:25.603680  5614 tablet_copy_service.cc:342] P b3083333af3348e4938f905ca4c4819f: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-08b7de4c4716494894a4643e09fb86f0 received from {username='slave'} at 127.0.0.1:34012
I20260709 12:13:25.604063  5614 tablet_copy_service.cc:434] P b3083333af3348e4938f905ca4c4819f: ending tablet copy session c02ed29558db481589fd3db23e43a07f-08b7de4c4716494894a4643e09fb86f0 on tablet 08b7de4c4716494894a4643e09fb86f0 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:13:25.657366  5604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:46698
I20260709 12:13:25.661005  5604 raft_consensus.cc:606] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:13:25.663687  5748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:25.664250  5748 raft_consensus.cc:606] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:13:25.666594  5604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:46698
I20260709 12:13:25.667122  5604 raft_consensus.cc:606] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:25.668104  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:25.669622  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:25.670320  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:25.727958  7011 raft_consensus.cc:993] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:25.728538  7011 raft_consensus.cc:1081] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:25.732264  5677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35874
I20260709 12:13:25.732956  5677 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.733340  5677 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.743460  5677 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:25.745258  5677 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:25.747763  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:25.748337  5752 raft_consensus.cc:3055] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:25.748684  5752 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:25.749361  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:25.749367  5752 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:25.750119  5604 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.750780  5752 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.762110  5752 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:25.763904  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:25.764837  6990 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:25.765415  6990 raft_consensus.cc:697] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:25.766295  6990 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:25.771492  6890 raft_consensus.cc:993] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:25.772006  6890 raft_consensus.cc:1081] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:25.787562  6325 raft_consensus.cc:1217] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:25.788511  5675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35876
I20260709 12:13:25.789113  5675 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.789499  5675 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.761276  5604 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:25.810321  5675 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:25.812006  5675 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:25.813910  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:25.814564  5748 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.817899  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:25.818536  5604 raft_consensus.cc:3055] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:25.818887  5604 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:25.822440  5604 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:25.824766  5604 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.828979  5748 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:25.837461  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:25.841341  6989 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:26.107656  6989 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:26.108639  6989 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:28.119012  5644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.010s	sys 0.009s
W20260709 12:13:28.119832  5644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.010s	sys 0.009s
I20260709 12:13:27.693044  7061 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.172525  7060 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:28.174053  7062 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:28.175223  7062 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.175849  7060 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.180310  7062 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.181069  7062 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:28.184278  7063 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:28.184731  7060 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:28.185199  7063 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.172350  7061 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.190062  7061 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.219602  7061 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:28.222854  7061 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.193953  7062 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.334740  7066 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:28.349587  7062 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.283615  7060 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:28.352180  7060 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.354424  7060 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:28.355019  7065 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.355792  7065 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.359639  7061 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.287760  7063 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.360920  7064 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:28.427029  7068 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:28.428045  7068 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.436929  7068 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:28.440088  7066 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.452359  7066 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:28.453281  7065 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.361622  7064 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.456211  7064 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.472286  7068 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:28.473206  7068 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.475360  7068 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:28.592705  7068 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:28.501268  7067 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.593806  7067 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.596525  7067 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.698361  7064 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.699296  7064 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:28.701680  7064 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.702418  7069 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:28.703374  7069 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.706020  7064 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:28.706899  7064 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.706275  7068 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.710042  7068 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:28.710127  7065 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.711242  7061 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:28.711069  7065 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.711994  7061 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.713439  7065 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.713970  7066 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.719937  7066 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.723785  7066 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.714442  7063 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.714164  7061 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.715401  7062 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.715938  7060 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.709471  7064 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:28.726500  7067 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:28.726922  7060 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.727275  7067 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.729259  7060 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.729921  7062 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.731462  7063 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:28.734380  5644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.019s
W20260709 12:13:28.734767  5644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.000s	sys 0.019s
I20260709 12:13:28.735397  7060 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.733649  7069 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:28.739107  7063 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.736245  7062 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:28.740418  5532 debug-util.cc:398] Leaking SignalData structure 0x7b080003d440 after lost signal to thread 4412
W20260709 12:13:28.742471  5532 debug-util.cc:398] Leaking SignalData structure 0x7b08000911a0 after lost signal to thread 5535
I20260709 12:13:28.736126  7060 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.746430  7060 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.746012  7073 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:28.742954  7067 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:28.751787  7067 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:28.752514  7067 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.754978  7067 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:28.755725  7067 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.756422  7067 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.758492  7067 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.758980  7067 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:28.759593  7067 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.750643  7073 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.761703  7067 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:28.762725  7073 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:28.764282  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.766043  7068 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:28.766718  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.766660  7068 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.767678  5600 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:28.769076  7068 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.769170  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.769675  7068 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:28.770408  7068 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.771234  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.771843  5600 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:28.775478  5600 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:28.769222  7072 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.778431  7072 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.804090  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.804978  5596 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:13:28.807708  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.819658  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.820361  5596 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:28.823333  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.846722  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.847714  5596 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:13:28.849539  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.850246  5596 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:28.852787  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.853565  5600 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:13:28.854444  7019 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:28.855120  7019 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.858999  7072 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.860191  7019 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:28.865422  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:28.867190  5604 consensus_meta.cc:287] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 3.041s	user 0.003s	sys 0.073s
I20260709 12:13:28.867615  5604 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:28.892899  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:28.904016  5718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.945s	user 0.018s	sys 0.043s
I20260709 12:13:28.906847  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.907155  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.907605  5596 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:28.908152  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.908871  5599 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:28.914000  5600 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
W20260709 12:13:28.919617  5718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.961s	user 0.019s	sys 0.043s
W20260709 12:13:28.917691  5604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1629) took 3097 ms (client timeout 1793 ms). Trace:
I20260709 12:13:28.923044  6831 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:28.923221  7074 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:28.923707  6831 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:28.921314  5604 rpcz_store.cc:269] 0709 12:13:25.813491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.817624 (+  4133us) service_pool.cc:224] Handling call
0709 12:13:28.889460 (+3071836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:28.928085  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.929807  6831 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:28.923888  7074 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.933950  7075 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.922052  7068 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.936405  7016 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:28.937623  7016 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:28.939441  5642 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.793s (SENT)
I20260709 12:13:28.941155  7016 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:28.943897  7074 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.945734  7019 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:28.947840  7019 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.958127  7041 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:28.934628  7075 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.962175  5597 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:28.964695  7075 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:28.965581  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 48243.7us
I20260709 12:13:28.968784  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:28.969594  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:28.970276  6890 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:28.970374  5601 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:28.951206  7068 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:28.975142  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:28.976002  7060 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:28.976372  7060 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.976742  7060 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.979831  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:28.980741  7062 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:28.981120  7062 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.981470  7062 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.984817  7060 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:28.973878  6890 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.989564  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:28.996344  7077 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:28.996611  7060 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:28.959044  7041 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:28.998765  7060 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:28.994089  7071 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:13:29.001561  5642 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:29.001158  7060 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:28.996999  7077 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.003755  7078 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:28.994473  7068 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.005391  7078 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.014734  7019 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.003145  7060 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.017165  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:29.016103  7082 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.021565  7072 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.022243  7072 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.006188  7067 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.013459  7073 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.023836  5642 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:29.004065  7070 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.047552  7087 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.048171  7087 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.021591  6989 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:29.051044  6913 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.023002  6831 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.051172  6989 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.052488  6989 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.025041  7063 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.024542  7074 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.065850  7069 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:29.066056  7081 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.066473  7069 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.067914  7069 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.070009  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:29.071605  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:29.068512  5497 catalog_manager.cc:5697] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 3, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.051677  6913 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.078231  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:29.065532  7063 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:29.051782  6831 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.078117  7080 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.074283  7061 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.078773  7077 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.080281  7065 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.087186  7084 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:29.082293  7066 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.081875  7063 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.061609  7070 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:29.067917  7081 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.107870  7081 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.108419  7081 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.108915  7081 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.099229  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:29.089154  7061 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.082540  7073 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.046523  7082 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.092314  7072 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.091859  7065 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.094689  7066 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:29.115497  5532 debug-util.cc:398] Leaking SignalData structure 0x7b080012ad00 after lost signal to thread 5628
I20260709 12:13:29.087802  7067 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.092723  7016 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.111703  7070 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.090211  7074 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.149747  7061 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.174746  7087 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.174948  6913 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:29.168182  7065 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.169636  7066 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.189929  7081 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.175005  7083 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.205276  7089 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:29.184067  7078 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.186986  7068 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:29.209417  6831 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.187357  7016 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:29.210188  5532 debug-util.cc:398] Leaking SignalData structure 0x7b08000463a0 after lost signal to thread 5703
I20260709 12:13:29.206092  6955 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.205478  7083 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.176318  7080 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.211300  7041 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.232995  7073 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.232378  6955 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.234339  6913 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.234927  6913 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.237326  6913 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.237990  6831 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.238477  7072 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.238643  7087 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.239213  7074 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.239130  7072 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.176569  7084 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.238499  6831 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.248703  7091 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.249838  7091 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.250737  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.252198  7091 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.253144  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.255371  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.238427  7086 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.262223  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.260551  6890 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.240851  7064 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.231048  7077 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.234944  6955 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.271965  7040 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.272133  7094 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.239233  7087 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.206174  7089 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.265885  7064 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.259466  7062 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.308957  7011 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.309785  7011 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.311630  6953 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.306684  7064 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.269438  7091 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.272709  7040 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.271862  7092 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.283955  7067 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.332126  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.332713  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.272014  7077 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.312250  6953 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.272729  7094 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.333750  7086 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.335223  7084 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.333948  7092 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.350775  7041 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:29.351569  7041 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.347615  7072 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.353128  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.356060  6325 raft_consensus.cc:1217] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:29.364857  7084 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.365324  7104 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.365610  7084 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.366290  7104 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.368324  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.368629  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.369105  6324 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:29.369277  6328 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
W20260709 12:13:29.362888  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 269217us
I20260709 12:13:29.364194  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.368553  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.345044  7091 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.370268  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:29.727130  7065 consensus_meta.cc:287] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.004s
I20260709 12:13:29.736038  7065 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:29.736861  7069 consensus_meta.cc:287] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.018s
I20260709 12:13:29.371047  6989 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:13:29.730247  7063 consensus_meta.cc:287] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.005s
I20260709 12:13:29.737304  7069 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:29.727586  7061 consensus_meta.cc:287] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.542s	user 0.014s	sys 0.005s
I20260709 12:13:29.738576  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.534446  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.363405  7082 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.739282  7061 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:29.469272  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 291010us
I20260709 12:13:29.609910  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:29.711241  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.710114  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.428423  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.376703  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:29.596364  7087 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:29.469462  7089 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:29.744683  5532 debug-util.cc:398] Leaking SignalData structure 0x7b0800368200 after lost signal to thread 5777
I20260709 12:13:29.647903  7066 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.748471  6326 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:29.751127  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:13:29.751312  5532 debug-util.cc:398] Leaking SignalData structure 0x7b0800348460 after lost signal to thread 6352
I20260709 12:13:29.639230  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.749930  5753 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:29.747999  5597 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.376573  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.662103  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.429090  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.602171  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.662413  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:29.711374  7060 consensus_meta.cc:287] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.689s	user 0.008s	sys 0.010s
I20260709 12:13:29.758869  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.635833  5599 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.538267  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.757424  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.419778  7011 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.370986  7096 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:29.762549  6990 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.763159  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.636368  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:29.606773  7094 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.648406  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.378746  7062 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.738873  7063 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.738533  6323 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:29.807911  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.808382  7091 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:29.468871  7086 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.538046  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.534399  6953 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.612033  7040 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:29.574419  7104 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.574429  7080 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:29.762650  7090 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.820858  5671 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:29.819804  6324 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:13:29.804831  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.822541  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.823033  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.823750  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.824371  6324 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:29.788530  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.648480  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.790719  7096 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.825675  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.825947  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.791157  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.791836  7077 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.827369  6328 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:29.792878  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.639087  7070 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.829668  6325 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:29.605932  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.462500  7041 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.790584  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.803433  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.858629  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.859365  5753 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 1.
I20260709 12:13:29.860360  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.861546  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.862401  5753 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 1.
I20260709 12:13:29.791316  5748 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:29.805227  5750 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:29.710171  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.646982  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.768208  7065 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.658670  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.819129  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.767215  7060 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.820214  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.821435  6989 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.749805  7099 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.785459  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.827445  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.875986  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.808915  7071 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.831005  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:29.831064  5749 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:13:29.832455  7090 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.817287  6990 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.809180  7064 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.839202  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.839730  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.823725  5746 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:13:29.845674  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.846050  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.846664  5675 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:29.847015  5670 raft_consensus.cc:1240] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:29.847689  7070 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.886718  7065 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:29.848464  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:29.848784  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.890923  7070 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.891011  7065 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.891539  7070 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.893162  7065 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.849191  5719 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:29.891245  5602 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.885066  5747 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:13:29.895524  7064 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.896168  7071 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.850199  7105 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.897935  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.898365  7071 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.898094  7105 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:29.863335  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.899188  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.900326  7105 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.817236  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.900424  5677 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:29.814513  5598 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:29.871095  5717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.901s	user 0.033s	sys 0.065s
I20260709 12:13:29.821452  7063 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.875347  5597 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:29.876204  6327 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:13:29.902050  7011 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:29.902526  7011 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.902940  7011 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.903658  7090 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.870532  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.877234  5750 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:29.881963  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.885474  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.888185  5751 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.889809  5672 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:29.890156  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.826952  7096 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.849563  7102 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:13:29.893985  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 44971.7us
I20260709 12:13:29.888880  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.910184  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:29.881680  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 100931us
I20260709 12:13:29.905103  5752 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 1.
I20260709 12:13:29.906284  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.893507  5676 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:29.889686  6990 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.909546  7102 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:29.879727  5744 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:29.911470  5597 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 1.
I20260709 12:13:29.904350  7099 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:29.912235  5717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.942s	user 0.033s	sys 0.065s
I20260709 12:13:29.893451  7070 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.908782  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:29.909484  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.916821  5673 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 1.
I20260709 12:13:29.914959  5719 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:29.915282  7102 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.922402  5674 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:29.923059  7096 raft_consensus.cc:1064] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:29.923520  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.915956  7041 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.911927  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.919275  7099 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.924304  7041 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.923823  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.924774  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.925159  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.925642  5719 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:29.925791  5670 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:29.926009  7040 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:29.926410  7040 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.926486  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:29.926792  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.927063  7091 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:29.926803  7040 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.927470  7091 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:29.927888  7091 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.928270  7080 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.928668  7089 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.928871  5677 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:29.928821  7080 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:29.929566  7089 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:29.930464  7060 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.923647  7011 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.931365  7080 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:29.924741  7041 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.936715  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.929154  6953 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.937145  7061 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.937454  6953 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:29.937947  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.938650  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.939105  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.939641  5601 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 1.
I20260709 12:13:29.939836  6953 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.940256  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.941912  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.943478  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.931439  7089 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:29.935650  7092 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.970510  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.946242  5602 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:29.947067  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.948092  7084 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:29.949005  6953 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:29.950341  5677 raft_consensus.cc:1240] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:29.952396  7016 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.953032  5676 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:29.954123  5675 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:29.953902  7080 consensus_queue.cc:1059] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:29.955009  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.985852  5670 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:29.987498  7092 raft_consensus.cc:3055] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:29.987903  7092 raft_consensus.cc:740] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:29.988595  7092 consensus_queue.cc:260] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.955606  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:29.956058  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:29.956274  5718 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:29.958719  7069 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.958732  6831 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.987638  7066 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:29.996377  6321 raft_consensus.cc:1217] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:29.997644  5674 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:29.957455  7096 consensus_queue.cc:237] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.015128  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.929235  7086 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.961215  7011 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.941706  5598 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:30.016105  7086 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.016837  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.968701  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.972101  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.974221  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:30.018934  6322 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.019147  5597 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:29.975216  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:29.981935  7101 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.982576  7080 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:29.985239  5601 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:29.992974  7092 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.014824  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:29.994277  7087 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:29.993703  7083 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:29.995215  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:30.002471  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 46276.3us
I20260709 12:13:30.026911  6323 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:13:30.026394  7091 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.028261  7083 consensus_queue.cc:1059] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:13:30.030575  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.029227  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:30.031435  7083 raft_consensus.cc:3055] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.004746  5570 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:29.993582  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:30.032284  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.032532  5718 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:30.031762  7091 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:29.997112  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:30.005738  7084 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.033218  7078 consensus_queue.cc:1059] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:30.007323  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.008097  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.010074  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.011629  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.995802  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 140) took 1278 ms. Trace:
I20260709 12:13:30.012598  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.013126  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.014060  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.025386  7101 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:29.994338  6293 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:30.026908  7080 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.031695  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.003515  5642 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:30.032013  7011 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.033442  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:29.977465  6953 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:30.052464  6953 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.029505  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.035437  5718 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:30.033850  7083 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:30.037078  7088 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.037854  7078 raft_consensus.cc:3055] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.058712  7088 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:30.065949  7078 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:30.018172  7086 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:30.049269  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 45790.1us
W20260709 12:13:30.055908  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 61749.5us
I20260709 12:13:30.066823  7078 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.068325  7078 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.014853  7109 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:30.035195  5570 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:30.037484  7089 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.055433  5718 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:30.073021  5718 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:30.038939  5671 rpcz_store.cc:276] 0709 12:13:28.717009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.109881 (+392872us) service_pool.cc:224] Handling call
0709 12:13:29.110232 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:29.821244 (+711012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:29.995544 (+174300us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54001b7954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:29.995722 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633628928}
I20260709 12:13:30.062556  7101 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:30.063076  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:30.050237  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:30.058514  7104 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.066031  7088 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.066808  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.088889  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.005729  5604 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:30.033398  7091 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.058435  7072 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.076107  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:30.077283  7016 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:30.077736  7084 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:30.077543  7083 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.078147  7011 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.051935  7066 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:30.064796  7080 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:30.101886  7011 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.106911  7011 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.093910  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:30.086692  7085 consensus_queue.cc:1059] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:30.086988  7104 consensus_queue.cc:1059] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:30.090794  7069 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:30.091199  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.092329  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.092555  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.112344  5677 raft_consensus.cc:2393] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:30.096798  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.099612  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.114617  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.115631  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.117178  7060 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:30.117621  7060 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.118005  7060 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:30.118510  6831 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.118919  6831 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:30.120213  5676 raft_consensus.cc:2393] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:30.111296  7069 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.115231  7108 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.121101  7108 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.118975  7062 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.115665  7061 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:13:30.122251  7083 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.099064  7016 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:30.102080  7066 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:30.099139  7084 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.098924  7102 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.098728  7072 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.084723  5570 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:30.132277  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 47629.3us
I20260709 12:13:30.074486  7109 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.108830  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:30.121897  7062 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:13:30.135121  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 49363.8us
I20260709 12:13:30.119310  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:30.123944  7066 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.110172  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.102838  7087 consensus_queue.cc:1059] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:30.136190  5570 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:30.137238  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:30.138288  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:30.155109  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.138473  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:30.124168  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:30.121491  7108 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.157083  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.160799  5750 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:30.135326  7076 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.127096  7084 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.124298  7016 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.151081  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:30.139072  5718 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:30.127787  7080 raft_consensus.cc:3055] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.131707  7102 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.157204  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.154614  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:30.134354  7072 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.157526  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.132831  7091 raft_consensus.cc:3055] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.150840  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:30.124389  7069 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.159581  6831 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.140190  7062 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.135535  7109 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.164520  5718 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:30.167544  7085 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.157785  7077 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.154930  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.161120  5642 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:30.162281  7076 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:30.184968  7076 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.177297  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:30.172466  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:30.172845  7091 raft_consensus.cc:740] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:30.180042  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.155194  7089 consensus_queue.cc:1059] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:13:30.177698  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.168241  7102 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.177980  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:30.166649  7080 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:30.177820  6831 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.167965  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:13:30.147348  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 52304.5us
I20260709 12:13:30.235015  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:30.246057  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:30.182967  7085 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.250481  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:30.251345  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.183867  7077 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:30.215374  7061 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:30.256247  7061 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:30.260519  7061 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:30.258261  6291 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:30.261371  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.263362  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:30.249975  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.267982  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.271416  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.194900  7112 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:30.255144  7085 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:30.275789  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 93767.7us
I20260709 12:13:30.270103  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.278057  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:30.278057  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.281536  5677 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:30.255527  7077 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.280866  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:30.285534  6291 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:30.287017  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:30.268704  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:30.292339  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.296232  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:30.301693  7110 log.cc:927] Time spent T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Append to log took a long time: real 0.237s	user 0.000s	sys 0.002s
I20260709 12:13:30.324184  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.286577  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.327128  7115 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.276633  7112 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.292209  7086 raft_consensus.cc:3055] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:30.335912  7087 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.337103  7101 raft_consensus.cc:3055] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:13:30.350509  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 65074.2us
I20260709 12:13:30.351486  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:30.339164  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.339977  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.340721  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.302021  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:30.323346  7114 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.352505  6291 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:13:30.357875  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.363358  5750 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:30.367338  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:30.361090  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 106472us
I20260709 12:13:30.343072  7112 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.343361  7086 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:30.355651  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.350291  7115 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.350778  7101 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:30.383186  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.386070  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.387681  7060 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:30.359109  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 55874.9us
I20260709 12:13:30.355952  7072 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.373780  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.393985  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.402105  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.353801  7091 consensus_queue.cc:260] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.409183  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.409979  7072 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:30.392390  7109 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.402922  7118 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.385501  7087 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.392617  7115 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.412989  6953 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.412832  6291 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:13:30.419505  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:30.425297  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:30.430279  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 59310.1us
I20260709 12:13:30.421715  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.442998  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:30.449448  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:30.450317  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:30.413261  7066 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.454700  7065 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:30.460723  7113 raft_consensus.cc:3055] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.461198  7113 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:30.463353  5642 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.454859  7116 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:13:30.431188  7087 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.467232  7087 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.385056  7080 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.471818  7113 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.473186  7113 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.478953  7112 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:30.481706  7087 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.483989  7087 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.484964  7112 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:30.491685  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.456347  6989 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.448424  7091 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.500443  7101 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:30.510675  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.443789  7111 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.168s
W20260709 12:13:30.491181  7041 consensus_meta.cc:287] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.006s
I20260709 12:13:30.457325  7071 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.506109  6989 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:30.507728  5676 raft_consensus.cc:1240] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:30.519188  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.526249  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.501713  7063 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.506150  7065 raft_consensus.cc:697] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:30.531191  5718 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:30.532151  5718 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:13:30.534684  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 78115.5us
I20260709 12:13:30.522274  5672 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:30.521003  7099 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:30.528201  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.522140  7075 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:30.523187  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.530797  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:30.531795  7064 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.533321  7071 raft_consensus.cc:697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:30.542181  7123 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:30.542249  7065 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.542733  7120 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:30.501696  7086 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.535668  7104 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.523865  7041 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.537026  7070 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.540105  7099 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.540297  7101 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.549481  7096 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:30.591970  7120 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.593904  6989 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.596956  7071 consensus_queue.cc:237] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.600926  5716 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:30.603070  6322 consensus_meta.cc:287] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.584s	user 0.003s	sys 0.007s
I20260709 12:13:30.604185  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.557147  7075 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:30.542187  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.632489  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.548439  7060 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.633962  7086 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.650621  7041 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:30.652546  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 51801.9us
I20260709 12:13:30.634344  7096 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.634238  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.632266  7099 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.651314  6322 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:30.670774  7114 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.673053  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:30.674410  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 142277us
I20260709 12:13:30.677325  6327 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:30.674477  5716 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.679313  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:30.683517  5716 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.687070  6831 raft_consensus.cc:3055] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.687453  6831 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:30.664235  7096 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.689745  7121 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.692108  5716 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.693009  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:30.675809  7104 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:30.686592  7011 consensus_meta.cc:287] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.579s	user 0.015s	sys 0.014s
I20260709 12:13:30.675483  5745 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:30.685173  7066 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:30.688961  7078 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.707053  6831 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.697814  6953 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:30.700276  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:30.692830  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 278803us
I20260709 12:13:30.691226  7061 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.705744  7083 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.714984  5716 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:30.605145  7123 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:30.714005  7062 consensus_meta.cc:287] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.028s
I20260709 12:13:30.738116  7126 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.741338  7120 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.744490  7077 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.745970  7127 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:30.746285  7109 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.747360  5753 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:30.729555  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:30.749452  7108 consensus_meta.cc:287] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.584s	user 0.000s	sys 0.011s
W20260709 12:13:30.750025  7069 consensus_meta.cc:287] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.564s	user 0.002s	sys 0.007s
I20260709 12:13:30.750725  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:30.708578  7011 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.746122  7075 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.771421  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:30.772846  7016 consensus_meta.cc:287] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.600s	user 0.015s	sys 0.014s
I20260709 12:13:30.774507  7016 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.776623  7016 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:30.771112  7069 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.788972  5675 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:30.784055  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 69154.2us
I20260709 12:13:30.752573  7062 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:30.782691  7092 consensus_meta.cc:287] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.756s	user 0.008s	sys 0.011s
W20260709 12:13:30.784240  7040 consensus_meta.cc:287] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.856s	user 0.013s	sys 0.031s
W20260709 12:13:30.781487  7084 consensus_meta.cc:287] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.608s	user 0.019s	sys 0.010s
I20260709 12:13:30.772212  7126 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:30.800593  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.801666  5751 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:30.802146  5671 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:30.803123  7062 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.807418  7011 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:30.809391  7102 consensus_meta.cc:287] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.001s
I20260709 12:13:30.809775  7102 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.809885  7040 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:30.784844  7088 consensus_meta.cc:287] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.012s
I20260709 12:13:30.764642  7108 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.821830  7123 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.815438  7084 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.833540  7108 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.834371  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:30.834565  7077 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:30.836882  5497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45220 (request call id 290) took 2005 ms. Trace:
I20260709 12:13:30.826233  5752 raft_consensus.cc:2393] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:30.856432  5673 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:30.858688  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:30.854019  7119 consensus_queue.cc:1059] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:13:30.826313  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:30.870440  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 67901.2us
I20260709 12:13:30.824630  7115 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.834617  7084 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:30.872684  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:30.847931  5747 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:30.877288  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:30.875252  7112 consensus_queue.cc:1059] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:30.877313  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.826056  7069 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.850333  7077 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:30.891992  7061 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.892751  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.896955  7096 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.897912  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:30.901674  7115 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.903301  7102 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:30.906576  5567 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:30.872273  7089 consensus_queue.cc:1059] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:13:30.913933  7089 raft_consensus.cc:3055] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:30.914278  7089 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:30.915042  7089 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.837303  5497 rpcz_store.cc:276] 0709 12:13:28.812614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.812918 (+   304us) service_pool.cc:224] Handling call
0709 12:13:30.818080 (+2005162us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:29.690731 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:29.691511 (+   780us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:29.691559 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:13:29.691594 (+    35us) tablet.cc:662] Decoding operations
0709 12:13:29.692079 (+   485us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:29.692186 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:29.692221 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:29.692538 (+   317us) tablet.cc:701] Row locks acquired
0709 12:13:29.692593 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:13:29.692795 (+   202us) write_op.cc:270] Start()
0709 12:13:29.692947 (+   152us) write_op.cc:276] Timestamp: P: 1783599209692721 usec, L: 0
0709 12:13:29.692984 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:13:29.756053 (+ 63069us) log.cc:844] Serialized 535 byte log entry
0709 12:13:30.495656 (+739603us) op_driver.cc:464] REPLICATION: finished
0709 12:13:30.644253 (+148597us) write_op.cc:301] APPLY: starting
0709 12:13:30.644374 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:30.644489 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:30.644622 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:30.662834 (+ 18212us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:30.663082 (+   248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:30.663142 (+    60us) write_op.cc:312] APPLY: finished
0709 12:13:30.669587 (+  6445us) log.cc:844] Serialized 23 byte log entry
0709 12:13:30.670463 (+   876us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:30.670564 (+   101us) write_op.cc:454] Released schema lock
0709 12:13:30.670620 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:30.671044 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:30.671071 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":48993,"apply.run_cpu_time_us":2716,"apply.run_wall_time_us":36833,"num_ops":1,"prepare.queue_time_us":423401,"prepare.run_cpu_time_us":20063,"prepare.run_wall_time_us":233707,"raft.queue_time_us":128806,"raft.run_cpu_time_us":28471,"raft.run_wall_time_us":37748,"replication_time_us":802491,"thread_start_us":362285,"threads_started":4,"wal-append.queue_time_us":151689}]]}
I20260709 12:13:30.928422  7132 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.928864  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:30.826609  7088 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.875243  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:30.882036  7040 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:30.916363  7089 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:30.892726  7099 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:30.946337  5567 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:30.949542  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:30.950654  5567 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:30.939669  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 499195us
I20260709 12:13:30.954306  6291 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:30.956629  5719 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:30.957810  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.958032  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:30.959297  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.959749  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:30.960453  5642 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.963020  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:30.964164  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:30.965334  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.904260  7077 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:30.973042  5604 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:30.962111  7061 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.976279  7114 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.979779  6322 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:30.979842  7114 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:30.980343  7114 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.954381  5745 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:30.971894  6291 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:30.981739  5716 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.971185  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.983150  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:30.970590  7069 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.974874  7119 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:30.995851  7119 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:30.987927  5716 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.976225  7040 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:30.970665  7102 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.988077  7061 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.990072  7111 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.990036  7092 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:30.983865  7085 consensus_meta.cc:287] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.690s	user 0.006s	sys 0.014s
I20260709 12:13:30.977073  7062 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.991535  7132 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.973237  7108 consensus_queue.cc:1059] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:13:31.004782  6291 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.008138  6291 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:30.998402  7119 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.011272  5716 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:31.013128  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.016096  6291 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.020427  5749 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:31.001991  7040 raft_consensus.cc:697] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:13:31.030058  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 332816us
I20260709 12:13:31.031278  5569 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.009893  7061 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.013594  7115 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.034965  5569 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:31.034965  5716 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.024212  7111 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.023777  7091 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.014904  7133 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.043915  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:31.037937  5716 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.009654  7085 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:31.025372  7062 raft_consensus.cc:697] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.052182  7062 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.054049  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:31.038926  7112 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.042254  7075 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.054982  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.056192  7099 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:31.056785  7077 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:31.053009  7061 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.058364  5569 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:31.036526  7132 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.048938  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.054701  7040 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.063529  7088 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:31.063730  7091 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.065625  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:31.045281  7096 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:31.067353  7085 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:31.067798  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.068849  5672 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:31.069734  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:31.069977  7076 consensus_meta.cc:287] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.885s	user 0.005s	sys 0.016s
I20260709 12:13:31.072726  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:31.073197  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.098451  7101 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.046325  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:13:31.078545  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 127955us
I20260709 12:13:31.111557  5567 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:31.079474  6831 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.083496  7080 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.086404  5673 raft_consensus.cc:1240] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.087177  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.110575  7088 consensus_queue.cc:1059] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:13:31.119907  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.120748  5748 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:31.121140  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:31.040220  7141 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:31.096526  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 47665.8us
I20260709 12:13:31.128485  5678 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 2: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:31.129326  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.129667  5567 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:31.130239  5716 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.104472  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.099608  5746 raft_consensus.cc:2393] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 2: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:13:31.076072  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.114235  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 67988.7us
I20260709 12:13:31.111174  7082 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:31.116287  7117 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:31.119907  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.144470  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.122419  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:31.124040  5601 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.125746  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.127579  7114 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.132779  5719 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.139303  6291 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:31.063555  6320 consensus_meta.cc:287] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.538s	user 0.022s	sys 0.001s
I20260709 12:13:31.140458  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:31.099800  7084 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:13:31.159942  6291 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.133255  7123 consensus_queue.cc:1059] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:13:31.161060  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.113371  7076 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.146064  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.161693  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.161926  7118 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.148150  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.148253  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.152316  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.122447  7077 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:31.127599  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.154035  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.147486  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.179278  5642 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.155488  5752 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:31.178699  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:31.180490  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:31.181234  5752 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 2: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:31.156317  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.138080  7086 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.146471  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.143507  7083 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.179809  5675 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 2: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:31.186551  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:31.155646  7117 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:31.190678  5596 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.153785  7120 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.184726  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.185329  5749 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 2: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:31.192595  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.183293  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.187667  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.189023  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.189625  6831 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:31.195761  6831 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:31.196142  6831 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.158823  7133 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.161381  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:31.198518  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.200114  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.201292  7114 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:31.205018  7076 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:31.205667  7076 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:31.206151  7076 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.207168  7113 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.181068  7141 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.158407  6320 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:31.202664  7117 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.210448  5600 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:31.211928  6291 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.218183  5596 raft_consensus.cc:1240] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.178270  7142 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.184775  7108 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.190773  7105 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:31.217417  6831 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.209699  7109 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:31.212685  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.232934  6831 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:31.190389  7077 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.240123  5745 raft_consensus.cc:2393] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:31.223692  7120 raft_consensus.cc:3055] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:31.240299  7139 log.cc:927] Time spent T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:13:31.241102  7140 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.222858  7070 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.206141  7119 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.261196  6327 raft_consensus.cc:1240] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.264868  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:31.228250  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.226938  7115 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:31.262424  7120 raft_consensus.cc:740] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:31.237900  5749 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:31.233919  7138 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:31.239269  7134 consensus_queue.cc:1059] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.182s
I20260709 12:13:31.191166  7127 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:13:31.248847  7065 consensus_queue.cc:1059] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:13:31.279155  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.278021  7076 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:31.292416  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 162836us
I20260709 12:13:31.283643  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:31.305215  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:31.306509  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.307622  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:31.308017  7132 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.311630  7120 consensus_queue.cc:260] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.313230  7120 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.315124  5567 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:31.321996  5601 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:31.323997  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.318742  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.326782  7129 raft_consensus.cc:3055] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.314898  6322 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.340068  5567 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:31.345049  7140 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.329071  7138 consensus_queue.cc:1059] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:31.330237  6319 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.372287  5601 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:31.343227  7129 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:31.344507  7134 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.423823  5567 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.447335  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:31.451983  5567 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:31.452093  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:31.427208  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.458235  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.429723  7041 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:31.447813  7077 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:31.452950  7138 raft_consensus.cc:3055] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.432240  7016 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:31.461400  7088 consensus_queue.cc:1059] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.462092  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:31.430725  7086 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:31.428699  7083 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:31.454895  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.474721  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.475366  7082 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:31.475802  7082 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:31.475967  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:31.476577  5753 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:31.477846  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.469702  7134 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.470247  7077 raft_consensus.cc:2764] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:13:31.466825  7138 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:31.466931  7041 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.472388  7016 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.478399  7083 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.481875  7086 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.505635  7077 raft_consensus.cc:3055] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.526914  5753 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.516191  7011 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:31.527464  7011 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.528113  5751 raft_consensus.cc:1240] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.528988  6326 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:31.529379  7011 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:31.506367  7105 raft_consensus.cc:697] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.531179  7105 consensus_queue.cc:237] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.535226  7041 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:31.536010  7109 raft_consensus.cc:3055] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.536497  7109 raft_consensus.cc:740] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.525822  7069 raft_consensus.cc:3055] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.537390  7109 consensus_queue.cc:260] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.538085  7069 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.538941  7069 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.540197  7069 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:31.541339  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 230929us
I20260709 12:13:31.541509  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.542454  5674 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:31.544096  5645 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.544808  7062 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.545203  5645 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.545850  7062 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.546471  7016 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:31.546897  7083 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:31.523819  7077 raft_consensus.cc:740] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:31.548283  7086 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:31.548102  7077 consensus_queue.cc:260] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.550374  5718 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.551517  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.552140  7077 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.556010  7011 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.556728  7011 consensus_queue.cc:1059] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.557747  7091 raft_consensus.cc:3055] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.558203  7091 raft_consensus.cc:740] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:31.559047  7091 consensus_queue.cc:260] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.557649  7129 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.560379  5501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45214 (request call id 294) took 1538 ms. Trace:
I20260709 12:13:31.560961  6328 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.524629  7096 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:31.563163  7096 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.564473  7080 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:31.565089  7080 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.565378  7096 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:31.560890  7129 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.569909  7080 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:31.526126  7075 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.574805  7123 raft_consensus.cc:3055] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.560720  5501 rpcz_store.cc:276] 0709 12:13:30.021896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.022048 (+   152us) service_pool.cc:224] Handling call
0709 12:13:31.560210 (+1538162us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":1408}
I20260709 12:13:31.595880  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:31.598663  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 375162us
W20260709 12:13:31.611007  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.573535  7108 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.614037  5671 raft_consensus.cc:2393] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:31.504515  7138 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.573670  7091 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.628885  5645 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.631546  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.613711  7123 raft_consensus.cc:740] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:31.621001  7147 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:31.627516  7080 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:13:31.649710  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.634471  7154 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.653805  5752 raft_consensus.cc:1240] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:31.659003  5752 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:31.665998  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.636824  7108 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.639807  7082 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.668643  7132 raft_consensus.cc:3055] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.670279  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.690128  7132 raft_consensus.cc:740] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:31.690999  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:31.692694  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.693747  7082 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:31.671119  7063 consensus_queue.cc:1059] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:13:31.667773  7071 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:31.666603  7123 consensus_queue.cc:260] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.694865  7071 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.695068  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.695312  7123 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.696900  7071 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:31.698904  5670 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:31.701815  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.699997  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.704131  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.707315  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.708209  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.708403  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.709425  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.710008  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:31.711431  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:31.711943  5603 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:31.648768  7080 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:31.718714  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 48594.4us
I20260709 12:13:31.669804  7077 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:31.716368  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:31.716650  7061 raft_consensus.cc:3055] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.720422  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:31.720554  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:31.668812  7134 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.721552  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:31.654407  7147 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.726296  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.728377  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1027) took 1571 ms. Trace:
I20260709 12:13:31.716368  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.669438  7117 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.731833  7155 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.728277  7060 consensus_queue.cc:1059] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:13:31.725855  7061 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.736672  7155 raft_consensus.cc:3055] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.737037  7155 raft_consensus.cc:740] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:13:31.734145  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.721156  6990 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.728344  7071 consensus_queue.cc:1059] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:13:31.737857  7155 consensus_queue.cc:260] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.739002  7155 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.739902  5645 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.740373  7132 consensus_queue.cc:260] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.741287  7132 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.741432  7063 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:31.742113  7063 raft_consensus.cc:697] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.742977  7063 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.743500  7080 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:31.730014  5598 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:31.730770  5748 rpcz_store.cc:276] 0709 12:13:30.154592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.325471 (+170879us) service_pool.cc:224] Handling call
0709 12:13:31.118733 (+793262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:31.121193 (+  2460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.725486 (+604293us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b5400052dd0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:31.725600 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766115072}
W20260709 12:13:31.735347  6320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 550) took 1607 ms (client timeout 1785 ms). Trace:
W20260709 12:13:31.745615  6320 rpcz_store.cc:269] 0709 12:13:30.127878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.131798 (+  3920us) service_pool.cc:224] Handling call
0709 12:13:31.735160 (+1603362us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b540053acd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:31.735273 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603044096}
I20260709 12:13:31.748173  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.748987  5676 raft_consensus.cc:2393] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 2: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:31.722479  7140 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.730263  7077 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.739003  7071 raft_consensus.cc:3055] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.752460  7077 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:31.737406  7061 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.748176  7117 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:31.753616  7061 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:31.753950  6989 consensus_queue.cc:1175] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c02ed29558db481589fd3db23e43a07f" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 12:13:31.754952  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.757381  5645 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.760056  6990 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:31.760516  6990 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.762032  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:31.762576  6327 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.763763  5604 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:31.764679  7123 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:31.765241  7123 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.765821  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.766224  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.761323  6990 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.766606  5752 raft_consensus.cc:2393] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:31.771049  5747 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.771420  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:31.767019  7159 log.cc:927] Time spent T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:13:31.767326  7080 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:31.760182  5570 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.777182  6327 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:31.772912  6291 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:31.767973  5716 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:31.778259  5570 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.779204  5716 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.779425  5570 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.783354  5716 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:31.782218  7120 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.785080  7140 consensus_queue.cc:1059] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:13:31.785532  5716 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:31.787163  7133 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:31.790416  7133 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:31.790807  7133 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.787849  7076 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.769261  7071 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.784785  7083 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.791024  5716 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.767854  7123 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:31.790078  5676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:31.768985  7147 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:31.784361  7117 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.796983  7140 consensus_queue.cc:1059] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:13:31.733992  7134 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.784150  7091 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:31.803246  7091 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:31.803743  7071 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.805045  7083 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.804896  7076 consensus_queue.cc:1059] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.804454  7109 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.806043  7084 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.806502  7084 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.804930  5676 raft_consensus.cc:606] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:31.790167  7149 raft_consensus.cc:3055] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.808634  7084 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:31.808880  7149 raft_consensus.cc:740] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:31.802090  7140 raft_consensus.cc:3055] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.808979  5750 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:31.808446  5746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 1655) took 1671 ms (client timeout 1735 ms). Trace:
I20260709 12:13:31.809847  7149 consensus_queue.cc:260] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.810160  7140 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:13:31.810451  5746 rpcz_store.cc:269] 0709 12:13:30.137452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.138163 (+   711us) service_pool.cc:224] Handling call
0709 12:13:30.361753 (+223590us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:31.808230 (+1446477us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54003638d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:31.808366 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516015360}
I20260709 12:13:31.811642  7091 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.812340  7149 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.812431  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.815615  5570 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.792044  7112 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:31.812942  7134 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:31.786569  7077 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.823217  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:31.823828  5746 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:31.819120  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:31.827850  5604 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:31.828585  7071 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.819752  7088 consensus_queue.cc:1059] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.829490  7088 raft_consensus.cc:3055] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.829819  7088 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:31.830608  7088 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.830987  6291 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.831693  7088 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.832353  7142 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.833580  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.834087  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1029) took 1619 ms. Trace:
I20260709 12:13:31.818113  7120 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.818118  7112 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:31.828655  5749 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:31.821890  7148 raft_consensus.cc:1064] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:31.835042  7112 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.833961  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.835961  7119 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:31.836196  7120 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:31.836549  7120 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:31.836776  7119 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.836906  7120 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.837220  7148 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.838442  5751 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:31.834822  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.818559  5570 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.834650  5716 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:31.840281  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.843845  5569 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:31.834419  5750 rpcz_store.cc:276] 0709 12:13:30.226675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.419622 (+192947us) service_pool.cc:224] Handling call
0709 12:13:31.808819 (+1389197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:31.810665 (+  1846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.833893 (+ 23228us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003638d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:31.834023 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3158011776}
I20260709 12:13:31.846160  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.843014  5567 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:31.850782  5642 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.851784  5642 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:31.852511  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.852607  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.853333  6328 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 2: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:31.855873  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.856849  6322 raft_consensus.cc:1240] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:31.857609  7101 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:31.857869  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:31.858016  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.859258  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:31.849875  7142 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.861611  6319 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.811260  7140 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.862272  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:31.868996  5569 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:31.870128  5569 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.871100  6327 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.873409  5719 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.861690  5753 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:31.864012  5751 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:31.867200  7101 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.878003  5569 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:31.867017  6324 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:31.879889  7146 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.846452  7113 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.868487  5752 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:31.863308  7016 raft_consensus.cc:3055] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.881742  7016 raft_consensus.cc:740] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:31.882567  7161 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.864768  7065 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.874404  7011 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.884300  7065 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:31.884737  7063 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.886284  7065 raft_consensus.cc:697] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.886816  6989 consensus_queue.cc:1059] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.887832  7155 raft_consensus.cc:3055] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.888155  7155 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.888463  6989 consensus_queue.cc:1059] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.888931  7155 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.877076  7101 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.890013  6989 raft_consensus.cc:3055] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.887151  7065 consensus_queue.cc:237] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.882580  7016 consensus_queue.cc:260] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:31.865132  7077 consensus_queue.cc:1175] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "831d76c5ee1045f0af923ce24fa4c301" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 12:13:31.853505  7134 consensus_queue.cc:1059] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:13:31.890964  7016 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.891661  7134 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.892031  7134 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:31.890388  6989 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.894070  6989 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.910120  7109 consensus_queue.cc:1059] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:31.910967  7161 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.911505  7061 raft_consensus.cc:3055] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.911880  7061 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:31.912241  7063 consensus_queue.cc:1059] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:31.913087  7102 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:31.914073  7134 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:31.916370  5569 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:31.916545  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.917503  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:31.918213  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 99690.9us
I20260709 12:13:31.924127  5497 catalog_manager.cc:5697] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.873984  7117 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.862804  7140 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.902408  7132 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.943235  5570 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:31.878715  7147 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:31.833591  7133 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.943171  5604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:46698
I20260709 12:13:31.946797  5604 raft_consensus.cc:606] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:13:31.947592  5604 raft_consensus.cc:614] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:31.951079  5671 raft_consensus.cc:1240] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.953161  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.954165  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:31.959597  5596 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.961532  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.961789  5596 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:31.954052  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:31.964854  5601 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:31.965163  5673 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:31.922593  7134 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.922744  7076 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.922657  7123 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:31.965996  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:31.865178  7120 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.935453  6990 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.935791  7138 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.985718  5677 raft_consensus.cc:1240] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:31.937736  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.970477  7082 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:31.985181  5679 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:31.937984  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:31.926790  7063 consensus_queue.cc:1059] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:13:31.945899  7077 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:31.964406  6989 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.942029  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.946141  7147 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:31.942251  7099 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:13:31.935425  7127 consensus_queue.cc:1059] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:13:31.979090  7158 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:31.989269  7155 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.940588  7091 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:31.926599  7161 consensus_queue.cc:1059] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:13:31.964326  7146 consensus_queue.cc:1059] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:13:31.997278  5746 raft_consensus.cc:1240] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:31.970160  7041 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:13:32.007483  5753 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:31.978691  7061 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.032248  7061 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.998030  6322 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:31.994617  7090 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:13:32.008720  7158 raft_consensus.cc:697] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:32.009338  7156 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:32.009449  7084 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:32.028352  7080 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:32.045899  7084 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.047999  7084 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:32.010077  6319 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:31.999532  7075 consensus_queue.cc:1059] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:13:32.050541  7146 raft_consensus.cc:3055] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.050896  7146 raft_consensus.cc:740] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:32.051684  7146 consensus_queue.cc:260] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.053906  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:32.054556  6319 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:32.055848  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:32.012187  7133 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:32.012356  7063 raft_consensus.cc:3055] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.979144  7096 consensus_queue.cc:1059] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:13:32.015556  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:32.022128  5602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:46698
I20260709 12:13:32.065407  5602 raft_consensus.cc:606] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:13:32.004033  7077 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.030632  5752 raft_consensus.cc:1240] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:32.031083  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:32.008548  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:32.003302  7147 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:32.032981  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:32.040762  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:32.035351  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:31.997169  7116 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:13:32.076205  7109 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:32.025249  7011 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:32.024657  7120 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:32.031778  7091 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:32.063345  5749 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:32.065325  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:32.002738  5600 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.067952  5597 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.057194  5595 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.072391  7168 raft_consensus.cc:3055] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.042258  7082 raft_consensus.cc:3055] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.073110  7077 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:32.075634  5672 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:32.078312  5716 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:32.034111  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:32.089697  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.076164  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:32.115592  7133 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:32.116534  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:32.067088  7084 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:32.118491  7084 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:32.118937  7084 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.064827  7063 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:32.120462  7063 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.092058  5570 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:32.123831  7149 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:32.055667  7158 consensus_queue.cc:237] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.124221  7149 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:32.070957  7083 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:32.111526  5678 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:32.112717  5597 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.073283  5747 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.124141  6990 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:32.149652  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.106535  5745 raft_consensus.cc:1275] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.117710  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:32.150177  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.105660  7126 raft_consensus.cc:3055] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.111850  7168 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:32.114904  7082 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:32.163007  5719 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:32.149358  7149 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.164129  5748 raft_consensus.cc:1240] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:32.158680  7080 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.183410  6990 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.184798  6990 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:32.186391  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:32.162918  7126 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:32.180001  5670 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:32.179610  7083 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:13:32.259495  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 279230us
W20260709 12:13:32.231349  7144 log.cc:927] Time spent T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:32.256603  7082 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:32.268811  7160 consensus_queue.cc:1059] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:13:32.280812  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 298662us
I20260709 12:13:32.281741  5567 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:32.283557  5569 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:32.198593  7080 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.270079  6322 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:32.292510  7088 raft_consensus.cc:993] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:32.293202  7123 raft_consensus.cc:3055] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:32.124366  7112 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:32.308547  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.318081  7088 raft_consensus.cc:1081] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:32.270187  7168 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.294150  7120 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:32.331316  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.335100  5567 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
W20260709 12:13:32.313199  7172 log.cc:927] Time spent T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:13:32.289109  7161 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:32.343573  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.341712  5750 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:32.304823  7123 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:13:32.344089  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:32.346930  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.347646  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:32.295393  7126 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.352875  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:32.356827  5745 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:32.336444  7109 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:13:32.375691  7082 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:32.377643  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.346014  7075 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:32.341712  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.380626  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:32.348450  7105 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 12:13:32.381032  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.382880  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:32.343849  7090 consensus_queue.cc:1059] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:13:32.369258  7084 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.354206  7088 consensus_queue.cc:1059] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 12:13:32.395722  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 73590us
I20260709 12:13:32.379770  7075 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:32.397078  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 196414us
I20260709 12:13:32.399538  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:32.398828  7075 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.406461  7065 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 12:13:32.407323  7178 log.cc:927] Time spent T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:13:32.407836  6989 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:32.361630  7147 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.412073  5597 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:32.398336  7112 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:32.396751  7174 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:32.416244  5716 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:32.419269  7101 consensus_meta.cc:287] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.000s
I20260709 12:13:32.413612  7138 consensus_queue.cc:1059] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:13:32.430178  7138 raft_consensus.cc:3055] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.430546  7138 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:32.431392  7138 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.432719  7138 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.428833  7101 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.435196  7101 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:32.436002  5744 raft_consensus.cc:2393] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:32.436802  7080 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:32.439106  7147 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:32.442121  5753 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:32.445837  5567 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:32.447777  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:32.448341  5600 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.449326  7069 raft_consensus.cc:3055] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:32.449683  7069 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:32.450477  7069 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.452445  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:32.451689  7069 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:32.461030  5673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35876
I20260709 12:13:32.461818  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:32.462275  5599 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:32.462244  5673 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.462875  5673 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.463415  5745 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:32.465481  5678 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:32.470012  5673 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.460307  7083 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:32.472023  5673 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:32.472965  5679 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:32.474505  7132 consensus_meta.cc:287] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.000s
I20260709 12:13:32.474898  7132 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:32.476078  5603 raft_consensus.cc:1275] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.478241  5567 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:32.413928  7090 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:13:32.451838  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:32.458139  7096 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.482300  7082 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:32.485342  7096 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.470669  7063 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.487887  5679 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:32.485800  7174 consensus_queue.cc:1059] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:32.489493  7174 raft_consensus.cc:3055] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.489861  7174 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:32.478600  7083 raft_consensus.cc:697] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:32.494895  7113 raft_consensus.cc:3055] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.495292  7113 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:32.495599  7083 consensus_queue.cc:237] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.496160  7113 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.507867  7146 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:32.513196  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 296141us
I20260709 12:13:32.451615  7149 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.516256  5601 raft_consensus.cc:1240] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:32.494513  7140 consensus_meta.cc:287] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.001s
I20260709 12:13:32.536300  6322 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:32.490707  7174 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.544986  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:32.529635  7120 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:32.546440  7142 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:32.547082  7174 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.551118  5600 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:32.552048  7142 consensus_queue.cc:1059] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:32.556239  7123 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.557435  7123 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:32.552275  7147 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:32.558734  5604 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:32.559664  7142 raft_consensus.cc:3055] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.560029  7142 raft_consensus.cc:740] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:32.562165  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:32.545962  7096 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:32.575189  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:32.577066  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:32.577436  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:32.577934  5676 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:32.578887  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:32.579684  5679 raft_consensus.cc:2393] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:32.594739  7167 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:32.594906  7084 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:32.595170  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:32.594925  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:32.599326  5672 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:32.595929  7117 consensus_queue.cc:1059] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:13:32.600811  6322 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:32.601166  7117 raft_consensus.cc:3055] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.601217  7126 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.597280  7105 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.603719  5718 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:32.561406  7142 consensus_queue.cc:260] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.601626  7117 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:32.599025  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:32.610535  7075 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.595460  7167 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.614370  7084 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:32.602130  7105 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.637846  7084 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.673527  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:32.674335  5753 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.677528  5600 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:32.689410  5716 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:32.656988  7084 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:32.735474  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:32.735819  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 46496.1us
I20260709 12:13:32.737295  5716 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:32.740743  5603 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:13:32.744880  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.746011  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:32.742372  7101 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:32.740119  7041 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.759178  7041 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:32.686017  7069 consensus_queue.cc:1059] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:13:32.756716  5753 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
W20260709 12:13:32.758131  7185 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:13:32.761523  7041 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:32.690346  7109 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:13:32.747918  7149 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:32.844671  7188 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:13:32.741448  7186 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:13:32.856446  7075 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:32.857002  5599 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:13:32.863824  7184 log.cc:927] Time spent T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:13:32.745168  7117 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.740675  7096 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:32.872824  5569 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:13:32.877456  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.899274  5673 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:32.877336  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:32.877936  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:32.914650  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:32.915100  6320 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:32.915510  5672 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:32.914554  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:32.881228  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 117056us
I20260709 12:13:32.916611  5676 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:32.888072  7101 raft_consensus.cc:697] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:32.917958  7101 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.919265  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:32.920500  7088 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.920976  7088 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:32.884536  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 145850us
I20260709 12:13:32.926919  7142 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.870368  7105 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:32.894234  7109 raft_consensus.cc:3055] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.928664  7109 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:32.929454  7109 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.930624  7109 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.931959  7117 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.886014  7174 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.901873  5602 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:32.785552  7113 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:32.940423  7189 log.cc:927] Time spent T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.106s	user 0.004s	sys 0.000s
I20260709 12:13:32.940907  7174 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.941592  7168 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.950083  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:32.950846  5602 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
W20260709 12:13:32.954635  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 55834.4us
I20260709 12:13:32.889155  7086 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.890537  7133 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:32.979987  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 51604.9us
I20260709 12:13:32.953732  7063 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.981699  5750 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:32.958452  7075 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:32.958333  7102 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.965894  7011 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.964903  7062 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.995718  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:32.999298  6327 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:33.000478  5570 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:33.012408  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:32.964568  7116 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:13:32.973004  7133 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:32.996762  7088 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:32.984404  7065 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:13:33.028188  5716 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:33.010005  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.014148  7040 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.010358  7167 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.037202  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.014649  7147 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:32.973210  7086 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:32.995541  7140 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:13:33.009245  7011 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.017907  6322 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:33.042511  5679 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 2: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:32.996865  7186 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:13:33.004022  7102 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:33.038126  7138 consensus_meta.cc:287] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.005s
I20260709 12:13:32.996526  7063 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:33.010890  7071 raft_consensus.cc:3055] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:33.011685  7062 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.029917  6324 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:33.045378  7088 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.128764  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:33.155110  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 139764us
I20260709 12:13:33.070999  7149 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.046226  7147 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.048185  7167 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:33.044987  7146 consensus_meta.cc:287] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.534s	user 0.003s	sys 0.008s
I20260709 12:13:33.153568  7123 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.162983  5595 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:33.165243  7011 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.165150  7065 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.169801  6320 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:33.085131  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:33.084200  7195 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:33.190078  5750 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:33.191617  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.192402  5670 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:33.192759  7133 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.195102  5570 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:33.174059  7147 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:33.082599  7197 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:13:33.083039  7192 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:13:33.073396  7174 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:33.178213  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.178546  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:33.038264  7105 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 12:13:33.100221  7129 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:33.180207  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:33.180411  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.155886  7071 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:33.074452  7155 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.173883  7167 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.144960  7132 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:13:33.175166  7096 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.083787  6989 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 12:13:33.045874  7040 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.100826  7084 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.217950  7133 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.231669  7133 raft_consensus.cc:697] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:33.157255  7088 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.232538  7133 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.213109  7041 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.234135  7088 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:33.195286  7090 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.234194  7041 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:33.217990  7167 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.234835  7090 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.236726  7090 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.238022  5602 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:33.171382  7149 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.216400  7209 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:33.201100  7075 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.216820  7117 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:33.213956  5642 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:13:33.262014  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 48134.3us
I20260709 12:13:33.263758  7108 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.264214  7108 raft_consensus.cc:697] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:33.265038  7108 consensus_queue.cc:237] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.198573  7140 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.212213  5679 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:33.222623  7071 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.230758  7040 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.291170  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:33.291885  5678 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.206990  7102 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:33.181990  7123 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.242178  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:33.244707  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.320528  5673 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:33.241248  7115 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:33.232542  7084 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.244848  7209 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.247516  7117 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.338636  6327 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.339818  7117 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:33.329289  7083 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:33.341485  7083 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.239027  7096 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.250661  7075 raft_consensus.cc:697] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:33.251448  7041 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.242816  7088 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.254534  7149 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:33.241807  7194 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:33.195787  7065 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:33.260213  7200 log.cc:927] Time spent T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:13:33.270358  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.363927  5750 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:33.278062  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.364974  5601 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:33.219937  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.219341  7129 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.224807  7155 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.369982  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.370617  5673 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:33.349051  5569 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:33.345825  6327 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:33.349973  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.350615  7202 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.354398  7096 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.354650  5674 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:33.355227  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.379961  5747 raft_consensus.cc:2368] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:33.317621  7146 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.380836  7146 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.381457  7155 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.382866  7146 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:33.303701  7142 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:33.329664  7071 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.356113  7075 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.327546  7063 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:33.366078  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:33.349164  7083 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.344236  7209 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.266327  7119 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.394173  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.319541  7140 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.353103  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.318888  7156 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:13:33.368696  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.374123  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.374346  7132 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:33.374637  6320 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 2: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:33.372447  5672 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:33.363795  7088 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.375804  7123 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.366772  7084 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:33.378226  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.378789  7133 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.374361  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.428740  5679 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:33.385987  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.335234  7115 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.365984  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.393512  5642 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:33.394790  5750 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:33.399086  7215 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:33.397212  5569 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:33.396490  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.407584  5601 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:33.394582  7119 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.439642  7115 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:33.440196  7119 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.409382  6291 leader_election.cc:400] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:33.440816  6291 leader_election.cc:403] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:33.441293  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 57238.6us
I20260709 12:13:33.442107  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.382900  7065 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.400694  5678 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:33.373059  7117 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:33.443380  7133 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.443840  7117 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.366379  7194 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.398434  7129 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.431521  5596 raft_consensus.cc:2393] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:33.438159  6321 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:33.445735  7117 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:33.392530  7142 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.446339  6328 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:13:33.451375  7142 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.451732  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.452390  6321 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:13:33.452342  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.432400  7084 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.453233  5596 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:33.447366  7194 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.447685  7129 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:33.454985  7084 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.449019  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.455838  7182 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.456007  6326 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:33.446054  5745 raft_consensus.cc:2410] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:33.456298  7182 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.458292  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.459100  6321 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 2: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:33.438422  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.460161  5674 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:33.461779  7086 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.414553  7149 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.462468  7149 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.462770  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.463358  6320 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:33.464564  7149 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.465094  7149 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:33.465408  7149 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.465327  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.466055  6323 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:33.468780  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.471031  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:33.471886  7083 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:33.472251  7083 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.472569  7083 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.474462  7088 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:33.475083  6319 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:33.476501  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.474483  5718 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:33.477807  5718 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:33.415922  7132 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.476773  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.478214  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:33.478413  7132 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.478674  7086 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:33.475344  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.479146  7086 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.479518  7086 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.480453  5596 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 2: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:33.481089  5746 raft_consensus.cc:2393] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 2: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:33.477563  7147 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.387673  7202 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.482864  5598 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:13:33.483359  7202 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.483711  5673 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:33.485085  5716 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:33.487048  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.487663  5604 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:33.488471  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.488991  5604 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:33.491467  7041 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:33.491922  7041 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.431125  7123 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:33.492638  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.492869  7123 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.493237  5601 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:33.493822  7041 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.494098  7198 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:33.494465  7198 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:33.490864  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.495098  7112 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.495323  5604 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:33.495870  7215 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.496229  7215 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:33.494630  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.496651  5567 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:33.497105  5600 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:33.498332  5600 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:33.498799  7146 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.499315  7146 raft_consensus.cc:697] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:33.500160  7146 consensus_queue.cc:237] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.494658  7040 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:33.501255  7040 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.501596  7040 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.468936  7140 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.502384  5596 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:33.495723  7198 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.445559  7133 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.503276  7133 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:33.503741  7133 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:33.505996  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 112559us
I20260709 12:13:33.506423  7096 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:33.506803  7096 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.507117  7096 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.508344  7112 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.508704  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.508839  7112 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.498726  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.510495  5597 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:33.511831  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.512466  5718 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:33.514022  7091 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.514477  7091 raft_consensus.cc:697] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:33.515347  7102 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.515347  7091 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:33.516108  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 73244.9us
I20260709 12:13:33.516489  7112 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.512382  7206 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:33.516039  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.518082  7206 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.518661  7206 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.518675  5674 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:33.519392  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.517623  7060 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:33.520015  5753 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:33.520606  7060 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:33.522409  7147 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.522780  7060 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:33.523228  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.523873  5753 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:13:33.524374  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.525161  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.508363  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:33.525692  5718 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:33.527174  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.525856  5753 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:33.527848  5749 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:33.526727  5718 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:33.525204  5601 raft_consensus.cc:2410] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:33.515527  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.532277  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.532827  7084 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:33.533327  7084 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.533661  7084 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.534476  5645 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:33.515544  7198 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.536249  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.536435  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.536808  6327 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:33.536988  7198 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.537176  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:33.532877  5746 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:33.537783  6328 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.530367  5570 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:33.539223  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.539932  6327 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:33.540390  5750 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:33.539197  6291 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:33.545935  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.546268  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:33.546473  6327 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:33.542068  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.553318  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.541049  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.555471  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.556092  5601 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:33.554200  5597 raft_consensus.cc:2393] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 4: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:33.523084  7147 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.560678  5497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45224 (request call id 305) took 1686 ms. Trace:
I20260709 12:13:33.560395  5570 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:33.571616  5570 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:33.560534  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:33.562825  6291 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:33.564729  7075 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:33.574726  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.574726  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.576457  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:33.414244  7062 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.514422  7155 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.583833  5645 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:33.550390  7149 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.505632  7133 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.560020  7160 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:33.520290  7102 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.586308  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.583441  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:33.598372  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.599077  5673 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:33.599077  5677 raft_consensus.cc:2368] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:33.600261  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.601573  5718 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:33.502568  7140 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:33.494813  7123 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.537817  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:33.519765  5676 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:33.570334  5497 rpcz_store.cc:276] 0709 12:13:31.874632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.874748 (+   116us) service_pool.cc:224] Handling call
0709 12:13:33.560613 (+1685865us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:32.221361 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:32.221989 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:32.222024 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:13:32.222045 (+    21us) tablet.cc:662] Decoding operations
0709 12:13:32.222394 (+   349us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:32.222467 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:32.222507 (+    40us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:32.222718 (+   211us) tablet.cc:701] Row locks acquired
0709 12:13:32.222739 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:13:32.222891 (+   152us) write_op.cc:270] Start()
0709 12:13:32.223011 (+   120us) write_op.cc:276] Timestamp: P: 1783599212222842 usec, L: 0
0709 12:13:32.223041 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:13:32.223928 (+   887us) log.cc:844] Serialized 530 byte log entry
0709 12:13:32.746214 (+522286us) op_driver.cc:464] REPLICATION: finished
0709 12:13:33.047545 (+301331us) write_op.cc:301] APPLY: starting
0709 12:13:33.250186 (+202641us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b5400010828. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503e079e1 00007f4503e0664c 00007f4501496e10 00007f450148297c 00007f4501486d61 00007f4501486d19 00007f4501486ca9 00007f4501486c71 00007f4501485e9d 0000000000388634 0000000000388479
0709 12:13:33.250296 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:33.250385 (+    89us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:33.250405 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:33.250671 (+   266us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:33.250814 (+   143us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:33.250856 (+    42us) write_op.cc:312] APPLY: finished
0709 12:13:33.251041 (+   185us) log.cc:844] Serialized 23 byte log entry
0709 12:13:33.251198 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:33.251276 (+    78us) write_op.cc:454] Released schema lock
0709 12:13:33.251313 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:33.251676 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:33.251703 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":276428,"apply.run_cpu_time_us":4033,"apply.run_wall_time_us":209843,"num_ops":1,"prepare.queue_time_us":276789,"prepare.run_cpu_time_us":3406,"prepare.run_wall_time_us":57817,"raft.queue_time_us":237522,"raft.run_cpu_time_us":37891,"raft.run_wall_time_us":312850,"replication_time_us":458207,"spinlock_wait_cycles":53716736,"thread_start_us":603606,"threads_started":4,"wal-append.queue_time_us":28644}]]}
I20260709 12:13:33.576388  7138 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:33.587247  7204 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:33.569562  7198 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:33.569903  7065 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:33.561260  5501 catalog_manager.cc:5697] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 2 to 3, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:13:33.576260  7075 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.560379  7210 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:33.583140  7129 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:33.584437  7182 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:33.585215  7147 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.623816  5676 pending_rounds.cc:85] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 1
I20260709 12:13:33.600637  7174 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:33.587100  7168 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:33.541846  7083 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.575755  5674 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:33.590427  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.592533  7080 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:13:33.492417  7167 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:33.609638  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:33.622148  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 224971us
I20260709 12:13:33.598325  7160 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.633839  6293 leader_election.cc:400] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:33.634902  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.610598  7133 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:33.648829  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:33.650134  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:33.593139  7155 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.585034  7206 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.627862  7138 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.634666  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.618316  7140 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:33.634526  6324 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:33.784251  6328 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
W20260709 12:13:33.991990  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 358308us
I20260709 12:13:33.627774  7065 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.334720  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:33.989662  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 259518us
I20260709 12:13:33.630601  7075 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.861212  5498 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44240 (request call id 202) took 1334 ms. Trace:
I20260709 12:13:33.625190  7123 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:33.990967  5678 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 2: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:33.632462  7210 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.636224  7129 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.993973  5677 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
W20260709 12:13:33.994519  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 433108us
I20260709 12:13:33.627600  7204 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:33.627492  7198 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:34.002846  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 393230us
I20260709 12:13:33.996500  5498 rpcz_store.cc:276] 0709 12:13:32.518007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.518214 (+   207us) service_pool.cc:224] Handling call
0709 12:13:33.852274 (+1334060us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307035,"reported_tablets":1}
I20260709 12:13:34.006052  5604 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 2: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:34.026832  5642 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:33.652035  7174 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.651468  7168 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:33.787194  7217 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:13:34.038333  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:34.030364  5671 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:34.032796  5748 raft_consensus.cc:2368] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4.
I20260709 12:13:33.723335  7142 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:33.779629  7211 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 12:13:34.033568  5673 raft_consensus.cc:2368] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:33.802639  5745 raft_consensus.cc:2368] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:34.035504  5642 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:33.996153  7065 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.872423  7102 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.995256  7138 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.042171  5718 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:33.757609  7115 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.995110  7160 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.851601  7088 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.779767  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:33.993582  7133 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:33.720378  7214 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:34.001839  7101 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.726362  7061 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:33.714112  5676 pending_rounds.cc:107] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:34.001246  7123 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:34.004221  7083 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.810923  7147 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.654165  7041 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.380s
I20260709 12:13:34.032485  6319 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:13:34.025942  7109 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.025732  7198 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.025085  7210 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:34.083453  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 48029.5us
I20260709 12:13:33.734740  5595 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:34.087998  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:34.165318  5673 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:34.097167  7126 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.098812  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:34.093462  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:34.101082  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:34.018683  7129 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.047147  5672 raft_consensus.cc:2393] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:33.892295  7040 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:34.103790  7219 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:34.038442  7174 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.881181  7096 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:34.236606  7149 consensus_meta.cc:287] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.003s
I20260709 12:13:34.238338  7149 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:34.239892  7096 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:33.867193  7086 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:34.129949  7101 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.241911  5752 raft_consensus.cc:2393] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:34.001673  7215 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:33.883809  7084 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:34.247761  7219 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.249305  7084 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:34.037328  7225 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.028529  7204 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.900831  7132 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:34.038362  7168 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.047119  7116 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:34.158975  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:34.255400  6328 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.860006  7209 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:34.134538  6293 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:34.258473  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 123995us
I20260709 12:13:34.259320  6293 leader_election.cc:400] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:34.259589  6293 leader_election.cc:403] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:34.129591  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:34.260198  5671 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:34.075208  7142 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.134255  5567 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:34.261336  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 127151us
I20260709 12:13:34.111949  7133 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:34.202713  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:34.113855  5676 raft_consensus.cc:2889] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:34.110903  7088 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:34.210894  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 46543.6us
I20260709 12:13:34.211113  7216 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:34.211503  7203 consensus_queue.cc:1059] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:34.216307  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:34.277179  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 234743us
I20260709 12:13:34.277558  5677 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.130396  7123 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.157722  7061 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.157400  7214 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.113327  5674 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:34.160794  7221 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.161882  7220 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:34.162444  7083 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:34.166019  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:34.108424  7115 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.302127  7115 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:34.218777  6324 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:34.244921  5570 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:34.218585  7194 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.304531  7194 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.306280  7155 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:34.254401  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 212288us
I20260709 12:13:34.262562  5567 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:34.165390  7109 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.267966  6293 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:34.226838  6320 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:13:34.217013  7126 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.273566  6328 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:34.287739  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:34.255072  7116 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.289197  5603 raft_consensus.cc:2368] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4.
I20260709 12:13:34.290621  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:34.278774  7215 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:34.296442  7237 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.250164  7225 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.276994  7113 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.338210  5716 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:34.330911  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:34.308676  6291 leader_election.cc:400] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:34.319640  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:34.394695  5750 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:34.394902  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 86381.4us
I20260709 12:13:34.340520  5678 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 1.
W20260709 12:13:34.357482  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 59130.9us
I20260709 12:13:34.395960  7238 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:34.396129  5642 leader_election.cc:400] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4.
I20260709 12:13:34.397261  5642 leader_election.cc:403] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:34.396850  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:34.360333  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:34.356777  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:34.415584  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:34.538430  5671 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:34.416630  6328 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:34.297014  5744 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:34.394891  5600 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:34.370543  7140 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:34.298802  6323 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:34.557126  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:34.478482  5602 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:34.478288  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 59212.3us
I20260709 12:13:34.561676  7088 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:34.562059  7142 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:34.362264  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:34.554009  7245 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:34.563781  7245 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.564129  7245 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.483467  7116 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.370308  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:34.383510  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:34.397006  7182 raft_consensus.cc:2764] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:13:34.299175  7167 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:34.308744  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:34.284294  7214 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:34.417876  7224 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:13:34.361334  7041 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:13:34.421154  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 153261us
I20260709 12:13:34.370640  7236 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:34.540326  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 202216us
I20260709 12:13:34.292233  7221 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:34.420305  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:34.551683  5677 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:34.370550  7220 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.432029  7215 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:34.297435  7147 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.520100  7146 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:34.568050  7088 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:34.555701  7115 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:34.625240  7129 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.555961  7194 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:34.554409  7091 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:34.634195  7235 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260709 12:13:34.555527  6321 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:34.427037  7083 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 12:13:34.639855  6293 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:34.646346  7041 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.641274  7132 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:34.563512  7142 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.529858  7237 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.580255  7219 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:34.636299  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:34.644778  7149 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:34.630924  7225 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:34.644371  7240 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:34.725347  7155 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:34.825096  7231 log.cc:927] Time spent T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:13:34.760222  7061 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:34.652864  7040 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:34.750068  5602 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:34.731840  5750 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:34.723469  7096 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:34.858382  5569 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:34.818953  7075 consensus_meta.cc:287] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.796s	user 0.006s	sys 0.003s
W20260709 12:13:34.827517  7174 consensus_meta.cc:287] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.001s
W20260709 12:13:34.742584  7228 log.cc:927] Time spent T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:13:34.679298  7146 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.678866  7080 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.680565  7209 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:34.880388  7220 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:34.652927  5595 raft_consensus.cc:2368] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:34.751283  5600 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:34.781809  7126 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:34.884377  7240 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:34.884399  7155 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:34.682814  7088 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:34.984773  7155 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:34.985674  7129 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:34.985961  7088 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:34.986954  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:34.987104  5745 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.987560  5595 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:34.987639  7063 raft_consensus.cc:3055] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:34.988024  7063 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:13:34.938038  7123 consensus_meta.cc:287] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.597s	user 0.004s	sys 0.004s
W20260709 12:13:34.938417  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 80125.3us
I20260709 12:13:34.961714  7146 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:34.872493  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 232693us
I20260709 12:13:34.967151  7061 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.893484  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:34.993633  5602 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:34.947038  5671 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
W20260709 12:13:34.973660  7229 log.cc:927] Time spent T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.695s	user 0.000s	sys 0.003s
I20260709 12:13:34.868970  5746 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:13:34.939853  7215 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4.
I20260709 12:13:34.972641  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:34.980051  7065 consensus_meta.cc:287] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.869s	user 0.007s	sys 0.002s
I20260709 12:13:34.984172  7237 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:34.989322  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:34.969892  7080 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:34.970584  7113 consensus_meta.cc:287] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.552s	user 0.003s	sys 0.005s
I20260709 12:13:34.960628  7149 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:34.882786  7194 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:34.905839  6325 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.018s	sys 0.057s
W20260709 12:13:35.009996  6325 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.022s	sys 0.061s
I20260709 12:13:34.946480  7096 raft_consensus.cc:697] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:34.989995  7063 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.993264  7123 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.006076  5597 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.006102  5600 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:34.936841  7245 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.005437  7113 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
W20260709 12:13:34.995935  7160 consensus_meta.cc:287] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.882s	user 0.007s	sys 0.001s
I20260709 12:13:34.994913  7129 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.980933  7116 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:34.656150  7236 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:35.024991  7204 consensus_meta.cc:287] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.769s	user 0.006s	sys 0.003s
I20260709 12:13:35.009490  7149 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.037549  5596 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
W20260709 12:13:35.039680  5567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.011s	sys 0.021s
I20260709 12:13:35.009702  7194 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:35.040513  5567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.011s	sys 0.021s
I20260709 12:13:34.998817  7240 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:34.996369  7061 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:34.996071  7221 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:35.055322  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 792755us
I20260709 12:13:35.053932  7149 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:35.063843  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 643572us
I20260709 12:13:35.032768  7063 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:35.038378  5672 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.004s	sys 0.045s
I20260709 12:13:35.025403  7091 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:35.036922  7113 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:35.065495  5601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.022s	sys 0.053s
I20260709 12:13:35.027319  7160 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.037808  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:35.068742  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:35.072134  6325 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:35.063407  5597 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:35.018788  7065 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.067358  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1518) took 1541 ms. Trace:
I20260709 12:13:35.057021  7194 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.048671  7041 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.079135  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:35.079941  5677 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:34.940348  5570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.015s	sys 0.040s
I20260709 12:13:35.036273  7129 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:35.068642  5601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.022s	sys 0.053s
W20260709 12:13:35.067942  5672 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.004s	sys 0.045s
I20260709 12:13:35.068132  7091 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.055552  7204 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.073088  5679 rpcz_store.cc:276] 0709 12:13:33.524906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.525111 (+   205us) service_pool.cc:224] Handling call
0709 12:13:33.569745 (+ 44634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:33.585519 (+ 15774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:33.585549 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:33.585983 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:13:33.928468 (+342485us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:33.928513 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:33.928590 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:35.066080 (+1137490us) raft_consensus.cc:1685] finished
0709 12:13:35.066101 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.066216 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57982,"raft.queue_time_us":15166,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7897,"thread_start_us":317919,"threads_started":1,"wal-append.queue_time_us":511014}
W20260709 12:13:35.082827  6291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.005s	sys 0.043s
W20260709 12:13:35.087744  6291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.005s	sys 0.043s
I20260709 12:13:35.084589  6327 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:13:35.080916  5570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.015s	sys 0.040s
I20260709 12:13:35.086696  5671 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:35.089026  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 844146us
I20260709 12:13:35.090034  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:35.090615  5600 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:35.068372  7221 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.070809  7237 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.094978  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:35.095875  5645 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:35.097926  5597 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 1.
I20260709 12:13:35.098212  5645 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:35.093628  5719 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:35.070713  7113 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.081600  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:35.099613  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:35.079227  7126 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.108904  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:35.108862  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 462927us
I20260709 12:13:35.111955  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:35.113785  5597 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:35.107645  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:34.865024  7147 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.119315  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:35.119876  5679 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.121320  5597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:46698
I20260709 12:13:35.121896  5597 raft_consensus.cc:606] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:35.122296  5677 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:35.123044  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:35.123705  5750 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.099283  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:35.124392  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:35.125008  5677 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:35.097901  7041 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:35.123394  5569 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:35.081138  7174 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:34.880854  7142 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.126958  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:35.128010  5748 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:35.128549  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:35.085386  7075 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.091841  7227 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.131335  5753 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.108518  7215 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:35.117630  7248 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:35.132297  5567 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:13:35.127164  7238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.000s	sys 0.019s
I20260709 12:13:35.134683  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:35.112672  7083 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:35.133544  6319 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:35.116487  7155 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:35.126665  7138 consensus_meta.cc:287] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 1.018s	user 0.010s	sys 0.000s
I20260709 12:13:35.109165  7237 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.132143  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:35.077617  7096 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.112809  7220 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:35.116080  7221 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.422322  7258 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:35.422467  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 290240us
I20260709 12:13:35.118536  6322 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:35.137950  5569 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:35.453688  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 315793us
I20260709 12:13:35.137027  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:35.451886  5753 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
W20260709 12:13:35.374015  6293 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.66:33011 timed out after 1.792s (SENT) [suppressed 9 similar messages]
I20260709 12:13:35.128402  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:35.421619  7248 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.134536  7132 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:35.128983  7241 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.133617  6326 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:35.119880  7126 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:35.483942  7210 consensus_meta.cc:287] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.282s	user 0.010s	sys 0.000s
I20260709 12:13:35.492614  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1584) took 1144 ms. Trace:
I20260709 12:13:35.137106  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:35.264169  5598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.015s	sys 0.026s
I20260709 12:13:35.131855  7086 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:35.127346  7101 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.336488  7112 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:35.502828  7132 raft_consensus.cc:697] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:35.503566  7204 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.466276  7220 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.425899  7215 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.478826  7088 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:35.539136  5677 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:35.445869  7116 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.462915  7083 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.518148  5596 rpcz_store.cc:276] 0709 12:13:34.326620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.330663 (+  4043us) service_pool.cc:224] Handling call
0709 12:13:35.469521 (+1138858us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54003e1f54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:35.471035 (+  1514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479008128}
I20260709 12:13:35.462019  7236 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.466764  7138 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.446390  7123 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.385160  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:35.192066  5750 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:35.443610  7040 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.487517  7239 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.505151  5599 raft_consensus.cc:2393] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 4: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:35.185078  7227 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:35.562294  5568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.053s	sys 0.136s
I20260709 12:13:35.420565  7075 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.508692  7167 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:35.548592  5598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.022s	sys 0.034s
I20260709 12:13:35.134277  7041 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.504431  7241 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.539664  7113 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:35.505445  6320 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:35.539639  7238 raft_consensus.cc:697] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:13:35.593142  5568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.054s	sys 0.137s
I20260709 12:13:35.562139  7088 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.613746  5716 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:35.600380  5600 raft_consensus.cc:2393] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:35.567003  7256 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.562703  7083 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.563927  7155 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.540387  7210 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.565382  7061 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:35.607788  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 233811us
I20260709 12:13:35.566089  7065 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.564929  7101 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:35.566042  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:35.592290  7129 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.641996  7129 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.615584  5716 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:35.563632  7215 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.558136  7112 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.596406  6324 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:35.602708  7262 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.649305  7262 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.636668  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:35.608215  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:35.639232  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:35.607996  7182 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:35.641304  5747 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:35.645991  7241 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:35.621107  7256 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:35.675041  5676 consensus_meta.cc:287] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.000s
I20260709 12:13:35.616257  7088 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:35.595304  7040 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.642459  7129 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:35.680271  5603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1573) took 2139 ms (client timeout 2219 ms). Trace:
W20260709 12:13:35.680658  5603 rpcz_store.cc:269] 0709 12:13:33.540396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.540820 (+   424us) service_pool.cc:224] Handling call
0709 12:13:35.680083 (+2139263us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540028c3d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:35.680218 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669995392}
I20260709 12:13:35.681039  7129 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:35.646859  5716 leader_election.cc:400] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:35.681747  5716 leader_election.cc:403] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:35.652611  7112 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.682518  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:35.682955  7112 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:35.653084  7262 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.654878  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1582) took 1347 ms. Trace:
I20260709 12:13:35.646297  7086 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.649214  7221 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:35.677663  7194 consensus_meta.cc:287] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.001s
I20260709 12:13:35.657963  7252 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.683221  5603 raft_consensus.cc:2393] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:35.683844  5599 rpcz_store.cc:276] 0709 12:13:34.307142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.308443 (+  1301us) service_pool.cc:224] Handling call
0709 12:13:35.654682 (+1346239us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b5400055854. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:35.654821 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715204992}
W20260709 12:13:35.669595  7063 consensus_meta.cc:287] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.000s
I20260709 12:13:35.604969  7167 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.621434  7204 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:35.689275  7204 raft_consensus.cc:697] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:13:35.690399  6321 consensus_meta.cc:287] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.810s	user 0.009s	sys 0.000s
I20260709 12:13:35.690868  6321 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:35.690191  7204 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:35.691385  6321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 328) took 1410 ms. Trace:
I20260709 12:13:35.621026  7155 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.691751  6321 rpcz_store.cc:276] 0709 12:13:34.280734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.284170 (+  3436us) service_pool.cc:224] Handling call
0709 12:13:35.691321 (+1407151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:35.685617  5676 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:35.662322  5602 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:35.694612  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:35.695269  5602 raft_consensus.cc:2368] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:35.695969  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:35.696434  7133 consensus_meta.cc:287] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.419s	user 0.005s	sys 0.004s
I20260709 12:13:35.696691  7142 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.696892  7133 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.697655  7174 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.686408  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:35.651315  7247 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.698580  6320 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.616509  7132 consensus_queue.cc:237] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.640425  7258 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.640758  7075 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:35.670179  7214 consensus_meta.cc:287] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.032s	user 0.009s	sys 0.000s
I20260709 12:13:35.670822  7238 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.649041  7227 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:35.673404  5679 consensus_meta.cc:287] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.553s	user 0.002s	sys 0.007s
I20260709 12:13:35.710326  5679 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:35.599516  7239 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.675390  7182 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.675859  7237 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.678195  7266 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:35.679035  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:35.679382  7040 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.646239  7101 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.659431  5675 raft_consensus.cc:2368] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:35.684466  7252 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.685065  7086 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.687963  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1581) took 1377 ms. Trace:
I20260709 12:13:35.687810  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:35.688750  7167 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:35.692898  7168 consensus_meta.cc:287] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.418s	user 0.008s	sys 0.002s
I20260709 12:13:35.646088  7264 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:35.664978  7210 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.696483  5602 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
W20260709 12:13:35.669440  5595 consensus_meta.cc:287] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.681s	user 0.005s	sys 0.005s
I20260709 12:13:35.671451  7109 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.705462  5748 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:35.684662  7080 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:35.691305  7198 consensus_meta.cc:287] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.488s	user 0.004s	sys 0.006s
I20260709 12:13:35.711756  5569 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:35.713172  6294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.007s
W20260709 12:13:35.745074  6294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.006s	sys 0.007s
I20260709 12:13:35.703243  7194 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.747566  7142 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.748211  7142 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.749943  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:35.751242  7262 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:35.751792  7262 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.754495  7262 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.700996  7258 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.755306  7123 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:35.714689  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:35.709470  6326 raft_consensus.cc:2368] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3.
I20260709 12:13:35.724761  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1747) took 1327 ms. Trace:
I20260709 12:13:35.696374  7088 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:35.729332  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 306120us
I20260709 12:13:35.728485  5604 rpcz_store.cc:276] 0709 12:13:34.298228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.298850 (+   622us) service_pool.cc:224] Handling call
0709 12:13:34.299158 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:34.361937 (+ 62779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:34.361966 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:35.004896 (+642930us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b2c00057948. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fc344a11 00007f44fc354372 00007f44fda86a01 00007f44fda4b43a 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2
0709 12:13:35.005266 (+   370us) log.cc:844] Serialized 26 byte log entry
0709 12:13:35.057655 (+ 52389us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:35.057695 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.057791 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:35.642319 (+584528us) raft_consensus.cc:1685] finished
0709 12:13:35.642339 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.675968 (+ 33629us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62400,"raft.queue_time_us":96067,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":20451072,"thread_start_us":52018,"threads_started":1,"wal-append.queue_time_us":535202}
I20260709 12:13:35.698774  7247 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.737874  5599 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:35.734136  7063 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:35.758965  5601 rpcz_store.cc:276] 0709 12:13:34.397784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.419254 (+ 21470us) service_pool.cc:224] Handling call
0709 12:13:34.419568 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:35.082863 (+663295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.082892 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:35.091677 (+  8785us) log.cc:844] Serialized 26 byte log entry
0709 12:13:35.541426 (+449749us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:35.541468 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.541535 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:35.724548 (+183013us) raft_consensus.cc:1685] finished
0709 12:13:35.724568 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.724700 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111072,"raft.queue_time_us":304072,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":17195,"thread_start_us":972521,"threads_started":2,"wal-append.queue_time_us":508409}
I20260709 12:13:35.738364  7182 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:35.747464  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:35.742568  7126 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:35.757390  5679 raft_consensus.cc:2393] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:13:35.715155  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 125179us
I20260709 12:13:35.713025  7075 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.726284  7266 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:35.742043  5595 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:35.727844  7251 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:35.709802  7214 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.744174  7264 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.772841  5567 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:35.741667  7071 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:35.745473  7248 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:35.759531  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 116198us
I20260709 12:13:35.759356  7220 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.779506  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:35.798697  5679 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:35.774833  7174 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.770802  7123 raft_consensus.cc:697] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:35.783741  5719 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:35.744434  7168 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.789023  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:35.809708  5604 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
W20260709 12:13:35.811201  5678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 190) took 2170 ms (client timeout 1792 ms). Trace:
I20260709 12:13:35.811892  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:13:35.790609  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.795641  5716 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:35.799659  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:35.783368  5645 leader_election.cc:400] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3.
I20260709 12:13:35.814146  5645 leader_election.cc:403] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:35.803212  6291 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:35.785964  7149 consensus_meta.cc:287] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.715s	user 0.007s	sys 0.002s
I20260709 12:13:35.822098  5674 raft_consensus.cc:2393] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:35.822017  7149 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.822387  7258 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.822394  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1531) took 1462 ms. Trace:
I20260709 12:13:35.823547  5676 rpcz_store.cc:276] 0709 12:13:34.359848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.425118 (+ 65270us) service_pool.cc:224] Handling call
0709 12:13:35.822213 (+1397095us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540007a654. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:35.822329 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334172032}
I20260709 12:13:35.823083  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:35.824775  5679 raft_consensus.cc:1240] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:35.825176  7116 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.825603  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:35.825937  5596 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:35.815056  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:35.826886  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:35.810801  7096 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:35.827709  7096 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:35.824314  7149 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.828091  7096 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.828363  7202 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:35.828938  7202 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.830302  7155 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.831063  7202 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.831554  7202 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:35.831946  7202 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.834071  7267 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:35.834478  7267 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.834800  7267 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.777034  7210 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:35.792892  7236 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:35.774158  7063 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.776880  7221 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:13:35.793398  7237 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:35.792754  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1757) took 1204 ms. Trace:
I20260709 12:13:35.820824  6328 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:35.827189  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:35.760232  7198 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:35.837277  5569 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:35.789155  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:35.823354  7182 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:35.807703  7041 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.806501  5719 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:35.794596  7080 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:35.814594  6322 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 2: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
W20260709 12:13:35.811595  5678 rpcz_store.cc:269] 0709 12:13:33.625370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.037883 (+412513us) service_pool.cc:224] Handling call
0709 12:13:35.795925 (+1758042us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54002e8e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:35.796019 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693449600}
W20260709 12:13:35.847442  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 51849.5us
I20260709 12:13:35.839931  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:35.814280  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:13:35.976006  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 161803us
I20260709 12:13:35.865113  7123 consensus_queue.cc:237] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.976104  7109 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:35.870644  5570 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:35.792514  7251 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.798287  7240 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:35.973840  7270 log.cc:927] Time spent T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:13:35.804453  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:35.800359  7071 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.866374  7252 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.973435  7086 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:35.977818  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 140728us
I20260709 12:13:35.979274  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:36.006035  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:36.030625  6328 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:35.979802  5716 leader_election.cc:400] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4.
I20260709 12:13:36.031327  5716 leader_election.cc:403] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:36.032022  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 52377.4us
I20260709 12:13:36.033365  5716 leader_election.cc:400] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:36.033638  5716 leader_election.cc:403] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:36.034795  5716 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:35.979511  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 108957us
W20260709 12:13:35.978101  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 171672us
I20260709 12:13:35.786693  7126 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:35.823027  7233 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:36.035902  7167 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4.
I20260709 12:13:35.977250  7080 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:35.862612  7206 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.861543  7075 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.974355  7142 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:35.974210  7133 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:35.812245  7174 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:36.040361  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:35.839910  7083 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.987006  7274 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:35.860829  7129 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:35.843598  7239 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:36.040095  7168 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:35.852720  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:35.993419  7236 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:35.986200  7132 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:35.864418  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:35.860929  7272 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:35.853271  7210 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:36.045377  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:35.986115  7237 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:36.041937  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:36.060571  7274 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.959110  7088 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:35.993695  7061 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:13:36.053268  7214 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:36.054018  7084 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:36.025657  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:36.055341  7071 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:36.055986  7080 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:36.099876  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:36.061317  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:36.121905  6328 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.044107  7204 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.975456  5595 rpcz_store.cc:276] 0709 12:13:34.588885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.986705 (+397820us) service_pool.cc:224] Handling call
0709 12:13:35.784493 (+797788us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:36.101784  5602 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:13:36.053604  7198 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:36.045235  7241 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:36.019236  7240 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.058822  7063 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.043171  7149 consensus_queue.cc:1059] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:13:35.862365  7194 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:36.109076  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 67363.2us
W20260709 12:13:36.110388  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 130635us
I20260709 12:13:36.058929  7202 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.061388  7129 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.157457  7129 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.089354  7277 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.045537  7233 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.112723  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:36.043658  7126 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.088793  7264 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.100104  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:36.164383  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:36.165103  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:36.165740  6322 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:36.166972  7146 consensus_meta.cc:287] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 1.164s	user 0.005s	sys 0.005s
I20260709 12:13:36.167429  7146 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:36.160178  7149 raft_consensus.cc:3055] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:36.169163  7149 raft_consensus.cc:740] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:36.106083  7132 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.107959  7272 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.976951  7182 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.108469  6324 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:36.176712  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1579) took 1890 ms. Trace:
I20260709 12:13:36.177646  7115 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:36.178125  7115 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.178849  7174 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.180312  7146 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.181798  7237 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.177243  5598 rpcz_store.cc:276] 0709 12:13:34.285965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.289405 (+  3440us) service_pool.cc:224] Handling call
0709 12:13:34.539863 (+250458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:34.646865 (+107002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:34.649445 (+  2580us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:34.726001 (+ 76556us) log.cc:844] Serialized 26 byte log entry
0709 12:13:36.153516 (+1427515us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b18002e3a80. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fd5f34bc 00007f44fa94148b 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1
0709 12:13:36.159870 (+  6354us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:36.163209 (+  3339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.169289 (+  6080us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:36.169337 (+    48us) raft_consensus.cc:1685] finished
0709 12:13:36.169355 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.176631 (+  7276us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":192730,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9469,"spinlock_wait_cycles":8106880,"thread_start_us":874935,"threads_started":1,"wal-append.queue_time_us":870167}
I20260709 12:13:36.184679  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:36.185267  5598 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.186188  7116 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3.
W20260709 12:13:36.186954  7268 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
I20260709 12:13:36.114198  7239 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:36.190413  7239 raft_consensus.cc:697] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:36.191291  7239 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.192338  7096 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.109912  7236 raft_consensus.cc:697] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:36.115674  7109 raft_consensus.cc:697] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:36.194588  7236 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.195151  7109 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:36.113446  7274 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.152812  6328 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:36.121323  5745 raft_consensus.cc:2368] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
I20260709 12:13:36.119695  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:36.113720  7215 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:35.865875  7266 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:36.161252  6323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 314) took 2343 ms (client timeout 1621 ms). Trace:
I20260709 12:13:36.161952  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:36.144074  7279 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:36.149636  7241 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.169324  7088 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:36.202958  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:36.256661  5750 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:36.189854  7210 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.165181  5595 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 2: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:36.177522  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:36.257830  5752 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:36.176769  7182 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:36.188783  7132 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:36.203480  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:36.270044  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 67846.1us
I20260709 12:13:36.315982  5642 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:36.187516  7126 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:36.260675  6326 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 2: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:36.262040  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:36.327392  5753 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:36.328078  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:36.328895  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:36.197077  7284 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:36.260063  7061 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.198701  6320 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:36.336285  7283 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:36.188107  7272 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:36.158510  7277 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.262454  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:36.336969  5673 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:36.349418  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 333) took 1246 ms. Trace:
I20260709 12:13:36.261947  7241 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:36.319815  6324 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Advancing to term 3
I20260709 12:13:36.335395  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:36.334059  5670 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:36.330394  7282 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.323143  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:36.368482  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:36.270076  7088 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:36.357992  5744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1071) took 2835 ms (client timeout 1521 ms). Trace:
I20260709 12:13:36.375620  7096 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:36.376770  7251 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.347373  7083 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:36.397938  7269 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.398479  7269 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.318459  7149 consensus_queue.cc:260] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:36.401808  5570 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:36.404189  5645 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:36.358862  6325 rpcz_store.cc:276] 0709 12:13:35.095568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.095705 (+   137us) service_pool.cc:224] Handling call
0709 12:13:35.115576 (+ 19871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:35.540528 (+424952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.540558 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:35.559107 (+ 18549us) log.cc:844] Serialized 26 byte log entry
0709 12:13:35.726826 (+167719us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:35.726881 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.726958 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:36.186402 (+459444us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:13:36.320951 (+134549us) raft_consensus.cc:1685] finished
0709 12:13:36.320972 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.342282 (+ 21310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2262,"raft.queue_time_us":446233,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5478,"spinlock_wait_cycles":17013632,"thread_start_us":540202,"threads_started":2,"wal-append.queue_time_us":254983}
I20260709 12:13:36.317752  7279 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.344404  7061 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:36.388422  5674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1529) took 2029 ms (client timeout 2684 ms). Trace:
I20260709 12:13:36.388417  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:36.358537  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:36.367901  6322 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:36.407855  5645 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:36.379395  7283 raft_consensus.cc:697] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:36.338887  7284 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:36.406903  5570 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:36.409137  7237 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:36.406392  7267 consensus_meta.cc:287] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.571s	user 0.000s	sys 0.009s
W20260709 12:13:36.257083  6323 rpcz_store.cc:269] 0709 12:13:33.817813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.826220 (+  8407us) service_pool.cc:224] Handling call
0709 12:13:34.093266 (+267046us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:36.159025 (+2065759us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b540068ea54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:36.161169 (+  2144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176987136}
W20260709 12:13:36.415160  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 88721us
I20260709 12:13:36.464311  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:36.374001  7182 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.405587  7251 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:36.387590  7277 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:36.458776  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 51941.1us
I20260709 12:13:36.458415  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:36.473985  6325 raft_consensus.cc:2393] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:36.411777  7216 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:36.457156  7149 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:36.381515  5744 rpcz_store.cc:269] 0709 12:13:33.506624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.511589 (+  4965us) service_pool.cc:224] Handling call
0709 12:13:36.334056 (+2822467us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54000537d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:36.341969 (+  7913us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713792256}
I20260709 12:13:36.491575  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:36.491730  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:36.492776  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:36.493223  7061 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.493331  5744 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.463737  7146 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:36.404896  7115 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.457588  6328 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:36.488214  7063 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:36.488883  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:36.489431  7284 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:36.490792  7182 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.393374  7282 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:36.496555  5570 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:36.496506  5567 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:36.462424  7206 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:36.457445  5595 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:13:36.461355  7237 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:36.497212  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:36.515389  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:36.515919  5596 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:36.516670  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:36.517153  5596 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:36.467909  7240 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:36.495148  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:36.480093  7215 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:36.412320  5674 rpcz_store.cc:269] 0709 12:13:34.359250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.361412 (+  2162us) service_pool.cc:224] Handling call
0709 12:13:36.388222 (+2026810us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54003cdcd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:36.388361 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2819760512}
W20260709 12:13:36.512499  5745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1078) took 1390 ms (client timeout 1799 ms). Trace:
I20260709 12:13:36.504143  7063 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.470691  7233 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:36.504205  7146 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:36.513726  7091 consensus_meta.cc:287] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.405s	user 0.010s	sys 0.001s
I20260709 12:13:36.508070  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:36.519062  7221 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.497676  7251 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.514309  7238 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:36.519259  7237 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.511233  7174 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:36.528750  7240 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:36.512745  7283 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.538849  5752 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:36.518095  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:36.470446  7267 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.528082  7206 raft_consensus.cc:697] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:36.539987  7146 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:36.524569  7269 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:36.535240  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 69821.6us
I20260709 12:13:36.572587  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1087) took 1444 ms. Trace:
I20260709 12:13:37.329677  5748 rpcz_store.cc:276] 0709 12:13:35.128369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.134480 (+  6111us) service_pool.cc:224] Handling call
0709 12:13:36.572412 (+1437932us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400011654. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:36.572529 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641896832}
I20260709 12:13:36.530735  7236 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:36.530468  6323 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:13:36.855149  5596 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:37.334327  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 1734) took 1173 ms. Trace:
I20260709 12:13:36.535535  7063 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:36.534963  7216 raft_consensus.cc:697] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:13:37.323858  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.354429  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1748) took 1028 ms. Trace:
W20260709 12:13:37.328145  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.347867  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1753) took 1012 ms. Trace:
I20260709 12:13:36.535056  7256 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:36.539821  7101 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:37.353356  5752 rpcz_store.cc:276] 0709 12:13:36.160569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.160951 (+   382us) service_pool.cc:224] Handling call
0709 12:13:37.334271 (+1173320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.354967  5748 rpcz_store.cc:276] 0709 12:13:36.325998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.353603 (+1027605us) service_pool.cc:224] Handling call
0709 12:13:37.353955 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.354122 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.354146 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.354187 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:37.354213 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.354266 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.354375 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:36.723032  7204 consensus_meta.cc:287] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.001s
W20260709 12:13:36.565652  7289 log.cc:927] Time spent T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:13:37.354094  7269 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:37.374410  5744 consensus_meta.cc:287] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.869s	user 0.016s	sys 0.026s
I20260709 12:13:36.567263  7138 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:36.814644  7109 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:37.361132  6324 consensus_meta.cc:287] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.981s	user 0.005s	sys 0.004s
I20260709 12:13:36.540290  7221 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:36.636230  7149 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:36.921944  7182 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.428570  7182 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.319795  7075 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:36.541471  7091 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.754535  7279 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.545958  7247 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.573154  7160 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:37.354979  6326 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:37.393635  7198 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.458701  7198 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:37.460868  7198 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:37.409403  7204 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:36.546123  7233 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:37.415230  7274 consensus_meta.cc:287] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.214s	user 0.007s	sys 0.001s
I20260709 12:13:36.814459  7116 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.356084  7216 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.346822  7240 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:36.545615  7129 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.497720  7240 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:37.498236  7129 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:36.630553  7272 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.354254  7174 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:37.415854  7251 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:37.446929  7221 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:37.489125  7132 consensus_meta.cc:287] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 1.167s	user 0.004s	sys 0.005s
I20260709 12:13:36.573998  7238 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.425421  7109 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:37.417068  7269 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.450686  7149 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.452723  7075 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:37.500013  7293 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:37.508399  7282 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:37.516425  7241 consensus_meta.cc:287] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.146s	user 0.010s	sys 0.000s
I20260709 12:13:37.492529  7233 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:37.491683  7274 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.507750  7116 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.540218  7274 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:37.514773  7132 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:37.544092  7132 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:37.544878  7182 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:37.505573  7206 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.526379  7293 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.563498  7293 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:37.607573  5498 catalog_manager.cc:5697] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 3, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:37.345907  5567 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.004s	sys 0.009s
W20260709 12:13:37.611442  5567 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.004s	sys 0.009s
W20260709 12:13:37.612052  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 906843us
I20260709 12:13:37.613461  5501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45214 (request call id 295) took 5261 ms. Trace:
I20260709 12:13:37.617489  5501 rpcz_store.cc:276] 0709 12:13:32.351486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.355310 (+  3824us) service_pool.cc:224] Handling call
0709 12:13:32.466246 (+110936us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b5400002490. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa9270b2 00007f45038a0759 00007f4503838a76 00007f4503809d58 00007f450390804e 00007f4501dc92a4 00007f4501dc9232 00007f4501dc9161 00007f4501dc90dc
0709 12:13:37.613127 (+5146881us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:34.212195 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:34.212724 (+   529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:34.212756 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:13:34.212773 (+    17us) tablet.cc:662] Decoding operations
0709 12:13:34.213094 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:34.213146 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:34.213172 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:34.213348 (+   176us) tablet.cc:701] Row locks acquired
0709 12:13:34.213364 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:13:34.213495 (+   131us) write_op.cc:270] Start()
0709 12:13:34.213597 (+   102us) write_op.cc:276] Timestamp: P: 1783599214213454 usec, L: 0
0709 12:13:34.213619 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:13:34.214279 (+   660us) log.cc:844] Serialized 535 byte log entry
0709 12:13:34.420278 (+205999us) op_driver.cc:464] REPLICATION: finished
0709 12:13:35.505516 (+1085238us) write_op.cc:301] APPLY: starting
0709 12:13:35.523745 (+ 18229us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:35.556895 (+ 33150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:35.601062 (+ 44167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:35.639575 (+ 38513us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:35.649487 (+  9912us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:35.649534 (+    47us) write_op.cc:312] APPLY: finished
0709 12:13:35.649745 (+   211us) log.cc:844] Serialized 23 byte log entry
0709 12:13:35.739621 (+ 89876us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:35.741542 (+  1921us) write_op.cc:454] Released schema lock
0709 12:13:35.755718 (+ 14176us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:35.784912 (+ 29194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:35.793516 (+  8604us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":305605,"reported_tablets":2,"spinlock_wait_cycles":8245120,"child_traces":[["op",{"apply.queue_time_us":923708,"apply.run_cpu_time_us":10972,"apply.run_wall_time_us":281519,"num_ops":1,"prepare.queue_time_us":345346,"prepare.run_cpu_time_us":2360,"prepare.run_wall_time_us":2359,"replication_time_us":160704,"thread_start_us":786098,"threads_started":3,"wal-append.queue_time_us":132684,"wal-append.run_cpu_time_us":5341,"wal-append.run_wall_time_us":1245108}]]}
I20260709 12:13:37.390177  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.356390  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.624004  5596 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 1.
I20260709 12:13:37.624967  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1772) took 1293 ms. Trace:
I20260709 12:13:36.573487  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:37.625309  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 158) took 2519 ms (client timeout 2623 ms). Trace:
W20260709 12:13:36.810436  5598 consensus_meta.cc:287] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.625s	user 0.004s	sys 0.008s
I20260709 12:13:37.625321  5596 rpcz_store.cc:276] 0709 12:13:36.331470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.389717 (+1058247us) service_pool.cc:224] Handling call
0709 12:13:37.624838 (+235121us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:37.626155  5600 rpcz_store.cc:269] 0709 12:13:35.106859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.107403 (+   544us) service_pool.cc:224] Handling call
0709 12:13:37.624856 (+2517453us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b5400207e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:37.625128 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117019392}
I20260709 12:13:37.627749  5598 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:37.628484  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.628648  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1766) took 1840 ms. Trace:
I20260709 12:13:37.628744  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:37.629186  5598 rpcz_store.cc:276] 0709 12:13:35.788504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.184346 (+395842us) service_pool.cc:224] Handling call
0709 12:13:37.628538 (+1444192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.629951  5596 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:37.630494  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1602) took 1118 ms. Trace:
I20260709 12:13:37.630877  5596 rpcz_store.cc:276] 0709 12:13:36.511885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.628286 (+1116401us) service_pool.cc:224] Handling call
0709 12:13:37.630425 (+  2139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.631785  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.632190  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.632839  5600 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:37.630756  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.633195  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1599) took 1130 ms. Trace:
I20260709 12:13:37.633952  5595 raft_consensus.cc:2410] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:37.634526  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1598) took 1137 ms. Trace:
I20260709 12:13:37.634886  5595 rpcz_store.cc:276] 0709 12:13:36.497415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.535190 (+ 37775us) service_pool.cc:224] Handling call
0709 12:13:37.634451 (+1099261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.636054  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.636883  5595 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:37.637392  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1605) took 1113 ms. Trace:
I20260709 12:13:37.631865  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.632964  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1764) took 1844 ms. Trace:
I20260709 12:13:37.638875  5602 rpcz_store.cc:276] 0709 12:13:35.787975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.789325 (+  1350us) service_pool.cc:224] Handling call
0709 12:13:35.789657 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:36.148668 (+359011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.632419 (+1483751us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54002ff154. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:37.632770 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717184768}
I20260709 12:13:37.641074  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.630942  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.642985  5603 raft_consensus.cc:2368] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5.
I20260709 12:13:36.568630  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1002) took 2569 ms. Trace:
I20260709 12:13:37.644866  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1006) took 2573 ms. Trace:
W20260709 12:13:37.645439  5670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1010) took 2571 ms (client timeout 2686 ms). Trace:
I20260709 12:13:37.377172  5753 rpcz_store.cc:276] 0709 12:13:36.335758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.347019 (+1011261us) service_pool.cc:224] Handling call
0709 12:13:37.347368 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.347550 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.347575 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.347617 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:37.347646 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.347696 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.347808 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:37.645917  5670 rpcz_store.cc:269] 0709 12:13:35.073895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.136760 (+ 62865us) service_pool.cc:224] Handling call
0709 12:13:37.644991 (+2508231us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54002e8bd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:37.645219 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655954688}
I20260709 12:13:37.414175  6321 raft_consensus.cc:2368] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
I20260709 12:13:37.428879  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:37.633699  5596 rpcz_store.cc:276] 0709 12:13:36.502511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.631811 (+1129300us) service_pool.cc:224] Handling call
0709 12:13:37.633127 (+  1316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.645339  5671 rpcz_store.cc:276] 0709 12:13:35.071333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.071449 (+   116us) service_pool.cc:224] Handling call
0709 12:13:35.071742 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.088547 (+ 16805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.644229 (+2555682us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b54001b7954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:37.644612 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33964288}
I20260709 12:13:37.633908  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 168) took 1230 ms. Trace:
I20260709 12:13:37.627250  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46698 (request call id 8) took 2509 ms. Trace:
I20260709 12:13:37.629513  5601 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
W20260709 12:13:37.646368  5677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1007) took 2573 ms (client timeout 3121 ms). Trace:
I20260709 12:13:37.643532  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1594) took 1147 ms. Trace:
W20260709 12:13:36.534214  5745 rpcz_store.cc:269] 0709 12:13:35.122384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.126439 (+  4055us) service_pool.cc:224] Handling call
0709 12:13:35.678925 (+552486us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:36.505672 (+826747us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400053cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:36.512428 (+  6756us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1428723968}
I20260709 12:13:36.542564  5747 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
W20260709 12:13:37.670512  6291 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.000s	sys 0.010s
I20260709 12:13:37.671212  6322 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:37.532712  7241 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.655064  5595 rpcz_store.cc:276] 0709 12:13:36.524280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.635677 (+1111397us) service_pool.cc:224] Handling call
0709 12:13:37.637337 (+  1660us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.682844  5602 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:37.688890  5600 rpcz_store.cc:276] 0709 12:13:36.403026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.631366 (+1228340us) service_pool.cc:224] Handling call
0709 12:13:37.633854 (+  2488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.705145  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:37.733934  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1596) took 1235 ms. Trace:
W20260709 12:13:37.697432  6293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.010s	sys 0.005s
I20260709 12:13:37.694487  5598 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 1.
I20260709 12:13:37.797432  7116 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:37.783376  7149 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:37.690745  5601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 163) took 1898 ms (client timeout 2249 ms). Trace:
I20260709 12:13:37.644176  5672 rpcz_store.cc:276] 0709 12:13:33.999071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.238706 (+239635us) service_pool.cc:224] Handling call
0709 12:13:34.239017 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.385590 (+146573us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:13:35.096865 (+711275us) log.cc:844] Serialized 14 byte log entry
0709 12:13:35.558686 (+461821us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:35.560292 (+  1606us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:35.566191 (+  5899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.264286 (+698095us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800369760. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:13:36.568353 (+304067us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540037a0d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:36.568406 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.568548 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":707228,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":49600,"raft.queue_time_us":2976,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":1716,"spinlock_wait_cycles":307078656,"thread_start_us":1086066,"threads_started":2,"wal-append.queue_time_us":456879,"wal-append.run_cpu_time_us":949,"wal-append.run_wall_time_us":1000971}
I20260709 12:13:37.798255  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1755) took 1458 ms. Trace:
I20260709 12:13:37.798733  5752 rpcz_store.cc:276] 0709 12:13:36.339656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.398068 (+1058412us) service_pool.cc:224] Handling call
0709 12:13:37.398400 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:37.405370 (+  6970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.405401 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:37.414469 (+  9068us) log.cc:844] Serialized 26 byte log entry
0709 12:13:37.690329 (+275860us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:37.690427 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.690552 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:37.797825 (+107273us) raft_consensus.cc:1685] finished
0709 12:13:37.797841 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.798017 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6548,"raft.queue_time_us":6654,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":18718,"thread_start_us":273157,"threads_started":1,"wal-append.queue_time_us":376369}
I20260709 12:13:37.784111  7216 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:13:37.694932  5675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 185) took 4105 ms (client timeout 2234 ms). Trace:
W20260709 12:13:37.801136  6291 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.001s	sys 0.012s
I20260709 12:13:37.689308  5603 rpcz_store.cc:276] 0709 12:13:36.496276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.569468 (+ 73192us) service_pool.cc:224] Handling call
0709 12:13:37.630556 (+1061088us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:37.643462 (+ 12906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12916480}
I20260709 12:13:37.626896  5498 catalog_manager.cc:5697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 3, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.688973  5597 rpcz_store.cc:276] 0709 12:13:35.118350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.118455 (+   105us) service_pool.cc:224] Handling call
0709 12:13:37.626520 (+2508065us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54002d8fa0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9c8520 00007f44fda45652 00007f4502a1360a 00007f44fbf997d4 00007f44fbf99762 00007f44fbf99691 00007f44fbf9960c 00007f44fbf988c2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:37.627052 (+   532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312829696}
W20260709 12:13:37.689172  5677 rpcz_store.cc:269] 0709 12:13:35.072539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.136776 (+ 64237us) service_pool.cc:224] Handling call
0709 12:13:37.645980 (+2509204us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b54003557d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:37.646186 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167761280}
I20260709 12:13:37.734653  5602 rpcz_store.cc:276] 0709 12:13:36.496849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.640668 (+1143819us) service_pool.cc:224] Handling call
0709 12:13:37.731795 (+ 91127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:37.807793  6321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 317) took 2006 ms (client timeout 1799 ms). Trace:
W20260709 12:13:37.808292  6321 rpcz_store.cc:269] 0709 12:13:35.801221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.813196 (+ 11975us) service_pool.cc:224] Handling call
0709 12:13:37.807381 (+1994185us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400673ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:37.807569 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2915615488}
I20260709 12:13:37.809427  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:13:37.810897  6322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 328) took 1422 ms (client timeout 1621 ms). Trace:
I20260709 12:13:37.811272  7311 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:13:37.814113  7311 raft_consensus.cc:3055] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:37.814476  7311 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:13:37.792047  7273 log.cc:927] Time spent T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 1.756s	user 0.010s	sys 0.012s
I20260709 12:13:37.799640  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1603) took 1286 ms. Trace:
I20260709 12:13:37.427793  6324 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 3 LEARNER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:37.707481  7238 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:37.700897  7293 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:37.801827  5675 rpcz_store.cc:269] 0709 12:13:33.589024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.100775 (+511751us) service_pool.cc:224] Handling call
0709 12:13:37.667686 (+3566911us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400064d54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:37.694688 (+ 27002us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3290218240}
W20260709 12:13:37.837895  6293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.015s	sys 0.008s
I20260709 12:13:37.703807  7075 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:37.692559  7283 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.855682  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:37.702611  6323 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.753751  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.709438  7269 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:37.861146  5570 leader_election.cc:336] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.621s (SENT)
I20260709 12:13:37.862390  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:37.863519  6321 raft_consensus.cc:2393] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:37.864059  6321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 331) took 1292 ms. Trace:
I20260709 12:13:37.864427  6321 rpcz_store.cc:276] 0709 12:13:36.571764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.809657 (+1237893us) service_pool.cc:224] Handling call
0709 12:13:37.863971 (+ 54314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.784472  7304 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.865126  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:37.842278  5596 raft_consensus.cc:2368] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4.
I20260709 12:13:37.865899  7304 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:37.866496  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:37.854678  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:37.695443  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 593) took 1301 ms. Trace:
I20260709 12:13:37.867964  6326 rpcz_store.cc:276] 0709 12:13:36.394006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.512983 (+118977us) service_pool.cc:224] Handling call
0709 12:13:37.688601 (+1175618us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.868460  7304 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:37.868705  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.857672  5498 catalog_manager.cc:5697] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 4, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 4 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.754868  7233 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:37.869570  5597 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:37.843504  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 578) took 4025 ms. Trace:
I20260709 12:13:37.710682  7272 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:37.870100  6327 rpcz_store.cc:276] 0709 12:13:33.817507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.817633 (+   126us) service_pool.cc:224] Handling call
0709 12:13:33.996960 (+179327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:35.088169 (+1091209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.840864 (+2752695us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540053acd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:37.843234 (+  2370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500751104}
I20260709 12:13:37.870965  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1608) took 1332 ms. Trace:
I20260709 12:13:37.869637  6321 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:37.700057  7282 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:37.872058  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 324) took 1715 ms. Trace:
I20260709 12:13:37.871891  7282 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.840687  7116 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:37.848726  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:37.872865  6321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 322) took 2070 ms. Trace:
I20260709 12:13:37.873411  5672 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:37.873315  6321 rpcz_store.cc:276] 0709 12:13:35.802645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.865283 (+2062638us) service_pool.cc:224] Handling call
0709 12:13:37.869321 (+  4038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.872572 (+  3251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.872792 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.872488  6326 rpcz_store.cc:276] 0709 12:13:36.156813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.870878 (+1714065us) service_pool.cc:224] Handling call
0709 12:13:37.871297 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.871598 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.871641 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.871715 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:37.871765 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.871860 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.871992 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:37.849277  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 861619us
I20260709 12:13:37.707937  7109 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:37.694200  5744 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:37.706158  7174 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:37.850930  7241 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:37.852741  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:37.886193  6319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 595) took 1412 ms. Trace:
I20260709 12:13:37.807714  7245 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:37.853814  5751 raft_consensus.cc:2368] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4.
W20260709 12:13:37.803038  5601 rpcz_store.cc:269] 0709 12:13:35.791869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.161437 (+369568us) service_pool.cc:224] Handling call
0709 12:13:37.627980 (+1466543us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:37.690680 (+ 62700us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21174016}
I20260709 12:13:37.800917  7149 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.914166  7149 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:37.870376  5498 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 3, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.918053  5498 catalog_manager.cc:5697] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 3, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.920152  5498 catalog_manager.cc:5697] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 2 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.921919  5600 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.873152  7116 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.923758  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:37.921941  7236 raft_consensus.cc:697] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:37.924502  5603 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.925457  7236 consensus_queue.cc:237] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.877185  6326 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:37.926885  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 329) took 1537 ms. Trace:
I20260709 12:13:37.927239  6326 rpcz_store.cc:276] 0709 12:13:36.389045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.876062 (+1487017us) service_pool.cc:224] Handling call
0709 12:13:37.876521 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.926584 (+ 50063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.926805 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:37.927239  6324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 340) took 1726 ms (client timeout 1799 ms). Trace:
I20260709 12:13:37.794353  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:37.690485  5746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1077) took 3409 ms (client timeout 1621 ms). Trace:
W20260709 12:13:37.811405  6322 rpcz_store.cc:269] 0709 12:13:36.388809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.491310 (+102501us) service_pool.cc:224] Handling call
0709 12:13:37.810620 (+1319310us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540068ea54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:37.810833 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2687373568}
I20260709 12:13:37.966014  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.966962  5602 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:37.966645  7221 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.967482  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1610) took 1393 ms. Trace:
I20260709 12:13:37.967815  5602 rpcz_store.cc:276] 0709 12:13:36.573942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.965682 (+1391740us) service_pool.cc:224] Handling call
0709 12:13:37.967435 (+  1753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.886722  6319 rpcz_store.cc:276] 0709 12:13:36.473753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.852260 (+1378507us) service_pool.cc:224] Handling call
0709 12:13:37.886107 (+ 33847us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.867368  5679 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:37.969486  5570 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:37.843197  5747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 1747) took 1517 ms (client timeout 1958 ms). Trace:
I20260709 12:13:37.844727  7267 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:37.878665  6325 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:37.791694  7306 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:37.870174  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1597) took 1373 ms. Trace:
I20260709 12:13:37.885021  7065 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.800910  7216 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:37.900692  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:37.903057  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:37.904181  7109 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:37.909229  5744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 1746) took 1585 ms (client timeout 2029 ms). Trace:
I20260709 12:13:37.910015  7233 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.821794  5598 rpcz_store.cc:276] 0709 12:13:36.513526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.630290 (+1116764us) service_pool.cc:224] Handling call
0709 12:13:37.799432 (+169142us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b5400207454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:37.799558 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109541632}
W20260709 12:13:37.929263  6324 rpcz_store.cc:269] 0709 12:13:36.157994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.177247 (+ 19253us) service_pool.cc:224] Handling call
0709 12:13:37.878560 (+1701313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.963155  6323 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:37.963271  7147 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:37.963647  5746 rpcz_store.cc:269] 0709 12:13:34.281170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.286811 (+  5641us) service_pool.cc:224] Handling call
0709 12:13:37.689945 (+3403134us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540022a1d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:37.690196 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695334144}
I20260709 12:13:37.968901  7293 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:37.961472  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:37.871368  5596 rpcz_store.cc:276] 0709 12:13:36.538213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.704677 (+1166464us) service_pool.cc:224] Handling call
0709 12:13:37.870909 (+166232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:38.160257  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.968848  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:37.970427  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.167269  5597 rpcz_store.cc:276] 0709 12:13:36.497158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.868357 (+1371199us) service_pool.cc:224] Handling call
0709 12:13:37.870093 (+  1736us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:38.169940  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 591) took 1773 ms (client timeout 2049 ms). Trace:
W20260709 12:13:38.076371  6328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 339) took 1918 ms (client timeout 1905 ms). Trace:
W20260709 12:13:38.170238  6325 rpcz_store.cc:269] 0709 12:13:36.389304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.808722 (+1419418us) service_pool.cc:224] Handling call
0709 12:13:38.162187 (+353465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.177687  5716 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:38.178381  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1745) took 1856 ms. Trace:
I20260709 12:13:38.178848  5749 rpcz_store.cc:276] 0709 12:13:36.321319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.321430 (+   111us) service_pool.cc:224] Handling call
0709 12:13:38.173111 (+1851681us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:38.177345 (+  4234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.177795 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.177826 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.177893 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:38.177961 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.178024 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.178173 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3645824}
I20260709 12:13:38.160777  5645 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:38.181943  7061 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.182358  7061 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:38.182735  7061 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.184187  5600 raft_consensus.cc:2410] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:38.183768  7296 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:13:38.184659  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1604) took 1666 ms (client timeout 1964 ms). Trace:
I20260709 12:13:38.155197  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:38.072522  7294 log.cc:927] Time spent T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.611s	user 0.000s	sys 0.012s
I20260709 12:13:38.078473  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:38.174170  6328 rpcz_store.cc:269] 0709 12:13:36.157646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.203236 (+ 45590us) service_pool.cc:224] Handling call
0709 12:13:38.076042 (+1872806us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001c8ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:38.076193 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236501888}
W20260709 12:13:37.975522  7237 consensus_meta.cc:287] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.004s
I20260709 12:13:38.160476  7221 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:37.929118  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 594) took 1534 ms. Trace:
I20260709 12:13:37.972914  7174 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:38.185030  5600 rpcz_store.cc:269] 0709 12:13:36.518335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.751203 (+1232868us) service_pool.cc:224] Handling call
0709 12:13:38.184602 (+433399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.189847  7075 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:38.190140  5670 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.190483  6989 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:38.190534  7091 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:38.191063  6323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 596) took 1716 ms (client timeout 1952 ms). Trace:
W20260709 12:13:38.193033  5718 connection.cc:256] RPC call timeout handler was delayed by -1.7402388240000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 12:13:38.226455  5718 connection.cc:256] RPC call timeout handler was delayed by -1.5402617199997621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 12:13:38.207278  5602 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
W20260709 12:13:38.226795  5718 connection.cc:256] RPC call timeout handler was delayed by -1.3107617199998458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2303s for a response
I20260709 12:13:38.219586  5716 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:38.193981  7305 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.194696  7225 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:38.162434  5747 rpcz_store.cc:269] 0709 12:13:36.325797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.417236 (+ 91439us) service_pool.cc:224] Handling call
0709 12:13:37.842963 (+1425727us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:38.075060  5751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1084) took 2947 ms (client timeout 1641 ms). Trace:
I20260709 12:13:38.196276  6321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 343) took 1855 ms. Trace:
I20260709 12:13:38.166442  7282 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:38.000509  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:37.978914  5599 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:38.205336  7227 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.217897  7311 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:38.215688  7293 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:38.219203  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:38.204483  7237 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:38.220127  7149 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:38.220572  7061 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:38.194648  7243 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:38.215402  7146 consensus_meta.cc:287] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.853s	user 0.009s	sys 0.005s
W20260709 12:13:38.224706  7278 log.cc:927] Time spent T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 2.112s	user 0.044s	sys 0.095s
I20260709 12:13:38.189230  7116 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:37.972307  7238 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:38.209309  5601 raft_consensus.cc:2368] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5.
W20260709 12:13:38.226969  5602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1601) took 1720 ms (client timeout 2236 ms). Trace:
I20260709 12:13:38.198786  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.261953  7146 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:38.261860  5602 rpcz_store.cc:269] 0709 12:13:36.506771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.968512 (+1461741us) service_pool.cc:224] Handling call
0709 12:13:38.226913 (+258401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.263944  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:38.264207  7146 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:38.264916  7243 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:38.199186  6326 rpcz_store.cc:276] 0709 12:13:36.394255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.928079 (+1533824us) service_pool.cc:224] Handling call
0709 12:13:37.928463 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.928774 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.928802 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.928861 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:37.928894 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.928948 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.929053 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.267076  7243 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:38.265355  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.268677  5676 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:38.269404  7274 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.269742  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.271162  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:38.271968  5676 raft_consensus.cc:2368] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:38.272735  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.273411  5676 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:38.275046  5718 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:38.278522  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:38.169286  5744 rpcz_store.cc:269] 0709 12:13:36.323959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.492555 (+168596us) service_pool.cc:224] Handling call
0709 12:13:37.909110 (+1416555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.230571  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:38.240235  7227 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:38.231674  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 326) took 2070 ms. Trace:
I20260709 12:13:38.237666  5750 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:38.239504  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.234544  7306 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:38.188799  7283 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:38.249595  5596 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:38.249750  7063 consensus_meta.cc:287] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.764s	user 0.009s	sys 0.001s
I20260709 12:13:38.250293  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.251403  7237 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:38.251127  7305 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:38.251946  5604 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:38.228914  5498 catalog_manager.cc:5697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 3, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:38.226363  6323 rpcz_store.cc:269] 0709 12:13:36.474355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.407614 (+933259us) service_pool.cc:224] Handling call
0709 12:13:38.186992 (+779378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.226680  7233 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:38.278689  6326 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:38.200910  7174 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:38.205942  6989 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:38.305850  5675 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:38.306173  6989 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:38.306741  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.307668  6989 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.308109  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.309262  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.309890  7311 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.229931  7109 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:38.281972  6327 rpcz_store.cc:276] 0709 12:13:36.162353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.872075 (+1709722us) service_pool.cc:224] Handling call
0709 12:13:38.078622 (+206547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.078955 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.078980 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.079038 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:38.079065 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.079128 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.231520 (+152392us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54001c8ed0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:38.231616 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474124032}
W20260709 12:13:38.285193  5601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1600) took 1780 ms (client timeout 2213 ms). Trace:
I20260709 12:13:38.287202  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:38.316478  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:38.317320  5674 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:38.317677  7115 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:38.318146  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.287902  7225 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:38.318567  5597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:46698
I20260709 12:13:38.319334  5597 raft_consensus.cc:606] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:13:38.319657  5597 raft_consensus.cc:614] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:38.245703  7091 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
W20260709 12:13:38.284956  5750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 1744) took 1965 ms (client timeout 1619 ms). Trace:
I20260709 12:13:38.250095  7065 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:38.269860  7274 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:38.290380  5600 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:38.297017  5716 leader_election.cc:400] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5.
I20260709 12:13:38.324066  5679 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
W20260709 12:13:38.231570  5751 rpcz_store.cc:269] 0709 12:13:35.127591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.129978 (+  2387us) service_pool.cc:224] Handling call
0709 12:13:35.864244 (+734266us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926e9c 00007f44fa926a5b 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:38.074782 (+2210538us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54000131d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:38.074976 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4069677312}
I20260709 12:13:38.285682  7227 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.258690  5672 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:38.299877  6319 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 2 LEARNER]: Advancing to term 4
I20260709 12:13:38.300078  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:38.302106  5599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 161) took 2510 ms (client timeout 2331 ms). Trace:
I20260709 12:13:38.297610  7063 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:38.249454  7155 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:38.311043  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 49895.7us
W20260709 12:13:38.313530  5604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 162) took 2521 ms (client timeout 1530 ms). Trace:
I20260709 12:13:38.320617  5677 raft_consensus.cc:2410] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:38.309959  5671 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:38.304889  6320 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:38.339287  7216 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:38.342273  6320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 321) took 2539 ms (client timeout 2686 ms). Trace:
I20260709 12:13:38.338819  7065 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:38.317689  7109 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:38.343317  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.343772  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:38.344403  6326 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.322485  5603 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
W20260709 12:13:38.347518  6293 leader_election.cc:336] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Timed out: RequestConsensusVote RPC to 127.4.78.66:33011 timed out after 1.792s (SENT)
W20260709 12:13:38.348028  5603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1607) took 1812 ms (client timeout 2109 ms). Trace:
I20260709 12:13:38.348330  7063 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:38.335501  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:38.349010  5673 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.349435  5678 raft_consensus.cc:2368] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5.
W20260709 12:13:38.287465  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 104484us
W20260709 12:13:38.350903  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:38.341926  5599 rpcz_store.cc:269] 0709 12:13:35.791512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.161833 (+370321us) service_pool.cc:224] Handling call
0709 12:13:37.356220 (+1194387us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:38.301859 (+945639us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54002684d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:38.302003 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830603776}
I20260709 12:13:38.324270  5716 leader_election.cc:403] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:38.353663  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1770) took 2031 ms. Trace:
I20260709 12:13:38.354063  5599 rpcz_store.cc:276] 0709 12:13:36.322101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.352703 (+2030602us) service_pool.cc:224] Handling call
0709 12:13:38.353075 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.353312 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.353341 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.353389 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:38.353419 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.353475 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.353595 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.329936  7274 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.324843  5602 raft_consensus.cc:2410] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:38.361583  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.362787  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.363865  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.364827  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:38.321221  5498 catalog_manager.cc:5697] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 3, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.369685  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.371233  6325 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
W20260709 12:13:38.320461  5750 rpcz_store.cc:269] 0709 12:13:36.319151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.319267 (+   116us) service_pool.cc:224] Handling call
0709 12:13:38.078080 (+1758813us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:38.284895 (+206815us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8565120}
I20260709 12:13:38.344470  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.303201  7305 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:38.345692  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:38.346131  5604 rpcz_store.cc:269] 0709 12:13:35.791715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.810402 (+ 18687us) service_pool.cc:224] Handling call
0709 12:13:37.631476 (+1821074us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:38.313375 (+681899us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54002abf54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:38.313469 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416115840}
I20260709 12:13:38.346556  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.346925  7283 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:38.324333  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:38.383248  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:38.383574  6324 raft_consensus.cc:2368] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4.
I20260709 12:13:38.383819  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.325810  7225 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:38.365228  6320 rpcz_store.cc:269] 0709 12:13:35.802402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.235093 (+2432691us) service_pool.cc:224] Handling call
0709 12:13:38.342198 (+107105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:38.348491  5603 rpcz_store.cc:269] 0709 12:13:36.536000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.842678 (+1306678us) service_pool.cc:224] Handling call
0709 12:13:38.347974 (+505296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.384758  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1776) took 1037 ms. Trace:
I20260709 12:13:38.384990  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.312242  7174 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:38.323150  5601 rpcz_store.cc:269] 0709 12:13:36.504608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.900336 (+1395728us) service_pool.cc:224] Handling call
0709 12:13:38.285134 (+384798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.367390  7306 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:38.375675  6293 leader_election.cc:336] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Timed out: RequestConsensusVote RPC to 127.4.78.66:33011 timed out after 2.234s (SENT)
I20260709 12:13:38.390337  6293 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:38.391146  7115 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.400048  7088 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:38.402748  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.370915  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.401940  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:38.403874  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:38.400542  6323 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:13:38.406653  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 56915.7us
W20260709 12:13:38.407886  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 203829us
I20260709 12:13:38.376211  5673 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:38.378161  5677 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:38.382594  5596 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:38.410400  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1777) took 1048 ms. Trace:
I20260709 12:13:38.386480  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.386987  5604 rpcz_store.cc:276] 0709 12:13:37.347662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.383881 (+1036219us) service_pool.cc:224] Handling call
0709 12:13:38.384215 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.384434 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.384458 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.384497 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:38.384542 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.384591 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.384686 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.355989  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1773) took 2020 ms. Trace:
I20260709 12:13:38.411377  5596 rpcz_store.cc:276] 0709 12:13:37.372654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.196443 (+823789us) service_pool.cc:224] Handling call
0709 12:13:38.410351 (+213908us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.389428  7241 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:38.390058  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.315500  7238 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:38.418630  6325 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.323100  7272 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
W20260709 12:13:38.418396  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 174956us
I20260709 12:13:38.404145  7305 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:13:38.424963  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.427222  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.427222  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:38.428205  5671 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.428751  5677 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:38.435354  5673 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:38.434690  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:38.410331  7063 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:38.439893  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 108383us
I20260709 12:13:38.441401  5604 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:38.444464  6327 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:38.444901  5716 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:38.451037  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.451768  5673 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:13:38.453557  7274 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:38.454280  5750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:38.454407  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:38.454844  5750 raft_consensus.cc:606] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:13:38.437703  5670 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:38.455681  7061 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:38.455687  7274 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:38.456768  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:38.414965  5599 rpcz_store.cc:276] 0709 12:13:36.335314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.355070 (+2019756us) service_pool.cc:224] Handling call
0709 12:13:38.355446 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.355643 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.355671 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.355738 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:38.355768 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.355831 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.355936 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:38.459494  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:38.233215  6321 rpcz_store.cc:276] 0709 12:13:36.331255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.874328 (+1543073us) service_pool.cc:224] Handling call
0709 12:13:37.874792 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:38.159804 (+285012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.159842 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:38.160471 (+   629us) log.cc:844] Serialized 26 byte log entry
0709 12:13:38.171252 (+ 10781us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:38.171298 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.171367 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:38.172736 (+  1369us) raft_consensus.cc:1685] finished
0709 12:13:38.172756 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.186531 (+ 13775us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":285849,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":166,"thread_start_us":10323,"threads_started":1,"wal-append.queue_time_us":10682}
I20260709 12:13:38.460530  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:38.461877  7063 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:38.464488  7063 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:38.440795  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.467048  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.467967  5746 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:38.468437  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.441483  7147 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.467871  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.469130  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.469535  5745 raft_consensus.cc:2393] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:38.469274  7147 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:38.469905  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.469551  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.470887  5744 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:38.471587  7147 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:38.471840  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.475088  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.476316  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.477321  5746 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:38.477208  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:38.476428  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.435591  7241 raft_consensus.cc:697] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:38.477548  6293 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:38.468694  7238 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:38.487952  5671 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:38.445904  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:13:38.491003  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 50527us
I20260709 12:13:38.494761  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:13:38.496258  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.497254  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.497486  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.479931  5745 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.470621  5747 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:38.476531  6326 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:38.511588  5749 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 1.
I20260709 12:13:38.512979  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:38.513666  5671 raft_consensus.cc:2393] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:38.488389  5744 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:38.519649  7241 consensus_queue.cc:237] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:38.537464  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:38.523265  6324 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.523597  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.538554  6293 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:38.524489  7227 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:38.528280  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.531461  7305 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5.
I20260709 12:13:38.531960  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:38.533006  6291 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:38.520182  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.523687  5716 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:38.512140  6323 raft_consensus.cc:2368] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:38.539696  5601 raft_consensus.cc:2410] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:38.510830  7115 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.544131  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:38.545897  5750 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:38.544327  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.533975  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.557960  5675 raft_consensus.cc:2393] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:38.556792  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.558575  5749 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:38.558844  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:38.559397  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.559873  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.560444  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.561041  5749 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 1.
I20260709 12:13:38.561201  5675 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:38.566511  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:38.544090  7233 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:38.572180  5749 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:13:38.573155  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 73966.7us
I20260709 12:13:38.576510  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.580343  7227 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:38.581250  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.582554  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.583081  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1609) took 2032 ms. Trace:
I20260709 12:13:38.557178  7115 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.581519  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.588393  7113 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.588862  7113 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:38.589259  7113 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:38.591495  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.592309  5596 raft_consensus.cc:2393] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:38.593511  6325 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:38.594470  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.609133  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:38.592491  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:38.587221  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:38.583524  5597 rpcz_store.cc:276] 0709 12:13:36.541380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.398821 (+1857441us) service_pool.cc:224] Handling call
0709 12:13:38.406634 (+  7813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.406898 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:38.438986 (+ 32088us) log.cc:844] Serialized 14 byte log entry
0709 12:13:38.569204 (+130218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.569259 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:38.573888 (+  4629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.573956 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.574063 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8413,"prepare.queue_time_us":45231,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":13477,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":4619,"thread_start_us":106109,"threads_started":2}
I20260709 12:13:38.610980  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:38.586066  7269 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:38.581292  5672 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:38.698720  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1767) took 2910 ms. Trace:
I20260709 12:13:38.934327  6325 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.830695  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.670323  5677 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:13:38.611097  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:38.673736  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.921095  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:38.921315  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:38.593048  7115 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.610033  6328 raft_consensus.cc:2368] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
W20260709 12:13:38.751575  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.921084  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:38.670084  5749 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:38.609728  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:38.726723  5750 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:13:38.738075  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 70279.9us
I20260709 12:13:38.945292  5673 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:38.701869  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.941437  5600 rpcz_store.cc:276] 0709 12:13:35.788759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.326417 (+2537658us) service_pool.cc:224] Handling call
0709 12:13:38.326764 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.327015 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:13:38.482124 (+155109us) log.cc:844] Serialized 14 byte log entry
0709 12:13:38.698304 (+216180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.698365 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:38.698406 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.698474 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.698626 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19782,"prepare.queue_time_us":124653,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":90318,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"thread_start_us":253154,"threads_started":2}
I20260709 12:13:38.592497  7321 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.610489  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:38.948956  5603 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:38.726579  7113 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:38.949682  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:38.950142  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.969345  5675 raft_consensus.cc:2410] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:38.950476  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.669742  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:38.610657  7319 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.611477  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.604964  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1606) took 2066 ms. Trace:
I20260709 12:13:38.953330  7269 raft_consensus.cc:697] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:38.605171  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.954008  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:38.954560  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:39.004442  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 66027.8us
I20260709 12:13:38.611743  5716 leader_election.cc:400] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4.
I20260709 12:13:39.162870  7238 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.163020  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:39.163455  7238 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:38.956403  5601 raft_consensus.cc:2393] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 4: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:39.165555  7238 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:39.162823  5716 leader_election.cc:403] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:13:39.167122  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 579032us
I20260709 12:13:39.172073  5716 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:38.951205  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.173178  6321 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:39.173640  7306 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.174034  7306 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:39.174088  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:38.922317  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:38.972266  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:38.972430  5604 raft_consensus.cc:2393] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:38.775885  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:39.176301  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.176424  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.176929  6321 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 1.
I20260709 12:13:39.177034  5747 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:38.770730  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:39.177870  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.178634  6321 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:38.726137  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.179380  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.180101  6323 raft_consensus.cc:1240] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:39.175020  5716 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:38.771500  7267 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.174930  5596 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:38.944473  5745 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:39.182111  7126 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:39.012262  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 107109us
I20260709 12:13:39.177695  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:39.183151  5719 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:39.183544  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.184356  5676 raft_consensus.cc:2393] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:39.184401  7225 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.012928  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.184886  7225 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:39.185051  5719 leader_election.cc:400] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4.
I20260709 12:13:39.014194  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.015226  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.969199  7321 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:39.178716  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.185782  7321 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.186391  5670 raft_consensus.cc:2368] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4.
I20260709 12:13:39.181916  7267 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.188445  6323 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:39.188681  7267 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:39.007357  5599 raft_consensus.cc:2393] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:39.189599  7227 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:39.020426  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:39.190640  7243 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.023046  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:39.186492  7305 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 12:13:39.191399  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 168458us
I20260709 12:13:39.192063  5642 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:39.192251  7341 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.192768  7233 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.193255  7233 raft_consensus.cc:697] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:39.193369  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:39.002282  7319 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:39.193938  7319 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.194238  7233 consensus_queue.cc:237] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:39.024147  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.197999  7341 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:39.013743  6326 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.028890  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.206224  5677 raft_consensus.cc:2368] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:39.007575  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.013548  7063 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.207819  7063 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.209923  7063 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:39.038079  5597 raft_consensus.cc:2393] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:13:39.037222  7174 consensus_meta.cc:287] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.627s	user 0.005s	sys 0.005s
I20260709 12:13:39.211128  7174 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.213332  7174 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:39.042224  5746 raft_consensus.cc:2393] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:39.044148  5672 raft_consensus.cc:2410] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:39.052156  6325 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:39.055554  5569 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:39.216061  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 160664us
I20260709 12:13:39.045678  7221 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.217658  7321 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.218120  7221 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.218991  7241 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4.
I20260709 12:13:39.219348  5719 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:39.220177  5719 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:39.220453  7221 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:39.060305  5603 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:39.221247  7241 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.221923  7227 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.222446  7227 raft_consensus.cc:697] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:39.223485  7227 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.224252  6326 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:39.054823  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.226313  6322 raft_consensus.cc:2368] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
I20260709 12:13:39.064875  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:39.065797  6291 connection.cc:256] RPC call timeout handler was delayed by -1.1309462789997724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 12:13:39.067286  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:39.227783  6291 connection.cc:256] RPC call timeout handler was delayed by -1.01502954700004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 12:13:39.075284  5570 leader_election.cc:400] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
I20260709 12:13:39.061863  7311 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:13:39.081126  7113 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:39.084411  6324 consensus_meta.cc:287] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.003s
I20260709 12:13:39.221657  7241 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.230151  6324 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:39.230644  7241 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:39.087814  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 85033.9us
I20260709 12:13:39.091140  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:39.081050  7115 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.008225  5598 rpcz_store.cc:276] 0709 12:13:36.530228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.367952 (+1837724us) service_pool.cc:224] Handling call
0709 12:13:38.368381 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.368724 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:38.433246 (+ 64522us) log.cc:844] Serialized 14 byte log entry
0709 12:13:38.564041 (+130795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.567248 (+  3207us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:38.572468 (+  5220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.575800 (+  3332us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.596224 (+ 20424us) inbound_call.cc:177] Queueing success response
0709 12:13:38.731776 (+135552us) spinlock_profiling.cc:243] Waited 8.53 ms on lock 0x7b18002a7360. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
Metrics: {"prepare.queue_time_us":83172,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":14831,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":10840,"spinlock_wait_cycles":19629440,"thread_start_us":148887,"threads_started":2,"wal-append.queue_time_us":140994}
W20260709 12:13:39.145816  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 71170.9us
I20260709 12:13:39.157665  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:39.159936  7330 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:13:39.160238  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:38.668527  6319 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 4 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:39.170100  6293 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:39.174469  7306 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.735272  5674 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:39.185293  7225 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.198449  7341 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.199247  5749 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:39.199599  7126 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:39.190883  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 181926us
I20260709 12:13:39.200572  7283 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.061281  7269 consensus_queue.cc:237] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.243631  7221 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.255039  7113 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:39.228680  5570 leader_election.cc:403] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:39.240154  5719 leader_election.cc:400] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:39.232909  5678 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
W20260709 12:13:39.233502  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 58601.5us
I20260709 12:13:39.244127  5569 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:39.257637  5719 leader_election.cc:403] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:39.227172  7319 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.262315  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:39.251873  6327 raft_consensus.cc:2393] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 4: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:39.253677  5595 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 2: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:13:39.249894  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 49202.6us
I20260709 12:13:39.252542  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1547) took 1060 ms. Trace:
W20260709 12:13:39.268234  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 98219.2us
I20260709 12:13:39.271250  5719 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:39.273242  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 201285us
I20260709 12:13:39.274052  6293 leader_election.cc:400] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4.
I20260709 12:13:39.274408  6293 leader_election.cc:403] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:39.270476  5569 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:39.276410  5744 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:39.276836  7319 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:39.278474  7321 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:39.257156  7283 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:39.280934  7283 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.282590  7221 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
I20260709 12:13:39.286223  5716 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:39.287175  5602 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.256681  7126 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.288626  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1593) took 2792 ms. Trace:
I20260709 12:13:39.288942  5602 rpcz_store.cc:276] 0709 12:13:36.495967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.359017 (+1863050us) service_pool.cc:224] Handling call
0709 12:13:39.287007 (+927990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:39.287672 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:39.288417 (+   745us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b540047fed0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:39.288541 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2133411584}
I20260709 12:13:39.290470  7115 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:39.292991  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.295176  5569 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:39.297302  5569 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:39.301491  7243 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.300222  7319 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:39.299732  7305 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:39.287106  5595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 167) took 2890 ms (client timeout 2095 ms). Trace:
I20260709 12:13:39.300992  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:39.309656  6293 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:39.299852  5719 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:39.301698  5718 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:39.310240  7113 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4.
I20260709 12:13:39.306308  7174 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.302196  7344 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.325026  7311 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.298095  7238 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.298593  7221 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.268159  5674 rpcz_store.cc:276] 0709 12:13:38.195687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.343031 (+147344us) service_pool.cc:224] Handling call
0709 12:13:38.345502 (+  2471us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:39.251475 (+905973us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3362176}
I20260709 12:13:39.322516  7115 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.329057  5569 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:39.330330  7345 log.cc:927] Time spent T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:13:39.323232  6291 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:39.320106  7306 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.332700  5642 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:39.340945  7311 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:39.342186  6293 leader_election.cc:400] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:39.339599  7305 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:13:39.339390  5595 rpcz_store.cc:269] 0709 12:13:36.396900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.752780 (+1355880us) service_pool.cc:224] Handling call
0709 12:13:39.286875 (+1534095us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540047fed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:39.287026 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2611177728}
I20260709 12:13:39.339712  7126 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.347781  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.349054  6293 leader_election.cc:403] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:39.349815  7063 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.338747  7243 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:39.351150  7233 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:39.343447  7113 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.363664  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.363965  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.365193  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.366400  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:39.382606  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 81741.5us
I20260709 12:13:39.382987  5596 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:39.366982  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.367069  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.353106  7227 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.376883  7126 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:39.342855  7174 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:39.380295  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 57131us
I20260709 12:13:39.394835  7174 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.380918  7243 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.398098  5599 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.383971  5604 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:39.348367  7321 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:39.383991  5601 raft_consensus.cc:2368] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4.
I20260709 12:13:39.374316  7319 raft_consensus.cc:697] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:39.355101  7305 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.353256  7311 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.354478  7335 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.348356  7115 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.394168  7349 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:39.394357  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 52294.3us
I20260709 12:13:39.430099  7349 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.430528  7349 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:39.430735  7283 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.433938  7115 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:39.409258  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.435598  7319 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.436543  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.393704  7269 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3.
I20260709 12:13:39.413398  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.413872  7306 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:39.414484  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.386693  7063 raft_consensus.cc:697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:39.415200  7353 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:39.416476  6327 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:13:39.464823  5570 leader_election.cc:336] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.620s (SENT)
I20260709 12:13:39.416975  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.417572  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.418198  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.470618  6324 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:39.419040  7221 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.471594  7221 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.420568  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.421501  6328 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:39.422143  7243 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.476317  7243 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:39.422497  6320 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:39.423903  7344 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:39.385262  7225 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.482043  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.482262  7225 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:39.427326  7358 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.406391  7321 raft_consensus.cc:697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:39.482720  5597 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:39.394846  7227 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.434448  7241 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.483600  7321 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.485085  7241 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:39.435105  6293 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:39.486136  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 51130.4us
I20260709 12:13:39.486836  6293 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:39.404074  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 102442us
I20260709 12:13:39.403271  5716 leader_election.cc:400] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5.
I20260709 12:13:39.487671  5716 leader_election.cc:403] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:13:39.449854  7349 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:13:39.450578  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 98257.3us
W20260709 12:13:39.451139  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 108346us
W20260709 12:13:39.467192  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.467844  6321 raft_consensus.cc:2376] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 3. Re-sending same reply.
I20260709 12:13:39.488660  5645 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:39.490731  5718 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:39.466699  5570 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:39.429440  7305 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.492057  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.493021  5718 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:39.482103  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.494844  7349 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:39.495608  7358 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.496447  7227 raft_consensus.cc:697] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:39.496722  6325 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:39.496976  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 108646us
I20260709 12:13:39.497424  7115 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.497912  7269 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.498654  7353 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.498950  6320 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:39.499497  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.544253  5678 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.500357  5675 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.500535  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.500888  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:39.501561  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.446048  7283 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:39.508080  7311 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.407601  7341 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.487195  6323 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:39.455727  5501 catalog_manager.cc:5697] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 2 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:39.502250  7063 consensus_queue.cc:237] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.517638  7241 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:39.521312  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 192307us
I20260709 12:13:39.527650  7238 raft_consensus.cc:697] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:13:39.523025  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 58230.8us
I20260709 12:13:39.491454  7221 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:39.536410  5718 leader_election.cc:400] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5.
I20260709 12:13:39.543466  5498 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45220 (request call id 291) took 5189 ms. Trace:
W20260709 12:13:39.561257  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 72653.5us
I20260709 12:13:39.564677  5671 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:39.522434  7306 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.529960  7346 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:39.522543  7357 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:39.566286  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 70874us
W20260709 12:13:39.522133  5567 leader_election.cc:336] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.521s (SENT)
I20260709 12:13:39.572283  5570 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:39.522691  7174 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.576751  6293 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:39.578989  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 48518.9us
I20260709 12:13:39.575243  6321 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:39.586782  7227 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.587448  7233 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:39.588153  7358 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:39.589449  7341 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:39.569298  7321 consensus_queue.cc:1059] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:13:39.590770  5570 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:39.573493  7353 consensus_queue.cc:1059] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:13:39.578083  7335 consensus_queue.cc:1059] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:13:39.603816  7221 consensus_queue.cc:1059] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:39.605149  7221 raft_consensus.cc:3055] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:39.611464  7221 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:39.594477  7361 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.612452  7221 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.613372  7335 raft_consensus.cc:3055] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:39.613626  7221 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.615644  5595 raft_consensus.cc:1240] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.615928  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.616560  5597 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:39.618239  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.580708  7344 consensus_queue.cc:1059] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 12:13:39.600417  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 80586.6us
I20260709 12:13:39.609462  5718 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:39.573354  5498 rpcz_store.cc:276] 0709 12:13:34.340414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.358143 (+ 17729us) service_pool.cc:224] Handling call
0709 12:13:35.865469 (+1507326us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54003b9cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b5090 00007f44fda53f3a 00007f4503809e9c 00007f450390804e 00007f4501dc92a4 00007f4501dc9232 00007f4501dc9161 00007f4501dc90dc 00007f4501dc8392 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:39.529364 (+3663895us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:38.592611 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:38.604355 (+ 11744us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:38.604404 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:13:38.604426 (+    22us) tablet.cc:662] Decoding operations
0709 12:13:38.702576 (+ 98150us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:38.702677 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:38.702709 (+    32us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:13:38.703507 (+   798us) tablet.cc:701] Row locks acquired
0709 12:13:38.703553 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:13:38.703728 (+   175us) write_op.cc:270] Start()
0709 12:13:38.703869 (+   141us) write_op.cc:276] Timestamp: P: 1783599218703672 usec, L: 0
0709 12:13:38.703907 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:13:38.725056 (+ 21149us) log.cc:844] Serialized 3196 byte log entry
0709 12:13:39.167119 (+442063us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b1800097d80. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:13:39.267120 (+100001us) op_driver.cc:464] REPLICATION: finished
0709 12:13:39.384338 (+117218us) write_op.cc:301] APPLY: starting
0709 12:13:39.401894 (+ 17556us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:39.402158 (+   264us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:39.402221 (+    63us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:39.413364 (+ 11143us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:39.413683 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:13:39.413750 (+    67us) write_op.cc:312] APPLY: finished
0709 12:13:39.423364 (+  9614us) log.cc:844] Serialized 65 byte log entry
0709 12:13:39.423566 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:39.423690 (+   124us) write_op.cc:454] Released schema lock
0709 12:13:39.423752 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:39.424178 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:39.424208 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1588927,"reported_tablets":14,"spinlock_wait_cycles":1305028480,"child_traces":[["op",{"apply.queue_time_us":78466,"apply.run_cpu_time_us":3830,"apply.run_wall_time_us":69757,"num_ops":8,"prepare.queue_time_us":177611,"prepare.run_cpu_time_us":7738,"prepare.run_wall_time_us":384930,"raft.queue_time_us":97472,"raft.run_cpu_time_us":18076,"raft.run_wall_time_us":71262,"replication_time_us":563048,"spinlock_wait_cycles":15963392,"thread_start_us":368408,"threads_started":4,"wal-append.queue_time_us":278884}]]}
I20260709 12:13:39.603180  5570 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:39.617435  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.622611  5602 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.623929  5678 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
W20260709 12:13:39.623689  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 44310.7us
I20260709 12:13:39.624886  5597 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:39.625077  6293 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:39.626391  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.626652  7311 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:39.627208  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.628428  7344 raft_consensus.cc:3055] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:39.628818  7344 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:39.629881  7113 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:39.629642  7344 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.630380  7113 raft_consensus.cc:697] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:39.631279  7113 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:39.632727  5567 leader_election.cc:336] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.621s (SENT)
I20260709 12:13:39.633342  5567 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:39.602788  7357 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.633152  5602 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:39.635157  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.635414  5570 leader_election.cc:400] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
I20260709 12:13:39.635707  5570 leader_election.cc:403] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:39.583261  7238 consensus_queue.cc:237] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.638325  7115 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:39.626276  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.618073  7335 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:39.641322  5645 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:13:39.647771  5567 leader_election.cc:336] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.641s (SENT)
I20260709 12:13:39.644714  7344 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.643328  7361 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:13:39.650216  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.644737  7358 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
I20260709 12:13:39.651153  7341 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:39.648037  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.651604  7341 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.651961  7341 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:39.652143  7115 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:39.652588  7115 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:39.652714  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:39.651173  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.653699  5744 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:39.645970  7353 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.641283  7357 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.655656  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:39.658450  7306 raft_consensus.cc:3055] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:39.658871  7306 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:39.659723  7306 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.660840  7306 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.663022  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:39.664899  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.641631  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.666450  5595 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:39.666719  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.667721  5744 raft_consensus.cc:2393] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:39.668908  7319 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.669615  7319 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.667666  7174 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:39.671341  7353 raft_consensus.cc:697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:39.672814  7243 raft_consensus.cc:1064] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:39.672379  7353 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:13:39.673290  7243 raft_consensus.cc:1068] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:39.647526  5599 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:39.674423  7360 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.674883  7305 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:39.665160  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.669564  7335 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.677346  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.676779  5604 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.679991  7321 raft_consensus.cc:3055] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.680447  7321 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:13:39.682340  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 72977.4us
I20260709 12:13:39.683109  5718 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:39.685376  5567 leader_election.cc:336] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.799s (SENT)
I20260709 12:13:39.686816  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:39.688037  5601 raft_consensus.cc:2410] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:39.687908  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.688643  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.677486  7335 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:39.692924  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 72195.3us
I20260709 12:13:39.697899  5718 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:39.688453  7305 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.707803  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.708787  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:39.709545  6323 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:39.714622  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.715322  6320 raft_consensus.cc:2376] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3. Re-sending same reply.
I20260709 12:13:39.717677  6291 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:39.718544  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:39.719329  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:39.725159  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 76679.9us
I20260709 12:13:39.729151  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.734154  5596 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:39.736287  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:39.736727  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.739286  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.704764  7346 raft_consensus.cc:697] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:39.681376  7321 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.740806  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:39.741149  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.739041  7283 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:39.750414  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:39.750584  7283 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.750818  7321 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.751210  7283 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:39.751543  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 65859.9us
I20260709 12:13:39.754559  7346 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.754998  7225 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:39.748036  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:39.734830  7243 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.758787  7243 raft_consensus.cc:697] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:39.759662  7243 consensus_queue.cc:237] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.761487  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.762027  7366 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:39.762918  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.763612  7283 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:39.764056  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.764779  5597 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:39.756880  7225 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:13:39.765579  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.763486  5603 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.773025  5604 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:39.740918  7267 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.758021  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.740028  7241 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5.
I20260709 12:13:39.782723  5749 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:39.774822  6319 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:39.786640  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:39.787587  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 46865.2us
I20260709 12:13:39.795445  5679 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.801894  5671 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:39.776074  7269 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.783353  7267 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.779497  5599 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:39.809957  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.807544  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.809304  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.813517  5674 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.814347  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.802546  6291 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:39.818117  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.801115  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:39.821559  5598 raft_consensus.cc:2393] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:39.822453  6291 leader_election.cc:400] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4.
I20260709 12:13:39.827586  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:39.796654  7283 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:39.828765  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.817580  7267 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.830646  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:39.832166  7269 raft_consensus.cc:2764] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:39.837421  5675 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:13:39.794967  7370 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:13:39.820777  7306 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.847824  6291 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:39.829885  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:39.852131  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.853048  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.845335  7306 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:39.858692  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:39.859337  7306 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:39.857596  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:39.860777  5679 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:39.861910  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.863718  7319 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:39.860210  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:39.866824  7356 raft_consensus.cc:993] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:39.867301  7306 raft_consensus.cc:1081] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:13:39.875414  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.876813  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:39.841674  7113 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.883867  5603 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:39.884709  5675 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:39.887521  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.893270  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:39.915087  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:39.985044  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.966671  7341 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:39.967602  7382 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.970175  7221 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:39.878252  7238 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:39.971256  7241 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:39.971323  7283 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:39.971851  5670 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:39.972505  5749 raft_consensus.cc:1240] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:13:39.972420  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.973724  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:39.974134  5570 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:40.006208  5750 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.005867  5753 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.007419  5570 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:39.869585  7269 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.896061  5672 raft_consensus.cc:1275] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:13:39.973265  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 87037.7us
I20260709 12:13:40.010466  5679 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:39.975646  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.011795  5603 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 2: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:39.970674  5671 raft_consensus.cc:1275] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:39.987306  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.987947  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:39.989043  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:39.972385  6319 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:39.992726  6323 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:39.993503  5599 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:39.994024  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:39.997794  7221 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.989519  5674 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:39.998802  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.001525  5673 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:39.991029  5642 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:39.973331  5744 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:40.007483  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.015079  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.032617  5749 raft_consensus.cc:2376] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4. Re-sending same reply.
I20260709 12:13:40.015681  5748 raft_consensus.cc:2410] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:13:40.016100  5645 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.023746  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:40.038012  5675 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
W20260709 12:13:40.040762  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.041519  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.041795  7311 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:40.033099  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.042284  7311 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.042725  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.038420  7115 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.043452  5752 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.044595  7311 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.044795  7341 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:40.045318  7227 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.029279  5678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35874
I20260709 12:13:40.047043  5678 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:40.047374  5678 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.048941  7356 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:13:40.049309  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 58353.5us
I20260709 12:13:40.050386  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.050778  7306 consensus_queue.cc:1059] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:40.051414  5642 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.051678  7305 raft_consensus.cc:3055] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:40.052078  7305 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:40.052454  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.052876  7305 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:40.054327  6326 raft_consensus.cc:1240] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:40.054801  7126 consensus_queue.cc:1059] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.055096  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.055886  7321 raft_consensus.cc:3055] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.056253  7321 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:40.057210  7063 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.057654  7063 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:40.058074  7063 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.019135  7358 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.017486  7174 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:40.005090  7241 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.041990  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:40.025306  7221 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.044858  7115 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.056121  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.057090  7321 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:40.066164  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 50136us
I20260709 12:13:40.060128  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.073282  5753 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:40.073698  5749 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:40.004738  7238 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.067405  5677 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:40.072531  5645 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:40.030814  5751 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:40.067871  7174 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.065560  5745 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:40.127127  5678 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.069432  7366 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:40.147571  7113 raft_consensus.cc:697] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:40.076301  7233 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.127856  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:40.072940  7358 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:40.070982  7319 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:13:40.144816  7383 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.154012  7238 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:40.155823  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 83366.4us
I20260709 12:13:40.168007  5678 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.156723  7371 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.146165  7174 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.147490  7366 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.173305  7366 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.072009  7225 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:13:40.175874  5747 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:40.032337  7344 consensus_queue.cc:1059] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:13:40.177738  7344 raft_consensus.cc:3055] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.178128  7344 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:40.178949  7344 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.180449  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.180573  7358 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.182157  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.182422  7174 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.182952  5751 raft_consensus.cc:2393] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:40.183871  7371 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.184319  7371 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.163131  5750 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:40.175761  7267 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.186509  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.186854  7321 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.187544  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.179471  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.187858  7267 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:40.188856  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.190755  7269 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.189482  5752 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:40.181530  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.169540  5569 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:13:40.165186  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 95433.3us
I20260709 12:13:40.170964  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:40.172402  7360 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.172685  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:40.196395  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.197558  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:40.200575  7371 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.205902  7357 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.206354  7221 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.207155  7371 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:40.207816  5569 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:40.201344  7113 consensus_queue.cc:237] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.208499  7221 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.208957  7349 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:40.209192  7221 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.209455  7349 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.211442  7349 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.211913  7349 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:40.212208  7349 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.212518  7349 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.201846  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.200414  7344 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.203971  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.215442  5753 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
W20260709 12:13:40.204854  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.216161  5750 raft_consensus.cc:1275] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:40.166488  5672 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.218222  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.208518  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.220994  5752 raft_consensus.cc:2393] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 2: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.183835  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:13:40.227164  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 175802us
I20260709 12:13:40.229940  5642 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.230162  5750 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:40.231575  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.234283  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.236451  6291 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:40.226408  7305 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.239971  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.240584  5750 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:40.241732  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.232237  5747 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.244910  5747 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:40.244596  7063 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.247540  5675 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.249976  7395 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.256863  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:40.260862  7366 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.262964  7366 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.263622  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.264230  5752 raft_consensus.cc:2376] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5. Re-sending same reply.
I20260709 12:13:40.229137  7393 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.265527  7393 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:40.265920  7393 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.267397  5672 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:40.268389  5671 raft_consensus.cc:1240] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:40.226127  7238 consensus_queue.cc:1059] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:13:40.232612  7346 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.270539  5718 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:40.270820  7353 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.271277  7321 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.271369  5718 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:40.191231  7269 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.272277  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:40.272471  7392 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:40.288931  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.273022  7321 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.292022  5753 raft_consensus.cc:2410] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:13:40.229259  7221 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:13:40.293030  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 84425us
I20260709 12:13:40.269745  7238 consensus_queue.cc:1243] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:40.296078  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.296380  5750 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:40.296844  5752 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:40.297915  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.288054  7392 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.298384  6293 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:40.298429  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.287950  7174 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:40.293589  7321 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.291602  7115 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.304183  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.306229  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:40.307415  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:40.368351  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 64227.9us
I20260709 12:13:40.369402  5642 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.369923  7233 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.370582  7233 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.371071  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.372557  7365 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:40.373008  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.310602  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:40.303653  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.302654  7392 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.306053  7366 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.359164  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.367507  7115 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:40.359944  5671 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:40.294221  7227 consensus_queue.cc:1059] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:13:40.313934  7394 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:40.299521  7395 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.314980  7221 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.360342  7390 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.374185  5642 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.373009  7365 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:40.401669  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.362340  7267 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:40.381353  7115 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.382030  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.409626  5751 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.410502  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.410684  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.411641  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.412021  5596 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:40.413326  5604 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:40.382863  7393 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.415447  7393 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.377925  7346 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.384975  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.386137  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.384222  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.416419  5747 raft_consensus.cc:2376] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3. Re-sending same reply.
I20260709 12:13:40.416553  5744 raft_consensus.cc:2376] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2. Re-sending same reply.
I20260709 12:13:40.416946  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.417333  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.386837  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.418036  5747 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:40.378849  7349 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.418130  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.399755  5671 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:40.419406  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.419729  7349 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.419975  5746 raft_consensus.cc:2376] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3. Re-sending same reply.
I20260709 12:13:40.402977  5567 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:40.386639  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.420972  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.421947  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.417430  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.422170  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.422783  5744 raft_consensus.cc:2393] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.422995  5746 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.423388  7311 raft_consensus.cc:3055] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:40.423877  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.424331  7267 raft_consensus.cc:697] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:40.424682  5567 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.424993  5749 raft_consensus.cc:1240] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.404793  7383 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.425527  7360 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:40.425307  7267 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.426993  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.427168  7233 consensus_queue.cc:1059] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:40.428140  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.428840  5747 raft_consensus.cc:2393] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 2: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.430754  5748 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:40.420274  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.430776  7354 raft_consensus.cc:2764] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:13:40.419797  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.426031  7357 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.423621  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.433339  5744 raft_consensus.cc:2376] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5. Re-sending same reply.
W20260709 12:13:40.422108  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.397135  7382 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:13:40.418550  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.434319  5567 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:40.434986  5750 raft_consensus.cc:2393] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:40.421096  5599 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:40.435678  7349 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:40.436118  7349 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.411152  7365 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.436468  7349 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:40.437574  7269 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.438267  5567 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:40.439078  7357 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.423785  7311 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:40.440105  7233 raft_consensus.cc:3055] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.440492  7233 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:40.441352  7233 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.440119  7311 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.429562  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.423727  7241 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:40.440714  5567 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:40.426949  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.446627  5753 raft_consensus.cc:2393] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.446691  7357 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.447185  7357 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:40.447541  7357 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.452484  7353 raft_consensus.cc:3055] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:40.452721  7321 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.456975  5501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44240 (request call id 203) took 1393 ms. Trace:
I20260709 12:13:40.460510  7063 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:40.460474  7115 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.461911  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.463387  5751 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:40.464812  7392 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.465504  7393 consensus_queue.cc:1059] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:40.466132  7398 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.466310  7360 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:40.466722  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.446789  6326 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 1 LEARNER]: Advancing to term 3
I20260709 12:13:40.468752  7311 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.469445  7360 consensus_queue.cc:1059] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:40.466549  7393 raft_consensus.cc:3055] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.470075  7393 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:40.470582  7360 raft_consensus.cc:3055] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.442608  7233 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.471395  7174 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:40.472117  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 67599.2us
I20260709 12:13:40.470953  7360 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:40.425009  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.477095  5746 raft_consensus.cc:2393] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.477388  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:40.480126  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.482372  5671 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.482928  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.484149  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.484736  5750 raft_consensus.cc:2376] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 4. Re-sending same reply.
I20260709 12:13:40.487473  7174 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.483247  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.457367  5501 rpcz_store.cc:276] 0709 12:13:39.063868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.064104 (+   236us) service_pool.cc:224] Handling call
0709 12:13:40.456887 (+1392783us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:39.810308 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:39.863345 (+ 53037us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:39.863379 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:13:39.863400 (+    21us) tablet.cc:662] Decoding operations
0709 12:13:39.863743 (+   343us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:39.863796 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:39.863822 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:39.864001 (+   179us) tablet.cc:701] Row locks acquired
0709 12:13:39.864014 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:13:39.864147 (+   133us) write_op.cc:270] Start()
0709 12:13:39.864249 (+   102us) write_op.cc:276] Timestamp: P: 1783599219864107 usec, L: 0
0709 12:13:39.864271 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:13:39.864877 (+   606us) log.cc:844] Serialized 530 byte log entry
0709 12:13:40.058264 (+193387us) op_driver.cc:464] REPLICATION: finished
0709 12:13:40.258651 (+200387us) write_op.cc:301] APPLY: starting
0709 12:13:40.258746 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:40.258839 (+    93us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:40.258953 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:40.259166 (+   213us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:40.259321 (+   155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:40.259361 (+    40us) write_op.cc:312] APPLY: finished
0709 12:13:40.259550 (+   189us) log.cc:844] Serialized 23 byte log entry
0709 12:13:40.259713 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:40.259795 (+    82us) write_op.cc:454] Released schema lock
0709 12:13:40.259829 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:40.260203 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:40.260243 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24043,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":175705,"apply.run_cpu_time_us":1530,"apply.run_wall_time_us":1530,"num_ops":1,"prepare.queue_time_us":209774,"prepare.run_cpu_time_us":2685,"prepare.run_wall_time_us":70360,"replication_time_us":193836,"thread_start_us":263274,"threads_started":2}]]}
I20260709 12:13:40.489902  5753 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 4: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:40.490069  5752 raft_consensus.cc:2368] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4.
I20260709 12:13:40.490978  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.495606  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:40.495745  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 197897us
I20260709 12:13:40.497071  6291 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:40.499043  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:40.499763  5604 raft_consensus.cc:2368] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5.
I20260709 12:13:40.501708  5753 raft_consensus.cc:2393] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.505438  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.506928  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:40.507867  5749 raft_consensus.cc:2376] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 3. Re-sending same reply.
I20260709 12:13:40.511821  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:40.484691  7353 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:40.517038  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.517779  5601 raft_consensus.cc:2393] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 2: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:40.513022  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.520136  5716 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.521726  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.522468  5603 raft_consensus.cc:2368] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3.
I20260709 12:13:40.515220  5642 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.516088  5567 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.528388  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.506527  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.530429  5749 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:13:40.531033  5749 pending_rounds.cc:85] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 2
I20260709 12:13:40.531128  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.510351  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:40.538457  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:40.541402  5603 raft_consensus.cc:2368] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5.
I20260709 12:13:40.533198  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.545895  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.547663  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.517901  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.545250  5497 catalog_manager.cc:5697] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.470927  7393 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.550732  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.553179  5752 raft_consensus.cc:2410] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:13:40.510396  7306 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:13:40.533375  7221 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:40.533187  7398 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:40.556631  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.539819  7359 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:40.533248  7225 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.527786  7402 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.558506  5671 raft_consensus.cc:1240] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:40.563838  5567 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:40.547900  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.531273  5749 pending_rounds.cc:107] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:13:40.550103  5672 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.565577  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:40.548071  7394 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.548316  7267 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.581079  7361 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:40.581331  7238 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:40.581650  7361 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:40.582597  7399 log.cc:927] Time spent T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:13:40.583835  7361 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:40.584498  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:40.586644  7405 log.cc:927] Time spent T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:13:40.590728  7392 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:40.574074  5599 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:40.475958  7360 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:40.592401  7406 log.cc:927] Time spent T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
I20260709 12:13:40.592598  7360 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.594056  5744 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:40.594980  5599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:46698
I20260709 12:13:40.595618  5599 raft_consensus.cc:606] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:40.596053  5747 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:40.564268  5603 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:40.600656  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 80587.4us
I20260709 12:13:40.517060  7319 consensus_queue.cc:1059] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:13:40.560670  5497 catalog_manager.cc:5697] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 3, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.602752  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:40.579490  5567 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.882s (SENT) [suppressed 70 similar messages]
I20260709 12:13:40.603833  5497 catalog_manager.cc:5697] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 2 to 4, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.565322  5604 raft_consensus.cc:2393] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:40.531329  7356 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:13:40.578336  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:40.580150  5749 raft_consensus.cc:2917] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:13:40.601450  5716 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.563380  7390 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.563803  7398 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.613055  7398 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.615846  5600 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:40.616259  7319 raft_consensus.cc:3055] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.616654  7319 raft_consensus.cc:740] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:40.616945  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:40.617691  5600 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:40.617518  7319 consensus_queue.cc:260] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.618142  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:40.618458  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:40.618749  5595 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.619266  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:40.619766  5602 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.621590  7126 raft_consensus.cc:3055] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.621985  7126 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:40.622732  7126 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.623821  7126 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.626250  7321 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:40.626668  7407 log.cc:927] Time spent T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:13:40.627772  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.628497  5597 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.629645  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:40.630105  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.630857  5745 raft_consensus.cc:2393] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:40.631861  5745 raft_consensus.cc:1240] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.606225  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.632977  5745 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.633415  6291 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:40.634817  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.635563  5752 raft_consensus.cc:2393] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.636474  7402 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.636883  7402 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:40.637043  5746 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.569517  7359 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.608088  7382 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:13:40.638048  7359 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:40.568071  7221 raft_consensus.cc:697] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:40.612807  5747 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.638633  7390 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.605949  7394 raft_consensus.cc:697] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:40.639142  7390 raft_consensus.cc:697] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:40.640744  7221 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.642597  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:40.644609  6320 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.645031  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:40.646083  5601 raft_consensus.cc:2393] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:40.551052  7357 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.565547  7353 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.611861  5749 raft_consensus.cc:2889] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:40.612185  7115 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.602017  5598 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:40.610695  5497 catalog_manager.cc:5697] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 2 to 3, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.653308  5602 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:40.654273  5753 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:40.639976  7394 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.656422  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:13:40.657311  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 53272us
I20260709 12:13:40.657815  5674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:40.607486  7393 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.689101  6324 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:40.692018  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:40.660522  5497 catalog_manager.cc:5697] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.714951  7349 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.717258  5596 raft_consensus.cc:2368] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
I20260709 12:13:40.648795  7319 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.646317  7402 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:40.720243  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 72712.7us
I20260709 12:13:40.726822  5603 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:13:40.731590  7412 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.732307  6323 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:40.717186  7353 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:40.733633  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 132259us
I20260709 12:13:40.734535  5497 catalog_manager.cc:5697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 2 to 4, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.745857  5600 raft_consensus.cc:2410] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:13:40.747440  5716 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.748149  5602 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.717630  5674 raft_consensus.cc:606] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:40.753901  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:40.756374  5497 catalog_manager.cc:5697] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 2 to 3, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.758697  6327 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:40.762884  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:40.763166  5716 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.763556  5673 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:40.714951  7359 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:40.774937  7409 log.cc:927] Time spent T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:13:40.775260  5598 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:13:40.776015  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 46087us
I20260709 12:13:40.776923  5642 leader_election.cc:400] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5.
I20260709 12:13:40.761510  5497 catalog_manager.cc:5697] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 2 to 4, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.777052  5716 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.777024  5569 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:40.782965  5716 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.782889  5497 catalog_manager.cc:5697] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 3, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.785630  5716 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.785102  5497 catalog_manager.cc:5697] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 2 to 4, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.786088  5603 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:40.774014  7227 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:13:40.795315  5750 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:13:40.788205  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.786788  7306 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.789711  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:40.791165  5642 leader_election.cc:400] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3.
I20260709 12:13:40.770880  5595 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:40.791541  7221 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.787789  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:40.776087  7305 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.798619  6291 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.771256  7243 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:40.640043  7390 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:40.803229  6327 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.784507  7321 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.798498  7356 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.811833  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.798161  5672 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:40.813928  5675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:40.820830  5675 raft_consensus.cc:606] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:40.821281  5642 leader_election.cc:400] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5.
I20260709 12:13:40.822371  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:40.802688  7221 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:40.835476  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 58521.4us
I20260709 12:13:40.837699  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:40.840975  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 55424.8us
I20260709 12:13:40.841046  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:40.844537  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:13:40.850247  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.845490  5569 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:40.825287  7233 raft_consensus.cc:2764] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:13:40.826601  7063 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:40.826519  7221 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.813721  7349 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.826005  6326 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 3 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:40.857554  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:40.861838  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.862287  5753 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:40.857995  5750 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.857074  5716 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.826901  7267 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.861426  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:40.864785  5749 raft_consensus.cc:2393] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 2: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:40.867128  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:40.868557  5716 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:40.850629  6321 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:40.872896  5749 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:40.826758  7354 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:13:40.855762  7360 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:40.882954  5716 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:40.931283  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 48422.9us
I20260709 12:13:40.931986  5716 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:40.909749  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.932952  5603 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:40.861094  7063 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:40.854449  7113 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:13:40.866487  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:40.931737  7404 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:13:40.873911  7412 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.850148  7365 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
W20260709 12:13:40.953699  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 67069.9us
I20260709 12:13:40.949195  6328 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:40.930473  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:40.942117  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 79145.6us
I20260709 12:13:40.860767  7341 consensus_queue.cc:1059] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:13:40.951179  5716 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
W20260709 12:13:40.956724  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 101786us
I20260709 12:13:40.932018  7357 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:40.940928  7063 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.954663  6291 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:40.944265  7354 consensus_queue.cc:1243] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:40.935578  7227 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.941390  7225 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.878533  7283 consensus_queue.cc:1059] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:13:40.972877  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:40.971696  7306 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.981351  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:40.957306  6322 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.954723  7360 raft_consensus.cc:697] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:41.003391  7360 consensus_queue.cc:237] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:40.984869  7269 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.006361  7269 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:41.006776  7269 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.007891  7398 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:41.010704  7417 log.cc:927] Time spent T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:13:40.979074  6291 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:40.974030  7359 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:40.991719  5674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:41.017167  5674 raft_consensus.cc:606] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:41.017509  5674 raft_consensus.cc:614] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:40.994853  5716 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:41.001698  7414 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:13:41.015407  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:41.025419  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 49822.1us
I20260709 12:13:41.026882  6327 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:41.027930  7115 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.028631  7115 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:40.985677  7383 consensus_queue.cc:1059] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:13:41.032024  5642 leader_election.cc:400] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
W20260709 12:13:40.711444  7241 consensus_queue.cc:1175] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c02ed29558db481589fd3db23e43a07f" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:41.036047  7398 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:41.012609  7366 raft_consensus.cc:3055] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:41.037529  7383 raft_consensus.cc:3055] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:13:41.040699  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 45950.7us
I20260709 12:13:41.035406  7341 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.039340  5674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
W20260709 12:13:41.056509  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.052481  7383 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:41.024899  7365 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.064080  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:41.035349  7422 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.067870  5596 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:13:41.068068  5601 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:41.030548  7382 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.087234  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:41.052760  7412 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.093089  5603 raft_consensus.cc:1275] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:41.095466  5567 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:41.054219  7366 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:41.105816  5567 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:13:41.052767  7344 consensus_queue.cc:1175] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a54957145d9647cb89f46531d107120c" responder_term: 5 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: [4.6-4.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:41.033638  7354 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 12:13:41.110796  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 129605us
I20260709 12:13:41.107719  7422 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:41.120757  7422 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:41.124532  7126 consensus_meta.cc:287] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.000s
I20260709 12:13:41.124384  7269 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.126106  7412 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:13:41.126569  7420 log.cc:927] Time spent T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:13:41.109541  7398 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.130470  7402 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.132524  7402 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:41.069147  7243 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:13:41.133152  7221 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:41.139636  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 104342us
I20260709 12:13:41.140650  5567 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:41.066645  7359 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:13:41.144398  5677 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:41.073148  7227 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:13:41.107928  7357 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.154222  5567 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:41.155635  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:41.134961  7341 raft_consensus.cc:697] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:41.177858  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:41.177946  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 157529us
I20260709 12:13:41.181854  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:41.153988  7398 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:41.181003  5570 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:41.186457  6325 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:41.207011  5567 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:41.148981  7365 consensus_queue.cc:1059] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:13:41.158460  7371 consensus_queue.cc:1059] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:13:41.183456  7346 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:41.183208  5599 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:13:41.221083  5599 pending_rounds.cc:85] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 5
I20260709 12:13:41.221356  5599 pending_rounds.cc:107] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 3.6
W20260709 12:13:41.221465  7427 log.cc:927] Time spent T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:13:41.160806  7402 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:13:41.224128  7394 raft_consensus.cc:3055] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.224506  7394 raft_consensus.cc:740] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:13:41.226948  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.227483  7267 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.228012  7433 raft_consensus.cc:3055] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:41.217800  7238 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.191645  7357 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:41.210969  7126 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:13:41.229900  5599 raft_consensus.cc:2889] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:41.217141  7341 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:41.231814  7433 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:41.220181  7437 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.148437  7383 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:41.236267  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 52133.3us
I20260709 12:13:41.187984  7233 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:13:41.211815  7361 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:13:41.249567  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:41.250603  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 63775.2us
I20260709 12:13:41.251833  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:41.252863  5746 raft_consensus.cc:1240] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:13:41.255906  5750 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:41.256696  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:41.257813  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:41.254180  5748 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:41.258805  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:41.205538  7063 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:41.268743  7115 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.269013  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:41.269588  7115 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.273874  7115 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:41.252637  7269 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:41.225279  7394 consensus_queue.cc:260] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.275142  7394 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.275394  5675 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:41.276635  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:41.277331  5748 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:41.278154  6291 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:41.266808  7306 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.283567  7306 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:41.178874  7366 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.284662  7366 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:41.284888  7063 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:41.285665  5747 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:13:41.286047  5747 pending_rounds.cc:85] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 4
I20260709 12:13:41.286278  5747 pending_rounds.cc:107] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:13:41.286451  7346 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.286957  7346 raft_consensus.cc:697] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:41.286511  5747 raft_consensus.cc:2889] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:41.289811  5671 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:41.287853  5642 leader_election.cc:400] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4.
I20260709 12:13:41.286463  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:41.291272  5642 leader_election.cc:403] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:41.291749  5746 raft_consensus.cc:2410] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:13:41.279220  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:41.292924  5748 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:41.236582  7357 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:41.296779  5750 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:41.293450  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:41.301343  5677 raft_consensus.cc:2410] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:41.300406  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:41.287139  7221 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:41.291003  5744 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:41.305090  7357 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.305651  6322 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:41.306540  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:41.307318  6319 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.307971  6323 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:41.309368  5750 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.290859  7383 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.301194  5745 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:13:41.327028  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 120079us
I20260709 12:13:41.328392  5642 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:41.340252  5567 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:41.330682  7440 consensus_queue.cc:1059] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:41.327759  5716 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:41.276782  7283 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:13:41.322763  7063 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.232745  7433 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.299667  7269 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:13:41.329208  7456 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.348747  5596 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:41.351253  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:41.352562  5567 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:41.326524  7225 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:41.287814  7346 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:41.389411  7450 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:13:41.397612  7412 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:41.435052  7412 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:41.436609  7412 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:41.359562  7437 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.437554  5603 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:13:41.398495  7402 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.442322  7402 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.366400  7227 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:13:41.350698  7321 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 12:13:41.377167  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:41.447670  5602 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:41.345379  7126 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:41.468731  5750 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
W20260709 12:13:41.493777  7439 log.cc:927] Time spent T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:13:41.498556  7449 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.487325  7267 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.461305  7443 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.527558  7459 raft_consensus.cc:3055] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:41.528031  7459 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:41.528832  7459 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:41.530643  7459 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:41.534454  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:13:41.535061  5595 consensus_meta.cc:287] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.001s
I20260709 12:13:41.535441  5595 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:41.523739  7267 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.540164  7456 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4.
W20260709 12:13:41.541568  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 190388us
I20260709 12:13:41.543092  5642 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:41.543418  5716 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:41.544210  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:41.544466  5716 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:41.545547  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:41.545823  5595 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:13:41.545699  7412 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:41.537842  7353 consensus_meta.cc:287] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.003s
I20260709 12:13:41.560372  5751 raft_consensus.cc:2368] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5.
W20260709 12:13:41.558486  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 205996us
I20260709 12:13:41.561420  5567 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:41.553725  5595 pending_rounds.cc:85] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 2
I20260709 12:13:41.547550  7356 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.552959  7283 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:41.548961  7450 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.552801  7063 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.556948  7126 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:41.582077  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:41.585960  5675 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:41.578135  5595 pending_rounds.cc:107] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:13:41.568665  7371 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:41.588750  6293 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:41.547286  7440 consensus_queue.cc:1175] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b3083333af3348e4938f905ca4c4819f" responder_term: 5 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:41.580161  7365 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:41.579811  7267 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:41.582523  7311 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.585364  7126 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.588341  5595 raft_consensus.cc:2917] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:13:41.609238  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:41.595980  7390 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.597838  7349 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:41.598132  7423 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:41.616457  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.595155  7357 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:41.604693  7449 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.605700  7126 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:41.582535  7356 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.622651  7432 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:13:41.623535  7453 consensus_queue.cc:1059] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 12:13:41.625149  7460 log.cc:927] Time spent T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:13:41.625521  7461 consensus_queue.cc:1059] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:13:41.596375  7366 consensus_queue.cc:1059] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:13:41.587436  7450 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:41.615367  5595 raft_consensus.cc:2889] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:41.598452  7456 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:13:41.639250  7423 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:41.641927  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.642482  7306 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:41.645103  6291 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:41.645702  7269 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:13:41.649273  7437 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.616348  7390 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.650519  7433 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.654603  5602 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:41.666337  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:41.675442  5675 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:13:41.678819  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.679975  7444 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:13:41.683866  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.674616  7390 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.674744  7443 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.704039  5674 raft_consensus.cc:606] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:41.704522  5674 raft_consensus.cc:614] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:41.706732  5645 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:41.688463  7349 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:41.716464  5751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 1780) took 1243 ms (client timeout 1561 ms). Trace:
W20260709 12:13:41.716952  5751 rpcz_store.cc:269] 0709 12:13:40.473489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.497884 (+ 24395us) service_pool.cc:224] Handling call
0709 12:13:41.716216 (+1218332us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400217fd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:41.716395 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315279616}
W20260709 12:13:41.722046  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.729238  5753 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:41.677256  7423 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:41.682348  7453 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:13:41.688036  7437 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:13:41.711828  7443 raft_consensus.cc:697] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:41.734366  7354 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.738503  7344 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.743211  6323 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:41.742753  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:41.757417  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:41.759294  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:41.767987  7238 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:41.756944  7450 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:41.797740  5677 raft_consensus.cc:2393] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:41.731181  7349 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.796186  7354 raft_consensus.cc:697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:41.809705  7450 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:13:41.798329  7344 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.855692  7306 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.840889  7444 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:41.875792  5644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.031s
W20260709 12:13:41.876273  5644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.000s	sys 0.031s
I20260709 12:13:41.845407  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:41.929893  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:41.997210  5677 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:41.973663  5678 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:42.037598  5679 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:42.042089  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:41.933261  7461 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.918788  7319 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.959977  7356 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:41.876649  7306 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:42.062026  7346 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.017s	sys 0.034s
W20260709 12:13:42.084733  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 523347us
W20260709 12:13:42.039762  7321 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.006s	sys 0.014s
I20260709 12:13:41.960167  5595 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:41.854625  7443 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:41.907459  7444 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.066089  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.094996  5567 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:42.001410  7126 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:42.085459  7346 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.018s	sys 0.034s
W20260709 12:13:42.097713  7321 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.006s	sys 0.017s
I20260709 12:13:41.932988  7227 consensus_queue.cc:1059] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 12:13:42.076285  7423 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:42.112376  7365 consensus_meta.cc:287] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.513s	user 0.002s	sys 0.007s
I20260709 12:13:42.084131  7356 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:42.121476  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.111843  7344 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:42.084391  7319 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.125219  7357 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:42.169394  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 74526.3us
I20260709 12:13:42.119575  5672 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:42.174844  7356 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:42.170776  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 56328.9us
I20260709 12:13:42.084463  7461 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.171689  5567 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:42.167387  5744 raft_consensus.cc:1240] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.185886  5567 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:42.073186  7354 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.167613  7365 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:42.199052  5567 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:42.174139  7398 raft_consensus.cc:2764] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:13:42.177075  5745 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:42.172187  7462 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:13:42.204882  7475 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.197134  7221 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.228726  5567 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:42.193807  7349 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:42.231259  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:42.176527  7357 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.235415  5642 leader_election.cc:400] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5.
I20260709 12:13:42.235725  5642 leader_election.cc:403] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:13:42.239849  7306 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:42.240434  7474 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:13:42.242144  7469 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:13:42.243495  7435 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5.
W20260709 12:13:42.244063  7471 log.cc:927] Time spent T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:13:42.230445  7440 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.246409  7440 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.248478  7440 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:42.232995  7445 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:42.249074  7356 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:42.249451  7349 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.249854  7349 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:42.252395  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 380) took 1015 ms. Trace:
I20260709 12:13:42.229171  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:42.257654  5604 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:42.252794  6324 rpcz_store.cc:276] 0709 12:13:41.236924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.239955 (+  3031us) service_pool.cc:224] Handling call
0709 12:13:41.310013 (+ 70058us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:41.450752 (+140739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.460818 (+ 10066us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.461372 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.751458 (+290086us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:41.751493 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.751557 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.252192 (+500635us) raft_consensus.cc:1685] finished
0709 12:13:42.252214 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.252337 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8903,"raft.queue_time_us":42235,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":63432,"thread_start_us":289708,"threads_started":1,"wal-append.queue_time_us":577471}
I20260709 12:13:42.242280  7366 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:42.270995  5604 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:42.272676  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 205) took 1083 ms. Trace:
I20260709 12:13:42.250224  7349 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.273093  5753 rpcz_store.cc:276] 0709 12:13:41.189263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.189413 (+   150us) service_pool.cc:224] Handling call
0709 12:13:41.716365 (+526952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:41.729703 (+ 13338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.272481 (+542778us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b5400217fd0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:42.272608 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1211192576}
I20260709 12:13:42.280443  5596 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:42.268548  7467 log.cc:927] Time spent T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:13:42.262104  7483 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:42.249256  7445 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.313558  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:42.315670  5753 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:42.316054  5752 raft_consensus.cc:1240] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.318933  5752 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:42.319170  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 381) took 1026 ms. Trace:
I20260709 12:13:42.321352  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:42.322064  6327 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:42.319576  6325 rpcz_store.cc:276] 0709 12:13:41.292397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.292547 (+   150us) service_pool.cc:224] Handling call
0709 12:13:41.292822 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:41.293364 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.293395 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.311681 (+ 18286us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.746530 (+434849us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:41.746582 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.746851 (+   269us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.318986 (+572135us) raft_consensus.cc:1685] finished
0709 12:13:42.319002 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.319117 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4495,"raft.queue_time_us":309,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4946,"thread_start_us":387727,"threads_started":1,"wal-append.queue_time_us":718719}
I20260709 12:13:42.297380  7126 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:42.297384  7356 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:42.302552  7483 raft_consensus.cc:697] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:42.304407  7361 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:42.356072  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40398 (request call id 18) took 1298 ms. Trace:
I20260709 12:13:42.356549  5674 rpcz_store.cc:276] 0709 12:13:41.039082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.039207 (+   125us) service_pool.cc:224] Handling call
0709 12:13:42.336810 (+1297603us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b5400447fd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda45853 00007f4502a1360a 00007f44fbf997d4 00007f44fbf99762 00007f44fbf99691 00007f44fbf9960c 00007f44fbf988c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:42.336953 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494998784}
I20260709 12:13:42.325480  7319 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:42.366238  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 137606us
I20260709 12:13:42.368433  5752 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:42.370100  7473 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 12:13:42.378041  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 142736us
I20260709 12:13:42.362068  7461 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:42.355846  7356 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.392328  5674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:42.395582  5674 raft_consensus.cc:606] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:42.395955  5674 raft_consensus.cc:614] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:42.380383  7482 log.cc:927] Time spent T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 12:13:42.398737  7476 log.cc:927] Time spent T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:13:42.396327  5567 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:42.404337  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.404919  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.405264  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.405710  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:42.405349  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.407438  5678 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:42.408193  5671 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:42.411271  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.412578  5567 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:42.357748  7361 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.371325  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1648) took 1023 ms. Trace:
I20260709 12:13:42.389096  5744 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:42.434806  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:42.435015  5567 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:42.436563  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:13:42.429319  7479 log.cc:927] Time spent T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:13:42.414906  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:42.434842  7488 log.cc:927] Time spent T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:13:42.424239  7440 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.431998  7360 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.431943  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.461908  7498 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:42.462276  7497 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.433620  7221 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.462489  7498 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.452760  7306 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:42.464040  7306 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.465432  7440 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.437863  7357 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:42.467643  7440 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:42.453855  7486 log.cc:927] Time spent T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:13:42.454442  7491 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:42.469522  7433 consensus_meta.cc:287] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.791s	user 0.004s	sys 0.005s
I20260709 12:13:42.456859  7344 raft_consensus.cc:1064] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
W20260709 12:13:42.485134  7344 raft_consensus.cc:1068] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:42.472390  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1655) took 1033 ms. Trace:
I20260709 12:13:42.430403  7267 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:42.485782  5601 rpcz_store.cc:276] 0709 12:13:41.439430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.440260 (+   830us) service_pool.cc:224] Handling call
0709 12:13:41.440561 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:41.744896 (+304335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.744927 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.752803 (+  7876us) log.cc:844] Serialized 26 byte log entry
0709 12:13:42.170672 (+417869us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:42.170707 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.170778 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.399179 (+228401us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4800003fd8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4502974aa1 00007f450296bb37 00007f450296b9ca 00007f4502a6326f 00007f4502a62f37 00007f4502a7755c 00007f4502a77508 00007f4502a77488 00007f4502a77443 00007f4502a766ec 00007f45019a0a96
0709 12:13:42.472064 (+ 72885us) raft_consensus.cc:1685] finished
0709 12:13:42.472087 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.472327 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143454,"raft.queue_time_us":153193,"raft.run_cpu_time_us":7796,"raft.run_wall_time_us":803067,"spinlock_wait_cycles":43690752,"thread_start_us":522877,"threads_started":2,"wal-append.queue_time_us":517409}
I20260709 12:13:42.428687  5599 rpcz_store.cc:276] 0709 12:13:41.348349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.351963 (+  3614us) service_pool.cc:224] Handling call
0709 12:13:41.492643 (+140680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:41.581201 (+ 88558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.581243 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.586070 (+  4827us) log.cc:844] Serialized 26 byte log entry
0709 12:13:42.064870 (+478800us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:42.321348 (+256478us) log.cc:844] Serialized 14 byte log entry
0709 12:13:42.357364 (+ 36016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.363551 (+  6187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.365088 (+  1537us) raft_consensus.cc:1685] finished
0709 12:13:42.366794 (+  1706us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.369076 (+  2282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79959,"prepare.queue_time_us":308271,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":5189,"raft.queue_time_us":74601,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":17163,"thread_start_us":631980,"threads_started":2,"wal-append.queue_time_us":635099}
I20260709 12:13:42.488500  7267 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:42.489713  7470 log.cc:927] Time spent T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 12:13:42.472283  6323 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
W20260709 12:13:42.489568  7390 consensus_meta.cc:287] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.003s
I20260709 12:13:42.499682  7390 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.491060  7267 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:42.496582  5719 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:42.494275  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 103815us
I20260709 12:13:42.501173  7227 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.501709  7227 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.503788  7227 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:42.504767  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.505411  5675 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:42.506274  7311 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.506592  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.506850  7311 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:42.506330  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.508486  5671 raft_consensus.cc:2393] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:42.508944  7311 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:42.456162  7063 consensus_meta.cc:287] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.868s	user 0.014s	sys 0.002s
W20260709 12:13:42.476884  5676 consensus_meta.cc:287] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.000s
I20260709 12:13:42.478783  7356 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:42.479117  7472 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:13:42.479839  7445 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:42.438301  7483 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.481237  7395 raft_consensus.cc:3055] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:42.509472  7311 consensus_queue.cc:1059] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:13:42.484318  7498 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:42.500038  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:42.513345  6293 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:42.443758  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:42.497026  7359 raft_consensus.cc:3055] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:42.531189  6327 raft_consensus.cc:2393] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 2: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:42.496037  7402 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:42.514070  7063 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.517446  7267 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:13:42.523469  7423 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:42.523941  6322 raft_consensus.cc:2368] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4.
I20260709 12:13:42.515225  7344 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.522223  7440 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:42.522671  5718 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:42.482944  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1656) took 1035 ms. Trace:
I20260709 12:13:42.524608  7449 raft_consensus.cc:3055] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:42.532312  7174 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.524796  7319 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.536478  5677 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:42.521804  5676 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:42.527979  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:42.528448  7475 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.528625  7306 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:42.522924  5719 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:42.529502  6320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 361) took 1173 ms. Trace:
I20260709 12:13:42.516664  7349 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.527086  7395 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:13:42.536500  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 92969us
I20260709 12:13:42.535583  5603 rpcz_store.cc:276] 0709 12:13:41.447616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.447743 (+   127us) service_pool.cc:224] Handling call
0709 12:13:41.448091 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:41.559131 (+111040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.559179 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.559618 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:13:42.083243 (+523625us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:42.303764 (+220521us) log.cc:844] Serialized 14 byte log entry
0709 12:13:42.304213 (+   449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.304353 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.471660 (+167307us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b4800003fd8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4502974aa1 00007f450296bb37 00007f450296b9ca 00007f4502a6326f 00007f4502a62f37 00007f4502a7755c 00007f4502a77508 00007f4502a77488 00007f4502a77443 00007f4502a766ec 00007f45019a0a96
0709 12:13:42.482629 (+ 10969us) raft_consensus.cc:1685] finished
0709 12:13:42.482754 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.482884 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156252,"prepare.queue_time_us":306912,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":132493,"raft.run_cpu_time_us":1614,"raft.run_wall_time_us":161331,"spinlock_wait_cycles":12189056,"thread_start_us":672011,"threads_started":2,"wal-append.queue_time_us":658915}
I20260709 12:13:42.524544  7227 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:13:42.533903  7457 raft_consensus.cc:3055] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:42.532518  7359 raft_consensus.cc:740] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:42.533171  7501 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:42.564380  7501 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:42.564862  7501 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:42.564802  7465 log.cc:927] Time spent T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.646s	user 0.006s	sys 0.000s
I20260709 12:13:42.566948  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:42.567340  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 207) took 1269 ms. Trace:
I20260709 12:13:42.569818  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:42.570829  5674 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.569474  5748 rpcz_store.cc:276] 0709 12:13:41.297649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.297802 (+   153us) service_pool.cc:224] Handling call
0709 12:13:41.298066 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:41.298376 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.298403 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.324025 (+ 25622us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.690673 (+366648us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:41.690714 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.690797 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.475312 (+784515us) spinlock_profiling.cc:243] Waited 82.2 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:13:42.564499 (+ 89187us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b2400257348. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa7e49c4 00007f44fa7e2acb 00007f44fa99ddc9 00007f44fa99da55 00007f44fa99d09d 00007f44fd5cf10e 00007f44fd5e688c 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221
0709 12:13:42.567119 (+  2620us) raft_consensus.cc:1685] finished
0709 12:13:42.567141 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.567283 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5051,"raft.queue_time_us":651,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":4098,"spinlock_wait_cycles":265602176,"thread_start_us":340607,"threads_started":1,"wal-append.queue_time_us":507529}
I20260709 12:13:42.578420  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.564278  7359 consensus_queue.cc:260] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.580979  7359 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:42.583678  5747 raft_consensus.cc:1240] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:42.544816  5718 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:42.584791  5595 raft_consensus.cc:1240] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:42.585429  5570 leader_election.cc:400] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4.
I20260709 12:13:42.585742  5570 leader_election.cc:403] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:42.586683  7174 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.587666  7306 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:42.588272  7423 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.588732  7423 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.543854  7440 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.590811  7423 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:42.550804  6320 rpcz_store.cc:276] 0709 12:13:41.355876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.358519 (+  2643us) service_pool.cc:224] Handling call
0709 12:13:41.463727 (+105208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:41.523465 (+ 59738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.529797 (+  6332us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.530481 (+   684us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.818280 (+287799us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:41.836910 (+ 18630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.842895 (+  5985us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.478490 (+635595us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:13:42.529121 (+ 50631us) raft_consensus.cc:1685] finished
0709 12:13:42.529153 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.529407 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2725,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":1145,"spinlock_wait_cycles":10661760,"thread_start_us":272389,"threads_started":1,"wal-append.queue_time_us":611076}
I20260709 12:13:42.542999  7319 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.591840  7319 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.554790  5567 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:42.558151  7233 raft_consensus.cc:3055] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:42.594730  7233 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:42.557955  7395 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.595546  7233 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.545943  7126 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:42.558804  7457 raft_consensus.cc:740] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:42.536911  7344 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.596537  7233 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.597785  7361 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:42.598233  7344 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:42.596479  7126 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.589148  7227 raft_consensus.cc:1064] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:42.537403  7449 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:42.556769  7491 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:42.592819  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:42.563524  7390 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:42.536156  7221 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:42.601855  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 47115.9us
I20260709 12:13:42.590755  7440 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:42.600787  7126 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:42.598922  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:42.611639  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:42.614610  5674 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:42.596257  7395 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.682548  7174 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4.
I20260709 12:13:42.684204  7440 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.684692  7440 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.598836  7349 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:42.686740  7440 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:42.687469  7449 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.688419  7449 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.688726  6293 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:42.617022  7491 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.689879  7269 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:42.690116  7491 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.690375  7269 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.690955  7390 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:42.691452  7390 raft_consensus.cc:697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:42.692296  7390 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.677057  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:42.679546  7311 consensus_queue.cc:1059] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:42.697947  7349 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:42.697897  7457 consensus_queue.cc:260] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.698405  7311 raft_consensus.cc:3055] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:42.698065  7344 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.698913  7311 raft_consensus.cc:740] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:42.699054  7344 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.699671  7457 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.699756  7311 consensus_queue.cc:260] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:42.617748  7227 raft_consensus.cc:1068] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:42.701066  7311 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:42.701416  7227 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:42.678192  7361 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 12:13:42.706373  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 94806us
I20260709 12:13:42.709538  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.710451  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.711184  5567 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:42.615588  7437 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.709609  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.714772  5674 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:42.715869  5567 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:42.719230  7238 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:42.719506  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.720171  5672 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:42.721388  7349 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.722218  7344 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:42.698248  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:42.718389  7459 raft_consensus.cc:3055] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.718291  7306 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.590307  7501 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:42.743870  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:42.748239  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.749645  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:42.738997  7356 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.736820  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:42.718618  7361 consensus_queue.cc:1059] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:13:42.732947  7221 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:13:42.745483  7306 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.744889  7459 raft_consensus.cc:740] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:42.745110  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.744786  6323 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:42.780139  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.782735  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.783387  5601 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:42.784385  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.752893  5744 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:42.786939  5600 raft_consensus.cc:2393] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:42.788552  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.791476  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:42.793783  7440 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.794183  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:42.794337  7440 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.794791  5598 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:42.795192  7490 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:42.795667  7490 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.797894  5751 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:42.777799  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.764567  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:42.807044  5718 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:42.757218  7356 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.808738  5719 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:42.805307  7321 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:13:42.809648  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.812794  5600 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:42.760458  6320 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:42.810971  7306 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:42.811245  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.830971  5602 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:42.814728  5718 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:42.833717  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.838423  5602 raft_consensus.cc:1240] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:42.833279  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.834465  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:42.811671  7440 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:42.860808  7432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.018s	sys 0.018s
I20260709 12:13:42.868712  5567 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:42.879520  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.860536  7306 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.875375  7344 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:42.884611  7344 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.884979  7344 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.861500  7349 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.870015  5604 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
W20260709 12:13:42.874881  7506 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 12:13:42.874915  7432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.018s	sys 0.019s
I20260709 12:13:42.871002  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:42.891783  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 157836us
I20260709 12:13:42.892725  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:42.901923  5602 raft_consensus.cc:2376] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2. Re-sending same reply.
I20260709 12:13:42.879447  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.903303  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:42.893653  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 79000.6us
W20260709 12:13:42.894971  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 101595us
I20260709 12:13:42.904589  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:13:42.898216  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 89583.2us
I20260709 12:13:42.906064  5719 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:42.813275  7459 consensus_queue.cc:260] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:42.911623  5716 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:42.912658  5604 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:42.914541  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:42.910485  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.913559  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:42.918552  7513 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:13:42.919507  7444 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:42.900554  7440 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:42.924918  6291 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:42.926195  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:42.929529  5604 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:42.930996  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:42.937142  6291 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:42.900471  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:42.911130  7501 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:42.898973  7349 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:42.960634  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 56107.8us
I20260709 12:13:42.938719  7459 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.917512  5599 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:42.941692  7390 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:42.940876  7440 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.946210  7445 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.946107  7267 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:13:42.996778  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 82309.5us
I20260709 12:13:42.997357  5596 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:42.941527  7514 consensus_queue.cc:1059] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 12:13:42.993649  7510 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:13:42.971428  7321 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.964040  7501 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.994062  7520 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.003480  5595 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:43.000166  7440 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:43.031054  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 93986.4us
I20260709 12:13:43.038913  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:43.046926  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:43.013994  7174 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.025345  7321 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.059760  6327 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 3 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:43.004705  7525 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:43.032829  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:43.011062  7445 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:43.073602  7523 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:13:43.082419  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 176422us
I20260709 12:13:43.068882  7321 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.067472  7490 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:43.037818  7491 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.069113  7525 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:43.093426  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 83338us
I20260709 12:13:43.066963  7390 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:13:43.083173  6323 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.082779  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:43.101008  6324 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:43.106271  5569 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:43.112411  7361 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:43.117098  7361 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.117894  7238 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.118391  7238 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.119298  7361 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.114550  7483 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:43.120153  7483 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:43.120416  7238 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.120954  7483 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:43.125566  7464 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.218s	user 0.005s	sys 0.027s
I20260709 12:13:43.128942  6319 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:43.080610  7319 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.130052  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 242) took 1906 ms. Trace:
I20260709 12:13:43.130383  5753 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:43.132800  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 80126.8us
I20260709 12:13:43.130442  5673 rpcz_store.cc:276] 0709 12:13:41.223640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.223773 (+   133us) service_pool.cc:224] Handling call
0709 12:13:41.224140 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:41.276102 (+ 51962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.276141 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:41.304200 (+ 28059us) log.cc:844] Serialized 52 byte log entry
0709 12:13:41.624781 (+320581us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4800002dd8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4502974aa1 00007f450296bb37 00007f450296b9ca 00007f4502a6326f 00007f4502a62f37 00007f4502a7755c 00007f4502a77508 00007f4502a77488 00007f4502a77443 00007f4502a766ec 00007f45019a0a96
0709 12:13:41.756344 (+131563us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:41.756393 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.756467 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:43.124948 (+1368481us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:13:43.129821 (+  4873us) raft_consensus.cc:1685] finished
0709 12:13:43.129845 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.129970 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32861,"raft.queue_time_us":78996,"raft.run_cpu_time_us":10979,"raft.run_wall_time_us":314954,"spinlock_wait_cycles":311509632,"thread_start_us":339330,"threads_started":1,"wal-append.queue_time_us":494503}
I20260709 12:13:43.097993  7490 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.139499  5600 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:43.094043  7525 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.098613  7354 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.144673  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:43.146056  6327 raft_consensus.cc:2393] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:43.144029  5601 raft_consensus.cc:1240] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:43.147591  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.150414  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.151121  5676 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:43.152356  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.153672  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.154469  5675 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:43.155984  5672 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:43.157604  5671 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:43.153575  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:43.160358  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.130316  7491 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.143450  7490 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.142038  7524 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:43.143795  7361 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:43.167840  7349 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.166805  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:43.165952  7344 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.179803  6319 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
W20260709 12:13:43.180109  7515 log.cc:927] Time spent T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:13:43.160036  7238 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:13:43.181233  7344 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.181473  5747 raft_consensus.cc:2368] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4.
I20260709 12:13:43.160200  7354 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.175223  7233 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:13:43.199517  7354 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.199641  7321 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.201653  7321 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:43.173821  7490 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.175348  7445 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:43.216349  6323 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:43.202100  5676 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:43.183764  7390 consensus_queue.cc:1059] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:13:43.236032  7344 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.184468  7361 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.182758  7524 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.201721  7525 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.265100  7238 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:43.287463  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.288344  5750 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:43.289810  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.266687  7319 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.300699  5673 raft_consensus.cc:3055] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:43.302312  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:43.310690  5673 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:43.324774  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:43.327831  7531 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:43.331708  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 329364us
I20260709 12:13:43.332703  5716 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:43.338405  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:43.309605  7390 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:43.285674  7344 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:43.317682  5598 consensus_meta.cc:287] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.002s
I20260709 12:13:42.758378  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:43.342093  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:13:43.340307  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 185134us
I20260709 12:13:43.341251  6327 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.349414  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:43.338764  5673 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.354760  5569 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:43.299721  7238 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.336314  7267 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:43.345091  5598 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:43.386418  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:43.387116  6321 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:43.388540  7444 raft_consensus.cc:3055] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:43.388962  7444 raft_consensus.cc:740] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:43.389241  7534 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.389859  7444 consensus_queue.cc:260] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.390317  7395 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:43.360329  5569 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:43.339257  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.344852  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:43.394783  5716 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:43.411504  5677 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:43.388335  6326 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:43.407649  6327 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
W20260709 12:13:43.386492  7527 log.cc:927] Time spent T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:13:43.392941  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.377708  7475 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:43.343261  7518 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.408901  7174 consensus_queue.cc:1059] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:13:43.424002  5719 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:43.424799  6323 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:43.359918  7390 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.427309  5672 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:43.428818  7344 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:43.432040  7361 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.433840  7390 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:43.434001  7536 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:13:43.438097  7238 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.441642  7524 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:43.443418  7267 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.377980  7432 consensus_queue.cc:1059] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:13:43.416064  7319 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.415902  7221 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:13:43.458750  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:43.477227  5752 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:43.413030  7483 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:43.451511  7126 consensus_meta.cc:287] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.753s	user 0.009s	sys 0.000s
I20260709 12:13:43.416822  7321 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.480228  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:43.429497  7518 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:43.481899  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 192655us
I20260709 12:13:43.450560  7432 consensus_queue.cc:1243] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Peer c02ed29558db481589fd3db23e43a07f log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:13:43.455242  7475 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.606973  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.600020  5752 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:43.481521  7491 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:43.457968  7520 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:43.409519  7349 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:13:43.481294  7344 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:43.609460  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 210463us
I20260709 12:13:43.610246  7518 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.607366  7306 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.623487  7475 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:43.630136  6293 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:43.445713  7490 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:43.642858  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 244481us
I20260709 12:13:43.644073  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:43.623239  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:43.647979  6293 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:43.630831  7491 raft_consensus.cc:697] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:43.619093  7321 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.640659  7402 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:43.612326  7126 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:43.689916  6293 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:43.648154  7174 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.647943  7361 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.649219  7546 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.683663  7390 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:43.739662  7549 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.631450  7344 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.644158  7306 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:43.775615  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.779337  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:43.780021  6325 raft_consensus.cc:2376] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 3. Re-sending same reply.
I20260709 12:13:43.784783  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:43.792493  7535 raft_consensus.cc:1064] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
W20260709 12:13:43.793011  7535 raft_consensus.cc:1068] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:43.748246  7524 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:43.758582  7549 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.798609  7437 raft_consensus.cc:3055] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:43.738795  7402 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.812036  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:43.770176  7390 raft_consensus.cc:697] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:43.747618  7174 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.813863  6325 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:43.815667  5752 raft_consensus.cc:1240] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:43.821712  7554 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:13:43.823257  7344 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:43.809639  7491 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.825336  7269 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:43.824502  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:43.757786  7546 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.829334  7546 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:43.830407  5744 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:43.815786  7445 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:43.832674  7445 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.833642  6322 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:43.834738  7445 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:43.804620  7544 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:43.810002  7437 raft_consensus.cc:740] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:43.837309  5570 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:43.818514  7440 consensus_meta.cc:287] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.000s
I20260709 12:13:43.808830  7549 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.844269  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:43.824582  7321 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:43.846230  7437 consensus_queue.cc:260] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.847962  7540 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:43.836433  7359 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:43.809393  7524 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:43.853917  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.843394  7542 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.844024  7490 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.846423  7361 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.842319  7546 consensus_queue.cc:1059] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:13:43.857033  7354 consensus_queue.cc:1059] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:13:43.846509  7449 consensus_queue.cc:1059] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:13:43.857594  7359 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.846647  7432 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:13:43.844758  7440 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.852836  7395 consensus_queue.cc:1059] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:13:43.866580  7437 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.864637  7361 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:43.883011  7457 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.014s	sys 0.013s
I20260709 12:13:43.886804  7540 raft_consensus.cc:3055] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:43.882580  7361 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.861172  7542 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.895004  7440 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:43.875407  7390 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.898105  7306 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:43.898972  7174 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:43.903565  7542 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.908437  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:43.910177  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1167) took 1168 ms. Trace:
I20260709 12:13:43.928521  5753 rpcz_store.cc:276] 0709 12:13:42.742190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.743521 (+  1331us) service_pool.cc:224] Handling call
0709 12:13:42.743849 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:43.130836 (+386987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.909926 (+779090us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54002297d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:43.910102 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888550784}
I20260709 12:13:43.910979  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 189) took 1078 ms. Trace:
I20260709 12:13:43.929966  5600 rpcz_store.cc:276] 0709 12:13:42.832614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.834238 (+  1624us) service_pool.cc:224] Handling call
0709 12:13:43.910839 (+1076601us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54002ffb54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:43.910930 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578642688}
I20260709 12:13:43.910125  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:43.914103  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:43.915556  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:43.933881  5752 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:43.912357  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:13:43.888854  7457 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.014s	sys 0.013s
I20260709 12:13:43.924598  7558 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.936065  7524 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:43.925057  7504 log.cc:927] Time spent T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 1.268s	user 0.004s	sys 0.014s
I20260709 12:13:43.889673  7540 raft_consensus.cc:740] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:43.936405  7558 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.937109  7540 consensus_queue.cc:260] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.938341  7540 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.938774  7558 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:43.935738  7359 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:43.939967  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:43.940414  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:43.940745  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:43.941229  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:43.941578  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.941905  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:43.942291  5747 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:43.945397  7432 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:43.945854  6326 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 4: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:43.946504  7449 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.948570  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.948827  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.946456  5673 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.949186  5677 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:43.946998  7449 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.949344  5671 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:43.951372  5718 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:43.963503  5718 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:43.950647  7395 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.899112  7475 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:43.975415  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:43.980518  7568 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.980602  7475 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:43.981068  7568 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.982147  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:43.982788  6326 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:13:43.983217  7568 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:43.985350  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:43.986045  6319 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.972111  7319 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.990604  7319 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:43.991009  7319 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.971891  7524 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:43.993703  7524 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.994109  7524 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.945950  7432 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:43.997419  7432 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:43.999920  7551 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.195s	user 0.001s	sys 0.001s
I20260709 12:13:44.002589  7525 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:44.007704  6328 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:13:43.978657  7395 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.008612  7402 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:44.011195  7449 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:44.014562  5645 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:44.015035  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.015720  5671 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:44.016256  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:44.016399  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:44.016800  5678 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.019632  6291 leader_election.cc:400] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4.
I20260709 12:13:44.019958  6291 leader_election.cc:403] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:44.023313  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:44.023939  5671 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.009647  7395 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:43.979007  7567 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:44.032550  7567 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:44.034327  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.035183  7475 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:44.035704  7475 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.038467  7174 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.038945  7174 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.039192  7459 raft_consensus.cc:3055] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:44.039624  7459 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:44.040741  7174 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:44.014096  7356 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:44.031849  7565 log.cc:927] Time spent T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:13:44.050573  5718 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:44.022485  7432 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:44.042105  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.075173  5751 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:44.043848  5567 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:44.045558  5645 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:44.049381  5752 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:44.052362  5570 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:44.053644  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:44.071487  7557 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.189s	user 0.002s	sys 0.000s
I20260709 12:13:44.078542  6291 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
W20260709 12:13:44.091553  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 47802.2us
I20260709 12:13:44.037665  7444 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.097349  5671 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:44.097437  5678 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:44.034904  7567 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:44.043036  7475 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:44.102990  5567 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:44.045044  7552 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.104533  5567 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:44.102960  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 154213us
I20260709 12:13:44.106777  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.046159  7221 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:44.107959  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.111024  5678 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:44.111886  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:44.106410  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.074687  7432 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.087191  7445 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.114300  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.115525  5678 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:44.096110  7359 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:44.123474  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.074218  7382 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4.
I20260709 12:13:44.132120  5671 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:44.139178  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.098728  7349 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.103193  7395 raft_consensus.cc:2764] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:13:44.140100  5671 raft_consensus.cc:2410] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:44.129005  7432 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.104676  7553 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:44.102315  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:44.139200  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.103680  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.115025  7475 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:44.089347  7568 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:13:44.100558  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.122049  7532 consensus_queue.cc:1059] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:13:44.150108  5678 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:44.156545  5671 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:44.137614  7233 consensus_queue.cc:1059] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:13:44.138406  7359 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.112246  7238 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:13:44.164170  5718 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:44.109341  7443 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:13:44.109480  7174 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.121018  7221 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:44.163141  7483 consensus_meta.cc:287] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 12:13:44.176515  7579 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:44.177269  6319 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:44.178539  7361 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.164855  7349 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.158486  7553 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:44.166785  7518 consensus_meta.cc:287] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.522s	user 0.006s	sys 0.003s
I20260709 12:13:44.201232  7553 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.201390  7518 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.201675  7524 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.203780  7518 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:44.204507  5748 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:44.110257  7552 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.206101  7524 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:44.186663  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:44.207367  5718 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:44.187740  5716 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:44.208483  7525 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:44.208959  7525 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:44.209417  5716 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:44.209931  7490 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:44.210318  7490 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.210641  7490 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.210740  7344 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:44.210928  7353 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:44.211241  7344 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.206677  7552 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:44.212257  5718 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:44.211536  7353 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:44.211664  7344 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:44.214083  7353 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.209749  7525 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.216632  7356 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:44.217114  7356 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.213231  7521 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:44.218520  7521 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:44.217357  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 103796us
I20260709 12:13:44.213147  5718 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:44.218842  7521 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.220603  7356 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:44.220914  7518 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:44.206555  7349 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.228767  7344 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.230795  7233 raft_consensus.cc:3055] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:44.231875  7402 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:44.232064  7221 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:44.191589  7542 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:44.191311  7483 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.182163  7449 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:44.253899  7319 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.257426  7437 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:44.258025  7437 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.259857  7319 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:44.235803  7521 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.237567  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:44.238031  7395 raft_consensus.cc:1064] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:44.260360  7457 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:44.184612  7359 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.241490  7233 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:13:44.260740  7395 raft_consensus.cc:1068] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:44.252890  7483 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:44.261929  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.262444  7483 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.254822  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:44.255471  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:44.188614  6326 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:13:44.171175  7549 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.252400  7542 raft_consensus.cc:697] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:44.264994  5604 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.265036  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.274277  5597 raft_consensus.cc:2393] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 4: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:44.255789  7581 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:44.261168  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.274991  5600 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:44.189453  7475 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:44.264564  7483 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:44.191027  7311 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:44.264426  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:44.260067  7437 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:44.286566  5604 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:44.286617  5718 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:44.243970  7524 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:44.285348  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 180854us
I20260709 12:13:44.294320  6325 raft_consensus.cc:2368] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:44.273484  7390 raft_consensus.cc:2764] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:13:44.276575  7395 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:44.253659  7449 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.324525  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.328063  5600 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:44.325150  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.311667  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.329560  5604 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:44.287240  7490 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.329938  5597 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:44.306492  7534 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:44.335363  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.338464  5600 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:44.272250  7457 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.333626  5567 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:44.347761  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:44.327625  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 107834us
I20260709 12:13:44.324882  7580 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.353274  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.288654  7475 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.287552  7581 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:44.356045  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.370640  5601 raft_consensus.cc:2393] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:44.331112  7518 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.293526  7311 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.365321  5604 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:44.373623  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.374246  5604 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 1.
I20260709 12:13:44.308881  7524 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.375074  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.375762  5604 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 4: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:44.376971  5604 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:44.317088  7349 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:44.281513  7233 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.378916  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.381518  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.352149  7221 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:44.330263  7395 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.372659  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.347559  7238 consensus_queue.cc:1059] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:13:44.396133  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.390604  7311 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:44.391568  7549 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:44.391727  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.357434  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:44.393733  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:44.393697  7572 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 12:13:44.357242  7534 raft_consensus.cc:697] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:44.396766  5746 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:44.399165  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:44.407238  5601 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.400295  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:44.387621  5604 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:44.393114  7221 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:44.416033  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.377882  7518 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.403018  7233 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.363327  7542 consensus_queue.cc:237] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.401674  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.401574  7553 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.423370  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:44.376252  7580 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.406025  5595 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.421387  7344 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:44.447916  5601 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:44.427426  5604 raft_consensus.cc:2393] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 4: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:13:44.414794  7582 log.cc:927] Time spent T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:13:44.428828  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:44.452764  5596 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:44.414752  7221 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.438874  7457 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:44.438424  7534 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.440160  7395 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:44.442510  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.425940  7361 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:44.463650  5602 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:44.437354  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 69752.2us
I20260709 12:13:44.470834  6322 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:44.474295  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.477267  5749 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:44.475101  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.479050  5596 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:44.481371  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.482054  5749 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:13:44.446350  5747 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:44.487408  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.490502  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.491418  5749 raft_consensus.cc:2368] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
I20260709 12:13:44.503585  5746 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:13:44.453572  7432 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.510030  7432 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:44.511776  7432 consensus_queue.cc:1059] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:44.512918  7432 raft_consensus.cc:3055] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:44.513281  7432 raft_consensus.cc:740] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:44.517210  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:44.519688  7594 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:44.520416  7459 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.521485  7459 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:44.542829  7553 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:44.523325  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:44.546672  7580 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:44.555949  7540 consensus_meta.cc:287] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.002s
I20260709 12:13:44.524740  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.524899  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.529052  7546 raft_consensus.cc:3055] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:44.560591  7546 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:44.560876  7524 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:44.561679  7583 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:13:44.561481  7546 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.562742  7546 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.540956  7475 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:44.534619  5753 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:44.537484  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:44.505571  7449 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:44.515056  7586 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.538260  7518 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:44.538578  7581 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:44.541034  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:44.501253  7588 log.cc:927] Time spent T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:13:44.565320  5672 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.570664  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:44.579214  5671 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.585682  5674 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:44.579814  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.591084  5673 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:44.591328  5677 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:44.594431  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.595610  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.601365  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.608394  5677 raft_consensus.cc:2410] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:13:44.593163  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.608886  5569 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:44.605365  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.515249  7490 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:44.615093  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.615732  5596 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:44.616032  5604 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:44.578686  7549 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.585776  7524 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:13:44.623593  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.624301  5745 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:44.626704  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.627583  5744 raft_consensus.cc:2368] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4.
I20260709 12:13:44.631892  5672 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:44.636059  5719 leader_election.cc:400] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:44.642496  5719 leader_election.cc:403] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:44.643599  7524 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.640973  5674 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:13:44.645785  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.609862  7553 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.636583  5673 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:44.641671  5671 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:44.646994  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.612732  7457 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:44.617494  7475 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:44.650492  6293 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:44.657859  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:44.658977  5671 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:13:44.734793  5671 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:44.634691  7549 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:44.878047  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.879150  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.620075  7432 consensus_queue.cc:260] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:44.879976  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 146062us
W20260709 12:13:44.883950  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.880312  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:44.880460  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:44.876030  7596 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:13:44.731201  7581 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:44.821343  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 214117us
I20260709 12:13:44.888903  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:44.731982  7475 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:44.890021  5674 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:13:44.890153  5679 raft_consensus.cc:2368] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:44.849432  5598 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:13:44.730412  7553 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.859040  7344 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:44.875473  5595 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:44.894896  5671 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:44.885561  5569 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:44.752561  7444 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:44.903497  5674 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:13:44.904112  5674 pending_rounds.cc:85] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 5
I20260709 12:13:44.904531  5674 pending_rounds.cc:107] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:13:44.905097  5674 raft_consensus.cc:2889] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:44.764575  7457 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.913959  5751 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:44.914440  5753 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:13:44.920244  5679 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:44.915166  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.932399  5600 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:44.933243  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.919775  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.917629  7444 raft_consensus.cc:697] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:44.941818  5746 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:44.942554  7444 consensus_queue.cc:237] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.943904  7126 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:44.899261  7475 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.920854  7549 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:44.921145  7553 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:44.923882  7603 log.cc:927] Time spent T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:13:44.901391  7344 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.924774  5671 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:13:44.925555  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.926497  7514 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:44.928485  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:44.929687  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:44.934204  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:44.934897  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 44915.4us
I20260709 12:13:44.972559  5676 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.939666  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.973322  5747 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 2: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:44.940315  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.940954  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:44.934849  5567 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:44.888509  7221 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:44.951109  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.901822  7432 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.930994  7311 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:44.967448  5671 pending_rounds.cc:85] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 3
I20260709 12:13:44.969987  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:44.970698  5598 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:13:44.971282  7514 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:44.972723  5600 raft_consensus.cc:2368] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
W20260709 12:13:44.984541  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 49768.3us
I20260709 12:13:44.900313  7581 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:44.996690  5676 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:45.109248  5746 raft_consensus.cc:2410] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:44.993496  5642 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:45.107436  5716 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:45.110369  5671 pending_rounds.cc:107] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:13:45.108459  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:44.951508  5595 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
W20260709 12:13:45.111096  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 117686us
I20260709 12:13:45.111917  5567 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:45.112670  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.113039  5567 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:45.113485  5671 raft_consensus.cc:2889] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:45.115221  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:45.115598  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.116494  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:45.117376  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:44.969326  7359 consensus_meta.cc:287] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.692s	user 0.008s	sys 0.001s
I20260709 12:13:45.118069  5600 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:45.120815  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:45.121035  5676 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:45.121460  5679 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:44.983737  7126 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:44.971863  7457 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:45.125165  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:45.114933  7604 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.985527  7553 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:45.126729  7606 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:45.115918  7311 raft_consensus.cc:697] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:45.129688  7605 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:45.130302  7514 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:45.130991  7526 raft_consensus.cc:3055] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:45.132156  7581 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:45.123550  5567 leader_election.cc:400] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4.
I20260709 12:13:45.126880  7126 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.128907  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.125859  7534 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:45.129706  7490 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:45.127841  7542 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.135125  5642 leader_election.cc:400] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
I20260709 12:13:45.163865  5642 leader_election.cc:403] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:45.123762  7359 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.122493  7238 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.148391  7553 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.158726  5567 leader_election.cc:403] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:45.124084  7590 consensus_queue.cc:1059] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:13:45.149042  7606 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.125562  7361 consensus_queue.cc:1059] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:13:45.154780  5599 raft_consensus.cc:2393] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:45.150346  7605 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.164901  5642 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:45.114712  7483 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.154474  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.153512  7526 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:13:45.169550  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 46362.4us
I20260709 12:13:45.158285  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.173383  7581 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.174142  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:45.171367  7553 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.161968  7534 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.166731  7319 raft_consensus.cc:1064] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
W20260709 12:13:45.177577  7613 log.cc:927] Time spent T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:13:45.166973  7579 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
W20260709 12:13:45.192751  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.182351  7233 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.188726  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1086) took 1174 ms. Trace:
I20260709 12:13:45.180382  7311 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.189284  7361 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.179811  7606 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:45.168270  7490 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.199210  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:45.199714  7526 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.219303  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:45.200824  7475 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.202615  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.221300  5642 leader_election.cc:400] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
I20260709 12:13:45.205407  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.192245  5598 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:45.186216  7483 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.181313  7605 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:45.183187  7344 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:45.207453  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 99075.7us
W20260709 12:13:45.193928  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 86580.4us
I20260709 12:13:45.194118  7534 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.228730  5718 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:45.215994  5679 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
W20260709 12:13:45.217054  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 85350.2us
I20260709 12:13:45.193737  5595 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.207984  7233 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:45.221475  5678 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:45.209112  7457 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.209149  5670 rpcz_store.cc:276] 0709 12:13:44.014267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.018327 (+  4060us) service_pool.cc:224] Handling call
0709 12:13:45.150182 (+1131855us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:45.188631 (+ 38449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28707072}
I20260709 12:13:45.232144  7457 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:45.233060  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:45.218400  7361 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.236497  7457 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:45.238209  7361 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:45.223987  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.242069  5601 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:45.242805  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.243230  5601 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:45.244068  5601 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:45.205286  7319 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.220533  7590 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.222337  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:45.226469  7483 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.227667  7526 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.247216  5718 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:45.249655  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:45.250351  5752 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:45.251269  5718 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:45.222204  7579 consensus_queue.cc:1059] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:13:45.234230  7233 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.228547  7221 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:45.255591  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:45.256178  7628 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:45.258296  7590 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.258841  7590 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.259205  7590 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.258821  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:45.260429  7628 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:45.262259  7395 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:45.262650  7395 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.262563  7604 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:45.263087  7395 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:45.264427  7628 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.266176  5718 leader_election.cc:400] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 2 election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:45.239116  5599 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.269991  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:45.270682  5746 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:45.248203  7432 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.250455  7344 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:45.252624  7542 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:45.290635  7632 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:45.305660  7311 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.306342  7311 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.308714  7311 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:45.271865  7126 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:45.268227  7622 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:45.274901  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:45.314168  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.316880  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.317263  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:45.332724  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 104131us
I20260709 12:13:45.333815  5601 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:45.335958  5716 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:45.295888  7359 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:45.338989  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 71498.4us
I20260709 12:13:45.339634  5718 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:45.340864  5601 raft_consensus.cc:1240] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:45.313848  7542 raft_consensus.cc:697] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:45.333195  7579 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.295553  7344 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.354719  7634 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:45.355330  7634 raft_consensus.cc:697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:45.355135  7590 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.356333  7634 consensus_queue.cc:237] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.357237  7590 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:45.358354  7490 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:45.358860  7490 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:45.359061  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.360626  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:45.362120  7521 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:45.351271  7359 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.371624  7475 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:45.377314  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.378099  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:45.379288  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:45.380476  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:45.382769  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:45.362059  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:45.383395  6328 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:45.392069  7221 consensus_queue.cc:1059] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:45.393014  7221 consensus_queue.cc:1059] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:45.393836  7221 raft_consensus.cc:3055] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:45.394192  7221 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:45.395110  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.395007  7221 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.395825  5672 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:45.396196  7221 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:45.399151  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:45.399854  6323 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:45.401126  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.402874  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.408908  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.409600  5678 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:45.410862  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:45.411558  5671 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:45.418128  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 82232us
I20260709 12:13:45.420557  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:45.408123  5570 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:45.439348  7126 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:45.439496  5599 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:45.421536  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:45.346269  7604 consensus_queue.cc:1059] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:13:45.440496  6328 raft_consensus.cc:2410] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:45.410840  5569 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:45.426324  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:45.441376  5679 raft_consensus.cc:2368] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5.
I20260709 12:13:45.441283  5570 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:45.403048  7459 raft_consensus.cc:3055] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:45.359093  7344 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:45.390084  7419 raft_consensus.cc:3055] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:13:45.432639  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.428988  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.427903  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:45.432936  7542 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.433656  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:45.434118  7483 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.434108  7233 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.435956  5671 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:45.439785  5716 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:45.437191  7605 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.441969  5569 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:45.432770  5595 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:45.439810  7126 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.428032  7534 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:45.455159  7524 consensus_meta.cc:287] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.001s
I20260709 12:13:45.460822  7590 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.466005  5670 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:45.466830  7395 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.452196  7459 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:45.467727  7475 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:45.455698  7419 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:45.455296  7311 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:45.453922  7361 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:45.470515  5716 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:45.473563  7126 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:45.476552  7457 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:45.474587  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 129043us
I20260709 12:13:45.465912  7604 raft_consensus.cc:3055] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:45.500026  5677 raft_consensus.cc:2393] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:45.483511  5601 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:13:45.489737  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.473960  5569 leader_election.cc:400] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5.
I20260709 12:13:45.501928  5569 leader_election.cc:403] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:13:45.502812  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 161761us
I20260709 12:13:45.503501  5718 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:45.494000  5716 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:45.511528  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:45.512856  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.513525  5595 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:45.514042  7620 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:45.514561  7620 raft_consensus.cc:697] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:45.473408  7636 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.514883  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:45.515309  7636 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:45.515424  5750 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.516062  7344 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.516429  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:45.496527  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:45.517939  7359 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.518244  5746 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.515409  7620 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:45.523839  5716 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:45.524896  7238 raft_consensus.cc:3055] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:45.525262  7238 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:45.525943  7321 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:45.495098  7457 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.526057  7238 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.484324  7590 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.522650  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.527392  7238 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.528072  7344 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.436571  6291 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:45.504415  7395 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:45.492488  6323 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:45.500433  7604 raft_consensus.cc:740] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:45.481662  7524 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3.
I20260709 12:13:45.502734  5569 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:45.529734  7604 consensus_queue.cc:260] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.530704  7604 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.507427  7605 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:45.507630  7361 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5.
I20260709 12:13:45.532274  7586 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:45.494737  7311 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:45.533012  7311 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.533423  5716 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:45.532253  7321 raft_consensus.cc:697] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:45.535764  7518 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:45.536343  7518 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:13:45.508025  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.536788  7359 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.508195  7459 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.537714  7539 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:45.538040  5716 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:45.538817  7524 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:45.538982  5716 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:45.540169  7539 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:45.502728  7419 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.540742  7539 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.507313  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:45.542001  7359 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:45.542371  7586 raft_consensus.cc:697] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:45.509212  7233 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:45.503896  7483 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:45.542667  7359 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:45.543403  7524 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.543802  7524 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:45.546348  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 113756us
I20260709 12:13:45.546728  5567 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:45.546993  6291 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:45.510541  7534 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:45.532616  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1184) took 1150 ms. Trace:
I20260709 12:13:45.557972  5751 rpcz_store.cc:276] 0709 12:13:44.382232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.383771 (+  1539us) service_pool.cc:224] Handling call
0709 12:13:44.384002 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.930567 (+546565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.532409 (+601842us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b5400011654. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:45.532563 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218346368}
I20260709 12:13:45.535416  7321 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.526527  7636 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.574250  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:45.528412  5599 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:45.548512  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:45.549437  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 45903.8us
I20260709 12:13:45.550562  5642 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:45.553278  5746 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:45.579313  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:45.541157  7419 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.581790  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:45.582480  5746 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:45.583544  5567 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:45.584872  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:45.587051  5746 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:45.590889  6291 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:45.579856  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:45.591646  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:45.596812  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:45.594763  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:45.597210  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:45.514891  5595 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:45.601725  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:45.528355  7590 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:45.570613  7514 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.553915  7457 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.590071  7395 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.603030  5746 raft_consensus.cc:2393] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:45.537225  7518 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.608027  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.609488  5671 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:45.595404  7552 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:45.594590  7544 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.603899  7579 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:45.611348  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:45.642243  5676 raft_consensus.cc:2393] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:45.643180  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:45.643795  5676 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.486927  7606 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.647467  7606 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:45.564785  5750 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:45.554471  7483 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.554116  7622 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:45.570010  7267 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:45.649348  7267 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:45.649848  7267 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.649400  7622 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.652088  5673 raft_consensus.cc:2393] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:45.605463  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:13:45.654453  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 49085us
I20260709 12:13:45.655254  5567 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:45.604524  6291 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:45.603829  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:45.595752  7233 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:45.610073  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.610715  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.618664  7432 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.620694  7552 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.617022  7620 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:13:45.664136  6323 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:45.640686  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:45.664465  7579 raft_consensus.cc:697] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:45.614769  5595 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:13:45.657079  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 52621.1us
I20260709 12:13:45.621301  7395 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:45.661240  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.614763  7514 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:45.614511  7532 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.671211  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:45.664721  7526 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:45.655766  7644 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:45.672411  7552 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:45.664588  7606 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:45.688122  5671 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.602756  7568 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:45.663594  7590 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:13:45.690400  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 249174us
I20260709 12:13:45.699841  7390 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:45.655547  7553 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.724736  5676 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:45.725270  7514 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.666844  7233 raft_consensus.cc:697] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:45.684386  7575 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:45.725987  7614 log.cc:927] Time spent T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:13:45.700809  7475 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.751649  5570 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:45.619683  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:45.806525  5678 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:45.755759  5671 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
W20260709 12:13:45.725907  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.742487  5599 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:45.724956  7532 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:45.808070  5642 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:45.684520  7311 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.673520  7432 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.727135  7526 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.669586  7586 consensus_queue.cc:237] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:45.798098  7641 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:13:45.821126  5597 raft_consensus.cc:1240] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 3. Ops: []
I20260709 12:13:45.752192  7647 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.796368  7629 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.754304  7605 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:45.799355  7639 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.820554  7539 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:45.816915  7532 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.752578  7544 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:13:45.861866  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.863739  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1862) took 1223 ms. Trace:
I20260709 12:13:45.756781  7590 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.841156  7526 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:45.753871  7568 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.864128  5600 rpcz_store.cc:276] 0709 12:13:44.639952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.861602 (+1221650us) service_pool.cc:224] Handling call
0709 12:13:45.863658 (+  2056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:45.796006  7390 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:45.865165  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.848680  7647 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.849969  7475 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:45.866907  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 140454us
I20260709 12:13:45.753826  7606 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:45.871129  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:45.881358  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 73363.6us
I20260709 12:13:45.883754  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:45.887791  6324 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.862295  7584 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.865379  7544 consensus_queue.cc:1243] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:45.889389  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:45.862280  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:45.840572  7126 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.891887  6327 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 3 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:45.898023  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:45.895254  5675 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:45.900602  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:45.899158  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:45.864439  7539 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:45.854857  7605 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.806993  7575 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:45.919843  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:45.748750  7644 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.926760  7644 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:45.927314  7644 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:45.930966  7126 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:45.887144  7534 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:45.932930  7534 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.935031  7534 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:45.879916  7647 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:45.901410  7643 log.cc:927] Time spent T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 12:13:45.869656  7622 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:13:45.960276  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:45.956290  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:45.902173  5744 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:45.992162  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 45063.4us
I20260709 12:13:45.955451  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:45.994750  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:45.995426  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:45.995761  5604 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.840909  7579 consensus_queue.cc:237] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:46.003592  7650 log.cc:927] Time spent T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:13:45.877873  7233 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.005051  7670 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:46.005975  7642 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:13:45.859429  7639 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.000180  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:46.001166  7652 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 12:13:46.001663  7655 log.cc:927] Time spent T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:13:46.001878  7665 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:46.002327  7651 log.cc:927] Time spent T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:13:45.986300  7660 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:46.014392  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1683) took 1759 ms. Trace:
I20260709 12:13:46.006511  7662 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:45.899065  7584 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:46.032717  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:46.017355  7666 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:46.018499  7221 consensus_meta.cc:287] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 12:13:46.021392  6324 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:46.011468  5747 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:45.892344  7475 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:46.026559  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 274982us
I20260709 12:13:46.028915  5602 rpcz_store.cc:276] 0709 12:13:44.255010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.272612 (+ 17602us) service_pool.cc:224] Handling call
0709 12:13:44.272865 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.465731 (+192866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.014110 (+1548379us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002684d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:46.014320 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438305664}
I20260709 12:13:46.044588  5750 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:46.054145  5570 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:46.000234  7568 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:45.936235  7539 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:45.980136  7267 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:46.043823  7649 log.cc:927] Time spent T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 12:13:46.060420  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:46.063480  5602 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:46.064320  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:46.064915  5602 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:46.065691  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:46.066788  5602 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:13:46.068008  5604 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:46.070217  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:46.027544  7432 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.027830  7395 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:46.074846  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:46.076418  5602 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:13:46.077241  5671 raft_consensus.cc:1275] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:46.056578  7660 raft_consensus.cc:697] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:46.075843  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:46.066242  5716 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:46.069176  7581 consensus_meta.cc:287] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.878s	user 0.003s	sys 0.008s
I20260709 12:13:46.086228  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:46.088423  5679 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:46.068881  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:46.053308  7668 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:46.027660  7514 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.071719  7568 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:46.110512  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 455316us
I20260709 12:13:46.111721  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:46.090175  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:46.109980  5671 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:46.113523  5567 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:46.114274  5604 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:46.115284  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:46.115619  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:46.088163  7432 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:46.062369  7221 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:46.100507  7581 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4.
I20260709 12:13:46.134035  7673 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.136668  5567 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:46.080643  7553 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.150882  5749 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:46.157713  5753 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:13:46.152933  7663 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:13:46.158866  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:46.053836  7666 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:46.127295  7432 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.165751  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:46.028568  7665 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:46.123472  7311 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:46.159476  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 105404us
I20260709 12:13:46.130883  7620 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.173177  5749 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:46.139056  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:46.145360  7395 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:46.178480  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:46.182936  7678 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:13:46.179320  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.184180  5749 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:46.185491  7629 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:46.153061  7575 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.186029  7629 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:46.174033  7432 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:46.165095  7390 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.187717  7647 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.189922  7660 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.049860  7662 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.179051  7675 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.181542  5670 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
W20260709 12:13:46.202301  7238 consensus_meta.cc:287] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.000s
I20260709 12:13:46.202693  7639 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:46.156168  7590 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:46.163676  7668 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.156343  7544 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.200055  5570 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:46.169298  7606 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.199816  7675 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:46.214118  7666 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.215077  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1855) took 1577 ms. Trace:
W20260709 12:13:46.216741  7457 consensus_meta.cc:287] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.000s
W20260709 12:13:46.219259  7636 consensus_meta.cc:287] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.002s
I20260709 12:13:46.220826  7662 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:46.128129  7568 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:46.276157  7604 consensus_meta.cc:287] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.001s
I20260709 12:13:46.276832  7568 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:46.225131  7665 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.199980  5595 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:13:46.208724  5602 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
W20260709 12:13:46.246704  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.179728  7620 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:46.286111  7620 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:46.248812  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 48837.8us
I20260709 12:13:46.290143  5599 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:46.290942  5570 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:46.291435  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:46.252192  7267 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:46.253082  7539 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.253834  7584 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.292035  5570 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:46.256091  7526 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.251386  7475 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.293884  7526 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:46.256125  7524 consensus_meta.cc:287] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.712s	user 0.004s	sys 0.004s
I20260709 12:13:46.260206  7514 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:46.268289  5597 rpcz_store.cc:276] 0709 12:13:44.637805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.637926 (+   121us) service_pool.cc:224] Handling call
0709 12:13:45.360364 (+722438us) spinlock_profiling.cc:243] Waited 8.82 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:45.360544 (+   180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.842391 (+481847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.214851 (+372460us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b5400434ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:46.215018 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068600448}
I20260709 12:13:46.294571  7524 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:46.294962  6326 raft_consensus.cc:1240] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:46.228926  5671 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:46.279388  7457 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:46.296216  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:46.296666  7524 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:46.296821  5671 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
W20260709 12:13:46.262362  7552 consensus_meta.cc:287] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 12:13:46.223428  7629 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:46.274379  7636 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:46.297397  7552 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:46.299326  5600 raft_consensus.cc:2393] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:46.210654  7605 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:46.282666  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:46.304096  5752 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:46.279060  7647 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:46.291636  7662 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:46.297463  7457 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.308220  7688 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:46.309284  5744 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:13:46.310266  5745 raft_consensus.cc:2393] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:46.294071  7475 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.165459  7671 consensus_queue.cc:1059] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 12:13:46.265856  7675 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.145339  7221 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:46.299252  5603 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 5. Ops: []
I20260709 12:13:46.302101  6293 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:46.297652  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:46.295277  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:46.388278  5597 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:46.389266  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:46.390158  5597 raft_consensus.cc:2410] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:13:46.298818  7629 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:46.319865  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1870) took 1135 ms. Trace:
I20260709 12:13:46.391600  5601 rpcz_store.cc:276] 0709 12:13:45.184268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.342601 (+158333us) service_pool.cc:224] Handling call
0709 12:13:45.342885 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:45.500923 (+158038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.319560 (+818637us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54003e08d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:46.319794 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322679168}
I20260709 12:13:46.323454  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:46.385558  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1819) took 1912 ms. Trace:
I20260709 12:13:46.393117  5602 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
W20260709 12:13:46.387257  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 85238us
I20260709 12:13:46.398141  5748 rpcz_store.cc:276] 0709 12:13:44.472956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.476068 (+  3112us) service_pool.cc:224] Handling call
0709 12:13:44.492519 (+ 16451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:44.579423 (+ 86904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:44.579451 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:44.579868 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 12:13:45.516774 (+936906us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b1800455d40. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:13:45.754583 (+237809us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:45.754618 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.754684 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:45.924690 (+170006us) raft_consensus.cc:1685] finished
0709 12:13:45.924711 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.385301 (+460590us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b540001fed0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:46.385475 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5308,"raft.queue_time_us":5457,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":22597,"spinlock_wait_cycles":47863552,"thread_start_us":237622,"threads_started":1,"wal-append.queue_time_us":1276819}
I20260709 12:13:46.499078  5601 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:13:46.499509  5601 pending_rounds.cc:85] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 3
I20260709 12:13:46.499718  5601 pending_rounds.cc:107] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:13:46.499949  5601 raft_consensus.cc:2889] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:46.506963  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:46.320902  7419 consensus_meta.cc:287] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.001s
I20260709 12:13:46.310848  5599 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:46.568742  7432 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.496747  7402 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.580304  7402 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:46.584395  5751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.029s	sys 0.051s
W20260709 12:13:46.584812  5751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.029s	sys 0.051s
I20260709 12:13:46.511198  7526 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.508083  7605 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:46.270649  7668 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:46.353582  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.619887  5674 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:13:46.534693  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:46.310701  7584 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:46.306334  7514 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.318s
I20260709 12:13:46.585161  7636 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:46.324222  7532 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.618315  7526 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:46.606256  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 480055us
I20260709 12:13:46.637869  6325 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:46.624157  7552 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:46.633000  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.642572  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:46.643286  5671 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:13:46.645660  6293 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:46.634788  7526 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.627784  5595 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:46.630199  7584 raft_consensus.cc:697] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:46.622771  7605 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.637317  7620 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:46.663858  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.648415  7606 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.650195  7267 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:46.668502  7267 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.657545  7620 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:46.652223  7584 consensus_queue.cc:237] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:46.678071  7221 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.667286  7402 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:46.691906  6327 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 4 LEARNER]: Advancing to term 6
I20260709 12:13:46.672369  7267 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:13:46.694403  5604 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.030s	sys 0.039s
W20260709 12:13:46.712730  5604 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.031s	sys 0.039s
I20260709 12:13:46.669656  7606 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:46.741813  6324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.003s	sys 0.016s
W20260709 12:13:46.742367  6324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.004s	sys 0.016s
I20260709 12:13:46.744334  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:46.746240  6327 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 6 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:46.761590  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:46.762918  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:46.764525  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:46.713039  7668 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.745337  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:46.765301  5753 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
W20260709 12:13:46.772498  6291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.024s	sys 0.043s
W20260709 12:13:46.773038  6291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.025s	sys 0.043s
W20260709 12:13:46.773806  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 683625us
I20260709 12:13:46.721282  7636 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:46.740805  7605 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:46.760162  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:46.765278  7432 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:46.786203  7518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.016s	sys 0.005s
W20260709 12:13:46.786603  7518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.016s	sys 0.005s
I20260709 12:13:46.787415  5746 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:46.794070  5753 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:13:46.776130  7660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.001s	sys 0.027s
W20260709 12:13:46.796543  7660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.001s	sys 0.028s
I20260709 12:13:46.775583  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:46.798655  5673 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:46.787257  7518 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.796267  6326 raft_consensus.cc:2393] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:46.791326  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:46.793002  7532 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:46.814764  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:46.817256  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:46.817735  6327 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:46.793740  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1883) took 1109 ms. Trace:
I20260709 12:13:46.781114  7636 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:46.813081  5678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.007s	sys 0.016s
W20260709 12:13:46.820034  6321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.013s	sys 0.020s
W20260709 12:13:46.850368  5678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.008s	sys 0.016s
W20260709 12:13:46.856842  5676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.013s	sys 0.018s
W20260709 12:13:46.857558  5676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.013s	sys 0.018s
I20260709 12:13:46.813237  7518 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:46.845407  5670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.010s	sys 0.024s
W20260709 12:13:46.854544  6321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.014s	sys 0.020s
I20260709 12:13:46.865260  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:46.852665  6327 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
W20260709 12:13:46.890337  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:46.890185  5670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.010s	sys 0.025s
I20260709 12:13:46.864064  7636 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:46.932711  6321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 653) took 1047 ms. Trace:
I20260709 12:13:46.933259  6321 rpcz_store.cc:276] 0709 12:13:45.885406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.887289 (+  1883us) service_pool.cc:224] Handling call
0709 12:13:45.993512 (+106223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.022683 (+ 29171us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:13:46.080300 (+ 57617us) log.cc:844] Serialized 14 byte log entry
0709 12:13:46.897789 (+817489us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:46.899331 (+  1542us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:46.922411 (+ 23080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.931447 (+  9036us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.932638 (+  1191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42351,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":1217,"raft.queue_time_us":2645,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3305,"spinlock_wait_cycles":6528,"thread_start_us":779588,"threads_started":1}
I20260709 12:13:46.819304  5595 rpcz_store.cc:276] 0709 12:13:45.682214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.667169 (+984955us) service_pool.cc:224] Handling call
0709 12:13:46.721135 (+ 53966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.765533 (+ 44398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.768664 (+  3131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:46.773892 (+  5228us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:46.775106 (+  1214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.780871 (+  5765us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.791719 (+ 10848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:46.896912  7539 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:13:46.924295  7602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.010s	sys 0.016s
W20260709 12:13:46.900162  6323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.024s	sys 0.039s
I20260709 12:13:46.892022  7267 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.900158  7660 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:13:46.945597  6323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.025s	sys 0.039s
W20260709 12:13:46.943279  7602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.012s	sys 0.016s
I20260709 12:13:46.968150  5498 catalog_manager.cc:5697] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 2 to 3, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 3 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.970409  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:46.971014  6324 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:46.975298  5719 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:46.970149  5498 catalog_manager.cc:5697] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 2 to 3, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:13:46.898798  7606 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:46.943511  7539 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:46.965221  7636 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:13:46.991135  7539 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:46.992919  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:46.993587  5678 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:46.962595  7660 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:46.995368  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 234) took 1003 ms. Trace:
I20260709 12:13:46.995822  5750 rpcz_store.cc:276] 0709 12:13:45.992346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.995182 (+  2836us) service_pool.cc:224] Handling call
0709 12:13:46.995190 (+1000008us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b54000c9c54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:46.995302 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106387200}
I20260709 12:13:46.995886  6293 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:46.998946  5677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1662) took 2352 ms (client timeout 2102 ms). Trace:
W20260709 12:13:46.999455  5677 rpcz_store.cc:269] 0709 12:13:44.646523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.731586 (+ 85063us) service_pool.cc:224] Handling call
0709 12:13:45.358902 (+627316us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:46.998693 (+1639791us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400490f54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:46.998854 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329861888}
I20260709 12:13:47.012538  7690 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:47.013291  7690 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.014755  7660 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:47.016222  7620 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:47.016712  7620 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:47.017084  7620 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.018219  7532 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.018798  7532 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.022533  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:47.023223  5677 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:47.024416  6293 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:47.001484  7689 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.021829  7539 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:47.025393  7690 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:47.033293  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1881) took 1483 ms. Trace:
I20260709 12:13:47.021185  7532 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:47.033676  5604 rpcz_store.cc:276] 0709 12:13:45.550064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.117824 (+567760us) service_pool.cc:224] Handling call
0709 12:13:46.118060 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.118232 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:13:46.713158 (+594926us) log.cc:844] Serialized 14 byte log entry
0709 12:13:47.032953 (+319795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.033003 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:47.033049 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.033125 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.033231 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":743262,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":436,"thread_start_us":913523,"threads_started":2}
I20260709 12:13:47.038776  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:47.039637  5677 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:47.029029  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1884) took 1139 ms. Trace:
W20260709 12:13:47.057844  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:47.040028  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.033908  7483 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:47.033856  7539 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:47.039595  7518 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:47.057547  6291 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.649s (SENT) [suppressed 7 similar messages]
I20260709 12:13:47.038977  7690 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:47.080917  7690 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:47.081621  7690 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.082664  6319 raft_consensus.cc:1240] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:47.083472  6319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 652) took 1198 ms. Trace:
I20260709 12:13:47.083778  6319 rpcz_store.cc:276] 0709 12:13:45.885073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.887173 (+  2100us) service_pool.cc:224] Handling call
0709 12:13:47.082315 (+1195142us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:47.082483 (+   168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.083176 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.083408 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6823808}
I20260709 12:13:47.035812  7689 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:47.085094  7696 log.cc:927] Time spent T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:13:47.087141  7689 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:47.088677  5567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.021s	sys 0.030s
W20260709 12:13:47.091336  5567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.022s	sys 0.031s
W20260709 12:13:47.091892  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 955408us
I20260709 12:13:47.089042  7395 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:47.099841  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1712) took 1546 ms. Trace:
I20260709 12:13:47.100287  5642 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:47.102525  5677 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:13:47.089246  7690 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.069392  7539 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:47.094980  7654 log.cc:927] Time spent T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 1.369s	user 0.010s	sys 0.012s
I20260709 12:13:47.104756  7689 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:47.106473  6293 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:47.105245  7682 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.098433  7395 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:13:47.110610  5747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 1836) took 1599 ms (client timeout 1539 ms). Trace:
W20260709 12:13:47.111068  5747 rpcz_store.cc:269] 0709 12:13:45.511129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.511273 (+   144us) service_pool.cc:224] Handling call
0709 12:13:47.110404 (+1599131us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5400011b54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:47.110539 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971450112}
I20260709 12:13:47.105336  7660 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.113574  7660 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.114027  7542 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:47.115548  7660 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:47.108564  7605 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:47.116483  7605 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:47.103214  7674 raft_consensus.cc:3055] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:13:47.104214  5598 consensus_meta.cc:287] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.926s	user 0.011s	sys 0.000s
I20260709 12:13:47.106487  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:47.116870  7605 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.120222  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1682) took 1035 ms. Trace:
I20260709 12:13:47.103510  7584 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.105686  7267 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:13:47.120635  5676 rpcz_store.cc:276] 0709 12:13:46.085058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.085224 (+   166us) service_pool.cc:224] Handling call
0709 12:13:46.110758 (+ 25534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.299053 (+188295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.299082 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:46.302497 (+  3415us) log.cc:844] Serialized 26 byte log entry
0709 12:13:46.857961 (+555464us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:47.117365 (+259404us) log.cc:844] Serialized 14 byte log entry
0709 12:13:47.119923 (+  2558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.119998 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:47.120033 (+    35us) raft_consensus.cc:1685] finished
0709 12:13:47.120043 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.120163 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5804,"spinlock_wait_cycles":19145088,"thread_start_us":928248,"threads_started":3,"wal-append.queue_time_us":663452}
I20260709 12:13:47.041788  5595 rpcz_store.cc:276] 0709 12:13:45.890105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.945427 (+1055322us) service_pool.cc:224] Handling call
0709 12:13:46.980465 (+ 35038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.987628 (+  7163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.989084 (+  1456us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:46.993415 (+  4331us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:46.996249 (+  2834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.022766 (+ 26517us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.027749 (+  4983us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:47.117161  7674 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:13:47.131510  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 156293us
I20260709 12:13:47.133540  5642 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:47.124399  5598 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:47.119359  7682 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.139554  7600 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:47.140693  7483 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:47.138770  7606 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:47.141425  7606 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.141746  7606 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.143105  7526 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.143827  7674 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.144995  7674 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.145630  7526 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:47.146661  7602 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:47.147223  7602 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.129920  7660 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:13:47.149264  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.101967  5602 rpcz_store.cc:276] 0709 12:13:45.553099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.393829 (+840730us) service_pool.cc:224] Handling call
0709 12:13:46.513326 (+119497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.513521 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:13:46.941124 (+427603us) log.cc:844] Serialized 14 byte log entry
0709 12:13:47.099486 (+158362us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.099542 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:47.099593 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.099660 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.099779 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":680,"prepare.queue_time_us":418120,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":1383,"raft.queue_time_us":4453,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3351,"thread_start_us":566081,"threads_started":2}
I20260709 12:13:47.151132  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:47.136040  7267 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:13:47.157552  7221 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.158152  7221 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.128880  7584 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.162278  5676 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:47.165429  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:47.151242  7483 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:47.170027  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:47.179740  5751 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:47.155835  7660 raft_consensus.cc:697] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:47.171214  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 647) took 1288 ms. Trace:
I20260709 12:13:47.140846  7682 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:47.183163  7660 consensus_queue.cc:237] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.175410  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:47.183897  6323 rpcz_store.cc:276] 0709 12:13:45.882652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.887020 (+  4368us) service_pool.cc:224] Handling call
0709 12:13:46.205343 (+318323us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:46.205528 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.205800 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:13:46.206149 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 12:13:47.137925 (+931776us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.138802 (+   877us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:47.151533 (+ 12731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.153609 (+  2076us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.171134 (+ 17525us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":708,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":172,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"spinlock_wait_cycles":5365504,"thread_start_us":909264,"threads_started":2,"wal-append.queue_time_us":859848}
I20260709 12:13:47.185442  5750 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:47.186612  7584 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:47.173586  6293 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:47.186612  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1713) took 1612 ms. Trace:
I20260709 12:13:47.187561  5599 rpcz_store.cc:276] 0709 12:13:45.574588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.621141 (+1046553us) service_pool.cc:224] Handling call
0709 12:13:46.636471 (+ 15330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.641689 (+  5218us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:13:46.932615 (+290926us) log.cc:844] Serialized 14 byte log entry
0709 12:13:47.117102 (+184487us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:47.151767 (+ 34665us) log.cc:844] Serialized 26 byte log entry
0709 12:13:47.167719 (+ 15952us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:47.171662 (+  3943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.171764 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:47.186397 (+ 14633us) raft_consensus.cc:1685] finished
0709 12:13:47.186415 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.186546 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2110,"prepare.queue_time_us":318918,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":4326,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":214,"thread_start_us":454807,"threads_started":2,"wal-append.queue_time_us":196760}
I20260709 12:13:47.171830  7526 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:47.190645  7690 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:47.189649  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:47.194177  7675 consensus_meta.cc:287] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.687s	user 0.005s	sys 0.006s
I20260709 12:13:47.194304  5599 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
W20260709 12:13:47.194594  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.195006  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:47.197264  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:47.197332  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:47.127732  7689 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.203684  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1887) took 1170 ms. Trace:
I20260709 12:13:47.203785  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:47.224861  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1674) took 1617 ms. Trace:
I20260709 12:13:47.227293  5642 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:13:47.226341  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 131715us
I20260709 12:13:47.233268  5604 rpcz_store.cc:276] 0709 12:13:46.033748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.036463 (+1002715us) service_pool.cc:224] Handling call
0709 12:13:47.036816 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.037019 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:13:47.063651 (+ 26632us) log.cc:844] Serialized 14 byte log entry
0709 12:13:47.203365 (+139714us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.203414 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:47.203454 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.203519 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.203624 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28511,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":583,"thread_start_us":138740,"threads_started":1}
I20260709 12:13:47.234740  7670 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:47.235224  7670 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.183104  7221 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:47.502974  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 329449us
I20260709 12:13:47.235453  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:47.228170  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 170664us
I20260709 12:13:47.509479  5604 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:47.235536  5718 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:47.477662  7432 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.518646  7432 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.198716  7267 raft_consensus.cc:697] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:13:47.522969  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 287503us
I20260709 12:13:47.523838  5718 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:47.282822  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:47.233187  5675 rpcz_store.cc:276] 0709 12:13:45.607113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.607812 (+   699us) service_pool.cc:224] Handling call
0709 12:13:47.224664 (+1616852us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54002e8954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:47.224794 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636701952}
I20260709 12:13:47.533330  5604 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:13:47.534343  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:47.535331  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:47.529686  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:47.536412  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:47.538148  5718 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:47.521452  7432 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:47.522159  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.276909  7647 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.189635  7395 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.288889  5599 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:47.435459  7682 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.194687  7675 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:47.259938  7690 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:47.260383  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:47.536342  5602 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:47.659905  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:47.202623  5747 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:47.579722  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:47.226143  7526 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.296708  7602 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:47.250290  7584 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.431s
I20260709 12:13:47.539152  7670 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:47.677201  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:47.679250  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 133770us
I20260709 12:13:47.576135  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 1835) took 2069 ms. Trace:
W20260709 12:13:47.701510  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.700798  5718 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:13:47.662357  7724 log.cc:927] Time spent T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:13:47.691814  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1716) took 1644 ms. Trace:
I20260709 12:13:47.753372  5604 rpcz_store.cc:276] 0709 12:13:46.047184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.690859 (+1643675us) service_pool.cc:224] Handling call
0709 12:13:47.691257 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.691467 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.691489 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.691532 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:47.691570 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.691628 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.691749 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:47.714023  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 474248us
I20260709 12:13:47.639863  7712 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:47.750226  5602 pending_rounds.cc:85] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 5
I20260709 12:13:47.752336  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:47.758924  5675 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.759502  5602 pending_rounds.cc:107] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:13:47.759837  5602 raft_consensus.cc:2889] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:47.760905  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.761852  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:47.769526  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 230) took 1798 ms. Trace:
I20260709 12:13:47.772106  7712 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:47.580287  7221 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.770022  5746 rpcz_store.cc:276] 0709 12:13:45.971716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.972513 (+   797us) service_pool.cc:224] Handling call
0709 12:13:45.972848 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.787860 (+815012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.769228 (+981368us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b5400257454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:47.769459 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872775424}
I20260709 12:13:47.781550  7731 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:47.782176  7731 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.784224  7731 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:47.752228  5595 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 4: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:47.698122  7689 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:47.694972  7726 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:47.626641  7647 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.700434  7715 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.776484  7602 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:47.808876  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 286) took 1545 ms. Trace:
I20260709 12:13:47.780246  7432 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:47.810956  5674 rpcz_store.cc:276] 0709 12:13:46.263482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.263610 (+   128us) service_pool.cc:224] Handling call
0709 12:13:46.263947 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.620371 (+356424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.808593 (+1188222us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54001b7954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:47.808801 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817953536}
W20260709 12:13:47.813383  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 112663us
I20260709 12:13:47.678136  7682 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.815316  6291 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:47.814204  5718 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:47.745815  5745 rpcz_store.cc:276] 0709 12:13:45.506902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.507054 (+   152us) service_pool.cc:224] Handling call
0709 12:13:47.541262 (+2034208us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54001e6c54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:47.576052 (+ 34790us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741606784}
I20260709 12:13:47.772606  7712 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.823547  5718 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:13:47.821502  7620 consensus_meta.cc:287] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.804s	user 0.009s	sys 0.001s
I20260709 12:13:47.813302  7602 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:47.792599  7221 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.770227  7267 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.832916  7395 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:47.833415  7675 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:47.834352  7712 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:47.836050  7717 log.cc:927] Time spent T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:13:47.833556  7735 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:13:47.836100  7647 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:47.837236  7605 consensus_meta.cc:287] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.710s	user 0.006s	sys 0.000s
I20260709 12:13:47.837929  7514 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.827096  7709 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:13:47.840559  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 654) took 1954 ms. Trace:
I20260709 12:13:47.843521  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1834) took 2346 ms. Trace:
W20260709 12:13:47.843794  7539 consensus_meta.cc:287] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.724s	user 0.008s	sys 0.001s
W20260709 12:13:47.844766  7713 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:13:47.817054  7432 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.832345  7602 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.831871  7620 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.852795  7735 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:47.853885  7730 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:47.855052  7221 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:47.856782  6325 rpcz_store.cc:276] 0709 12:13:45.885777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.886130 (+   353us) service_pool.cc:224] Handling call
0709 12:13:45.886405 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.638330 (+751925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.840308 (+1201978us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b540068f454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:47.840494 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727686400}
I20260709 12:13:47.828315  7690 raft_consensus.cc:697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:47.860066  7712 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.892439  7735 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.887645  7730 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:47.910924  7730 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.861340  7682 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:47.858443  7674 consensus_meta.cc:287] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.708s	user 0.000s	sys 0.008s
I20260709 12:13:47.859416  7532 raft_consensus.cc:3055] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:47.927804  7532 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:47.828302  7726 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:47.860543  7606 consensus_meta.cc:287] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.000s
I20260709 12:13:47.928851  7606 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.859632  7605 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.933729  7605 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:47.938781  7690 consensus_queue.cc:237] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:47.953478  7600 raft_consensus.cc:3055] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:47.953997  7600 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:47.954823  7600 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:47.955838  7600 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:47.961714  7725 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:13:48.058460  7634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.408s	user 0.010s	sys 0.032s
I20260709 12:13:48.132263  7670 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:47.993381  7636 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.005s	sys 0.004s
W20260709 12:13:48.136211  7636 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.006s	sys 0.004s
I20260709 12:13:48.133303  7730 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.197116  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 212) took 1093 ms. Trace:
I20260709 12:13:48.198167  5595 rpcz_store.cc:276] 0709 12:13:47.103862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.152515 (+ 48653us) service_pool.cc:224] Handling call
0709 12:13:48.196620 (+1044105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:48.200764  5567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.007s	sys 0.008s
W20260709 12:13:48.201268  5567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.007s	sys 0.008s
I20260709 12:13:48.201213  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1717) took 2043 ms. Trace:
I20260709 12:13:48.201819  5599 rpcz_store.cc:276] 0709 12:13:46.157409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.702012 (+1544603us) service_pool.cc:224] Handling call
0709 12:13:47.788026 (+ 86014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:48.200261 (+412235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:48.200371 (+   110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:48.200489 (+   118us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:48.200557 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.200711 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.200991 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:48.207441  5598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1702) took 3271 ms (client timeout 3147 ms). Trace:
W20260709 12:13:48.207926  5598 rpcz_store.cc:269] 0709 12:13:44.935591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.251233 (+315642us) service_pool.cc:224] Handling call
0709 12:13:48.207024 (+2955791us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b540021bbd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:48.207230 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1923734912}
I20260709 12:13:48.211534  5596 raft_consensus.cc:1240] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 2. Current term is 4. Ops: []
W20260709 12:13:48.216531  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.218644  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1709) took 2668 ms. Trace:
I20260709 12:13:48.219190  5601 rpcz_store.cc:276] 0709 12:13:45.550314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.392490 (+842176us) service_pool.cc:224] Handling call
0709 12:13:46.498694 (+106204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.500365 (+  1671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.218045 (+1717680us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54004349d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:48.218367 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243538688}
W20260709 12:13:48.222047  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:48.222838  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:48.223954  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:47.822113  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.227118  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:48.228513  5671 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:48.230446  5679 raft_consensus.cc:1240] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:48.230366  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1678) took 2167 ms. Trace:
I20260709 12:13:48.238668  5672 rpcz_store.cc:276] 0709 12:13:46.063149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.073778 (+ 10629us) service_pool.cc:224] Handling call
0709 12:13:47.773536 (+1699758us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:47.773775 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.799927 (+ 26152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.805460 (+  5533us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.809708 (+  4248us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:47.813008 (+  3300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.817366 (+  4358us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.230132 (+412766us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9863040}
I20260709 12:13:48.241475  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 285) took 1978 ms. Trace:
I20260709 12:13:48.241933  5679 rpcz_store.cc:276] 0709 12:13:46.263171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.263821 (+   650us) service_pool.cc:224] Handling call
0709 12:13:47.224826 (+961005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:48.231096 (+1006270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.240755 (+  9659us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002e8954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:48.241235 (+   480us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54002e8950. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:48.241394 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4520711680}
I20260709 12:13:47.857213  5752 rpcz_store.cc:276] 0709 12:13:45.497312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.497447 (+   135us) service_pool.cc:224] Handling call
0709 12:13:45.497718 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.304477 (+806759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.843221 (+1538744us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54003633d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:47.843423 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844114304}
W20260709 12:13:48.256018  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:48.256614  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 441241us
I20260709 12:13:47.862166  7432 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:47.888520  7483 consensus_meta.cc:287] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.003s
I20260709 12:13:48.259289  7483 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.260828  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 450) took 1121 ms. Trace:
I20260709 12:13:48.261569  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:47.862279  7539 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.222841  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1852) took 3604 ms. Trace:
I20260709 12:13:48.260623  6293 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:48.314208  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 53967.6us
I20260709 12:13:48.307859  5596 rpcz_store.cc:276] 0709 12:13:44.617988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.637372 (+ 19384us) service_pool.cc:224] Handling call
0709 12:13:46.014994 (+1377622us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:48.210935 (+2195941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:48.212228 (+  1293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.222545 (+ 10317us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b540021bbd0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:48.222739 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5070667904}
I20260709 12:13:48.316412  7731 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:48.316973  7731 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:48.317431  7731 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.318220  7730 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:48.318719  7728 consensus_queue.cc:1059] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:13:48.319389  5675 consensus_meta.cc:287] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.002s
I20260709 12:13:48.319888  5675 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
W20260709 12:13:48.064574  7634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.422s	user 0.010s	sys 0.033s
W20260709 12:13:48.321465  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1882) took 2633 ms (client timeout 1893 ms). Trace:
I20260709 12:13:48.325644  7688 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:48.316603  7734 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:48.330271  7734 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:48.330374  7733 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:48.330681  7734 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.331694  7620 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:48.332531  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1854) took 1146 ms. Trace:
I20260709 12:13:48.333789  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1853) took 3696 ms. Trace:
I20260709 12:13:48.339601  5598 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:48.340709  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:48.340996  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:48.342278  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:48.343547  5599 raft_consensus.cc:2393] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:48.344523  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:48.345788  5595 raft_consensus.cc:2393] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:48.350669  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:48.350888  7735 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:48.351838  5604 raft_consensus.cc:2393] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:13:48.321938  5600 rpcz_store.cc:269] 0709 12:13:45.675605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.900057 (+224452us) service_pool.cc:224] Handling call
0709 12:13:48.205198 (+2305141us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b540028c3d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:48.309284 (+104086us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914842880}
W20260709 12:13:48.352406  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 103444us
I20260709 12:13:48.337750  5603 rpcz_store.cc:276] 0709 12:13:44.637261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.535472 (+898211us) service_pool.cc:224] Handling call
0709 12:13:45.535789 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.386965 (+851176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.210021 (+1823056us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b540009d8d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:48.333608 (+123587us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755424000}
I20260709 12:13:48.321933  7606 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.369712  6293 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:48.371013  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 72651.2us
I20260709 12:13:48.372998  6291 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:48.373812  5675 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:13:48.375180  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:48.377194  7526 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:48.366532  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 113199us
I20260709 12:13:48.261368  6328 rpcz_store.cc:276] 0709 12:13:47.138992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.139136 (+   144us) service_pool.cc:224] Handling call
0709 12:13:47.139463 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:47.139802 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:13:47.139826 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:47.140256 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:13:47.531845 (+391589us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:47.531887 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.531952 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:48.260196 (+728244us) raft_consensus.cc:1685] finished
0709 12:13:48.260239 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.260583 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6750,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":391300,"threads_started":1,"wal-append.queue_time_us":633064}
I20260709 12:13:48.392382  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 281) took 2133 ms. Trace:
I20260709 12:13:48.391988  7733 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.392843  5673 rpcz_store.cc:276] 0709 12:13:46.227008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.227799 (+   791us) service_pool.cc:224] Handling call
0709 12:13:46.228085 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.799028 (+570943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.227699 (+1428671us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b540029bdd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:48.360017 (+132318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1311792896}
I20260709 12:13:48.395068  7670 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.395803  7712 raft_consensus.cc:697] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:48.398543  7726 raft_consensus.cc:697] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:48.399937  7716 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:48.400720  7716 consensus_queue.cc:1243] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:48.402349  7664 consensus_queue.cc:1059] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:48.403368  7664 consensus_queue.cc:1243] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:48.405130  7664 raft_consensus.cc:3055] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:48.407073  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:48.407970  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.408842  7675 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.412031  7432 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.412946  7432 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:48.415773  7432 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.417309  7395 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:13:48.419260  5716 connection.cc:256] RPC call timeout handler was delayed by -1.3189518859999225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 12:13:48.419600  5601 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:48.421617  7644 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.405579  7664 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:48.423146  5600 raft_consensus.cc:1275] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:48.423933  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 452) took 1237 ms. Trace:
I20260709 12:13:48.424996  5671 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:13:48.384186  7483 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:48.423941  7735 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:48.413340  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:48.421973  7539 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:48.393091  7526 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:48.390290  5598 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.428298  7361 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:48.429320  6324 rpcz_store.cc:276] 0709 12:13:47.186521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.186669 (+   148us) service_pool.cc:224] Handling call
0709 12:13:47.186959 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.699640 (+512681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.699669 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.699709 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:47.699742 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.423468 (+723726us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540059a954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:48.423535 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.423777 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178595712}
I20260709 12:13:48.435775  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:48.430214  7675 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:48.386261  7688 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:48.441708  7361 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.441946  7395 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:48.443509  7688 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.443974  7395 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.332897  5748 rpcz_store.cc:276] 0709 12:13:47.176186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.176311 (+   125us) service_pool.cc:224] Handling call
0709 12:13:47.176635 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:47.177014 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.177042 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:47.224749 (+ 47707us) log.cc:844] Serialized 52 byte log entry
0709 12:13:47.634798 (+410049us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:47.786158 (+151360us) log.cc:844] Serialized 14 byte log entry
0709 12:13:47.787840 (+  1682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.787912 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:47.935252 (+147340us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b1800289480. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:13:47.961054 (+ 25802us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:13:48.228805 (+267751us) raft_consensus.cc:1685] finished
0709 12:13:48.228841 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.322759 (+ 93918us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1273,"prepare.queue_time_us":124691,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":62385,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":16299,"spinlock_wait_cycles":10461440,"thread_start_us":447582,"threads_started":2,"wal-append.queue_time_us":513413}
W20260709 12:13:48.441401  5718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.007s	sys 0.007s
W20260709 12:13:48.440119  5602 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.010s	sys 0.012s
W20260709 12:13:48.448662  5718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.007s	sys 0.007s
I20260709 12:13:48.436187  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:48.450099  5603 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:48.451570  5602 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.010s	sys 0.013s
I20260709 12:13:48.397447  7712 consensus_queue.cc:237] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:48.453341  5570 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:48.443989  7361 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:48.445816  7735 raft_consensus.cc:697] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:48.444811  7526 raft_consensus.cc:697] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:48.463770  5673 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.461833  7644 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.464119  7734 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.453663  7688 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:48.466468  7395 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:48.470346  7675 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.475514  5498 catalog_manager.cc:5697] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.450984  7728 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:13:48.482499  7526 consensus_queue.cc:237] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.483394  7459 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.482523  5748 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:48.491677  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:48.491890  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:48.492465  6328 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.496069  7532 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.497370  7532 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:48.492589  5679 pending_rounds.cc:85] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 5
I20260709 12:13:48.498193  5679 pending_rounds.cc:107] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:13:48.498528  5679 raft_consensus.cc:2889] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:48.499496  7726 consensus_queue.cc:237] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:48.502224  7753 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:48.502947  7321 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:48.503221  7688 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:48.504931  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:48.505625  7688 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.506176  7688 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.506774  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:48.507507  5745 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.505473  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:48.510418  5752 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 2: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:48.503046  7721 raft_consensus.cc:3055] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:48.510694  7735 consensus_queue.cc:237] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.511169  7721 raft_consensus.cc:740] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:48.512493  7721 consensus_queue.cc:260] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.513495  5601 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:48.514218  7361 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.514958  7361 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.516381  7664 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.517899  7664 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.214428  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:48.520139  5645 connection.cc:256] RPC call timeout handler was delayed by -2.3510478569999123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 12:13:48.503070  7753 raft_consensus.cc:697] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:48.526196  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.518890  5498 catalog_manager.cc:5697] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.515679  7321 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:48.557621  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.551968  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:48.570839  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.571142  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.571797  5749 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:48.572252  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.572597  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:48.573971  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.560740  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.574689  7675 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:48.575158  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.575320  7675 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:48.553262  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:48.576587  5746 raft_consensus.cc:2393] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:48.577557  7675 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.506808  7688 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:48.532684  7733 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:48.558234  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.576772  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.580614  7688 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.537231  7361 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:48.538959  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 110067us
I20260709 12:13:48.582077  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.582499  6291 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:48.584398  6291 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:48.585461  7402 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:48.587924  7745 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:13:48.547834  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 134730us
I20260709 12:13:48.573670  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:48.588135  5645 connection.cc:256] RPC call timeout handler was delayed by -2.2270034659998146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
I20260709 12:13:48.569859  7753 consensus_queue.cc:237] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.532294  7734 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.591566  5497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45224 (request call id 306) took 8965 ms. Trace:
I20260709 12:13:48.592095  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:48.592944  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:48.594023  6319 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:48.594740  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:48.595384  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:48.532168  7602 consensus_meta.cc:287] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.669s	user 0.004s	sys 0.010s
I20260709 12:13:48.610507  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:48.584992  5498 catalog_manager.cc:5697] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 4, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 4 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.573469  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.551458  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.609040  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:48.588992  7321 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:48.540532  7644 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:48.629539  5604 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 2.
I20260709 12:13:48.629547  5673 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:48.628671  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:48.625962  5498 catalog_manager.cc:5697] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.632081  5746 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.633190  7361 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:48.633723  7361 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.635747  7361 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:48.636579  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:48.637586  6319 raft_consensus.cc:2410] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:13:48.631686  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.638671  5753 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.624912  7602 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:48.642189  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 818800us
I20260709 12:13:48.631642  5752 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:48.647909  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 47721.4us
I20260709 12:13:48.643968  7567 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.622692  7721 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.654202  7567 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:48.654769  7734 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:48.655588  7734 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.655973  7734 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.662300  5745 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:48.663794  5746 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:48.647063  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:48.651683  6328 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:48.646996  6293 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:48.667409  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 105930us
I20260709 12:13:48.670804  7402 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:48.671382  7745 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:48.672080  7745 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.670955  7567 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.643997  7602 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.671451  7402 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:48.676086  7745 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.677260  7321 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:48.676115  7402 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.679162  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:48.681102  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 213) took 1566 ms. Trace:
I20260709 12:13:48.682818  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:48.685956  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.688217  5753 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:48.682317  5602 rpcz_store.cc:276] 0709 12:13:47.104137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.749650 (+645513us) service_pool.cc:224] Handling call
0709 12:13:47.750028 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:48.474846 (+724818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:48.474902 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:48.475688 (+   786us) log.cc:844] Serialized 52 byte log entry
0709 12:13:48.614690 (+139002us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:48.614724 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.620712 (+  5988us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:48.667929 (+ 47217us) raft_consensus.cc:1685] finished
0709 12:13:48.667947 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.670015 (+  2068us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43474,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5365,"thread_start_us":767412,"threads_started":2,"wal-append.queue_time_us":165870}
I20260709 12:13:48.698477  5598 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
W20260709 12:13:48.703401  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.694154  7745 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:48.761739  7600 consensus_meta.cc:287] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.805s	user 0.010s	sys 0.004s
W20260709 12:13:48.768496  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.832885  7361 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.699620  5749 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:48.760906  7459 consensus_queue.cc:1059] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:13:48.875279  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.875164  7688 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:48.878386  7526 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.876084  7734 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.885171  7733 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:48.889143  7733 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:48.608415  5497 rpcz_store.cc:276] 0709 12:13:39.626447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.626716 (+   269us) service_pool.cc:224] Handling call
0709 12:13:48.591296 (+8964580us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:41.185974 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:41.395724 (+209750us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:41.397975 (+  2251us) write_op.cc:435] Acquired schema lock
0709 12:13:41.398468 (+   493us) tablet.cc:662] Decoding operations
0709 12:13:41.506975 (+108507us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:41.507045 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:41.507074 (+    29us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:13:41.507860 (+   786us) tablet.cc:701] Row locks acquired
0709 12:13:41.507878 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:13:41.508028 (+   150us) write_op.cc:270] Start()
0709 12:13:41.508151 (+   123us) write_op.cc:276] Timestamp: P: 1783599221507981 usec, L: 0
0709 12:13:41.508174 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:13:41.508922 (+   748us) log.cc:844] Serialized 4005 byte log entry
0709 12:13:42.452359 (+943437us) op_driver.cc:464] REPLICATION: finished
0709 12:13:42.555454 (+103095us) write_op.cc:301] APPLY: starting
0709 12:13:42.555541 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:42.555754 (+   213us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:42.568227 (+ 12473us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:42.572729 (+  4502us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:42.572940 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:13:42.572986 (+    46us) write_op.cc:312] APPLY: finished
0709 12:13:42.573307 (+   321us) log.cc:844] Serialized 77 byte log entry
0709 12:13:42.573526 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.573681 (+   155us) write_op.cc:454] Released schema lock
0709 12:13:42.573734 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:42.574196 (+   462us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.574228 (+    32us) write_op.cc:454] Released schema lock
0709 12:13:42.700964 (+126736us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b54003b9cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4832a 00007f44fd9cdf14 00007f44fd9cdec3 00007f44fd9cde38 00007f44fd9cddf3 00007f44fd9cd0dc 00007f44fd9f6e16 00007f44fd9decbb 00007f44fd9c939d 00007f44fd9ccd75
Metrics: {"mutex_wait_us":20762,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":78074,"apply.run_cpu_time_us":3347,"apply.run_wall_time_us":18708,"num_ops":10,"prepare.queue_time_us":306476,"prepare.run_cpu_time_us":34297,"prepare.run_wall_time_us":689490,"raft.queue_time_us":170000,"raft.run_cpu_time_us":12928,"raft.run_wall_time_us":271565,"replication_time_us":930294,"spinlock_wait_cycles":5408000,"thread_start_us":594015,"threads_started":4,"wal-append.queue_time_us":602390,"wal-append.run_cpu_time_us":24421,"wal-append.run_wall_time_us":1484550}]]}
I20260709 12:13:48.891523  7733 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:48.886605  7600 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.893235  7600 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:48.894181  7688 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:48.895568  7600 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:48.879977  7731 consensus_meta.cc:287] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.562s	user 0.005s	sys 0.014s
I20260709 12:13:48.883713  7675 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.883435  7745 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:48.896405  7688 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.899219  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:48.900224  7734 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:48.900509  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:48.901275  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 201528us
I20260709 12:13:48.901536  7402 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.902820  7395 raft_consensus.cc:3055] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:48.902954  7632 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.902143  7733 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:48.907554  7726 raft_consensus.cc:1064] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
W20260709 12:13:48.905313  5569 connection.cc:256] RPC call timeout handler was delayed by -1.6492314629999782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
W20260709 12:13:48.897318  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 197864us
I20260709 12:13:48.886533  5718 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:48.882436  7361 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:49.105818  5678 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:49.091694  7664 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:49.104493  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:49.092583  7712 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:13:49.114379  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:49.089998  7514 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:49.115245  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:49.115540  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:49.115911  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:48.999356  6328 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:49.102029  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:48.941511  7745 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.119962  5679 raft_consensus.cc:2393] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:48.943231  7483 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.116803  5678 raft_consensus.cc:2410] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:49.022488  5673 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:48.957593  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:49.118173  5675 raft_consensus.cc:2410] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:49.000859  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:49.020388  7765 log.cc:927] Time spent T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 12:13:49.110459  7726 raft_consensus.cc:1068] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:49.102778  5672 raft_consensus.cc:1240] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:49.000233  6319 raft_consensus.cc:2410] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:13:48.957492  7395 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:49.132522  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:48.974668  7586 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.977054  7606 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.913678  7731 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.121846  5670 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:49.126425  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:49.144644  5674 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.971693  7432 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:49.112246  5569 connection.cc:256] RPC call timeout handler was delayed by -1.0514052690000426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
I20260709 12:13:48.971539  7526 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.112854  7632 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.133302  5677 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:49.139530  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:49.006206  7675 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:49.026602  7402 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.135684  5719 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:49.151788  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:49.139438  7712 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:13:49.156737  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 281708us
I20260709 12:13:49.122426  7514 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.131259  7483 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:49.160571  5673 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:49.162009  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:49.135483  7664 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.133582  7586 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:49.168390  7629 consensus_queue.cc:1059] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:13:49.169438  7629 raft_consensus.cc:3055] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:49.169816  7629 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:49.166183  6324 raft_consensus.cc:2410] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:13:49.144116  7716 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:13:49.168053  7605 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.171283  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:49.202167  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 46706.6us
I20260709 12:13:49.206486  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:49.209444  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.207127  5679 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:49.216097  5677 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:13:49.166299  7726 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:49.169883  7586 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:49.160588  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:49.223796  7726 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:13:49.226640  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 343715us
I20260709 12:13:49.159186  7606 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:49.228111  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:49.228780  5677 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:49.167645  7432 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:49.225220  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:49.237329  5676 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:49.217571  7321 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:13:49.199502  7733 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:49.244973  5671 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:49.245834  5674 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:49.242252  5642 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:49.170902  7629 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.232333  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:49.247850  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 155895us
I20260709 12:13:49.249567  6325 raft_consensus.cc:2410] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:49.250046  5679 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:49.250906  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:49.261727  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:49.228134  7605 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.266022  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:49.268487  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 49959.4us
I20260709 12:13:49.269690  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:49.269942  7514 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:49.270402  7629 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.271059  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:49.271636  6321 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:49.272953  7483 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:49.273689  5679 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:49.274487  6320 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:49.278287  7402 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:49.279292  7432 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:49.268400  5642 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:49.261085  7670 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:49.288897  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:49.289915  7726 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.291632  7632 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:49.294211  7605 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:49.297971  7664 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:49.264628  7361 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:49.298681  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:49.298823  7361 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.299409  7361 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.300475  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:49.301026  5677 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.301440  7361 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:49.302007  7567 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:49.302615  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:49.326603  6327 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:49.289436  7629 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:13:49.461968  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:49.538808  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:49.454160  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:49.454872  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.458204  5596 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:49.551725  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:49.333477  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.453970  5674 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:49.553150  5598 raft_consensus.cc:2393] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:13:49.352999  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 186711us
I20260709 12:13:49.553918  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:49.407711  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.496088  5677 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:49.462643  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:49.454535  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:49.514057  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 265525us
I20260709 12:13:49.558135  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:49.545686  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:49.450516  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.562559  6293 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:49.562486  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:49.528577  7483 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.459511  7233 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:49.565790  5676 raft_consensus.cc:2393] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:49.458739  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.510761  7526 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:49.513994  7675 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:49.462338  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.348644  7670 raft_consensus.cc:697] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:49.487054  7361 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:49.454895  7733 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:49.506844  7432 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.308858  7753 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.569809  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:49.570221  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:49.459560  7402 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:49.462620  7395 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:49.573071  5749 raft_consensus.cc:1275] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:49.572873  7742 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:13:49.573364  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:49.349356  7600 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:49.559299  7745 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.576718  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:49.893276  5645 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:49.600409  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:13:49.632174  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.600384  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.932552  5598 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.831132  5678 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:49.568168  7664 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:49.588050  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.568199  7567 raft_consensus.cc:697] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:49.673054  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:49.892912  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:49.930335  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:49.787789  6324 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:49.725751  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:49.603848  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.578009  5718 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:13:49.889406  7773 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 12:13:49.938421  5601 raft_consensus.cc:2410] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:13:49.606336  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:49.941495  5596 raft_consensus.cc:2376] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 7. Re-sending same reply.
I20260709 12:13:49.941643  7732 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:49.941956  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:49.942176  7732 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:49.940852  5600 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:49.569185  7233 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:49.942625  5601 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.942682  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.942608  7732 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.944949  7402 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.947423  7600 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:49.948648  7402 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:49.573441  7349 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.957002  7629 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:49.957309  6328 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:49.946789  7395 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.949156  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:49.628855  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:49.958268  7745 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:49.967365  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 380379us
I20260709 12:13:49.967921  5598 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:49.968844  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.969220  7712 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:49.957944  5752 raft_consensus.cc:1275] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:49.960286  6323 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:49.606019  6320 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:49.960245  7670 consensus_queue.cc:237] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:49.955193  5597 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:49.891374  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.746176  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:49.868006  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:49.961561  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.969430  5598 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:49.946455  5596 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:49.971922  5719 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:49.934064  7606 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:49.958729  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 392882us
I20260709 12:13:49.978708  7731 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:49.945379  7733 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:50.023614  7772 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:50.024099  7644 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:50.025233  5718 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:50.023131  5601 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:49.976085  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:49.959767  6325 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:49.974445  6293 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:49.601879  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:49.939589  7664 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:49.578697  7483 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:49.950105  7233 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.960978  6319 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:50.021085  5600 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:50.011047  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:50.006896  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:50.031862  7349 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.035923  6324 raft_consensus.cc:2393] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:49.946264  7432 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:50.036748  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:49.986294  7567 consensus_queue.cc:237] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:50.031641  6291 connection.cc:256] RPC call timeout handler was delayed by -1.0981619249998857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 12:13:49.983771  7777 log.cc:927] Time spent T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Append to log took a long time: real 0.314s	user 0.005s	sys 0.000s
W20260709 12:13:50.034737  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 62548.5us
I20260709 12:13:50.056319  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:49.982767  5744 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:50.037290  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 65452.6us
I20260709 12:13:50.001855  7600 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:50.040053  7644 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:50.061182  7644 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.061555  7644 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.990110  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:50.062508  6323 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 2: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:50.064616  7349 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:50.064793  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.065160  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.065493  5602 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 4: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:50.065654  5746 raft_consensus.cc:2393] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:50.066911  7774 consensus_queue.cc:1059] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:50.067811  7774 raft_consensus.cc:3055] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:50.068152  7774 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:50.069308  5744 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:13:50.038976  5597 raft_consensus.cc:2393] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:50.065179  7349 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:50.070480  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:50.070393  7349 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.071187  5597 raft_consensus.cc:2393] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:50.071900  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.037314  5595 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:50.032895  7664 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.072497  5597 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:50.073417  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:50.036949  7775 raft_consensus.cc:2764] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:13:50.042451  7732 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.074395  6327 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:50.037951  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 144818us
I20260709 12:13:50.075593  7732 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:50.043208  6322 raft_consensus.cc:2393] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:49.977114  7753 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.078116  7753 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:50.077939  7600 consensus_queue.cc:1059] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:50.044101  5679 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:50.079103  7402 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.079407  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:50.079878  7606 raft_consensus.cc:3055] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:50.080262  7606 raft_consensus.cc:740] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:50.080904  5679 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:13:50.081053  7606 consensus_queue.cc:260] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.044906  5676 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:50.045398  7432 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:50.047032  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.035130  7361 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.051544  7629 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:50.052253  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:50.052713  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.052960  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:50.024091  7733 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.037093  7712 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:50.054337  5603 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:50.055888  7483 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:50.056350  5675 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:50.011943  6320 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:50.139611  5596 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:50.068933  7774 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.072296  5752 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
W20260709 12:13:50.043694  5642 leader_election.cc:336] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.539s (SENT)
W20260709 12:13:50.077883  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.098496  6327 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:50.095428  5716 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:50.072453  7349 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:50.099355  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.060184  7731 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:50.093464  7606 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.099107  6321 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:50.144266  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:50.147161  5597 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:50.181705  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.182315  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 143229us
I20260709 12:13:50.123405  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:50.144215  7753 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.082188  7402 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.202351  7629 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.150929  7712 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.195431  5570 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:50.173069  7731 raft_consensus.cc:697] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:50.195375  7780 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:50.228251  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.229054  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.234984  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 64625.6us
I20260709 12:13:50.235124  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:50.223052  7782 log.cc:927] Time spent T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:13:50.238395  7675 consensus_queue.cc:1059] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:13:50.259392  7712 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:50.264850  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:50.265743  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 222075us
I20260709 12:13:50.228690  7459 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:13:50.324941  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.330132  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1115) took 1274 ms. Trace:
I20260709 12:13:50.208493  7753 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:50.330389  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 247681us
I20260709 12:13:50.321460  7780 consensus_queue.cc:1059] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:13:50.341843  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:50.330643  5671 rpcz_store.cc:276] 0709 12:13:49.030322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.030449 (+   127us) service_pool.cc:224] Handling call
0709 12:13:50.304559 (+1274110us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54002d4454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:50.304703 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279041024}
I20260709 12:13:50.334120  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 400) took 1069 ms. Trace:
I20260709 12:13:50.342687  6328 rpcz_store.cc:276] 0709 12:13:49.254570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.254712 (+   142us) service_pool.cc:224] Handling call
0709 12:13:50.323984 (+1069272us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400513bd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:50.324108 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598448512}
I20260709 12:13:50.259398  7716 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.345391  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:50.346035  5673 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.253039  7402 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:50.339277  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.334643  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:50.259457  7675 raft_consensus.cc:3055] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:50.248225  7483 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:13:50.338243  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 69378.8us
I20260709 12:13:50.347822  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:50.354079  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.360314  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.354858  5596 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:50.357534  5716 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:50.365746  6291 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:50.370071  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 109567us
I20260709 12:13:50.370568  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:50.368583  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:50.331219  7349 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:13:50.248368  7233 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.375638  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.349273  7483 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.346726  7361 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:50.349447  7675 raft_consensus.cc:740] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:50.351490  7774 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.377624  5671 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:50.379096  5600 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:50.380513  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.385834  5598 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:50.385933  7796 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.386727  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.379086  5645 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:50.383064  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.402683  5598 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 2.
I20260709 12:13:50.403321  5603 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:50.367220  7402 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.351878  7742 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:13:50.374352  7779 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:50.402815  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.405125  5677 raft_consensus.cc:2393] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:50.412159  5596 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:50.405019  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.405238  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:50.402863  5716 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:50.377210  7395 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:50.381219  7483 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:50.362548  7670 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:13:50.353645  7716 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:50.445204  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 66394.9us
I20260709 12:13:50.414306  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:50.451817  5603 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.451902  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:50.384467  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:50.457260  5673 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:50.458725  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.461793  5598 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:50.462709  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.461090  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:50.406050  7712 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:50.464442  5600 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:50.366756  7786 consensus_queue.cc:1059] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 12:13:50.439901  7349 consensus_queue.cc:1243] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer c02ed29558db481589fd3db23e43a07f log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:13:50.411696  7779 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:50.441660  7395 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:50.484315  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 105304us
I20260709 12:13:50.482103  5595 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:13:50.412286  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:50.486557  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.487435  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:50.369095  7731 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.488231  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1904) took 1035 ms. Trace:
I20260709 12:13:50.492460  7799 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:50.510854  5595 rpcz_store.cc:276] 0709 12:13:49.452908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.036485 (+583577us) service_pool.cc:224] Handling call
0709 12:13:50.488176 (+451691us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:50.463836  7780 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.497506  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.498937  5744 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:50.499287  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.499765  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.500078  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.498937  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.501209  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.508518  7395 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.497313  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.528142  5750 raft_consensus.cc:2393] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:50.480919  7712 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.480774  7432 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:50.527422  5748 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:50.523976  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.526893  5749 raft_consensus.cc:2410] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:50.530650  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:50.530970  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.555079  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.555790  5598 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:50.556283  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.482630  7733 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:50.417292  7402 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.556707  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:50.557965  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.551856  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.558552  5598 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:13:50.559098  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1924) took 1034 ms. Trace:
I20260709 12:13:50.559433  5598 rpcz_store.cc:276] 0709 12:13:49.524418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.557689 (+1033271us) service_pool.cc:224] Handling call
0709 12:13:50.559043 (+  1354us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:50.560055  7733 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:50.560494  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.561162  5598 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:50.562254  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:50.554711  5716 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:50.509613  7779 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:50.559477  6328 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:50.515277  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:50.526218  7786 consensus_queue.cc:1243] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer c02ed29558db481589fd3db23e43a07f log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:13:50.592777  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:50.533363  5674 raft_consensus.cc:1275] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:50.602870  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:50.588856  5595 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:13:50.510056  7732 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:50.584811  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.480501  7664 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.607947  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1900) took 1155 ms. Trace:
I20260709 12:13:50.609066  5595 rpcz_store.cc:276] 0709 12:13:49.452049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.555950 (+1103901us) service_pool.cc:224] Handling call
0709 12:13:50.607865 (+ 51915us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:50.610277  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 205112us
I20260709 12:13:50.551496  7793 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.614730  5567 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:50.531960  7726 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.553676  7712 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.616437  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:50.618969  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 102539us
I20260709 12:13:50.554162  7432 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:50.618597  5748 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:50.624328  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.510174  7800 consensus_queue.cc:1059] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 12:13:50.628887  5595 raft_consensus.cc:1275] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:50.629474  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1902) took 1177 ms. Trace:
I20260709 12:13:50.629652  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.629850  5595 rpcz_store.cc:276] 0709 12:13:49.452466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.610140 (+1157674us) service_pool.cc:224] Handling call
0709 12:13:50.620752 (+ 10612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.629232 (+  8480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.629425 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:50.609901  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:50.526880  7799 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:50.632284  5645 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:50.635764  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:50.637346  5746 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:50.625174  7432 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.642395  7233 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:50.642768  7567 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.634654  6321 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:50.643846  5599 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:50.636406  5748 raft_consensus.cc:2376] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5. Re-sending same reply.
W20260709 12:13:50.634812  7644 consensus_meta.cc:287] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.005s
I20260709 12:13:50.666107  5600 raft_consensus.cc:2410] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:13:50.667037  5595 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:50.617022  7721 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:13:50.670409  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:50.670334  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 59325.2us
I20260709 12:13:50.687862  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:13:50.670459  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 43638.2us
I20260709 12:13:50.671542  5603 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
W20260709 12:13:50.643503  7795 log.cc:927] Time spent T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:13:50.676182  7798 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.634583  7632 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:50.621956  7793 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.631757  7726 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.646399  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:50.696203  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.703790  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:50.703593  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 194478us
I20260709 12:13:50.704747  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.697817  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1921) took 1171 ms. Trace:
I20260709 12:13:50.706228  5600 rpcz_store.cc:276] 0709 12:13:49.523543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.694171 (+1170628us) service_pool.cc:224] Handling call
0709 12:13:50.694490 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.694670 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.694693 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:50.694732 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:50.694759 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.694810 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.694915 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:50.707541  5746 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:50.697738  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 233) took 1238 ms. Trace:
W20260709 12:13:50.699007  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 79517.2us
I20260709 12:13:50.708940  5595 rpcz_store.cc:276] 0709 12:13:49.455714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.630747 (+1175033us) service_pool.cc:224] Handling call
0709 12:13:50.666733 (+ 35986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.686641 (+ 19908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.693811 (+  7170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:50.709982  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:50.685433  7732 raft_consensus.cc:697] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:50.680145  7806 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:50.695808  7233 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:50.697312  5672 consensus_meta.cc:287] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.001s
I20260709 12:13:50.706327  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1916) took 1188 ms. Trace:
I20260709 12:13:50.741881  7402 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:50.736897  7794 log.cc:927] Time spent T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
W20260709 12:13:50.749367  5597 consensus_meta.cc:287] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.003s
I20260709 12:13:50.745934  5744 raft_consensus.cc:2393] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:50.735805  7804 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.704035  7632 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:50.736424  7805 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.696455  7753 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:50.739300  7675 consensus_queue.cc:260] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:50.738988  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 50235.8us
I20260709 12:13:50.836115  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:50.836038  5678 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:50.735316  5595 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:50.753830  6328 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:50.737015  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.837746  5752 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:50.736425  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.782125  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1928) took 1206 ms. Trace:
I20260709 12:13:50.838555  5600 rpcz_store.cc:276] 0709 12:13:49.575541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.707236 (+1131695us) service_pool.cc:224] Handling call
0709 12:13:50.707544 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.711722 (+  4178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.711748 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:50.781826 (+ 70078us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:50.781876 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.781939 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.782061 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:50.696799  7644 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:50.760644  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.814378  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 200918us
W20260709 12:13:50.815979  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 223270us
I20260709 12:13:50.748190  7716 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:50.749394  7806 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:50.982463  7806 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.982321  7775 consensus_queue.cc:1059] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:50.983168  7775 consensus_queue.cc:1243] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer c02ed29558db481589fd3db23e43a07f log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:13:50.983670  7775 raft_consensus.cc:3055] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:50.983982  7775 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:13:50.984781  7810 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.161s	user 0.002s	sys 0.000s
I20260709 12:13:50.822084  5597 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:50.816570  5672 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:50.978768  7804 consensus_queue.cc:1059] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:13:50.783726  6322 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:13:50.735960  7801 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:50.817427  7233 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.841449  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.001822  7233 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.004021  7567 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:51.004568  5597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 232) took 1549 ms (client timeout 2018 ms). Trace:
W20260709 12:13:51.004980  5597 rpcz_store.cc:269] 0709 12:13:49.455422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.073179 (+617757us) service_pool.cc:224] Handling call
0709 12:13:51.004413 (+931234us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b54003e4754. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:51.004511 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168327040}
I20260709 12:13:51.006898  5603 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:51.007509  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1926) took 1482 ms. Trace:
I20260709 12:13:51.008670  5752 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:13:51.007805  5603 rpcz_store.cc:276] 0709 12:13:49.525012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.006274 (+1481262us) service_pool.cc:224] Handling call
0709 12:13:51.006578 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.007239 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.007425 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:51.012540  5596 consensus_meta.cc:287] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.503s	user 0.001s	sys 0.005s
I20260709 12:13:51.013429  5596 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:50.891420  7805 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:50.842463  7664 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:50.937958  7790 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:13:50.836593  7402 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.984825  7775 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:50.992390  7774 consensus_meta.cc:287] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.000s
I20260709 12:13:50.832967  7732 consensus_queue.cc:237] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:50.995002  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.996254  7779 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:50.997313  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.997586  7606 consensus_meta.cc:287] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.824s	user 0.005s	sys 0.005s
I20260709 12:13:50.998667  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:50.998872  7786 consensus_queue.cc:1059] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:50.999264  7793 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:50.999876  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.001346  7801 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:51.001525  7349 raft_consensus.cc:3055] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:13:50.891579  7753 consensus_queue.cc:1059] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
W20260709 12:13:50.947149  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 175121us
I20260709 12:13:50.818079  5599 rpcz_store.cc:276] 0709 12:13:49.518255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.643277 (+1125022us) service_pool.cc:224] Handling call
0709 12:13:50.643662 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.686497 (+ 42835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.704458 (+ 17961us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:51.009569  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.037498  5595 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:13:51.058094  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 235) took 1049 ms. Trace:
I20260709 12:13:51.058424  5595 rpcz_store.cc:276] 0709 12:13:50.008336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.837522 (+829186us) service_pool.cc:224] Handling call
0709 12:13:51.037033 (+199511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.057799 (+ 20766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.058034 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:51.042271  5567 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:51.045608  5753 raft_consensus.cc:1240] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:51.051367  7459 raft_consensus.cc:3055] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:51.061690  7459 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:51.062263  5679 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:51.062700  7459 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.017656  7776 raft_consensus.cc:1064] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:51.052649  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:51.064116  7776 raft_consensus.cc:1068] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:51.018975  7602 raft_consensus.cc:1064] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:51.064019  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:51.065011  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.065696  5753 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
W20260709 12:13:51.063409  5602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 228) took 1760 ms (client timeout 1553 ms). Trace:
I20260709 12:13:51.066514  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.029587  7349 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:51.064502  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1691) took 1009 ms. Trace:
I20260709 12:13:51.025528  5746 raft_consensus.cc:2376] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6. Re-sending same reply.
W20260709 12:13:51.025048  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.066787  5602 rpcz_store.cc:269] 0709 12:13:49.302993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.303147 (+   154us) service_pool.cc:224] Handling call
0709 12:13:51.063194 (+1760047us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54002684d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:51.063321 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1169083776}
I20260709 12:13:51.073508  5749 raft_consensus.cc:2368] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5.
I20260709 12:13:51.047626  5600 raft_consensus.cc:3055] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:51.074592  5600 raft_consensus.cc:740] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:51.017488  5596 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:51.021126  5603 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.068548  5753 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:13:51.050884  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:51.044227  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 65453.2us
I20260709 12:13:51.073266  5678 rpcz_store.cc:276] 0709 12:13:50.055341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.056067 (+   726us) service_pool.cc:224] Handling call
0709 12:13:51.064352 (+1008285us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b540007a154. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:51.064445 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714417408}
I20260709 12:13:51.132596  5596 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:13:51.136214  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 44901.4us
W20260709 12:13:51.137193  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.137610  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:51.026927  7809 raft_consensus.cc:3055] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:51.030520  7753 raft_consensus.cc:3055] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:51.041946  7675 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:51.019595  7483 consensus_meta.cc:287] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.000s
I20260709 12:13:51.022856  7775 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.027779  7801 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.039961  5599 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:51.036154  7726 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:51.027366  7779 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:51.015434  7805 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:51.148614  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.137418  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.038715  7632 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:51.144428  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.063421  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:51.159911  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.169431  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.162134  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 398761us
I20260709 12:13:51.013798  7395 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.022241  7402 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.040155  7233 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.021881  7712 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.144629  7809 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:51.042965  7800 consensus_queue.cc:1059] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 12:13:51.146126  7753 raft_consensus.cc:740] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:51.032467  7806 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:51.148142  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.255697  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.156522  7644 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:51.167070  5596 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.157483  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:51.145684  7776 consensus_queue.cc:1059] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 12:13:51.182075  6291 leader_election.cc:336] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.649s (SENT)
I20260709 12:13:51.183230  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:51.257917  6327 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.168298  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:13:51.243120  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 56586.7us
I20260709 12:13:51.260361  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.270419  5675 raft_consensus.cc:1240] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:51.271363  5752 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:51.157291  7483 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:51.284672  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 448592us
I20260709 12:13:51.179890  7459 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.286283  5751 raft_consensus.cc:2368] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
I20260709 12:13:51.172351  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:51.165912  7432 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.142838  7602 consensus_queue.cc:237] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.320286  5570 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.319746  6327 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:51.328845  5598 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:51.287266  7800 consensus_queue.cc:1243] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer c02ed29558db481589fd3db23e43a07f log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:51.324888  5718 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:51.301095  7816 raft_consensus.cc:3055] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:51.343514  7816 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:51.323791  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:51.346338  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 167112us
W20260709 12:13:51.346639  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 175335us
I20260709 12:13:51.338768  7822 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:51.339772  7820 log.cc:927] Time spent T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:13:51.342072  7776 consensus_queue.cc:1059] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:51.342675  7321 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:51.349748  5671 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.355123  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:51.355932  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.358619  7233 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:51.355219  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:51.360407  5718 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.360960  7632 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:51.362341  7644 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:51.401027  7806 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:51.402582  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.403369  5671 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:51.403754  7402 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:51.405179  6293 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.353713  7822 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.303113  7629 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:13:51.183743  7349 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.362123  7809 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.364666  7483 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:51.367750  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 75611.1us
I20260709 12:13:51.419391  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:51.320976  6321 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:51.373894  7753 consensus_queue.cc:260] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:51.377421  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.378134  7828 consensus_queue.cc:1059] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:51.379698  6324 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:51.302021  7779 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:13:51.388239  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.388418  7804 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:51.426153  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:51.390147  5745 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:51.392379  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:51.344403  7816 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.396932  6328 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.407164  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.307163  6320 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
W20260709 12:13:51.409066  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 48732.9us
I20260709 12:13:51.409336  7632 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:51.408537  7776 raft_consensus.cc:3055] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:51.413475  7395 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:51.398151  7712 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:51.428720  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 362452us
I20260709 12:13:51.433990  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.394325  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.422051  7817 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.450896  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.451308  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.451583  5673 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:13:51.452482  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 230) took 2144 ms. Trace:
I20260709 12:13:51.452080  5677 raft_consensus.cc:2393] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:51.438688  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.436208  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:51.435611  5642 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:51.405730  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.456418  5753 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:51.412806  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.407073  7822 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.398087  5750 raft_consensus.cc:2376] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6. Re-sending same reply.
I20260709 12:13:51.430511  7402 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:51.407262  5599 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:51.444067  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.445290  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:51.445956  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.470459  5678 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 2.
I20260709 12:13:51.435217  7459 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:51.432449  7804 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.443279  7776 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:51.429914  7233 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:13:51.478272  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.463112  5718 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:13:51.474092  5642 connection.cc:256] RPC call timeout handler was delayed by -1.3002089770000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 12:13:51.463450  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 155750us
I20260709 12:13:51.415717  7629 consensus_queue.cc:1059] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:13:51.429379  7733 consensus_queue.cc:1059] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:13:51.468672  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.452047  7632 raft_consensus.cc:697] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:51.452905  5604 rpcz_store.cc:276] 0709 12:13:49.308270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.308380 (+   110us) service_pool.cc:224] Handling call
0709 12:13:49.455107 (+146727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:50.093958 (+638851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.093990 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:50.144118 (+ 50128us) log.cc:844] Serialized 26 byte log entry
0709 12:13:50.333589 (+189471us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:50.451158 (+117569us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.595542 (+144384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.744407 (+148865us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540048e254. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:50.744454 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:51.417134 (+672680us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b24001818f8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa7e49c4 00007f44fa7e2acb 00007f44fa99ddc9 00007f44fa99da55 00007f44fa99cfb0 00007f44fd613488 00007f44fd613be8 00007f44fd5eb398 00007f44fd5e676a 00007f44fd5e5bb6
0709 12:13:51.452259 (+ 35125us) raft_consensus.cc:1685] finished
0709 12:13:51.452281 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.452420 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11892,"prepare.queue_time_us":181569,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":41836,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":76329,"spinlock_wait_cycles":1566037504,"thread_start_us":331206,"threads_started":3,"wal-append.queue_time_us":179749}
I20260709 12:13:51.473555  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.436710  7824 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:51.459407  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 65210.8us
I20260709 12:13:51.474689  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:51.429574  7805 consensus_queue.cc:1059] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:13:51.458683  7816 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.468765  7664 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:51.474813  7459 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.470624  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.495277  5567 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.465245  7402 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.484109  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.498319  5678 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:13:51.488493  5753 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:51.477228  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.500327  5677 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:51.468676  7780 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:51.487883  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.502362  6291 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:51.443928  7806 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:13:51.465371  7786 consensus_queue.cc:1059] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
W20260709 12:13:51.506937  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 43897.4us
I20260709 12:13:51.491312  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.507673  5718 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.494091  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.508566  5751 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:51.497153  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:51.509868  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 413) took 1023 ms. Trace:
I20260709 12:13:51.510529  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.510942  7776 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.511662  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.512225  7776 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.512629  7793 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:51.513023  7793 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.513340  7793 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.510265  6322 rpcz_store.cc:276] 0709 12:13:50.486171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.508359 (+ 22188us) service_pool.cc:224] Handling call
0709 12:13:51.497907 (+989548us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54000938d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:51.509798 (+ 11891us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257271680}
I20260709 12:13:51.515645  7632 consensus_queue.cc:237] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.477747  7804 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.516405  7799 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:51.517954  7731 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:51.519426  7432 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:51.520277  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.497787  7459 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.520956  7780 raft_consensus.cc:697] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:51.521499  5752 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:51.521678  7644 raft_consensus.cc:3055] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:13:51.522109  7644 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:51.522964  7644 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.524220  7644 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:51.525306  7812 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:51.502610  7402 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:51.525878  7812 raft_consensus.cc:697] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:51.526862  7812 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.529928  7526 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:51.531378  7526 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:51.531848  7526 raft_consensus.cc:697] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:51.532747  7526 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.536618  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.537257  5750 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.466708  7817 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.504920  7832 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.503069  5671 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:51.504531  5604 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:13:51.505506  5567 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.483121  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.485958  7753 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.542291  7780 consensus_queue.cc:237] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.551551  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.552762  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.553310  5745 raft_consensus.cc:2376] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3. Re-sending same reply.
I20260709 12:13:51.520426  7514 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:51.492296  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1742) took 1002 ms. Trace:
I20260709 12:13:51.553591  6293 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.554008  5599 rpcz_store.cc:276] 0709 12:13:50.488182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.286935 (+798753us) service_pool.cc:224] Handling call
0709 12:13:51.333536 (+ 46601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.470018 (+136482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.490191 (+ 20173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:51.500502  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.544723  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1740) took 1061 ms. Trace:
I20260709 12:13:51.521463  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.489955  6326 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:51.491744  7809 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.546401  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.566206  5673 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
W20260709 12:13:51.549836  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 44397.7us
I20260709 12:13:51.547923  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1744) took 1058 ms. Trace:
I20260709 12:13:51.557842  5601 rpcz_store.cc:276] 0709 12:13:50.482944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.145465 (+662521us) service_pool.cc:224] Handling call
0709 12:13:51.162619 (+ 17154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.320787 (+158168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.320814 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:51.349875 (+ 29061us) log.cc:844] Serialized 26 byte log entry
0709 12:13:51.468334 (+118459us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:51.468376 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.479555 (+ 11179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:51.544497 (+ 64942us) raft_consensus.cc:1685] finished
0709 12:13:51.544516 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.544666 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1977,"raft.queue_time_us":216372,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":170300,"threads_started":2,"wal-append.queue_time_us":56735}
I20260709 12:13:51.493229  7664 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:51.489938  7831 raft_consensus.cc:2764] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:51.565516  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:51.558635  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 51046.9us
I20260709 12:13:51.578127  5677 raft_consensus.cc:2410] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:13:51.578796  5718 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.567214  5604 rpcz_store.cc:276] 0709 12:13:50.489391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.486967 (+997576us) service_pool.cc:224] Handling call
0709 12:13:51.504208 (+ 17241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.547553 (+ 43345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.547862 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:51.568054  5749 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:51.556428  7514 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:51.567381  5567 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.575687  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.520210  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.583154  5678 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 2.
I20260709 12:13:51.583837  5673 raft_consensus.cc:1240] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.583365  5718 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.556807  7733 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.590261  5677 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.577508  7664 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:51.572335  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 221858us
I20260709 12:13:51.586551  7514 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.581316  7805 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.630452  5753 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.602686  7819 consensus_queue.cc:1059] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:13:51.631594  7819 raft_consensus.cc:3055] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:51.631927  7819 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:51.632711  7819 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.623036  7804 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.604884  7816 consensus_queue.cc:1059] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:13:51.635963  7816 raft_consensus.cc:3055] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:51.636355  7816 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:51.627256  7459 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:51.630447  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 63119us
I20260709 12:13:51.639446  7459 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:51.639595  7483 raft_consensus.cc:3055] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:51.640035  7483 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:51.640266  5679 raft_consensus.cc:2368] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
I20260709 12:13:51.591912  7800 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.640852  7483 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.637133  7816 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.644472  7816 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.644855  7402 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.628955  7801 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.575855  7806 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:13:51.593253  7776 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:51.604508  5569 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:51.640394  5567 leader_election.cc:336] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.722s (SENT)
I20260709 12:13:51.622800  7712 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.648725  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1747) took 1157 ms. Trace:
I20260709 12:13:51.663247  5601 rpcz_store.cc:276] 0709 12:13:50.491165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.587523 (+1096358us) service_pool.cc:224] Handling call
0709 12:13:51.605317 (+ 17794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.648390 (+ 43073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.648416 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:51.648459 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:51.648492 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.648551 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.648669 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:51.664674  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.651218  7819 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.648694  5750 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:51.651373  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1743) took 1162 ms. Trace:
W20260709 12:13:51.652508  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 172986us
I20260709 12:13:51.673388  5603 rpcz_store.cc:276] 0709 12:13:50.488779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.410787 (+922008us) service_pool.cc:224] Handling call
0709 12:13:51.411203 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:51.411643 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.411672 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:51.412342 (+   670us) log.cc:844] Serialized 52 byte log entry
0709 12:13:51.486656 (+ 74314us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:51.650739 (+164083us) log.cc:844] Serialized 14 byte log entry
0709 12:13:51.651046 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.651132 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:51.651172 (+    40us) raft_consensus.cc:1685] finished
0709 12:13:51.651185 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.651315 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14110,"raft.queue_time_us":11382,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":2071,"thread_start_us":175422,"threads_started":2,"wal-append.queue_time_us":69465}
W20260709 12:13:51.656000  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 144391us
I20260709 12:13:51.675530  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.677059  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:51.677737  5601 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:51.661856  7843 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:51.649695  7793 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.662357  7731 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:13:51.683450  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 79039.3us
I20260709 12:13:51.686308  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:51.687948  5603 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:13:51.688086  5569 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:51.689253  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.689795  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.690377  5569 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:51.691032  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.691748  5750 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:51.651510  7483 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:51.680006  5747 raft_consensus.cc:2410] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:51.673445  7799 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.670238  7804 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:51.698810  7733 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.703668  7664 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:51.704895  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.718817  7801 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:51.711993  7840 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:51.695616  7800 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.719542  7840 raft_consensus.cc:697] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:51.720562  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.720479  7840 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.712702  7402 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:51.713884  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:51.687884  7843 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.721844  7833 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.722172  7843 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:51.661821  5672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:51.722811  5672 raft_consensus.cc:606] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.724026  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.724747  5679 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:51.725060  7664 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:51.681113  7822 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.725865  7664 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:51.726668  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.726744  7731 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.727690  7822 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:51.729082  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1749) took 1224 ms. Trace:
I20260709 12:13:51.729490  5602 rpcz_store.cc:276] 0709 12:13:50.504875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.728295 (+1223420us) service_pool.cc:224] Handling call
0709 12:13:51.728575 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.728749 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.728780 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:51.728828 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:51.728863 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.728925 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.729025 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:51.712020  5596 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.724843  5676 raft_consensus.cc:2410] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:13:51.734009  5642 connection.cc:256] RPC call timeout handler was delayed by -1.0845733750002182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:13:51.737344  5642 leader_election.cc:336] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.825s (SENT)
I20260709 12:13:51.731130  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1750) took 1169 ms. Trace:
I20260709 12:13:51.738523  5602 rpcz_store.cc:276] 0709 12:13:50.561867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.730383 (+1168516us) service_pool.cc:224] Handling call
0709 12:13:51.730646 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.730812 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.730838 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:51.730873 (+    35us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:51.730933 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.730982 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.731077 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:51.740542  6293 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.695897  5569 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:13:51.742597  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 46788.3us
I20260709 12:13:51.743273  5569 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:51.669477  7712 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.748003  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.748652  5750 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:51.749678  5642 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:51.751305  5752 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:51.751946  5746 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:51.754806  5601 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:51.755450  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1748) took 1263 ms. Trace:
I20260709 12:13:51.755820  5601 rpcz_store.cc:276] 0709 12:13:50.491726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.739895 (+1248169us) service_pool.cc:224] Handling call
0709 12:13:51.754435 (+ 14540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.755224 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.755399 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:51.700683  7812 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.757628  5602 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:13:51.757951  5596 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:13:51.761706  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 242) took 1738 ms. Trace:
I20260709 12:13:51.762442  5569 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:51.761098  5602 pending_rounds.cc:85] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 3
I20260709 12:13:51.763439  5602 pending_rounds.cc:107] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:13:51.763723  5569 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:51.763748  5602 raft_consensus.cc:2889] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:51.762262  5596 rpcz_store.cc:276] 0709 12:13:50.023226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.016860 (+993634us) service_pool.cc:224] Handling call
0709 12:13:51.017171 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.711797 (+694626us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b58007001d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9a70aa 00007f44fda29447 00007f44fda41fe7 00007f44fda437de 00007f44fda4db49 00007f44fda4e416 00007f44fda4ad8f 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4
0709 12:13:51.761193 (+ 49396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.761648 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":982490368}
I20260709 12:13:51.746742  7402 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:51.745167  7809 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:51.747501  7822 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:13:51.769011  5642 leader_election.cc:336] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.888s (SENT)
W20260709 12:13:51.769523  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.770228  5601 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:51.764853  5569 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:51.768539  7733 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:51.775962  7733 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:51.776326  7733 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:51.778241  7712 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:51.779472  7793 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:51.781874  7349 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:51.783730  7733 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:51.784792  5600 consensus_queue.cc:260] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.753147  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.802762  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:13:51.801105  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.804006  5750 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:51.769568  7361 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:13:51.760069  7459 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.767889  7833 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.811447  5601 raft_consensus.cc:1275] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:51.806406  5569 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:13:51.775547  5642 leader_election.cc:336] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 2.138s (SENT)
I20260709 12:13:51.812980  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.807183  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1746) took 1316 ms. Trace:
I20260709 12:13:51.760241  7832 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.771775  7402 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.815745  5569 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.771508  7526 consensus_queue.cc:1059] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 12:13:51.819921  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 74822.8us
I20260709 12:13:51.803258  7804 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:51.814219  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 137767us
I20260709 12:13:51.818897  5719 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.818305  5569 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:13:51.824846  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 49332.6us
I20260709 12:13:51.825403  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.826159  5748 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:51.826704  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:51.768898  7812 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:51.813673  5599 rpcz_store.cc:276] 0709 12:13:50.490568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.554824 (+1064256us) service_pool.cc:224] Handling call
0709 12:13:51.555142 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:51.555513 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.555538 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:51.556138 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 12:13:51.693641 (+137503us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:51.693684 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.693770 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:51.791525 (+ 97755us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:13:51.799637 (+  8112us) raft_consensus.cc:1685] finished
0709 12:13:51.799661 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.807112 (+  7451us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":458,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"spinlock_wait_cycles":12556672,"thread_start_us":137068,"threads_started":1,"wal-append.queue_time_us":203475}
I20260709 12:13:51.829003  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 237) took 1819 ms. Trace:
I20260709 12:13:51.829020  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.829434  5598 rpcz_store.cc:276] 0709 12:13:50.010067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.562042 (+551975us) service_pool.cc:224] Handling call
0709 12:13:51.828843 (+1266801us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b540008cad4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:51.828952 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744903424}
I20260709 12:13:51.817543  7822 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:51.830685  6322 raft_consensus.cc:1240] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.830981  7848 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:51.831480  7526 raft_consensus.cc:3055] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:51.831892  7526 raft_consensus.cc:740] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:51.832722  7526 consensus_queue.cc:260] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.827510  7459 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.833360  7817 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:51.847163  5597 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:13:51.847280  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 243) took 1083 ms. Trace:
I20260709 12:13:51.842614  5718 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:51.854816  5597 pending_rounds.cc:85] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 6
I20260709 12:13:51.855233  5597 pending_rounds.cc:107] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:13:51.855633  5597 raft_consensus.cc:2889] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:51.841394  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.860319  5679 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:13:51.818225  7809 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:51.867340  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:51.869061  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:51.854949  5753 rpcz_store.cc:276] 0709 12:13:50.763978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.581319 (+817341us) service_pool.cc:224] Handling call
0709 12:13:51.581591 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.630915 (+ 49324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.847053 (+216138us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b54000a8054. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:51.847223 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111960832}
W20260709 12:13:51.870524  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 52297.6us
I20260709 12:13:51.870779  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.818374  7402 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.827694  5670 raft_consensus.cc:2393] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:51.888273  6293 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:51.835319  7813 raft_consensus.cc:1064] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:13:51.880810  5679 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:13:51.873845  7361 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:51.878295  7644 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.897297  7839 consensus_queue.cc:1059] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:13:51.898433  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.866241  7843 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.885666  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:51.902776  5753 raft_consensus.cc:2410] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:51.902809  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:51.842270  7816 consensus_queue.cc:1059] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:13:51.830895  7822 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:51.887610  5750 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:51.889309  5676 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:13:51.840027  7812 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:51.866984  7712 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:13:51.871294  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 48701.4us
I20260709 12:13:51.874259  7459 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:13:51.895781  7813 raft_consensus.cc:1068] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:51.872416  7732 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:51.874629  7800 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:51.900988  5642 leader_election.cc:336] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.654s (SENT)
I20260709 12:13:51.878397  7801 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:51.878196  7799 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:51.872932  5569 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:51.834475  7514 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.904117  7526 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.908643  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:51.893131  7824 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:51.892685  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:51.920812  5750 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:13:51.923022  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:51.918077  7839 raft_consensus.cc:3055] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:51.925650  5753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:51.955878  5567 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:51.897964  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 245) took 1074 ms. Trace:
W20260709 12:13:51.933904  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 61047.1us
I20260709 12:13:51.924849  7459 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.918823  7822 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.954059  5598 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:51.923502  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:51.957698  5676 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.968308  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:51.968786  5603 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:51.954128  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:51.955055  5674 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.959919  5751 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:51.939311  5678 raft_consensus.cc:2393] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:51.935213  6291 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:51.898576  7806 consensus_queue.cc:1059] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:13:51.985651  7629 raft_consensus.cc:3055] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:51.986029  7629 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:51.963455  5569 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:51.986821  7629 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:51.987411  5569 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:51.988058  7629 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.988682  5569 leader_election.cc:400] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
I20260709 12:13:51.990589  5569 leader_election.cc:403] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:51.965183  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:51.965785  5567 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:51.969244  5599 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.932073  7732 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.984431  5750 raft_consensus.cc:1275] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:51.984457  5596 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:51.984920  5672 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 3: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:13:51.993387  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 92415.5us
I20260709 12:13:51.918957  7817 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:51.947247  7809 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.956562  7801 raft_consensus.cc:697] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:51.933789  7774 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:51.931998  7712 raft_consensus.cc:697] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:51.998993  7483 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:52.020147  7712 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.005475  7833 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:52.021481  7833 raft_consensus.cc:697] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:52.022388  7833 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.025636  7851 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:13:51.995358  5718 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:51.933043  7799 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:13:51.999720  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 64604.3us
I20260709 12:13:51.947039  7514 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:52.000190  7732 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:51.962273  7839 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:51.965009  7800 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:13:52.012759  5569 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:51.966316  7459 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.015027  5750 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.967531  6320 raft_consensus.cc:1240] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.988197  7361 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:52.016525  5678 pending_rounds.cc:85] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 1
W20260709 12:13:51.995239  5642 leader_election.cc:336] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.729s (SENT)
I20260709 12:13:52.027096  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.084030  5678 pending_rounds.cc:107] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:51.934340  7812 consensus_queue.cc:1059] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:13:52.087318  7812 raft_consensus.cc:3055] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:52.087440  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:52.087774  7812 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:52.088644  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:52.088792  7812 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.089468  6322 raft_consensus.cc:2368] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5.
I20260709 12:13:52.031443  5599 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
W20260709 12:13:52.033466  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.090515  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:52.044335  5676 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:52.092358  5676 raft_consensus.cc:1240] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:52.044826  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.030462  7817 raft_consensus.cc:697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:52.101017  5603 raft_consensus.cc:2410] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:51.999478  7432 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:52.064256  5645 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:52.064561  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.104408  5596 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:52.065145  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:52.065634  5570 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:52.066007  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 240) took 2043 ms. Trace:
I20260709 12:13:52.067108  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:52.069558  5598 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:52.105330  5597 rpcz_store.cc:276] 0709 12:13:50.022716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.005997 (+983281us) service_pool.cc:224] Handling call
0709 12:13:51.006342 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.871515 (+865173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.065749 (+194234us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54002ff154. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:52.065950 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932887424}
I20260709 12:13:52.106194  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:51.963572  5747 rpcz_store.cc:276] 0709 12:13:50.823194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.999602 (+176408us) service_pool.cc:224] Handling call
0709 12:13:51.897774 (+898172us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400257454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:51.897902 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1430376832}
W20260709 12:13:52.070958  7852 log.cc:927] Time spent T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
W20260709 12:13:52.072705  6291 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.000s (SENT) [suppressed 62 similar messages]
W20260709 12:13:52.081841  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 69179.4us
I20260709 12:13:52.108875  5569 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:52.015561  7731 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.084160  5642 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:52.084386  5678 raft_consensus.cc:2889] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:52.095706  5749 raft_consensus.cc:1240] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:52.095956  6293 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:52.136487  7514 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:52.136992  7514 raft_consensus.cc:697] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:52.137912  7514 consensus_queue.cc:237] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.096844  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:52.142547  6325 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:52.093874  7832 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3.
W20260709 12:13:52.056689  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 61415.8us
I20260709 12:13:52.100164  5750 raft_consensus.cc:1240] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:52.059913  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:52.165894  6328 raft_consensus.cc:2376] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5. Re-sending same reply.
I20260709 12:13:52.058451  7799 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.062335  7776 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.107306  7349 raft_consensus.cc:2764] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:13:51.964185  7824 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.061208  6323 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: []
W20260709 12:13:52.116127  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.074016  7800 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.188212  5753 raft_consensus.cc:606] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:13:52.133991  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.134269  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.097988  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.154457  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:52.167405  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.177590  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:52.189612  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.168677  5676 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:52.174150  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.127661  7809 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:52.078717  7774 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.190344  5597 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:52.194226  5602 raft_consensus.cc:2368] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5.
I20260709 12:13:52.192291  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:52.189919  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.192901  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1155) took 1049 ms. Trace:
I20260709 12:13:52.155965  7786 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.195071  5599 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.195472  5671 rpcz_store.cc:276] 0709 12:13:51.143572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.463323 (+319751us) service_pool.cc:224] Handling call
0709 12:13:52.192742 (+729419us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b540029b8d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:52.192845 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55619968}
I20260709 12:13:52.173305  7432 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.191639  7800 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:52.217053  5750 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:52.188704  7812 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:52.229079  7860 log.cc:927] Time spent T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:13:52.236505  7670 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.237097  7670 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.239274  7670 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:52.241874  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:52.249732  7833 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.250293  7833 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.252247  7833 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:52.213244  7780 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:52.253913  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:52.257719  5599 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:13:52.174080  7801 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:52.259366  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 195177us
W20260709 12:13:52.385746  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:52.386299  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:52.263123  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.389842  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:52.391317  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:52.392241  5670 raft_consensus.cc:2410] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:52.395550  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.396332  5599 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:52.397292  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:52.210600  7816 consensus_queue.cc:1059] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:13:52.224481  7843 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:52.216357  7826 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.284570  5600 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.170274  7839 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.413158  7839 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:52.294556  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:52.418372  7867 log.cc:927] Time spent T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:13:52.422250  7816 raft_consensus.cc:3055] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:52.422675  7816 raft_consensus.cc:740] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:52.423619  7816 consensus_queue.cc:260] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.424803  7816 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.427510  5744 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:52.428210  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1232) took 1927 ms. Trace:
I20260709 12:13:52.428545  5744 rpcz_store.cc:276] 0709 12:13:50.501050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.035892 (+534842us) service_pool.cc:224] Handling call
0709 12:13:52.093455 (+1057563us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:52.426998 (+333543us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926f8c 00007f44fa926ef6 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:52.427134 (+   136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.427951 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.428153 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20954240}
I20260709 12:13:52.430656  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.431349  5596 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:13:52.432296  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.432850  5596 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.295136  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:52.260295  7822 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:52.313305  7862 log.cc:927] Time spent T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:13:52.314591  7859 log.cc:927] Time spent T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:13:52.226719  7817 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.304167  7712 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 12:13:52.336975  5569 leader_election.cc:336] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Timed out: RequestConsensusVote RPC to 127.4.78.66:33011 timed out after 2.072s (SENT)
I20260709 12:13:52.337857  7776 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:52.443717  5569 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:13:52.340350  7846 log.cc:927] Time spent T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.560s	user 0.002s	sys 0.000s
I20260709 12:13:52.340586  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.343565  7733 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:52.344241  7402 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.462318  5604 raft_consensus.cc:2376] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 4. Re-sending same reply.
I20260709 12:13:52.367651  5752 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:52.400636  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:52.401255  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:52.402315  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 329611us
I20260709 12:13:52.471146  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:52.403959  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:52.406507  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:52.439669  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:52.455772  5600 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:13:52.663275  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.668861  5671 raft_consensus.cc:2368] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4.
I20260709 12:13:52.568992  5596 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:13:52.670203  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.671000  5596 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:52.586422  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:52.589797  5570 leader_election.cc:336] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.543s (SENT)
W20260709 12:13:52.473712  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 136776us
W20260709 12:13:52.672066  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 82335.8us
I20260709 12:13:52.472254  5672 raft_consensus.cc:2368] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5.
I20260709 12:13:52.674142  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 236) took 2665 ms. Trace:
I20260709 12:13:52.674239  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:52.674926  5672 raft_consensus.cc:2393] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:52.674536  5600 rpcz_store.cc:276] 0709 12:13:50.008763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.839489 (+830726us) service_pool.cc:224] Handling call
0709 12:13:50.839795 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.047533 (+207738us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400437c20. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9c2dc0 00007f44fda4d1c0 00007f44fda4e231 00007f44fda4ad8f 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c
0709 12:13:51.784417 (+736884us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400437c20. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9c906f 00007f44fda41f60 00007f44fda437de 00007f44fda4db49 00007f44fda4e416 00007f44fda4ad8f 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62
0709 12:13:52.260589 (+476172us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b58006905d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9a70aa 00007f44fda29447 00007f44fda41fe7 00007f44fda437de 00007f44fda4db49 00007f44fda4e416 00007f44fda4ad8f 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4
0709 12:13:52.673856 (+413267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.674079 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1159937280}
I20260709 12:13:52.576087  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:52.477294  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.676157  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.676712  5599 raft_consensus.cc:2376] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 7. Re-sending same reply.
I20260709 12:13:52.676760  5600 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.677629  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.678651  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.679576  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.680279  5599 raft_consensus.cc:2410] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:13:52.682345  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:52.682619  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.668170  5675 raft_consensus.cc:2376] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5. Re-sending same reply.
I20260709 12:13:52.683432  5604 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 3: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:13:52.684340  5570 leader_election.cc:336] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.650s (SENT)
W20260709 12:13:52.472292  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 477050us
W20260709 12:13:52.668098  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 87328.9us
I20260709 12:13:52.687388  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:13:52.689592  5671 raft_consensus.cc:2393] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:52.685565  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:52.680945  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.442374  7809 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:52.666383  7868 log.cc:927] Time spent T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:13:52.669296  7786 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.586301  7813 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:52.626597  7459 consensus_meta.cc:287] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.003s
I20260709 12:13:52.700476  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.576018  7840 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.561213  7753 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:52.694715  7811 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:13:52.705670  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:52.710271  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.713038  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.444334  7826 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.587755  7824 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:52.697228  5600 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:52.705966  5642 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:52.697934  7877 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:52.443702  7732 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.469691  7799 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.721277  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:52.723037  5570 leader_election.cc:336] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.686s (SENT)
I20260709 12:13:52.724328  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.725732  6291 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:52.705016  7872 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.735013  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1745) took 2245 ms. Trace:
I20260709 12:13:52.735469  5595 rpcz_store.cc:276] 0709 12:13:50.489980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.543616 (+1053636us) service_pool.cc:224] Handling call
0709 12:13:51.543913 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.557881 (+ 13968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.557911 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:51.578729 (+ 20818us) log.cc:844] Serialized 26 byte log entry
0709 12:13:51.672881 (+ 94152us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:51.672918 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.672985 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.339706 (+666721us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:13:52.734734 (+395028us) raft_consensus.cc:1685] finished
0709 12:13:52.734756 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.734957 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4584,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":11252,"spinlock_wait_cycles":33641216,"thread_start_us":59154,"threads_started":1,"wal-append.queue_time_us":179323}
I20260709 12:13:52.738761  7774 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:52.744875  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1890) took 1006 ms. Trace:
I20260709 12:13:52.710263  7813 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.712998  7840 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.747747  7813 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:52.707898  7233 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.749097  5602 raft_consensus.cc:1275] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:52.749575  5748 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:52.749866  7877 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:52.704118  7809 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.750820  7877 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.734936  7824 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.754640  7813 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.755163  7813 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.757042  7813 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:52.754664  5604 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:52.758922  5604 raft_consensus.cc:1275] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:52.760327  5604 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:52.745306  5746 rpcz_store.cc:276] 0709 12:13:51.738068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.072282 (+334214us) service_pool.cc:224] Handling call
0709 12:13:52.072587 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.072963 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.072990 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:52.073447 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.402009 (+328562us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:52.402048 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.402118 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.744658 (+342540us) raft_consensus.cc:1685] finished
0709 12:13:52.744678 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.744811 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":328224,"threads_started":1,"wal-append.queue_time_us":669500}
I20260709 12:13:52.700922  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:52.749537  7233 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.763944  5670 raft_consensus.cc:2393] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:52.692744  7514 consensus_queue.cc:1059] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:13:52.765239  7514 raft_consensus.cc:3055] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:13:52.713378  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.765668  7514 raft_consensus.cc:740] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:52.766595  7514 consensus_queue.cc:260] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.767940  7514 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:52.768528  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.769134  5597 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:13:52.769486  5597 pending_rounds.cc:85] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 3
I20260709 12:13:52.710522  7712 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.769744  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:52.770335  5679 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:52.770248  7712 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.762428  7831 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:52.765272  7233 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:52.749295  7732 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:52.747879  7840 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:52.710326  7459 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.774235  7459 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:52.775772  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.776336  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 244) took 1959 ms. Trace:
I20260709 12:13:52.776149  7872 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.776597  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:52.737712  5595 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:13:52.778322  7872 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:52.778479  7843 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:52.779400  7402 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:52.781368  7799 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:52.774847  5676 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:52.784608  7826 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:52.726217  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:13:52.786064  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 59931us
I20260709 12:13:52.775709  7822 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:52.787096  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:52.787626  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:52.787895  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 62236.7us
I20260709 12:13:52.788982  6291 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:52.787190  5674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:13:52.790078  5674 raft_consensus.cc:606] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:13:52.790411  5674 raft_consensus.cc:614] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:52.793445  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.794137  5599 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:13:52.769694  5597 pending_rounds.cc:107] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:13:52.798336  5597 raft_consensus.cc:2889] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:52.799330  5596 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:13:52.776702  5749 rpcz_store.cc:276] 0709 12:13:50.817111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.583487 (+766376us) service_pool.cc:224] Handling call
0709 12:13:51.583711 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.135432 (+551721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.776113 (+640681us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54000a7154. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:52.776280 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177062784}
W20260709 12:13:52.803524  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.806782  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:52.807468  5595 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:52.809262  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:52.772230  7712 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:52.802791  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:52.806295  7800 consensus_meta.cc:287] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.003s
W20260709 12:13:52.832556  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 45478.6us
I20260709 12:13:52.820223  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:52.810092  7872 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:13:52.839347  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 145581us
I20260709 12:13:52.846922  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:52.811187  7402 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:52.845571  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:52.914971  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 68330.3us
W20260709 12:13:52.914971  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 76571.9us
I20260709 12:13:52.924135  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:52.924825  5675 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.815594  7839 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:52.808442  7459 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:13:52.945720  5749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:13:52.819895  7840 consensus_queue.cc:1059] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 12:13:52.848519  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:52.949119  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 94294.8us
I20260709 12:13:52.950495  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:52.834956  7801 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:13:52.936403  7731 consensus_meta.cc:287] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.804s	user 0.006s	sys 0.004s
I20260709 12:13:52.818413  7812 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
W20260709 12:13:52.938727  7878 log.cc:927] Time spent T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:13:52.934839  7402 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.915081  7853 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:13:52.847718  7799 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 12:13:52.841856  7675 consensus_queue.cc:1059] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
W20260709 12:13:52.966259  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 134909us
I20260709 12:13:52.843544  7233 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 12:13:52.847533  7806 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:13:52.935902  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1893) took 1190 ms. Trace:
I20260709 12:13:52.974032  7894 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:52.974602  7894 raft_consensus.cc:697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:52.973321  5747 rpcz_store.cc:276] 0709 12:13:51.745504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.107539 (+362035us) service_pool.cc:224] Handling call
0709 12:13:52.107928 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:52.108350 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.108381 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:52.108978 (+   597us) log.cc:844] Serialized 52 byte log entry
0709 12:13:52.327622 (+218644us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:52.808414 (+480792us) log.cc:844] Serialized 14 byte log entry
0709 12:13:52.835476 (+ 27062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.842970 (+  7494us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.848327 (+  5357us) raft_consensus.cc:1685] finished
0709 12:13:52.915960 (+ 67633us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.931239 (+ 15279us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":333082,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":14622,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":52928,"thread_start_us":574356,"threads_started":2,"wal-append.queue_time_us":275073}
I20260709 12:13:52.975518  7894 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:52.970770  7712 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:13:52.979331  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1720) took 1110 ms. Trace:
I20260709 12:13:52.979758  5677 rpcz_store.cc:276] 0709 12:13:51.869000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.874154 (+  5154us) service_pool.cc:224] Handling call
0709 12:13:52.193235 (+319081us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.684531 (+491296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.684560 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:52.691211 (+  6651us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.835505 (+144294us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:52.835541 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.835617 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.977668 (+142051us) raft_consensus.cc:1685] finished
0709 12:13:52.977687 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.979070 (+  1383us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540029b8d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:52.979269 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34021,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6208,"spinlock_wait_cycles":733138688,"thread_start_us":596604,"threads_started":2,"wal-append.queue_time_us":255629}
I20260709 12:13:52.983803  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1724) took 1087 ms. Trace:
I20260709 12:13:52.960789  7824 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:13:52.984254  5673 rpcz_store.cc:276] 0709 12:13:51.895975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.944085 (+ 48110us) service_pool.cc:224] Handling call
0709 12:13:51.944392 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.212535 (+268143us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:13:52.224180 (+ 11645us) log.cc:844] Serialized 14 byte log entry
0709 12:13:52.397451 (+173271us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:52.397507 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:52.397555 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.762054 (+364499us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b18003a9de0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:13:52.983539 (+221485us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54001e4e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:52.983592 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.983735 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13373,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":99,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4668,"spinlock_wait_cycles":660882048,"thread_start_us":143808,"threads_started":1,"wal-append.queue_time_us":164786}
I20260709 12:13:52.986807  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:52.988137  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 248) took 1947 ms. Trace:
W20260709 12:13:52.989255  7875 log.cc:927] Time spent T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:13:52.843958  7872 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:52.914631  7892 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:13:52.841116  7800 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:52.968735  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:52.962212  7402 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.988608  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:52.988556  5745 rpcz_store.cc:276] 0709 12:13:51.040282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.586903 (+546621us) service_pool.cc:224] Handling call
0709 12:13:51.608407 (+ 21504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.672936 (+ 64529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.679935 (+  6999us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:51.686468 (+  6533us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:13:51.686521 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.987843 (+1301322us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b5400217fd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:52.987902 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.988069 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111795072}
I20260709 12:13:52.956768  7839 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:52.981696  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:52.960232  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 114714us
W20260709 12:13:52.955514  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.961751  7731 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:53.017596  5675 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:52.963086  5670 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:13:53.029227  5716 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:53.023097  5675 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:53.000316  7872 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:13:53.034338  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 75999.3us
I20260709 12:13:53.033677  5716 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:53.035967  5569 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:53.001227  7459 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:53.002048  7732 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.041011  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:53.048053  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:53.052254  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:53.052886  5598 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:53.054967  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:53.055025  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:53.055629  5753 raft_consensus.cc:2376] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5. Re-sending same reply.
I20260709 12:13:53.055732  5746 raft_consensus.cc:2376] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4. Re-sending same reply.
I20260709 12:13:53.049669  5569 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:53.056236  5570 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:53.067148  5753 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:53.067327  5604 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:53.072321  5569 leader_election.cc:400] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5.
I20260709 12:13:53.072690  5569 leader_election.cc:403] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:53.073933  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:53.074576  5604 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.077672  5718 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:53.041332  7774 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:53.081868  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 125463us
I20260709 12:13:53.021723  7813 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:13:53.031869  7801 consensus_queue.cc:1059] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:13:53.084661  5569 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:53.083787  5598 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:13:53.087386  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:53.088460  5597 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:53.083592  6293 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:53.066016  7822 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:53.057888  7832 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.098585  6325 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 3 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:53.077138  7818 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.101343  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:53.073398  7812 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:53.085788  7853 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.102072  7898 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:13:53.158047  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 74606.7us
I20260709 12:13:53.074694  7459 raft_consensus.cc:697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:53.088151  7753 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.089788  7361 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.164000  5745 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:13:53.169188  7816 consensus_meta.cc:287] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.744s	user 0.007s	sys 0.000s
I20260709 12:13:53.109320  7786 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.163203  7459 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:13:53.170459  7895 log.cc:927] Time spent T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 12:13:53.171379  7897 log.cc:927] Time spent T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:13:53.094372  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:53.197407  5598 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:53.172091  7233 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.172051  7361 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5.
I20260709 12:13:53.200773  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:53.172333  7903 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:13:53.206910  7800 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:53.207547  7903 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.208086  7903 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:53.210925  5672 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:53.172976  7898 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:53.163015  7857 log.cc:927] Time spent T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 1.221s	user 0.003s	sys 0.000s
I20260709 12:13:53.108832  7774 raft_consensus.cc:697] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:53.214002  7898 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:53.214845  7774 consensus_queue.cc:237] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:53.175411  7813 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:53.175619  7885 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:53.217720  7813 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.219004  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1885) took 1743 ms. Trace:
I20260709 12:13:53.219417  5748 rpcz_store.cc:276] 0709 12:13:51.475941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.932345 (+456404us) service_pool.cc:224] Handling call
0709 12:13:51.966088 (+ 33743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.750024 (+783936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.218782 (+468758us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b5400229cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:53.218946 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1801396480}
I20260709 12:13:53.220122  7813 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:53.178138  7906 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:53.178709  7644 raft_consensus.cc:3055] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:53.090050  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:53.085220  7891 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:13:53.159446  5569 leader_election.cc:400] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4.
W20260709 12:13:53.195236  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 127295us
I20260709 12:13:53.110136  7812 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.102715  7839 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.195502  6319 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:13:53.198722  7843 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:53.226661  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:53.246027  7786 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.190889  7840 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:53.259002  7664 raft_consensus.cc:3055] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:53.259479  7664 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:53.260314  7664 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.244895  5716 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:53.245393  5569 leader_election.cc:403] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:13:53.263290  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 105940us
I20260709 12:13:53.229310  7644 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:53.248432  7812 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.158417  7853 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.249212  7906 raft_consensus.cc:697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:53.266396  7786 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.251343  7843 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:53.276660  7664 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.275385  7813 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:53.274969  7840 raft_consensus.cc:697] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:53.326244  6320 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:53.325881  7644 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:53.309425  7877 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.014s	sys 0.031s
W20260709 12:13:53.420408  7877 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.014s	sys 0.031s
I20260709 12:13:53.266528  7806 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:13:53.317351  7903 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:53.606423  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 361616us
W20260709 12:13:53.606222  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 504921us
I20260709 12:13:53.608287  5569 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:53.608702  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:53.602035  7909 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.613190  7909 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.613961  7800 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:53.614537  7800 raft_consensus.cc:697] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:53.615381  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:53.615449  7800 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:53.607582  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:53.621325  5569 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:53.468640  7905 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:53.624797  7905 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.607695  5716 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:53.627432  7774 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:53.627872  7774 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:53.628260  7774 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:53.635514  7774 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:53.639396  7774 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:53.639685  7924 consensus_queue.cc:1059] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:53.640482  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:53.642808  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.643486  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:53.643953  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:53.668435  5678 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:13:53.470180  7893 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:13:53.606593  7813 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.674620  5569 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:53.600919  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:53.607894  7644 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.606029  7629 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:53.595916  7904 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.668200  7826 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.668687  7903 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:13:53.692111  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 76780.9us
I20260709 12:13:53.709540  7822 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:53.690555  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.599494  7839 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:13:53.720949  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:53.683758  7902 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:13:53.683856  7233 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:13:53.687086  7885 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:53.737649  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:53.748957  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 105537us
I20260709 12:13:53.701699  7813 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.724399  7731 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.736143  7800 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.755882  6291 leader_election.cc:400] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5.
I20260709 12:13:53.788337  6291 leader_election.cc:403] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:53.739399  7818 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:53.742969  7885 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:53.747215  7826 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.785734  7233 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:13:53.804376  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 66836.6us
I20260709 12:13:53.832325  5642 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:53.720829  7629 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:53.811776  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 61540.6us
W20260709 12:13:53.806541  5604 consensus_meta.cc:287] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.731s	user 0.007s	sys 0.001s
I20260709 12:13:53.828985  5678 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:13:53.833900  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:53.834643  7913 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:53.835156  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 108601us
I20260709 12:13:53.845140  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 353) took 1212 ms. Trace:
I20260709 12:13:53.847230  5678 rpcz_store.cc:276] 0709 12:13:52.632987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.682964 (+ 49977us) service_pool.cc:224] Handling call
0709 12:13:53.643807 (+960843us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:53.845066 (+201259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4026240}
I20260709 12:13:53.703226  7906 consensus_queue.cc:237] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:53.811518  7885 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.852697  5746 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:53.853199  5750 raft_consensus.cc:1240] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:53.850672  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:53.718384  7840 consensus_queue.cc:237] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.721930  7904 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.855931  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:53.800278  7922 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.858426  5751 raft_consensus.cc:2410] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:13:53.845544  5604 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:53.851214  6291 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:53.820904  7877 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.851253  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:53.794173  7800 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:53.856397  7914 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
I20260709 12:13:53.844667  7826 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.866369  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:53.853704  7913 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:53.862848  7853 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:53.895504  7910 log.cc:927] Time spent T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:13:53.865522  7903 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:53.857591  7361 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:53.885366  7922 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:13:53.895048  7929 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:53.800539  7818 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:53.855835  7901 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:13:53.902472  5604 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:53.896450  7907 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5.
I20260709 12:13:53.866855  7459 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:13:53.904824  7911 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:13:53.886068  7822 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:53.909328  7786 consensus_meta.cc:287] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.008s
I20260709 12:13:53.869277  7877 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.900487  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:53.911890  7903 raft_consensus.cc:697] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:53.946569  7936 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.868484  7233 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:53.912547  7361 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.934672  7813 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:53.974493  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 67098.7us
I20260709 12:13:53.915952  7913 consensus_queue.cc:1059] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:13:53.938200  7786 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 3. Current term is 4.
W20260709 12:13:53.953276  7812 consensus_meta.cc:287] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.646s	user 0.018s	sys 0.044s
I20260709 12:13:53.978658  5604 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:53.951651  7911 raft_consensus.cc:697] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:13:53.974272  7918 log.cc:927] Time spent T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:13:53.932652  7822 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:53.985772  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:53.915674  7929 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:53.996066  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:53.996908  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:53.978947  7905 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:53.999600  5600 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:54.000420  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:53.969720  7936 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.002146  7926 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:13:54.002619  5600 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:54.003202  7904 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.003814  7936 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.004315  7936 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:54.004554  7361 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.001785  5604 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:54.004796  7948 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:53.991127  7786 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:53.981446  7812 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:53.997197  7629 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:54.015445  7935 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.015342  7812 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:54.014534  7818 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:54.013960  7931 log.cc:927] Time spent T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:13:54.008952  7936 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.034674  7935 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:54.029196  7664 consensus_meta.cc:287] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.002s
I20260709 12:13:54.031343  7929 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:54.034080  7872 consensus_meta.cc:287] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.977s	user 0.008s	sys 0.002s
I20260709 12:13:54.007982  7903 consensus_queue.cc:237] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:54.216308  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 365130us
I20260709 12:13:54.454589  7811 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:13:54.349509  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1742) took 1528 ms. Trace:
W20260709 12:13:54.276575  7817 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.513s	user 0.007s	sys 0.020s
W20260709 12:13:54.481529  7817 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.718s	user 0.009s	sys 0.022s
I20260709 12:13:54.481818  7514 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:13:54.140589  7879 log.cc:927] Time spent T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.378s	user 0.002s	sys 0.016s
I20260709 12:13:54.483479  6291 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:54.013234  7948 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.480295  5674 rpcz_store.cc:276] 0709 12:13:52.820926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.821140 (+   214us) service_pool.cc:224] Handling call
0709 12:13:52.821387 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.821557 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:52.990016 (+168459us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.348810 (+1358794us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b18003a99c0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fd5f34bc 00007f44fa94148b 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95b455 00007f44fda43060 00007f44fda55716 00007f44fda66287
0709 12:13:54.348945 (+   135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:54.349012 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:54.349070 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.349207 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.349424 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56556,"prepare.queue_time_us":357995,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":50335,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":21289,"spinlock_wait_cycles":12704640,"thread_start_us":226046,"threads_started":2}
I20260709 12:13:54.480960  7811 consensus_queue.cc:1059] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:13:54.486649  7948 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.350231  7881 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:54.510504  5673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.015s	sys 0.051s
I20260709 12:13:54.476847  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 366) took 1251 ms. Trace:
I20260709 12:13:54.387562  5604 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
W20260709 12:13:54.213601  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.515061  5753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.004s
W20260709 12:13:54.573961  5753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.003s	sys 0.007s
I20260709 12:13:54.574709  5604 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:13:54.020627  7843 consensus_meta.cc:287] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.711s	user 0.002s	sys 0.008s
I20260709 12:13:54.573374  5671 rpcz_store.cc:276] 0709 12:13:53.225904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.250141 (+ 24237us) service_pool.cc:224] Handling call
0709 12:13:53.250506 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:53.250858 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.250887 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:53.268395 (+ 17508us) log.cc:844] Serialized 26 byte log entry
0709 12:13:53.664940 (+396545us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:53.664982 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.665052 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:54.037253 (+372201us) raft_consensus.cc:1685] finished
0709 12:13:54.037278 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.476777 (+439499us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10149,"raft.queue_time_us":7184,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":16748,"thread_start_us":396129,"threads_started":1,"wal-append.queue_time_us":417926}
W20260709 12:13:54.578871  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 95480.2us
I20260709 12:13:54.579566  7891 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.583429  7891 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.584043  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:54.582412  7843 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:54.214771  7898 consensus_meta.cc:287] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.955s	user 0.003s	sys 0.007s
I20260709 12:13:54.585923  7898 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:54.579988  6327 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:54.587237  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:54.587724  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:54.587956  7898 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:54.580559  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:54.230252  7920 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.580792  7514 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:54.597141  5752 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.590253  5716 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:54.487458  7960 raft_consensus.cc:3055] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:54.445329  7772 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.038373  7822 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:54.138862  7818 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:54.270160  7884 log.cc:927] Time spent T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 1.491s	user 0.014s	sys 0.026s
I20260709 12:13:54.121052  7800 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.113359  7361 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.586637  7774 raft_consensus.cc:3055] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:54.588915  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:54.590451  5604 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:54.591471  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.576735  5673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.015s	sys 0.055s
I20260709 12:13:54.013384  7786 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:54.619346  7774 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:54.620183  7774 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:54.620811  7786 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:54.621034  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:54.604127  7514 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:54.152819  7873 log.cc:927] Time spent T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 1.769s	user 0.011s	sys 0.024s
I20260709 12:13:54.630453  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 255) took 2523 ms. Trace:
I20260709 12:13:54.630900  5603 rpcz_store.cc:276] 0709 12:13:52.107250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.197605 (+ 90355us) service_pool.cc:224] Handling call
0709 12:13:52.197967 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:52.259255 (+ 61288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.259286 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:52.282542 (+ 23256us) log.cc:844] Serialized 52 byte log entry
0709 12:13:52.596491 (+313949us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:52.701552 (+105061us) log.cc:844] Serialized 14 byte log entry
0709 12:13:52.701783 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.701849 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.775900 (+ 74051us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b18002366e0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa92c2a6 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db
0709 12:13:54.168129 (+1392229us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:13:54.630213 (+462084us) raft_consensus.cc:1685] finished
0709 12:13:54.630235 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.630389 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42911,"prepare.queue_time_us":101417,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":49112,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":42649,"spinlock_wait_cycles":12279040,"thread_start_us":279646,"threads_started":1,"wal-append.queue_time_us":370635}
I20260709 12:13:54.632268  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:54.571295  7664 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.608425  5716 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:54.613000  7941 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:54.513482  7885 consensus_meta.cc:287] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.005s
I20260709 12:13:54.488014  7944 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.586391  6322 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:54.278342  7913 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:54.167253  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:54.165053  7712 raft_consensus.cc:3055] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:54.473678  7909 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.333477  7809 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.588495  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:54.585438  7891 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.169669  7826 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:54.149567  6319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 420) took 2089 ms (client timeout 2524 ms). Trace:
I20260709 12:13:54.586457  7843 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:54.615278  7818 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:54.278761  7877 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.617703  6324 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:54.618414  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1746) took 1608 ms. Trace:
I20260709 12:13:54.533211  7872 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:54.600297  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:54.140928  7402 consensus_meta.cc:287] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 1.122s	user 0.005s	sys 0.005s
I20260709 12:13:54.607344  7960 raft_consensus.cc:740] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:54.628901  5744 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:54.629733  7514 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:54.633256  5604 raft_consensus.cc:2393] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:13:54.634974  5716 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:54.036882  7936 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.641042  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:54.588526  7898 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.605280  7926 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:13:54.731386  5675 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:54.621151  7774 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.616876  7935 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:54.630398  7813 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:54.687995  7880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.928s	user 0.043s	sys 0.039s
I20260709 12:13:54.588995  7920 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.646229  7941 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.641841  7943 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:54.616618  7772 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:54.707464  5598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.016s	sys 0.023s
I20260709 12:13:54.711694  5676 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.712662  6328 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:13:54.626973  7361 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:54.147836  7934 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.656102  7786 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:54.109346  7911 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.720003  5752 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:54.718406  5673 rpcz_store.cc:276] 0709 12:13:53.010048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.093027 (+ 82979us) service_pool.cc:224] Handling call
0709 12:13:53.688349 (+595322us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:53.688561 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.688777 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:13:53.725604 (+ 36827us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.618101 (+892497us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:54.618157 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:54.618203 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.618260 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.618361 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36666,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":58,"raft.queue_time_us":18669,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":5086976,"thread_start_us":892082,"threads_started":2,"wal-append.queue_time_us":202808}
I20260709 12:13:54.644927  7664 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.699752  7712 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:54.604144  7886 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 12:13:54.731209  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 96322.6us
I20260709 12:13:54.732182  5595 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:54.949007  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:54.697204  7944 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:54.742306  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.780237  5603 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.704645  7913 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:54.781612  7891 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.782423  5604 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:54.952921  7934 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.953953  5746 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.688377  7885 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.718366  7951 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:54.956024  7951 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.958072  7951 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.788169  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1765) took 2784 ms. Trace:
W20260709 12:13:54.724118  5747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 275) took 1666 ms (client timeout 2000 ms). Trace:
W20260709 12:13:54.959398  5747 rpcz_store.cc:269] 0709 12:13:53.053980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.070470 (+ 16490us) service_pool.cc:224] Handling call
0709 12:13:54.167047 (+1096577us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:54.718274 (+551227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5393792}
I20260709 12:13:54.960667  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:54.955772  7934 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:54.790136  5598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.016s	sys 0.024s
I20260709 12:13:54.962716  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1774) took 1314 ms. Trace:
I20260709 12:13:54.963044  5598 rpcz_store.cc:276] 0709 12:13:53.648010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.648228 (+   218us) service_pool.cc:224] Handling call
0709 12:13:53.648517 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.648752 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:13:53.750842 (+102090us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.962419 (+1211577us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:54.962466 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:54.962509 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.962568 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.962665 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59350,"prepare.queue_time_us":205275,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":31938,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":2945,"spinlock_wait_cycles":197886208,"thread_start_us":1312877,"threads_started":3,"wal-append.queue_time_us":261557}
I20260709 12:13:54.967670  5601 rpcz_store.cc:276] 0709 12:13:52.003250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.013834 (+ 10584us) service_pool.cc:224] Handling call
0709 12:13:52.014151 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.080938 (+ 66787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.080969 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:52.081400 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.277281 (+195881us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:52.277325 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.277398 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:54.152064 (+1874666us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:13:54.733469 (+581405us) raft_consensus.cc:1685] finished
0709 12:13:54.733491 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.788020 (+ 54529us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18848,"raft.queue_time_us":20110,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":21049,"spinlock_wait_cycles":8548736,"thread_start_us":143637,"threads_started":1,"wal-append.queue_time_us":220872}
I20260709 12:13:54.780258  7898 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:54.788290  7935 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.970170  7786 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.970609  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:54.970927  7944 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:54.950142  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:54.972458  5752 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:54.787776  7941 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:54.783341  7880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.022s	user 0.044s	sys 0.039s
I20260709 12:13:54.732851  7812 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:54.723702  7402 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:54.969421  7732 consensus_queue.cc:1059] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:54.973892  5752 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:55.023504  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:54.844866  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:54.733552  7926 consensus_queue.cc:1243] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer 831d76c5ee1045f0af923ce24fa4c301 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:13:54.711807  6319 rpcz_store.cc:269] 0709 12:13:52.059797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.062211 (+  2414us) service_pool.cc:224] Handling call
0709 12:13:54.149326 (+2087115us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b540051e354. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:54.149480 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2175498624}
I20260709 12:13:55.013674  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:54.853628  6323 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:54.932013  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:13:55.004384  7776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.224s	user 0.022s	sys 0.072s
I20260709 12:13:55.035634  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:54.925444  7909 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.051158  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:54.853977  7806 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:55.058284  6328 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:54.784998  7813 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:55.062642  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1254) took 1215 ms. Trace:
I20260709 12:13:55.070979  5753 rpcz_store.cc:276] 0709 12:13:53.847087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.852851 (+  5764us) service_pool.cc:224] Handling call
0709 12:13:53.853153 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:53.909337 (+ 56184us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:13:53.996264 (+ 86927us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.161698 (+165434us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b1800358cc0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e522 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:13:54.579351 (+417653us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.629279 (+ 49928us) log.cc:844] Serialized 26 byte log entry
0709 12:13:54.631061 (+  1782us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:54.631241 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.631489 (+   248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.053407 (+421918us) raft_consensus.cc:1685] finished
0709 12:13:55.062413 (+  9006us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.062575 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4732,"prepare.queue_time_us":46465,"raft.queue_time_us":108844,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":8196,"spinlock_wait_cycles":10730752,"thread_start_us":690347,"threads_started":3,"wal-append.queue_time_us":702616}
I20260709 12:13:55.073130  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:55.052610  7776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.272s	user 0.022s	sys 0.072s
I20260709 12:13:55.081611  5749 raft_consensus.cc:606] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:13:55.073714  5753 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:13:55.087865  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:55.068686  7883 log.cc:927] Time spent T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 2.048s	user 0.008s	sys 0.013s
I20260709 12:13:55.050832  7970 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.067184  7943 raft_consensus.cc:3055] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:13:54.948897  7960 consensus_queue.cc:260] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.127595  7943 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:55.013145  7935 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:55.132337  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 183396us
I20260709 12:13:55.059058  7812 raft_consensus.cc:697] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:13:55.110383  7964 log.cc:927] Time spent T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
W20260709 12:13:55.111006  7962 log.cc:927] Time spent T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 12:13:55.115870  7956 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.409s	user 0.001s	sys 0.000s
I20260709 12:13:55.116856  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:55.117980  7813 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:55.058205  7966 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.121420  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:55.122231  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:55.122747  7913 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:55.123206  7872 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:55.076478  7936 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.124488  7402 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:55.125651  7898 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:55.126961  7920 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:55.129506  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.109746  7965 log.cc:927] Time spent T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:13:55.109638  7963 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 12:13:55.132704  7955 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
I20260709 12:13:55.158326  7968 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:55.136780  6321 raft_consensus.cc:2393] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:13:55.133368  7951 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:55.162621  5719 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:55.136638  7832 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:55.165290  7920 consensus_queue.cc:1059] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:55.166818  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:55.199304  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1779) took 1527 ms. Trace:
I20260709 12:13:55.158768  7936 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:55.166400  7971 log.cc:927] Time spent T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:13:55.077111  7712 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.152818  7960 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.171664  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:55.143273  7943 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:55.167330  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.026849  7891 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.164003  7872 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.144275  6324 raft_consensus.cc:2376] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6. Re-sending same reply.
I20260709 12:13:55.182432  7976 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:13:55.188043  7774 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:55.188661  6319 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:55.188834  7812 consensus_queue.cc:237] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.189956  7977 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:55.172387  7514 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:55.192672  7664 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:55.192608  7951 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.094916  7806 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:55.178189  7818 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:55.199734  5596 rpcz_store.cc:276] 0709 12:13:53.671366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.016955 (+345589us) service_pool.cc:224] Handling call
0709 12:13:54.017277 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.064781 (+ 47504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.064812 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.065287 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:13:54.403357 (+338070us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:54.403409 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.403495 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.199014 (+795519us) raft_consensus.cc:1685] finished
0709 12:13:55.199037 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.199238 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47075,"raft.queue_time_us":89047,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":11390,"thread_start_us":234288,"threads_started":1,"wal-append.queue_time_us":466218}
I20260709 12:13:55.152858  7966 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:55.074494  7909 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:55.132899  7970 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.186893  7786 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:55.214344  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.215138  7984 raft_consensus.cc:3055] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:55.230106  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.215833  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1962) took 1305 ms. Trace:
I20260709 12:13:55.230841  5597 rpcz_store.cc:276] 0709 12:13:53.910045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.568027 (+657982us) service_pool.cc:224] Handling call
0709 12:13:54.568412 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.575614 (+  7202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.575864 (+   250us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.576893 (+  1029us) log.cc:844] Serialized 26 byte log entry
0709 12:13:54.715906 (+139013us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:54.715947 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.716024 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.215639 (+499615us) raft_consensus.cc:1685] finished
0709 12:13:55.215656 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.215778 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1728,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":1943,"thread_start_us":93210,"threads_started":1,"wal-append.queue_time_us":339150}
I20260709 12:13:55.233127  5567 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:55.202864  5744 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:55.221356  7935 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:55.212477  7944 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:55.216637  5745 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:55.199059  7832 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.204770  7772 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:55.225782  5753 raft_consensus.cc:2410] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:13:55.212764  7712 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.216357  7872 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:55.235035  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.196503  7968 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.240434  5750 raft_consensus.cc:2393] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
W20260709 12:13:55.239468  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 53714.9us
I20260709 12:13:55.241963  7514 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:55.244030  7872 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:55.244143  7917 log.cc:927] Time spent T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 1.424s	user 0.023s	sys 0.032s
I20260709 12:13:55.245870  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:55.246829  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.248525  5752 raft_consensus.cc:2410] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:13:55.249711  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.249876  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:55.250634  7753 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:55.251047  7753 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:55.251567  7753 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.250993  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.254671  7936 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:55.255597  6327 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:13:55.256451  7891 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:55.257043  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:55.258044  7909 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:55.259725  7832 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:55.259662  5596 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:13:55.258651  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.250547  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.261277  7909 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.261962  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.262548  5752 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:55.262852  7970 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:55.265861  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.266942  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.267488  5679 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:55.269021  6325 raft_consensus.cc:3055] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:55.261746  7909 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.263101  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1967) took 1342 ms. Trace:
I20260709 12:13:55.268361  5570 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:55.259928  7936 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:55.238245  7944 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.270679  5595 rpcz_store.cc:276] 0709 12:13:53.920488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.647847 (+727359us) service_pool.cc:224] Handling call
0709 12:13:54.729460 (+ 81613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.949368 (+219908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.262951 (+313583us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b5400206f50. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:55.263053 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186946816}
I20260709 12:13:55.271775  5570 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:55.271924  7909 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:55.230376  7984 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:13:55.272416  7944 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:55.272951  7984 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:55.273969  7936 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.274328  7984 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.275367  7943 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:55.277263  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:55.278358  5570 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:55.269372  6325 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:55.279464  5570 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:55.260972  5750 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:55.269603  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:55.236501  7786 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:55.281389  6293 connection.cc:256] RPC call timeout handler was delayed by -1.4345857829998749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 12:13:55.285857  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.286536  5750 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:13:55.286893  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:55.287446  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:13:55.288192  5645 connection.cc:256] RPC call timeout handler was delayed by -1.01969403399994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
I20260709 12:13:55.288203  5750 raft_consensus.cc:2393] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:55.289016  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:55.289719  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.290525  5678 raft_consensus.cc:2410] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:13:55.292141  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.294773  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:55.295539  5671 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:55.299304  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.300184  5678 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:55.305792  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.306496  5674 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:55.308494  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.269619  5567 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:55.313505  6293 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:55.295015  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:55.272914  7944 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:55.241667  6320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 674) took 2198 ms. Trace:
I20260709 12:13:55.319077  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.300716  6325 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:55.317658  5679 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:55.320119  5750 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:13:55.320502  5750 pending_rounds.cc:85] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 3
I20260709 12:13:55.317615  5570 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:55.321468  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.322105  5674 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:13:55.285450  7818 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.287992  7832 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.281086  7233 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:55.285079  7872 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:55.285383  7909 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:55.295125  7913 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:55.299916  7664 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.328238  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.330405  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.312750  7712 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:55.332760  5679 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:55.333967  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.335364  5678 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:55.320713  5750 pending_rounds.cc:107] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 12:13:55.315161  7824 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.322897  7786 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:55.365890  5750 raft_consensus.cc:2917] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 12:13:55.328104  7886 consensus_queue.cc:1059] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:13:55.366487  5750 raft_consensus.cc:2889] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:55.332275  7944 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:55.331770  7989 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:55.364984  5671 raft_consensus.cc:2410] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:55.343086  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.326777  7926 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 12:13:55.426167  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 112752us
W20260709 12:13:55.426712  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 157137us
I20260709 12:13:55.435781  5595 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:55.439875  7936 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:55.332160  7832 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.338527  7952 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:13:55.339653  7872 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:55.421041  7985 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.337949  7753 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:55.339499  7233 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:55.408695  7824 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:55.416225  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.339812  7913 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:55.344440  7664 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:55.515491  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.577499  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.510896  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:55.422706  7989 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.423918  7514 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.433251  7944 raft_consensus.cc:697] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:13:55.578740  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.323012  6320 rpcz_store.cc:276] 0709 12:13:53.042909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.046826 (+  3917us) service_pool.cc:224] Handling call
0709 12:13:53.102072 (+ 55246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.326677 (+224605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.241408 (+1914731us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54005a6ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:55.241579 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511848704}
I20260709 12:13:55.579226  5596 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.529263  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:55.464085  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 133657us
I20260709 12:13:55.579242  5673 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:55.448589  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:55.578276  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:55.430306  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 79899.4us
I20260709 12:13:55.434609  7786 consensus_queue.cc:1059] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.207s
I20260709 12:13:55.972313  5595 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.645032  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:55.643761  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 176405us
I20260709 12:13:55.975414  5671 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
W20260709 12:13:55.727020  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.974793  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.664551  5672 raft_consensus.cc:2410] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:13:55.801013  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 336548us
I20260709 12:13:55.982558  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:55.985085  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:55.985452  6291 leader_election.cc:336] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.000s (SENT)
I20260709 12:13:55.985894  6291 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:13:55.527041  7982 log.cc:927] Time spent T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:13:55.573447  7926 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.481s
I20260709 12:13:55.569695  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:55.986822  5673 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:13:56.089874  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.089689  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:55.526086  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:56.090807  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:56.090857  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.055142  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.021270  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:56.093426  6324 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:56.094779  5595 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
W20260709 12:13:56.063042  5629 heartbeater.cc:646] Failed to heartbeat to 127.4.78.126:44725 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.78.126:44725 timed out after 15.000s (SENT)
I20260709 12:13:55.526461  7968 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:55.499183  7951 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:55.754561  7986 log.cc:927] Time spent T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260709 12:13:56.104364  5595 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:56.120636  5673 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:13:55.895650  5744 consensus_meta.cc:287] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.644s	user 0.004s	sys 0.004s
W20260709 12:13:55.867153  7896 log.cc:927] Time spent T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 2.877s	user 0.015s	sys 0.007s
I20260709 12:13:55.584059  7989 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:55.867257  7981 log.cc:927] Time spent T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.374s	user 0.001s	sys 0.001s
I20260709 12:13:56.117127  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:56.096016  7966 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:55.724677  7980 log.cc:927] Time spent T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:13:55.440815  7886 consensus_queue.cc:1243] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:56.126317  5596 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
W20260709 12:13:55.724490  7987 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 12:13:56.085568  7943 consensus_meta.cc:287] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.003s
W20260709 12:13:55.650478  7941 consensus_meta.cc:287] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
I20260709 12:13:56.129468  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:55.587538  7824 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:56.085739  7988 consensus_queue.cc:1059] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:13:55.589385  7664 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:55.700486  7992 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.675696  7960 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.612972  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:55.587090  7913 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:56.053272  7952 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.096138  7786 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.981900  7832 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:56.097388  7233 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:56.057085  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:56.144758  5671 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:13:56.144668  8007 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:56.126816  6319 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:56.150637  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 269) took 1538 ms. Trace:
I20260709 12:13:56.144797  7968 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.582441  7991 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.564s
I20260709 12:13:56.220603  7968 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.054404  7944 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.222796  7968 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:55.581182  7985 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.226297  7985 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:56.136883  5744 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:13:56.226970  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1258) took 1089 ms. Trace:
I20260709 12:13:56.227324  5744 rpcz_store.cc:276] 0709 12:13:55.137315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.143178 (+  5863us) service_pool.cc:224] Handling call
0709 12:13:56.226903 (+1083725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.228394  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:56.158120  7806 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:56.159504  7998 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.230278  7998 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.233112  7998 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:56.160161  8006 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:13:56.234117  7733 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.012s	sys 0.024s
W20260709 12:13:55.888991  7818 consensus_meta.cc:287] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.001s
W20260709 12:13:56.192128  5642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.010s	sys 0.003s
W20260709 12:13:56.195011  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 223065us
I20260709 12:13:56.234849  7818 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.218556  7786 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:56.240044  5642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.010s	sys 0.003s
I20260709 12:13:56.241926  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:56.187353  7943 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:56.238391  5567 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:56.220386  5601 rpcz_store.cc:276] 0709 12:13:54.611883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.002352 (+390469us) service_pool.cc:224] Handling call
0709 12:13:55.002787 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:55.025338 (+ 22551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.025394 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:55.027493 (+  2099us) log.cc:844] Serialized 26 byte log entry
0709 12:13:55.237752 (+210259us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:13:55.413169 (+175417us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.772774 (+359605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.772860 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.150395 (+377535us) raft_consensus.cc:1685] finished
0709 12:13:56.150414 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.150572 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43953,"prepare.queue_time_us":912274,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":164939,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":3062,"thread_start_us":544282,"threads_started":3,"wal-append.queue_time_us":233795}
I20260709 12:13:56.252455  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 270) took 1634 ms. Trace:
I20260709 12:13:56.251861  5671 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:13:56.197870  7872 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:56.253049  5602 rpcz_store.cc:276] 0709 12:13:54.617887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.018498 (+400611us) service_pool.cc:224] Handling call
0709 12:13:55.060069 (+ 41571us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:55.060469 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.060497 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:55.080419 (+ 19922us) log.cc:844] Serialized 52 byte log entry
0709 12:13:55.220306 (+139887us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:55.220342 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.220408 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.241170 (+1020762us) raft_consensus.cc:1685] finished
0709 12:13:56.252071 (+ 10901us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.252401 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":531,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13855,"thread_start_us":83048,"threads_started":1,"wal-append.queue_time_us":162168}
I20260709 12:13:56.236430  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:56.229658  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:56.188633  7941 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.256475  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:56.283867  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 267) took 1677 ms. Trace:
I20260709 12:13:56.214710  7992 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.242291  8007 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.311758  5748 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:13:56.235888  7960 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.322556  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:56.235900  7999 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:56.316821  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:56.348675  5679 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
W20260709 12:13:56.257942  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 168351us
W20260709 12:13:56.349502  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.305073  7968 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:13:56.324620  5642 connection.cc:256] RPC call timeout handler was delayed by -2.2437729829998716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 12:13:56.363376  5642 connection.cc:256] RPC call timeout handler was delayed by -1.927518930000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 12:13:56.286402  5567 leader_election.cc:336] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.561s (SENT)
I20260709 12:13:56.364396  5567 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:56.250731  7832 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:56.322293  7753 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:56.315213  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1264) took 1176 ms. Trace:
I20260709 12:13:56.338805  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:56.341320  5569 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:13:56.257705  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 270816us
I20260709 12:13:56.350184  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:56.282490  7818 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.307726  5598 rpcz_store.cc:276] 0709 12:13:54.605973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.964876 (+358903us) service_pool.cc:224] Handling call
0709 12:13:54.965240 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.965871 (+   631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.965901 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.966403 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:13:55.231855 (+265452us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:55.975381 (+743526us) log.cc:844] Serialized 14 byte log entry
0709 12:13:56.197078 (+221697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.197168 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.283603 (+ 86435us) raft_consensus.cc:1685] finished
0709 12:13:56.283622 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.283794 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185,"prepare.queue_time_us":322501,"raft.queue_time_us":263366,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":15241,"spinlock_wait_cycles":14677248,"thread_start_us":627327,"threads_started":3,"wal-append.queue_time_us":348913}
I20260709 12:13:56.378252  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:56.365278  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 78903.8us
W20260709 12:13:56.365697  5642 connection.cc:256] RPC call timeout handler was delayed by -1.7025189299999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
W20260709 12:13:56.379541  5642 connection.cc:256] RPC call timeout handler was delayed by -1.6516007069999432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3025s for a response
W20260709 12:13:56.234583  7733 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.012s	sys 0.024s
I20260709 12:13:56.252350  7943 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.338742  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:56.382278  5569 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:56.388617  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:56.388717  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:56.390184  5671 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:56.391669  5569 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:56.393466  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:56.363898  8011 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.337788  6321 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:56.372530  8016 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.424710  5569 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:56.424787  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:56.436110  5598 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:56.436928  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:56.437451  5598 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:56.438172  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:56.438661  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.373015  8006 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:56.426573  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:56.378042  7894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.003s	sys 0.018s
I20260709 12:13:56.427670  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:56.377292  7968 raft_consensus.cc:697] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:56.382928  8010 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:13:56.386193  7985 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.389524  7824 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.433687  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:56.434980  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:56.381413  7943 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.388262  7872 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:56.372918  7999 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.425623  7675 raft_consensus.cc:3055] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:56.425040  7998 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:13:56.427403  7901 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.455483  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 287) took 1186 ms. Trace:
I20260709 12:13:56.456095  8024 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:56.383390  7832 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:56.446074  7894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.003s	sys 0.018s
I20260709 12:13:56.440145  7988 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:56.459951  5600 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:13:56.388866  7818 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.462210  5598 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:13:56.471860  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 45352.3us
I20260709 12:13:56.439157  8023 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.448007  7951 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:56.448292  7753 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.483707  5750 rpcz_store.cc:276] 0709 12:13:55.268611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.421478 (+152867us) service_pool.cc:224] Handling call
0709 12:13:55.421817 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:55.442606 (+ 20789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.442639 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:56.009886 (+567247us) log.cc:844] Serialized 26 byte log entry
0709 12:13:56.258178 (+248292us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:56.258221 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.258297 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.455267 (+196970us) raft_consensus.cc:1685] finished
0709 12:13:56.455287 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.455425 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20420,"raft.queue_time_us":20768,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":41738,"thread_start_us":170146,"threads_started":1,"wal-append.queue_time_us":365866}
I20260709 12:13:56.458287  7992 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:56.425508  8008 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:13:56.463399  7824 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.470248  8010 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:56.435442  8011 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.451081  8006 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.458243  8017 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 12:13:56.460346  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:56.524152  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:56.481554  7944 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:56.650359  8023 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:56.650563  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:56.486143  7901 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.567258  5595 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:56.540161  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 503) took 1013 ms. Trace:
I20260709 12:13:56.651789  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:56.652693  7901 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:56.541492  5602 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:56.650503  7944 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:56.524698  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:56.655364  7944 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:56.655702  7991 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:56.656214  7991 raft_consensus.cc:697] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:56.649880  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:56.657078  7991 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.659283  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:56.651208  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.571261  5603 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:56.605955  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 357) took 3688 ms. Trace:
W20260709 12:13:56.659970  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 135347us
I20260709 12:13:56.655375  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1747) took 3643 ms. Trace:
I20260709 12:13:56.667369  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:56.673162  5750 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
W20260709 12:13:56.589224  7514 consensus_meta.cc:287] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.609s	user 0.006s	sys 0.002s
I20260709 12:13:56.665458  5676 rpcz_store.cc:276] 0709 12:13:53.012393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.107232 (+ 94839us) service_pool.cc:224] Handling call
0709 12:13:54.150546 (+1043314us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:54.150776 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.790246 (+639470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.655142 (+1864896us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54002d3f54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:56.655320 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298330240}
I20260709 12:13:56.541080  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:56.567443  8013 log.cc:927] Time spent T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:13:56.447129  8016 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.670852  8021 consensus_queue.cc:1059] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:56.591102  7941 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:56.483741  7675 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:56.652300  6324 rpcz_store.cc:276] 0709 12:13:55.526440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.189077 (+662637us) service_pool.cc:224] Handling call
0709 12:13:56.191903 (+  2826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.239293 (+ 47390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.239323 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:56.255060 (+ 15737us) log.cc:844] Serialized 26 byte log entry
0709 12:13:56.453193 (+198133us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:56.453240 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.453308 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.539930 (+ 86622us) raft_consensus.cc:1685] finished
0709 12:13:56.539948 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.540073 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24846,"raft.queue_time_us":48519,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4412,"thread_start_us":140304,"threads_started":1,"wal-append.queue_time_us":218511}
I20260709 12:13:56.675907  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:13:56.568507  8014 log.cc:927] Time spent T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:13:56.682214  5676 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:13:56.664261  5677 rpcz_store.cc:276] 0709 12:13:52.917923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.018708 (+100785us) service_pool.cc:224] Handling call
0709 12:13:53.019000 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.019205 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:13:53.091528 (+ 72323us) log.cc:844] Serialized 14 byte log entry
0709 12:13:56.605225 (+3513697us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b180018a3c0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fd5f34bc 00007f44fa94148b 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb23a
0709 12:13:56.605494 (+   269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:56.605557 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:13:56.605613 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.605692 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.605881 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41802,"prepare.queue_time_us":210077,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":137,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":24231,"spinlock_wait_cycles":9063168,"thread_start_us":212504,"threads_started":2,"wal-append.queue_time_us":358030,"wal-append.run_cpu_time_us":2153,"wal-append.run_wall_time_us":1329733}
I20260709 12:13:56.673225  8023 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.590034  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:56.666926  7753 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.520537  8022 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.542097  7988 raft_consensus.cc:697] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:56.524355  7998 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:56.682916  7989 consensus_meta.cc:287] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.003s
I20260709 12:13:56.665036  6321 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
W20260709 12:13:56.686321  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 145320us
I20260709 12:13:56.691792  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:56.692790  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:56.721670  5750 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:13:56.721817  7733 raft_consensus.cc:3055] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:56.722203  7733 raft_consensus.cc:740] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:13:56.722569  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:56.723289  5750 raft_consensus.cc:2393] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:13:56.723135  7733 consensus_queue.cc:260] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.669092  7664 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:13:56.622236  7997 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:13:56.715529  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 329560us
I20260709 12:13:56.540639  8015 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.158s
I20260709 12:13:56.729805  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:13:56.733846  5570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.011s	sys 0.009s
W20260709 12:13:56.746721  5570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.011s	sys 0.009s
I20260709 12:13:56.689772  7901 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:56.721385  6291 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:13:56.686776  7514 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:56.747931  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 323276us
I20260709 12:13:56.758152  5569 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:13:56.747005  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:56.752499  7992 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:56.715152  7753 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.690886  7632 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:56.479984  7872 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.586704  7968 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.691545  8011 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:56.762121  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:56.860651  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 111760us
W20260709 12:13:56.843536  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 85489.8us
I20260709 12:13:56.673657  8010 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.846983  7632 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.875571  7632 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:56.847458  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:56.875898  8010 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:56.744810  7989 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.721385  7998 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.877648  5750 raft_consensus.cc:2410] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:13:56.878428  7998 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:56.709959  7402 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:13:56.690908  7675 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.880745  5597 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:56.842835  7992 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.849542  7824 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:56.853164  7988 consensus_queue.cc:237] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.883612  7992 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:56.845734  8008 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:56.856423  7901 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:56.856683  7872 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:56.460168  8020 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.310s
I20260709 12:13:56.846297  7966 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:13:56.901609  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 58873.3us
I20260709 12:13:56.872926  5569 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:56.873502  8006 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:56.750428  7733 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.744426  7941 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:13:56.908627  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 44198.5us
I20260709 12:13:56.750838  8024 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.376752  5745 rpcz_store.cc:276] 0709 12:13:55.138818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.254684 (+115866us) service_pool.cc:224] Handling call
0709 12:13:55.255054 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:55.256100 (+  1046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.256131 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:55.257590 (+  1459us) log.cc:844] Serialized 52 byte log entry
0709 12:13:55.327375 (+ 69785us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:55.801584 (+474209us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.983829 (+182245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.050839 (+ 67010us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.314957 (+264118us) raft_consensus.cc:1685] finished
0709 12:13:56.314985 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.315150 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":862869,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":76240,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":252,"thread_start_us":438014,"threads_started":2,"wal-append.queue_time_us":156568}
W20260709 12:13:56.760133  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.921133  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.870092  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:56.885144  8011 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.922386  5570 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:56.756669  8002 consensus_queue.cc:1059] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 12:13:56.854560  7753 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.896999  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:56.898988  8007 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:56.916023  7992 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.991664  7992 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.891554  7951 consensus_queue.cc:1059] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:13:56.930660  8011 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:56.962297  5747 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: []
W20260709 12:13:56.961675  5673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.012s	sys 0.010s
I20260709 12:13:56.927376  7966 raft_consensus.cc:697] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:13:56.971738  7402 raft_consensus.cc:3055] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:56.754695  8022 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.896234  8008 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:56.991137  5744 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 12:13:56.956878  5719 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:57.060357  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.003640  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 81373.3us
W20260709 12:13:57.005172  5673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.012s	sys 0.011s
W20260709 12:13:57.006603  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 48892.5us
I20260709 12:13:57.005119  8007 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:56.953821  8024 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:56.928422  7941 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:57.051395  5748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1267) took 1911 ms (client timeout 1561 ms). Trace:
W20260709 12:13:57.008849  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 204473us
I20260709 12:13:57.055179  7402 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:13:57.071046  5748 rpcz_store.cc:269] 0709 12:13:55.139466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.160449 (+ 20983us) service_pool.cc:224] Handling call
0709 12:13:57.051211 (+1890762us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b5400363dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:57.051321 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253045504}
I20260709 12:13:57.072947  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 290) took 1803 ms. Trace:
I20260709 12:13:57.073274  5748 rpcz_store.cc:276] 0709 12:13:55.269394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.072162 (+1802768us) service_pool.cc:224] Handling call
0709 12:13:57.072463 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.072631 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.072656 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.072697 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:13:57.072738 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.072788 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.072896 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:57.054796  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 181948us
I20260709 12:13:57.056833  7966 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:56.989668  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 320676us
W20260709 12:13:57.057847  5596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.053s	sys 0.061s
W20260709 12:13:57.076036  5596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.053s	sys 0.061s
I20260709 12:13:57.076205  5569 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:57.078835  5569 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:13:57.067828  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 111010us
W20260709 12:13:57.081512  5570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.175s (SENT) [suppressed 9 similar messages]
I20260709 12:13:57.068845  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 288) took 1800 ms. Trace:
I20260709 12:13:57.082016  5744 rpcz_store.cc:276] 0709 12:13:55.268890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.990412 (+1721522us) service_pool.cc:224] Handling call
0709 12:13:56.990856 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:57.059470 (+ 68614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.068787 (+  9317us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:57.069170  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.069523  5718 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:13:57.049919  8037 log.cc:927] Time spent T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:13:57.059620  7943 consensus_meta.cc:287] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.005s
I20260709 12:13:56.892884  7997 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:57.058627  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.006903  8011 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.082813  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:13:57.067963  8020 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:57.086004  5642 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:13:57.079986  5645 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:57.089006  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.090133  5603 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:13:57.065523  7998 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.085246  7968 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:57.148339  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 62396.8us
I20260709 12:13:57.093326  8020 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.148927  5603 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:57.149464  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:57.156486  5569 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:13:57.151501  5642 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:13:57.152860  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:57.107883  7799 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.005390  7901 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:57.099395  7898 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:57.182677  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:57.096073  7991 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:13:57.100056  8006 consensus_queue.cc:1059] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:13:57.128538  7361 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:57.200006  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 280) took 1076 ms. Trace:
I20260709 12:13:57.096001  7998 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:57.183947  8048 consensus_queue.cc:1059] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:13:57.096804  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:57.183422  8028 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:57.093398  7913 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:13:57.090256  7943 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:57.161135  8020 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:57.192788  5601 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:57.198240  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:57.198800  8049 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:13:57.192526  7898 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.166088  7753 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:57.200395  5604 rpcz_store.cc:276] 0709 12:13:56.123479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.123613 (+   134us) service_pool.cc:224] Handling call
0709 12:13:56.123935 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.283479 (+159544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.283513 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:56.372421 (+ 88908us) log.cc:844] Serialized 26 byte log entry
0709 12:13:56.701072 (+328651us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:56.701114 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.701209 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:57.199776 (+498567us) raft_consensus.cc:1685] finished
0709 12:13:57.199797 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.199949 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12958,"raft.queue_time_us":122903,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":2337,"spinlock_wait_cycles":1447808,"thread_start_us":425149,"threads_started":2,"wal-append.queue_time_us":598930}
I20260709 12:13:57.196417  8015 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:57.181111  8007 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.205798  7998 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.210157  5744 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:13:57.164955  7799 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.192159  8016 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:57.216979  8007 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.226611  7943 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:57.215519  7898 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:57.212769  8028 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:57.210565  5745 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:13:57.230069  8052 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.234649  5744 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:57.243022  8022 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:57.232160  8007 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:57.251909  5751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1257) took 3401 ms (client timeout 1943 ms). Trace:
I20260709 12:13:57.253998  7942 raft_consensus.cc:3055] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:13:57.254230  8023 consensus_meta.cc:287] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
I20260709 12:13:57.245518  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1277) took 1022 ms. Trace:
W20260709 12:13:57.252344  5751 rpcz_store.cc:269] 0709 12:13:53.847895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.848748 (+   853us) service_pool.cc:224] Handling call
0709 12:13:57.248990 (+3400242us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b54001e6c54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:57.249135 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3733760}
I20260709 12:13:57.240022  8015 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:57.237591  8028 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:57.266021  7942 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:57.267397  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 676) took 2556 ms. Trace:
I20260709 12:13:57.228540  7799 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:57.278245  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.270531  7885 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:57.297055  6327 rpcz_store.cc:276] 0709 12:13:54.711411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.711748 (+   337us) service_pool.cc:224] Handling call
0709 12:13:55.255383 (+543635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:55.255970 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.267191 (+2011221us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540062e150. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:57.267339 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221518592}
I20260709 12:13:57.259558  8049 raft_consensus.cc:3055] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:57.328596  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:57.330271  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:57.330957  6328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 435) took 2612 ms (client timeout 2175 ms). Trace:
I20260709 12:13:57.247686  8052 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:57.201326  7402 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:57.299808  7941 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:57.323441  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:57.593907  5570 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.037s	sys 0.054s
W20260709 12:13:57.504987  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.405900  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 312231us
W20260709 12:13:57.795369  7514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.026s	sys 0.026s
W20260709 12:13:57.985407  7514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.028s	sys 0.028s
W20260709 12:13:57.984191  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.985541  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.297950  8023 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:57.987579  8015 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:57.988207  8015 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:57.989940  8023 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:57.554445  8057 log.cc:927] Time spent T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:13:57.990746  6322 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
W20260709 12:13:57.991565  6322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 498) took 2466 ms (client timeout 2562 ms). Trace:
W20260709 12:13:57.738893  8041 log.cc:927] Time spent T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 12:13:57.583715  7968 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.293900  5745 rpcz_store.cc:276] 0709 12:13:56.223628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.934468 (+710840us) service_pool.cc:224] Handling call
0709 12:13:57.241348 (+306880us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:57.877888  6292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.004s	sys 0.014s
W20260709 12:13:57.993945  6292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.005s	sys 0.014s
W20260709 12:13:57.561419  8050 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 12:13:57.653923  6291 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.013s	sys 0.048s
W20260709 12:13:57.336340  6328 rpcz_store.cc:269] 0709 12:13:54.718984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.330709 (+2611725us) service_pool.cc:211] Skipping call since client already timed out
0709 12:13:57.330893 (+   184us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:13:57.877267  8020 consensus_meta.cc:287] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.003s
I20260709 12:13:57.666909  8024 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:57.299995  8008 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:57.984431  5570 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.044s	sys 0.064s
I20260709 12:13:58.058590  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59380 (request call id 16) took 5123 ms. Trace:
W20260709 12:13:57.992061  6322 rpcz_store.cc:269] 0709 12:13:55.525007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.528972 (+  3965us) service_pool.cc:224] Handling call
0709 12:13:57.293613 (+1764641us) spinlock_profiling.cc:243] Waited 876 us on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:57.991368 (+697755us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2014464}
I20260709 12:13:58.060998  5749 rpcz_store.cc:276] 0709 12:13:52.927454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.927829 (+   375us) service_pool.cc:224] Handling call
0709 12:13:58.050597 (+5122768us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b5400021cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda45853 00007f4502a1360a 00007f44fbf997d4 00007f44fbf99762 00007f44fbf99691 00007f44fbf9960c 00007f44fbf988c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:58.050708 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4910355328}
I20260709 12:13:57.275012  8039 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:57.984802  5750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1276) took 2007 ms (client timeout 2646 ms). Trace:
I20260709 12:13:57.995301  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 386) took 1327 ms. Trace:
W20260709 12:13:58.070101  5750 rpcz_store.cc:269] 0709 12:13:55.976899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.746735 (+769836us) service_pool.cc:224] Handling call
0709 12:13:57.984584 (+1237849us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002170d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:57.984736 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271635328}
W20260709 12:13:58.066553  6291 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.017s	sys 0.052s
W20260709 12:13:58.071689  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 976216us
I20260709 12:13:57.500824  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 384) took 1064 ms. Trace:
W20260709 12:13:57.995718  5602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1975) took 1655 ms (client timeout 1926 ms). Trace:
W20260709 12:13:58.073160  5602 rpcz_store.cc:269] 0709 12:13:56.339890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.434731 (+ 94841us) service_pool.cc:224] Handling call
0709 12:13:57.995532 (+1560801us) spinlock_profiling.cc:243] Waited 82.7 ms on lock 0x7b54003e0b54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:57.995659 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190248832}
I20260709 12:13:57.505254  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:58.066610  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 985041us
I20260709 12:13:58.077034  6327 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
W20260709 12:13:57.967325  7898 consensus_meta.cc:287] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.726s	user 0.005s	sys 0.002s
W20260709 12:13:58.069186  5498 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45214 (request call id 296) took 18189 ms (client timeout 15000 ms). Trace:
W20260709 12:13:57.994469  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.914145  8055 log.cc:927] Time spent T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:13:57.999045  5672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1176) took 2709 ms (client timeout 1613 ms). Trace:
W20260709 12:13:58.121006  5672 rpcz_store.cc:269] 0709 12:13:55.289128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.291901 (+  2773us) service_pool.cc:224] Handling call
0709 12:13:57.998159 (+2706258us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b540037a0d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:57.998913 (+   754us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854215936}
I20260709 12:13:58.122133  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:58.122279  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:57.329245  8049 raft_consensus.cc:740] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:57.986394  8052 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.072414  5676 rpcz_store.cc:276] 0709 12:13:56.667904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.693692 (+ 25788us) service_pool.cc:224] Handling call
0709 12:13:56.694469 (+   777us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.694679 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.694704 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:56.695154 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:13:57.005153 (+309999us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:57.005190 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.005254 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:57.995074 (+989820us) raft_consensus.cc:1685] finished
0709 12:13:57.995097 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.995244 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":309608,"threads_started":1,"wal-append.queue_time_us":411343}
I20260709 12:13:58.076740  5671 rpcz_store.cc:276] 0709 12:13:56.435978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.448232 (+ 12254us) service_pool.cc:224] Handling call
0709 12:13:56.448564 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.448905 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.448932 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:56.449414 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:13:56.897674 (+448260us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:56.897711 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.897794 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:57.500566 (+602772us) raft_consensus.cc:1685] finished
0709 12:13:57.500585 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.500750 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":707,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9973,"thread_start_us":419607,"threads_started":1,"wal-append.queue_time_us":754616}
I20260709 12:13:58.127072  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:58.127631  5671 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.128489  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:58.128661  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:57.977479  7998 consensus_meta.cc:287] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.749s	user 0.006s	sys 0.002s
I20260709 12:13:58.129091  5601 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:58.011770  7999 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:58.130005  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:57.918179  7733 consensus_meta.cc:287] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.990s	user 0.008s	sys 0.003s
I20260709 12:13:58.076051  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:58.089519  5599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.005s	sys 0.008s
I20260709 12:13:57.983445  7943 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:57.582703  8047 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 12:13:58.109067  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:57.878086  6323 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.016s	sys 0.013s
I20260709 12:13:58.109917  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:58.083843  5498 rpcz_store.cc:269] 0709 12:13:39.812724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.818760 (+  6036us) service_pool.cc:224] Handling call
0709 12:13:58.001680 (+18182920us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:48.701510 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:49.024726 (+323216us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b5c0020fd8c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503c3d331 00007f4503c3d221 00007f4503c37f6c 00007f4501495d69 00007f45014810a6 00007f4501480d58 00007f45014859f1 00007f45014859a9 00007f4501485939 00007f4501485901 00007f4501484b2d
0709 12:13:49.024834 (+   108us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:49.024879 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:13:49.024892 (+    13us) tablet.cc:662] Decoding operations
0709 12:13:49.029448 (+  4556us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:49.092202 (+ 62754us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:49.092258 (+    56us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:13:49.124760 (+ 32502us) tablet.cc:701] Row locks acquired
0709 12:13:49.131396 (+  6636us) write_op.cc:260] PREPARE: finished
0709 12:13:49.152201 (+ 20805us) write_op.cc:270] Start()
0709 12:13:49.206210 (+ 54009us) write_op.cc:276] Timestamp: P: 1783599229146048 usec, L: 0
0709 12:13:49.209243 (+  3033us) op_driver.cc:348] REPLICATION: starting
0709 12:13:49.281815 (+ 72572us) log.cc:844] Serialized 2427 byte log entry
0709 12:13:49.979428 (+697613us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:13:50.203776 (+224348us) op_driver.cc:464] REPLICATION: finished
0709 12:13:50.445882 (+242106us) write_op.cc:301] APPLY: starting
0709 12:13:50.469434 (+ 23552us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:50.551720 (+ 82286us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:50.584462 (+ 32742us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:50.818751 (+234289us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:50.945997 (+127246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:13:50.978611 (+ 32614us) write_op.cc:312] APPLY: finished
0709 12:13:50.999939 (+ 21328us) log.cc:844] Serialized 53 byte log entry
0709 12:13:51.000133 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:51.000234 (+   101us) write_op.cc:454] Released schema lock
0709 12:13:51.000296 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:51.006741 (+  6445us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:51.006771 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3110948,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":180679,"apply.run_cpu_time_us":6429,"apply.run_wall_time_us":600667,"num_ops":6,"prepare.queue_time_us":35989,"prepare.run_cpu_time_us":37747,"prepare.run_wall_time_us":823093,"raft.queue_time_us":136881,"raft.run_cpu_time_us":47422,"raft.run_wall_time_us":139756,"replication_time_us":994356,"spinlock_wait_cycles":66173952,"thread_start_us":364029,"threads_started":4,"wal-append.queue_time_us":258052,"wal-append.run_cpu_time_us":62124,"wal-append.run_wall_time_us":2453658}]]}
I20260709 12:13:58.150370  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:58.111696  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:58.068608  8011 consensus_meta.cc:287] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.939s	user 0.005s	sys 0.006s
I20260709 12:13:58.050690  7402 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.042742  7941 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:57.545961  8032 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 12:13:58.077986  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.123642  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:57.962282  7944 consensus_meta.cc:287] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 1.306s	user 0.003s	sys 0.008s
I20260709 12:13:58.158543  5672 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
W20260709 12:13:57.980212  8028 consensus_meta.cc:287] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.653s	user 0.006s	sys 0.001s
I20260709 12:13:58.121177  7898 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:58.134632  5601 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:58.083343  8022 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.131420  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:58.135830  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:13:58.165069  5718 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:58.157670  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:58.169435  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:58.170313  5604 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:57.566820  7942 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:58.159746  7733 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.137364  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 443) took 1044 ms. Trace:
I20260709 12:13:58.137694  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:13:58.163841  7995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.020s	sys 0.039s
I20260709 12:13:58.177101  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 690) took 1082 ms. Trace:
I20260709 12:13:58.102596  8039 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:58.118693  7712 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.146427  5674 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:57.708101  8044 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:58.151886  5671 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:58.167671  7929 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.151103  5673 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:58.189663  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:58.138442  7872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.000s	sys 0.025s
I20260709 12:13:58.152693  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:58.130748  7968 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.131989  8024 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:58.129505  8006 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.012s	sys 0.016s
I20260709 12:13:58.159636  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:58.137773  8015 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:58.151667  6323 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.021s	sys 0.013s
W20260709 12:13:58.151667  8007 consensus_meta.cc:287] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.896s	user 0.006s	sys 0.005s
W20260709 12:13:58.162006  5645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.014s	sys 0.037s
W20260709 12:13:58.220988  5645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.015s	sys 0.037s
W20260709 12:13:58.221319  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 1.14133e+06us
I20260709 12:13:58.221866  5673 raft_consensus.cc:3055] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:13:58.147455  6320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.005s	sys 0.009s
I20260709 12:13:58.175410  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:58.138186  7998 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:58.175678  6294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.014s	sys 0.044s
I20260709 12:13:58.147044  7943 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:58.177500  6327 rpcz_store.cc:276] 0709 12:13:57.094555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.120251 (+1025696us) service_pool.cc:224] Handling call
0709 12:13:58.177036 (+ 56785us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:58.139341  5602 raft_consensus.cc:2410] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:13:58.176512  6328 rpcz_store.cc:276] 0709 12:13:57.092569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.075778 (+983209us) service_pool.cc:224] Handling call
0709 12:13:58.137293 (+ 61515us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:58.136595  5599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.005s	sys 0.008s
I20260709 12:13:58.184333  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 281) took 3585 ms. Trace:
I20260709 12:13:58.069092  8020 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:58.185935  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:58.187068  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:58.158519  8011 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:58.180485  7799 consensus_meta.cc:287] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.848s	user 0.009s	sys 0.001s
I20260709 12:13:58.177109  8022 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:58.182071  7733 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:58.154852  8072 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:13:58.201447  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 388) took 1319 ms. Trace:
I20260709 12:13:58.165704  8049 consensus_queue.cc:260] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:58.188633  7995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.021s	sys 0.039s
I20260709 12:13:58.162750  7944 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:58.181715  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 691) took 1085 ms. Trace:
I20260709 12:13:58.225507  8007 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:58.219110  8024 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:58.238492  7799 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:58.215817  8044 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:58.181811  8039 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.163378  8028 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:58.202096  7942 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.189011  7929 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.222239  5673 raft_consensus.cc:740] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:13:58.197168  7872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.000s	sys 0.026s
I20260709 12:13:58.223486  5645 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:58.224659  6294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.014s	sys 0.045s
W20260709 12:13:58.246497  8048 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.005s	sys 0.017s
W20260709 12:13:58.215677  8006 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.012s	sys 0.017s
I20260709 12:13:58.228178  5746 rpcz_store.cc:276] 0709 12:13:54.594175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.594300 (+   125us) service_pool.cc:224] Handling call
0709 12:13:54.594579 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.954310 (+359731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.179386 (+3225076us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54000a8054. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:58.179548 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826099968}
W20260709 12:13:58.249363  7913 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.003s	sys 0.015s
W20260709 12:13:58.333295  7913 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.003s	sys 0.015s
I20260709 12:13:58.334854  8028 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:58.247802  5748 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:58.339778  6325 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.259729  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1972) took 1921 ms. Trace:
I20260709 12:13:58.341024  5600 rpcz_store.cc:276] 0709 12:13:56.338683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.339101 (+   418us) service_pool.cc:224] Handling call
0709 12:13:56.371953 (+ 32852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.519827 (+147874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.259448 (+1739621us) spinlock_profiling.cc:243] Waited 87.8 ms on lock 0x7b540008cad4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:58.259654 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201848576}
W20260709 12:13:58.262919  5598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1974) took 1923 ms (client timeout 2191 ms). Trace:
W20260709 12:13:58.343029  5598 rpcz_store.cc:269] 0709 12:13:56.339648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.437974 (+ 98326us) service_pool.cc:224] Handling call
0709 12:13:58.262725 (+1824751us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b540031b5d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:58.262861 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48217984}
I20260709 12:13:58.228624  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 283) took 1161 ms. Trace:
I20260709 12:13:58.342128  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1913) took 2011 ms. Trace:
I20260709 12:13:58.196033  5601 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:13:58.233637  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:58.234853  7943 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:58.235119  8021 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.025s	sys 0.026s
W20260709 12:13:58.224408  6320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.005s	sys 0.010s
I20260709 12:13:58.236577  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1744) took 5286 ms. Trace:
W20260709 12:13:58.360397  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.188668  7712 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:58.410602  5675 rpcz_store.cc:276] 0709 12:13:52.950023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.036605 (+ 86582us) service_pool.cc:224] Handling call
0709 12:13:53.036862 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.731879 (+1695017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.236311 (+3504432us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b540007a654. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:58.236486 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3896631168}
I20260709 12:13:58.160670  7941 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:58.244505  5677 rpcz_store.cc:276] 0709 12:13:56.882130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.882291 (+   161us) service_pool.cc:224] Handling call
0709 12:13:56.882603 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:56.883014 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:13:56.883041 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:56.883610 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 12:13:57.094486 (+210876us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:57.094526 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.094591 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:58.201243 (+1106652us) raft_consensus.cc:1685] finished
0709 12:13:58.201261 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:58.201389 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10334,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":2016,"thread_start_us":210487,"threads_started":1,"wal-append.queue_time_us":597771}
I20260709 12:13:58.206786  7968 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:58.342832  5753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 1904) took 3260 ms (client timeout 3225 ms). Trace:
W20260709 12:13:58.323800  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 100389us
I20260709 12:13:58.277518  7799 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:13:58.512461  5753 rpcz_store.cc:269] 0709 12:13:55.082830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.087570 (+  4740us) service_pool.cc:224] Handling call
0709 12:13:58.342638 (+3255068us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54000532d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:58.342767 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315065600}
W20260709 12:13:58.325084  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.344379  5748 rpcz_store.cc:276] 0709 12:13:56.330789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.074169 (+743380us) service_pool.cc:224] Handling call
0709 12:13:57.090931 (+ 16762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:58.338581 (+1247650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.341888 (+  3307us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400181ad4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:58.342068 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2660108544}
I20260709 12:13:58.253098  5604 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:58.344959  6327 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:58.314478  5716 connection.cc:256] RPC call timeout handler was delayed by -1.6625803160000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 12:13:58.515829  5716 connection.cc:256] RPC call timeout handler was delayed by -1.59391149399994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260709 12:13:58.206270  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:13:58.517010  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 310808us
I20260709 12:13:58.517685  5718 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:13:58.407137  5752 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 12:13:58.406695  8021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.026s	sys 0.026s
I20260709 12:13:58.282752  8044 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:58.338030  7988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.206s	user 0.080s	sys 0.128s
I20260709 12:13:58.408877  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:58.343940  5599 rpcz_store.cc:276] 0709 12:13:57.066851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.067077 (+   226us) service_pool.cc:224] Handling call
0709 12:13:57.097194 (+ 30117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.097404 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:13:57.097643 (+   239us) log.cc:844] Serialized 14 byte log entry
0709 12:13:58.228248 (+1130605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:58.228295 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:13:58.228336 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.228458 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:58.228574 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":424,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":84,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":8215,"thread_start_us":1130277,"threads_started":1,"wal-append.queue_time_us":1091351}
I20260709 12:13:58.274372  7998 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:58.284767  8020 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:58.312165  6326 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
W20260709 12:13:58.407320  5642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.247s	user 0.006s	sys 0.012s
I20260709 12:13:58.345726  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:58.337507  5501 catalog_manager.cc:5697] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 4, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 4 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:58.288607  7675 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:58.253252  7812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.000s	sys 0.017s
I20260709 12:13:58.518361  5752 pending_rounds.cc:85] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 3
I20260709 12:13:58.322314  5673 consensus_queue.cc:260] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:58.255362  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:58.253597  8049 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.267159  8022 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:58.266654  8024 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:58.323855  8048 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.005s	sys 0.018s
I20260709 12:13:58.254972  8011 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:58.255744  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 504) took 2729 ms. Trace:
I20260709 12:13:58.300390  7361 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:58.324040  7872 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.257402  8007 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:58.304240  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1896) took 3518 ms. Trace:
I20260709 12:13:58.332000  7989 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:58.276576  7944 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:58.305326  7733 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:58.317538  7929 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:58.777626  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 111540us
W20260709 12:13:58.776728  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 207495us
W20260709 12:13:58.563230  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.778877  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 113801us
W20260709 12:13:58.782771  6293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.002s	sys 0.022s
W20260709 12:13:58.716642  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.781422  5601 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:58.776875  5673 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:58.604507  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.561450  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:58.782837  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.785565  5600 raft_consensus.cc:2410] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:13:58.782776  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.786181  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.775592  5752 pending_rounds.cc:107] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:13:58.787123  5752 raft_consensus.cc:2889] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:58.699846  6327 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:58.787853  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 445) took 1695 ms. Trace:
I20260709 12:13:58.788230  6327 rpcz_store.cc:276] 0709 12:13:57.092871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.231187 (+1138316us) service_pool.cc:224] Handling call
0709 12:13:58.787784 (+556597us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:58.776804  5642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.617s	user 0.007s	sys 0.020s
W20260709 12:13:58.782505  5719 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.000s	sys 0.010s
W20260709 12:13:58.789352  5719 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.000s	sys 0.011s
I20260709 12:13:58.561797  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:58.790053  5599 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
W20260709 12:13:58.867906  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.866540  5673 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:58.785121  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:13:58.981017  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.992093  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 478069us
W20260709 12:13:58.994261  5678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.030s	sys 0.050s
W20260709 12:13:58.789686  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 546624us
I20260709 12:13:58.775067  5747 rpcz_store.cc:276] 0709 12:13:54.785692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.961733 (+176041us) service_pool.cc:224] Handling call
0709 12:13:54.962046 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.004994 (+2042948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.303985 (+1298991us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54002175d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:58.304166 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4599611136}
W20260709 12:13:58.781584  6292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.017s	sys 0.024s
W20260709 12:13:58.783223  6293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.002s	sys 0.022s
W20260709 12:13:58.965950  6319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 679) took 2502 ms (client timeout 1730 ms). Trace:
I20260709 12:13:58.753909  6320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 686) took 2235 ms. Trace:
I20260709 12:13:58.769477  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:58.254487  6322 rpcz_store.cc:276] 0709 12:13:57.094794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.124976 (+1030182us) service_pool.cc:224] Handling call
0709 12:13:58.180623 (+ 55647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:58.791656  7361 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:58.614949  7786 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:58.775063  7812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.556s	user 0.010s	sys 0.032s
I20260709 12:13:58.777976  7872 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:13:58.992655  7913 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.015s	sys 0.057s
I20260709 12:13:59.400529  7989 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:59.036440  7941 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:58.559895  7943 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:13:59.402046  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 1.2728e+06us
I20260709 12:13:59.402434  7943 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:13:59.403967  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.404291  7818 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:59.404812  5678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.032s	sys 0.056s
I20260709 12:13:59.129769  7992 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:59.404402  7943 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:13:59.282724  5716 connection.cc:256] RPC call timeout handler was delayed by -1.558892300000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 12:13:58.782671  7966 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.375s	user 0.016s	sys 0.021s
W20260709 12:13:59.406045  5716 connection.cc:256] RPC call timeout handler was delayed by -1.5437803160000385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 12:13:58.550367  7988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.450s	user 0.082s	sys 0.131s
I20260709 12:13:58.590411  7998 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.411576  5501 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 4, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:13:58.800801  7999 consensus_queue.cc:1059] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.167s
W20260709 12:13:58.862191  8006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.007s	sys 0.010s
I20260709 12:13:58.511344  8052 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:58.710520  8065 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:59.123337  8070 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.349s	user 0.002s	sys 0.000s
W20260709 12:13:59.034440  8078 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
W20260709 12:13:59.216993  5595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1979) took 2876 ms (client timeout 1845 ms). Trace:
I20260709 12:13:59.229372  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:59.393062  7832 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:13:59.259271  6325 consensus_meta.cc:287] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.919s	user 0.006s	sys 0.002s
I20260709 12:13:59.213996  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:59.394294  7968 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:59.237231  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:13:59.129433  7960 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:59.285234  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.399062  7997 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:13:59.253646  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.399441  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:59.400367  7786 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:58.564829  7934 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:13:59.233850  5597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 276) took 3785 ms (client timeout 1638 ms). Trace:
W20260709 12:13:59.402731  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.780345  7995 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.024s
W20260709 12:13:59.512876  7995 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.008s	sys 0.024s
W20260709 12:13:59.406453  5716 connection.cc:256] RPC call timeout handler was delayed by -1.5219119640000827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 12:13:59.404467  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.286269  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1796) took 1130 ms. Trace:
W20260709 12:13:59.513929  5716 connection.cc:256] RPC call timeout handler was delayed by -1.4744803159999265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 12:13:59.212235  5567 connection.cc:256] RPC call timeout handler was delayed by -1.5340088099999321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260709 12:13:59.237711  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1784) took 1117 ms. Trace:
W20260709 12:13:59.514503  5567 connection.cc:256] RPC call timeout handler was delayed by -1.5139917859999059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 12:13:59.504163  7675 consensus_meta.cc:287] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.692s	user 0.013s	sys 0.006s
W20260709 12:13:59.279922  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 2.12816e+06us
I20260709 12:13:59.232477  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 377) took 2845 ms. Trace:
I20260709 12:13:59.250602  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1265) took 4111 ms. Trace:
I20260709 12:13:59.286720  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:13:59.256837  6326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 441) took 2164 ms (client timeout 1605 ms). Trace:
W20260709 12:13:59.130975  8067 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 12:13:59.406564  7966 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.068s	user 0.017s	sys 0.021s
I20260709 12:13:59.420899  7944 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:13:59.421468  6292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.017s	sys 0.034s
I20260709 12:13:59.422263  7872 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.215719  5570 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:13:59.127409  8039 consensus_meta.cc:287] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.826s	user 0.007s	sys 0.000s
W20260709 12:13:59.425164  6319 rpcz_store.cc:269] 0709 12:13:56.462179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.462948 (+   769us) service_pool.cc:224] Handling call
0709 12:13:58.255252 (+1792304us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:58.959544 (+704292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6565632}
I20260709 12:13:59.279186  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:13:59.427425  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.412675  7998 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:13:59.400414  7913 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.066s	user 0.015s	sys 0.057s
I20260709 12:13:59.433117  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.434245  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:59.434952  7233 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:13:59.401503  7989 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:59.436509  5501 catalog_manager.cc:5697] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.401933  8007 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:13:59.516072  6326 rpcz_store.cc:269] 0709 12:13:57.092114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.328308 (+236194us) service_pool.cc:224] Handling call
0709 12:13:59.256192 (+1927884us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b5400673ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:59.256453 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236885248}
I20260709 12:13:59.127213  7898 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:59.078625  7712 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:59.457676  7992 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.473815  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:59.458705  7818 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.466161  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1801) took 1151 ms. Trace:
I20260709 12:13:59.156011  7929 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:59.494868  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.495630  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1776) took 1388 ms. Trace:
W20260709 12:13:59.490893  5595 rpcz_store.cc:269] 0709 12:13:56.340777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.425006 (+ 84229us) service_pool.cc:224] Handling call
0709 12:13:59.216384 (+2791378us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54002aadd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:59.216697 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249029888}
W20260709 12:13:59.498298  6291 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.016s	sys 0.008s
I20260709 12:13:59.497303  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1785) took 1340 ms. Trace:
I20260709 12:13:59.491945  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.497473  5596 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:13:59.563403  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1795) took 1423 ms. Trace:
W20260709 12:13:59.491740  8006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.007s	sys 0.010s
I20260709 12:13:59.505657  5598 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.505506  5672 raft_consensus.cc:1240] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:59.508451  5597 rpcz_store.cc:269] 0709 12:13:55.448145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.448280 (+   135us) service_pool.cc:224] Handling call
0709 12:13:59.233370 (+3785090us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b5400267fd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:59.233617 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083139456}
W20260709 12:13:59.514884  5567 connection.cc:256] RPC call timeout handler was delayed by -1.1421496399998432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 12:13:59.518363  5716 connection.cc:256] RPC call timeout handler was delayed by -1.4654803159999119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260709 12:13:59.514629  5602 rpcz_store.cc:276] 0709 12:13:58.120639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.128395 (+  7756us) service_pool.cc:224] Handling call
0709 12:13:59.237287 (+1108892us) spinlock_profiling.cc:243] Waited 9.7 ms on lock 0x7b54002ffb54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:59.237513 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22316416}
W20260709 12:13:59.520852  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.519389  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1798) took 1337 ms. Trace:
I20260709 12:13:59.514216  5604 rpcz_store.cc:276] 0709 12:13:58.155474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.175124 (+ 19650us) service_pool.cc:224] Handling call
0709 12:13:59.237082 (+1061958us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b54002abf54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:59.285950 (+ 48868us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68042496}
I20260709 12:13:59.523278  5600 raft_consensus.cc:2393] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:13:59.507390  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.530269  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 508) took 1015 ms. Trace:
I20260709 12:13:59.515522  5752 rpcz_store.cc:276] 0709 12:13:55.139033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.263173 (+124140us) service_pool.cc:224] Handling call
0709 12:13:58.343081 (+3079908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:58.801710 (+458629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.250040 (+448330us) spinlock_profiling.cc:243] Waited 3.08 s on lock 0x7b54000532d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:59.250312 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7082491648}
I20260709 12:13:59.515430  5679 rpcz_store.cc:276] 0709 12:13:56.386866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.386973 (+   107us) service_pool.cc:224] Handling call
0709 12:13:57.998292 (+1611319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.998558 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.998584 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.998631 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:57.998666 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.998725 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:59.231946 (+1233221us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540037a0d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:13:59.232171 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3705027328}
I20260709 12:13:59.562270  5676 rpcz_store.cc:276] 0709 12:13:58.107550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.126852 (+ 19302us) service_pool.cc:224] Handling call
0709 12:13:59.231225 (+1104373us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:13:59.495505 (+264280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5485952}
I20260709 12:13:59.542208  5675 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
W20260709 12:13:59.569691  5716 connection.cc:256] RPC call timeout handler was delayed by -1.3655803159999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260709 12:13:59.544152  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.544891  7934 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:59.545284  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 685) took 3052 ms. Trace:
I20260709 12:13:59.562569  5673 rpcz_store.cc:276] 0709 12:13:58.120520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.204207 (+ 83687us) service_pool.cc:224] Handling call
0709 12:13:58.204466 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:59.410049 (+1205583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.461202 (+ 51153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:59.503258  7786 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:59.326758  7733 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:13:59.558548  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.542258  7998 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:59.563736  5596 rpcz_store.cc:276] 0709 12:13:58.140165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.228838 (+1088673us) service_pool.cc:224] Handling call
0709 12:13:59.563330 (+334492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:59.561868  5599 rpcz_store.cc:276] 0709 12:13:58.245456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.551016 (+305560us) service_pool.cc:224] Handling call
0709 12:13:59.391056 (+840040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:59.565953  5603 rpcz_store.cc:276] 0709 12:13:58.180223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.238532 (+1058309us) service_pool.cc:224] Handling call
0709 12:13:59.517491 (+278959us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:59.568235  6291 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.017s	sys 0.009s
W20260709 12:13:59.574879  5716 connection.cc:256] RPC call timeout handler was delayed by -1.3448803159999443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
W20260709 12:13:59.581369  5716 connection.cc:256] RPC call timeout handler was delayed by -1.1517279719998896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
I20260709 12:13:59.411067  6320 rpcz_store.cc:276] 0709 12:13:56.518319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.876603 (+358284us) service_pool.cc:224] Handling call
0709 12:13:56.877008 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.896617 (+ 19609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.899074 (+  2457us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:56.987791 (+ 88717us) log.cc:844] Serialized 26 byte log entry
0709 12:13:58.512395 (+1524604us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:58.550503 (+ 38108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.564547 (+ 14044us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:58.568225 (+  3678us) raft_consensus.cc:1685] finished
0709 12:13:58.589268 (+ 21043us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:58.711239 (+121971us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16024,"raft.queue_time_us":17499,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3818,"thread_start_us":1316878,"threads_started":1,"wal-append.queue_time_us":1240497,"wal-append.run_cpu_time_us":2022,"wal-append.run_wall_time_us":1123789}
W20260709 12:13:59.578817  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1800) took 1354 ms (client timeout 1689 ms). Trace:
I20260709 12:13:59.568477  6325 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:13:59.586234  6325 pending_rounds.cc:85] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 5
W20260709 12:13:59.586019  5600 rpcz_store.cc:269] 0709 12:13:58.224696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.825947 (+601251us) service_pool.cc:224] Handling call
0709 12:13:59.573421 (+747474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:59.587172  5674 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:13:59.587682  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:59.587850  8021 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:59.588433  5600 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:59.588546  8021 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:59.591161  8021 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:59.592248  7924 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.592908  7924 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:59.593411  7991 raft_consensus.cc:3055] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:59.588948  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1807) took 1278 ms. Trace:
I20260709 12:13:59.568054  6322 rpcz_store.cc:276] 0709 12:13:58.514331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.398933 (+884602us) service_pool.cc:224] Handling call
0709 12:13:59.530163 (+131230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:59.633400  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1784) took 1516 ms. Trace:
I20260709 12:13:59.610008  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:59.597390  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:59.600813  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:59.655586  5600 rpcz_store.cc:276] 0709 12:13:58.310700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.587316 (+1276616us) service_pool.cc:224] Handling call
0709 12:13:59.588882 (+  1566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:59.613495  5501 catalog_manager.cc:5697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 4, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 4 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:59.626235  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:59.574512  7934 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.611897  7989 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:59.619437  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.598205  6328 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 6. Ops: []
I20260709 12:13:59.596501  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:59.606595  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1791) took 1455 ms. Trace:
I20260709 12:13:59.603019  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:59.633553  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.639748  7924 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:59.612705  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:58.780463  6323 rpcz_store.cc:276] 0709 12:13:55.526761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.219285 (+692524us) service_pool.cc:224] Handling call
0709 12:13:56.649659 (+430374us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:56.669271 (+ 19612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.671172 (+  1901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.671203 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:56.671699 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:13:57.068230 (+396531us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:58.227144 (+1158914us) log.cc:844] Serialized 14 byte log entry
0709 12:13:58.243580 (+ 16436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.248217 (+  4637us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:58.250794 (+  2577us) raft_consensus.cc:1685] finished
0709 12:13:58.255531 (+  4737us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:58.255687 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":127759,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":65737,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"spinlock_wait_cycles":46927744,"thread_start_us":1545493,"threads_started":2,"wal-append.queue_time_us":546287,"wal-append.run_cpu_time_us":2572,"wal-append.run_wall_time_us":2173811}
I20260709 12:13:59.621423  8007 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:59.622291  7733 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:59.555401  8039 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:13:59.619611  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:59.606160  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.598105  7818 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:59.618026  7992 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:59.600170  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:13:59.635016  8049 consensus_meta.cc:287] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.000s
I20260709 12:13:59.573675  7944 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:59.641089  8052 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:59.629195  7929 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:59.603776  5567 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:13:59.571429  6324 rpcz_store.cc:276] 0709 12:13:56.492260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.892353 (+400093us) service_pool.cc:224] Handling call
0709 12:13:58.607414 (+1715061us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:13:58.607653 (+   239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:58.615428 (+  7775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:58.615458 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:59.284464 (+669006us) log.cc:844] Serialized 548 byte log entry
0709 12:13:59.480078 (+195614us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:59.481549 (+  1471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.487540 (+  5991us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:59.544776 (+ 57236us) raft_consensus.cc:1685] finished
0709 12:13:59.544796 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:59.545056 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3392768,"thread_start_us":189890,"threads_started":1,"wal-append.queue_time_us":257795}
W20260709 12:13:59.585451  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 370179us
I20260709 12:13:59.586489  6325 pending_rounds.cc:107] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:13:59.665441  7793 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.666121  8017 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.717320  6325 raft_consensus.cc:2889] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:59.667233  7786 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:59.667435  7843 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:59.667979  5597 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:59.668641  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:59.670003  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:59.605281  8065 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:59.661551  5672 rpcz_store.cc:276] 0709 12:13:58.151331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.221817 (+ 70486us) service_pool.cc:224] Handling call
0709 12:13:58.222082 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:59.578419 (+1356337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.606301 (+ 27882us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540029b3d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:59.606518 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2905959808}
I20260709 12:13:59.666273  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:13:59.587458  7812 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:13:59.674880  5675 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:13:59.606658  6321 raft_consensus.cc:2376] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5. Re-sending same reply.
I20260709 12:13:59.675536  5595 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:59.676497  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:13:59.677711  7361 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:59.655509  7991 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:13:59.656145  5678 rpcz_store.cc:276] 0709 12:13:58.117018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.200397 (+ 83379us) service_pool.cc:224] Handling call
0709 12:13:58.200691 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:58.201045 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:58.201074 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:58.206493 (+  5419us) log.cc:844] Serialized 26 byte log entry
0709 12:13:59.405585 (+1199092us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:59.405669 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.405808 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:59.633143 (+227335us) raft_consensus.cc:1685] finished
0709 12:13:59.633161 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:59.633338 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":212,"raft.queue_time_us":106,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":15366,"thread_start_us":1173803,"threads_started":1,"wal-append.queue_time_us":1304300}
W20260709 12:13:59.627146  8087 log.cc:927] Time spent T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:13:59.678467  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.702872  5670 raft_consensus.cc:2410] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:59.676388  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:13:59.723515  7806 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:59.666776  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 788928us
I20260709 12:13:59.721524  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:13:59.734068  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 75061.9us
W20260709 12:13:59.742794  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.702600  8024 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:59.673558  5501 catalog_manager.cc:5697] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 4, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 4 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:59.725627  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1809) took 1411 ms. Trace:
I20260709 12:13:59.727706  5603 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:59.729981  5676 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.745112  5597 rpcz_store.cc:276] 0709 12:13:58.311427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.612348 (+1300921us) service_pool.cc:224] Handling call
0709 12:13:59.722442 (+110094us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:59.728595  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1804) took 1475 ms. Trace:
I20260709 12:13:59.715122  7913 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:13:59.713342  5599 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:59.746110  5595 rpcz_store.cc:276] 0709 12:13:58.253557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.583093 (+1329536us) service_pool.cc:224] Handling call
0709 12:13:59.728539 (+145446us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:59.745265  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.725211  7924 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.744807  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.746932  5601 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.750856  7999 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.741848  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.748237  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1811) took 1436 ms. Trace:
I20260709 12:13:59.753360  5599 rpcz_store.cc:276] 0709 12:13:58.311897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.602607 (+1290710us) service_pool.cc:224] Handling call
0709 12:13:59.748180 (+145573us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:59.751684  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:59.752251  6327 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.750916  7786 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:13:59.757696  5600 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:13:59.732501  8007 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:13:59.745946  8049 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:59.761065  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.762856  5501 catalog_manager.cc:5697] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 4, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 4 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:13:59.762249  7793 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:59.767745  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:13:59.747054  7806 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:13:59.740758  7843 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:59.751129  7913 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:13:59.964807  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:59.980822  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 380897us
I20260709 12:13:59.764128  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1797) took 1593 ms. Trace:
I20260709 12:13:59.858248  5596 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:59.796228  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:13:59.857041  5598 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:13:59.794134  5604 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 12:13:59.795277  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 687) took 3257 ms. Trace:
W20260709 12:13:59.984130  5598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1813) took 1671 ms (client timeout 1865 ms). Trace:
I20260709 12:13:59.982890  5600 rpcz_store.cc:276] 0709 12:13:58.165318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.665893 (+1500575us) service_pool.cc:224] Handling call
0709 12:13:59.758290 (+ 92397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:59.784353  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:13:59.898903  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.942322  6324 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: []
W20260709 12:13:59.913712  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 68675.3us
I20260709 12:13:59.797606  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:00.023950  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:13:59.985323  5598 rpcz_store.cc:269] 0709 12:13:58.312389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.236639 (+924250us) service_pool.cc:224] Handling call
0709 12:13:59.984065 (+747426us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:59.793534  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 426) took 6370 ms. Trace:
I20260709 12:13:59.759459  7898 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:13:59.984571  6328 rpcz_store.cc:276] 0709 12:13:56.538247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.231106 (+1692859us) service_pool.cc:224] Handling call
0709 12:13:58.235525 (+  4419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:59.673233 (+1437708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.774846 (+101613us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54005ce254. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:13:59.795158 (+ 20312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3077297024}
I20260709 12:14:00.040913  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:13:59.994705  5601 raft_consensus.cc:2410] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:00.026804  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1792) took 1866 ms. Trace:
I20260709 12:13:59.795776  7991 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:59.887535  7799 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.859562  7818 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:13:59.849781  8017 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:13:59.857781  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:00.028847  5675 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:00.029500  5673 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:59.973892  5748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:14:00.030079  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 442) took 2926 ms. Trace:
I20260709 12:13:59.771241  8024 raft_consensus.cc:697] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:00.056811  6324 rpcz_store.cc:276] 0709 12:13:57.092401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.730657 (+2638256us) service_pool.cc:224] Handling call
0709 12:13:59.784594 (+ 53937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.018588 (+233994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.018849 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.037640  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1789) took 1861 ms. Trace:
I20260709 12:14:00.058358  5604 rpcz_store.cc:276] 0709 12:13:58.123899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.722939 (+1599040us) service_pool.cc:224] Handling call
0709 12:13:59.764059 (+ 41120us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:59.985098 (+221039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.985331 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.024808  6325 rpcz_store.cc:276] 0709 12:13:53.423424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.423562 (+   138us) service_pool.cc:224] Handling call
0709 12:13:53.595693 (+172131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:55.268935 (+1673242us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5400513ea0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9c2dc0 00007f44fda4d1c0 00007f44fda4e231 00007f44fda4ad8f 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c
0709 12:13:58.339234 (+3070299us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b58007d1ed0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9a70aa 00007f44fda29447 00007f44fda41fe7 00007f44fda437de 00007f44fda4db49 00007f44fda4e416 00007f44fda4ad8f 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4
0709 12:13:59.770754 (+1431520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.793418 (+ 22664us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14044800}
W20260709 12:13:59.981385  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 377793us
I20260709 12:13:59.856983  6320 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.041975  5596 rpcz_store.cc:276] 0709 12:13:58.125318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.726230 (+1600912us) service_pool.cc:224] Handling call
0709 12:13:59.784694 (+ 58464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:59.990820 (+206126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.991010 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:00.046054  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.051834  6327 raft_consensus.cc:2410] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:13:59.767951  7361 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:13:59.980497  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:00.054361  5679 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:59.795222  8002 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.796926  7793 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:13:59.797320  5501 catalog_manager.cc:5697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 4, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 4 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.770318  6323 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:00.062294  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:00.052286  5570 leader_election.cc:336] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.605s (SENT)
I20260709 12:14:00.068437  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:00.064960  5753 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 3.
I20260709 12:13:59.771561  7812 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:00.081249  5677 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.081388  5570 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:00.103664  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.075520  5672 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:00.109180  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:00.102380  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.797941  7924 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:00.060748  7995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.025s	sys 0.015s
I20260709 12:13:59.797941  7999 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:00.510044  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:00.376353  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 330741us
W20260709 12:14:00.222678  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.126571  5599 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:00.114511  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:00.308068  6291 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:00.117316  6326 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:14:00.582607  5675 raft_consensus.cc:2410] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:00.311414  5677 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:14:00.336498  5748 raft_consensus.cc:606] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:00.702761  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1788) took 2581 ms. Trace:
I20260709 12:14:00.871415  5596 raft_consensus.cc:1240] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:00.873884  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1208) took 1257 ms. Trace:
I20260709 12:14:00.655423  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 392) took 1047 ms. Trace:
I20260709 12:14:00.118947  5604 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:00.376147  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.538424  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:00.117969  5595 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:00.874482  5603 rpcz_store.cc:276] 0709 12:13:58.121709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.719860 (+1598151us) service_pool.cc:224] Handling call
0709 12:13:59.724721 (+  4861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:59.748399 (+ 23678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.702525 (+954126us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b54002aba50. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:00.702688 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6738816}
I20260709 12:14:00.292420  5673 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
W20260709 12:14:00.376330  5569 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.018s
I20260709 12:14:00.794127  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:00.307406  5600 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:00.130201  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 68956.7us
I20260709 12:14:00.687820  5749 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:00.613355  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.514780  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:00.538956  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:00.649071  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:00.294875  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 172480us
W20260709 12:14:00.711321  5601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1805) took 2401 ms (client timeout 1561 ms). Trace:
W20260709 12:14:00.619760  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 48767us
W20260709 12:14:00.871603  6293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.003s	sys 0.007s
I20260709 12:14:00.826738  5672 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:14:00.878600  5748 raft_consensus.cc:614] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:00.880735  6326 pending_rounds.cc:85] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 3
I20260709 12:14:00.883530  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1207) took 1268 ms. Trace:
I20260709 12:14:00.883617  6326 pending_rounds.cc:107] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 12:14:00.879557  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1806) took 2569 ms. Trace:
W20260709 12:14:00.590407  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 279900us
W20260709 12:14:00.871387  5717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.017s	sys 0.008s
W20260709 12:14:00.399272  8006 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.054s	sys 0.076s
W20260709 12:14:00.144917  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 69344.8us
I20260709 12:14:00.116973  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:00.882766  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 696) took 1044 ms. Trace:
W20260709 12:14:00.880209  5569 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.363s	user 0.029s	sys 0.030s
I20260709 12:14:00.875595  5677 rpcz_store.cc:276] 0709 12:13:59.615878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.774154 (+158276us) service_pool.cc:224] Handling call
0709 12:14:00.873711 (+1099557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.882629  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1808) took 2571 ms. Trace:
I20260709 12:14:00.883989  6326 raft_consensus.cc:2917] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 12:14:00.618784  5501 catalog_manager.cc:5697] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 4, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 4 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.883266  6327 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:00.883224  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:00.590543  5597 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.007s	sys 0.005s
W20260709 12:14:00.899219  5597 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.007s	sys 0.018s
W20260709 12:14:00.899329  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.528879  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:00.293736  5752 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:00.117108  6322 raft_consensus.cc:2410] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:00.887867  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1814) took 2573 ms. Trace:
I20260709 12:14:00.087922  7733 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:00.889793  8006 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.055s	sys 0.103s
W20260709 12:14:00.885638  5717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.018s	sys 0.008s
I20260709 12:14:00.880205  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1212) took 1263 ms. Trace:
I20260709 12:14:00.904538  5673 rpcz_store.cc:276] 0709 12:13:59.617066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.768885 (+151819us) service_pool.cc:224] Handling call
0709 12:14:00.880147 (+1111262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1501952}
I20260709 12:14:00.888727  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1810) took 2577 ms. Trace:
W20260709 12:14:00.882802  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.792927  5598 raft_consensus.cc:1240] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:00.906536  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 297) took 1167 ms. Trace:
I20260709 12:14:00.906921  5752 rpcz_store.cc:276] 0709 12:13:59.763164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.767321 (+  4157us) service_pool.cc:224] Handling call
0709 12:14:00.900464 (+1133143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.559860  6320 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:00.794795  7812 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:00.908072  5596 rpcz_store.cc:276] 0709 12:13:58.311666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.062084 (+1750418us) service_pool.cc:224] Handling call
0709 12:14:00.871235 (+809151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.884781 (+ 13546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.888674 (+  3893us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:00.882876  6293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.004s	sys 0.008s
I20260709 12:14:00.883901  5672 rpcz_store.cc:276] 0709 12:13:59.615580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.772293 (+156713us) service_pool.cc:224] Handling call
0709 12:14:00.883474 (+1111181us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:00.142226  7872 consensus_meta.cc:287] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
I20260709 12:14:00.650571  7913 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:00.618238  7806 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:00.115789  8095 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:14:00.886027  5601 rpcz_store.cc:269] 0709 12:13:58.310215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.784870 (+474655us) service_pool.cc:224] Handling call
0709 12:14:00.711044 (+1926174us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54003e1554. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:00.711234 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750729984}
W20260709 12:14:00.512578  7995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.035s	sys 0.046s
I20260709 12:14:00.890377  6328 rpcz_store.cc:276] 0709 12:13:59.838205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.224547 (+386342us) service_pool.cc:224] Handling call
0709 12:14:00.882709 (+658162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.912300  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1815) took 2592 ms. Trace:
I20260709 12:14:00.912716  5598 rpcz_store.cc:276] 0709 12:13:58.315066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.792247 (+2477181us) service_pool.cc:224] Handling call
0709 12:14:00.792677 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.906831 (+114154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.907043 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.886379  5595 rpcz_store.cc:276] 0709 12:13:58.310470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.920022 (+1609552us) service_pool.cc:224] Handling call
0709 12:14:00.117493 (+197471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.879314 (+761821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.879504 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.656337  8017 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:00.911195  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:00.420845  8052 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.473s
I20260709 12:14:00.913873  5672 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.426765  8065 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:00.115059  7818 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.814165  7991 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.914758  7817 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:00.780871  6321 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:00.676103  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:00.915724  5670 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.915374  7817 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:00.916721  7818 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:00.891963  7943 consensus_queue.cc:1059] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:14:00.918772  7943 raft_consensus.cc:3055] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:00.919137  7943 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:00.920099  7943 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:00.921344  7943 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.926160  6321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 507) took 2412 ms. Trace:
I20260709 12:14:00.926535  6321 rpcz_store.cc:276] 0709 12:13:58.514056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.759677 (+1245621us) service_pool.cc:224] Handling call
0709 12:14:00.780359 (+1020682us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:00.780590 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.925886 (+145296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.926086 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25039104}
I20260709 12:14:00.121963  7799 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:00.114714  5747 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:00.931707  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 298) took 1086 ms. Trace:
I20260709 12:14:00.932047  5747 rpcz_store.cc:276] 0709 12:13:59.845276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.849556 (+  4280us) service_pool.cc:224] Handling call
0709 12:14:00.931631 (+1082075us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.222524  8002 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:00.895314  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:00.933429  5679 consensus_meta.cc:287] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.853s	user 0.005s	sys 0.000s
I20260709 12:14:00.130024  6319 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:14:00.877337  5674 rpcz_store.cc:276] 0709 12:13:59.607722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.607874 (+   152us) service_pool.cc:224] Handling call
0709 12:13:59.608273 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:59.608788 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:59.608816 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:59.609308 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:14:00.055631 (+446323us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:00.055675 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.055730 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:00.654552 (+598822us) raft_consensus.cc:1685] finished
0709 12:14:00.654577 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:00.654743 (+   166us) inbound_call.cc:177] Queueing success response
0709 12:14:00.688227 (+ 33484us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b4800002dd8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4502974aa1 00007f450296bb37 00007f450296b9ca 00007f4502a6326f 00007f4502a62f37 00007f4502a7755c 00007f4502a77508 00007f4502a77488 00007f4502a77443 00007f4502a766ec 00007f45019a0a96
Metrics: {"raft.queue_time_us":1342,"raft.run_cpu_time_us":8919,"raft.run_wall_time_us":1078265,"spinlock_wait_cycles":83375360,"thread_start_us":445912,"threads_started":1,"wal-append.queue_time_us":1041848}
I20260709 12:14:00.512497  7361 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:00.934286  6319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 689) took 3841 ms. Trace:
I20260709 12:14:00.934640  6319 rpcz_store.cc:276] 0709 12:13:57.093063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.742375 (+2649312us) service_pool.cc:224] Handling call
0709 12:14:00.050102 (+307727us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:00.933973 (+883871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.934225 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.935341  7992 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:00.935442  7361 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:00.307142  7843 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:00.895908  5567 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:00.891709  6326 raft_consensus.cc:2889] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:00.896800  8081 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:00.115958  7898 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:00.892407  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1795) took 1220 ms. Trace:
I20260709 12:14:00.936983  5678 rpcz_store.cc:276] 0709 12:13:59.668645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.055406 (+386761us) service_pool.cc:224] Handling call
0709 12:14:00.888684 (+833278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.937983  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:00.934652  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:00.938796  5678 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:00.936792  7806 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:00.939357  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1217) took 1209 ms. Trace:
I20260709 12:14:00.939864  5678 rpcz_store.cc:276] 0709 12:13:59.731109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.937692 (+1206583us) service_pool.cc:224] Handling call
0709 12:14:00.939286 (+  1594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.940394  7806 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.939018  5674 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.940552  7361 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:00.892776  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1205) took 1270 ms. Trace:
I20260709 12:14:00.940837  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:00.941363  5675 rpcz_store.cc:276] 0709 12:13:59.614972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.065787 (+450815us) service_pool.cc:224] Handling call
0709 12:14:00.885388 (+819601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.943420  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:00.945083  5675 raft_consensus.cc:2410] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:00.945935  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 404) took 1088 ms. Trace:
I20260709 12:14:00.946511  5675 rpcz_store.cc:276] 0709 12:13:59.857232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.942991 (+1085759us) service_pool.cc:224] Handling call
0709 12:14:00.945807 (+  2816us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:00.890844  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 1.4096e+06us
I20260709 12:14:00.893780  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1197) took 1349 ms. Trace:
I20260709 12:14:00.941027  7806 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:00.537878  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1802) took 2264 ms. Trace:
I20260709 12:14:00.700369  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:00.116436  7924 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:00.681944  8080 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.948055  5671 rpcz_store.cc:276] 0709 12:13:59.451453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.464284 (+ 12831us) service_pool.cc:224] Handling call
0709 12:13:59.484219 (+ 19935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:59.558369 (+ 74150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:59.558403 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:59.603817 (+ 45414us) log.cc:844] Serialized 26 byte log entry
0709 12:14:00.055315 (+451498us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:00.055359 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.055430 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:00.798018 (+742588us) raft_consensus.cc:1685] finished
0709 12:14:00.798040 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:00.798198 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35840,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":67023,"thread_start_us":451071,"threads_started":1,"wal-append.queue_time_us":1049376}
I20260709 12:14:00.952564  8080 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:00.953210  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:00.949663  5599 rpcz_store.cc:276] 0709 12:13:58.248609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.759147 (+1510538us) service_pool.cc:224] Handling call
0709 12:14:00.056530 (+297383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.513042 (+456512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.513248 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16512}
I20260709 12:14:00.122570  8021 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.779s
I20260709 12:14:00.900669  5604 rpcz_store.cc:276] 0709 12:13:58.314790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.118250 (+1803460us) service_pool.cc:224] Handling call
0709 12:14:00.118668 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.884559 (+765891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.887815 (+  3256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.955793  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:00.870820  7786 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:00.948639  7934 consensus_meta.cc:287] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.220s	user 0.004s	sys 0.005s
I20260709 12:14:00.783784  8039 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:00.896617  5501 catalog_manager.cc:5697] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 3, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.911566  7872 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:00.891068  5600 rpcz_store.cc:276] 0709 12:13:58.310925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.047317 (+1736392us) service_pool.cc:224] Handling call
0709 12:14:00.112698 (+ 65381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.882383 (+769685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.882572 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.938431  7898 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:00.559109  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:00.655468  7840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.008s	sys 0.034s
I20260709 12:14:00.964704  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:00.950920  5672 raft_consensus.cc:2410] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:00.964952  6324 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:14:00.949476  5679 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:00.905736  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:00.966231  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1209) took 1350 ms. Trace:
I20260709 12:14:00.959435  5674 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
W20260709 12:14:00.959935  5676 consensus_meta.cc:287] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.129s	user 0.006s	sys 0.002s
I20260709 12:14:00.141309  7929 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.769s
W20260709 12:14:00.962929  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.965505  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 695) took 1127 ms. Trace:
I20260709 12:14:00.967861  5671 raft_consensus.cc:2410] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:14:00.968102  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.966588  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1203) took 1352 ms. Trace:
W20260709 12:14:00.970080  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.969933  5672 rpcz_store.cc:276] 0709 12:13:59.614336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.909639 (+1295303us) service_pool.cc:224] Handling call
0709 12:14:00.966528 (+ 56889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.971875  6324 rpcz_store.cc:276] 0709 12:13:59.837911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.066304 (+228393us) service_pool.cc:224] Handling call
0709 12:14:00.965442 (+899138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.967602  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:14:00.968485  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.973825  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:00.966879  5677 rpcz_store.cc:276] 0709 12:13:59.616164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.898692 (+1282528us) service_pool.cc:224] Handling call
0709 12:14:00.966174 (+ 67482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.968456  5676 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
W20260709 12:14:00.974941  5676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1211) took 1358 ms (client timeout 1578 ms). Trace:
W20260709 12:14:00.966717  7840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.008s	sys 0.060s
W20260709 12:14:00.975353  5676 rpcz_store.cc:269] 0709 12:13:59.616786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.619376 (+  2590us) service_pool.cc:224] Handling call
0709 12:14:00.974878 (+1355502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.976203  8080 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:00.976953  5678 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.977190  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 393) took 1369 ms. Trace:
I20260709 12:14:00.978149  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:00.978324  7872 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:00.978852  6324 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:14:00.975559  5746 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.981154  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:00.981897  5677 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:00.983640  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 394) took 1375 ms. Trace:
I20260709 12:14:00.983994  5677 rpcz_store.cc:276] 0709 12:13:59.608351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.982649 (+1374298us) service_pool.cc:224] Handling call
0709 12:14:00.982969 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.983271 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:00.983296 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:00.983375 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:00.983418 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.983472 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:00.983569 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.985442  5677 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:00.538182  8100 consensus_queue.cc:1059] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.593s
W20260709 12:14:00.979102  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 83305us
I20260709 12:14:00.977697  5676 rpcz_store.cc:276] 0709 12:13:59.608045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.976204 (+1368159us) service_pool.cc:224] Handling call
0709 12:14:00.976532 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.976794 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:00.976823 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:00.976888 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:00.976933 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.976991 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:00.977103 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.116612  8024 consensus_queue.cc:237] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:00.954907  6320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 513) took 1359 ms. Trace:
I20260709 12:14:00.974349  5675 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:01.131095  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1798) took 1461 ms. Trace:
W20260709 12:14:01.120199  5679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1215) took 1460 ms (client timeout 1695 ms). Trace:
I20260709 12:14:01.008904  5746 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:00.998868  5678 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
W20260709 12:14:01.016963  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.113934  5570 leader_election.cc:336] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.175s (SENT)
W20260709 12:14:00.989902  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 681994us
I20260709 12:14:01.132121  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:01.140704  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 51629.3us
I20260709 12:14:01.150918  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1792) took 1483 ms. Trace:
I20260709 12:14:01.152738  5675 rpcz_store.cc:276] 0709 12:13:59.667577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.951158 (+1283581us) service_pool.cc:224] Handling call
0709 12:14:01.150848 (+199690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:01.040343  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59380 (request call id 17) took 1094 ms. Trace:
W20260709 12:14:01.076066  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.080199  6327 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:01.153964  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 395) took 1522 ms. Trace:
I20260709 12:14:01.153666  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.005610  5718 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:01.165385  7898 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.164482  5748 rpcz_store.cc:276] 0709 12:13:59.942134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.973569 (+ 31435us) service_pool.cc:224] Handling call
0709 12:14:01.014334 (+1040765us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54002297d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda45853 00007f4502a1360a 00007f44fbf997d4 00007f44fbf99762 00007f44fbf99691 00007f44fbf9960c 00007f44fbf988c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:01.014481 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625024384}
I20260709 12:14:01.151137  5671 rpcz_store.cc:276] 0709 12:13:59.669468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.952930 (+1283462us) service_pool.cc:224] Handling call
0709 12:14:01.130900 (+177970us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b540029bdd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:01.131029 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31730944}
I20260709 12:14:01.159828  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 300) took 1099 ms. Trace:
W20260709 12:14:01.150394  5679 rpcz_store.cc:269] 0709 12:13:59.663235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.732353 (+ 69118us) service_pool.cc:224] Handling call
0709 12:14:01.119988 (+1387635us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b5400063954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:01.120123 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689519872}
I20260709 12:14:01.162638  5672 raft_consensus.cc:2393] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:01.167029  5746 rpcz_store.cc:276] 0709 12:14:00.067934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.318327 (+250393us) service_pool.cc:224] Handling call
0709 12:14:01.150848 (+832521us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840}
I20260709 12:14:01.159397  5570 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:01.168366  8108 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:01.168561  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 54720.9us
I20260709 12:14:01.168032  5672 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.170709  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:01.173506  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:14:01.078364  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 45876us
W20260709 12:14:01.166554  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 161045us
I20260709 12:14:01.174713  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:01.166985  5677 rpcz_store.cc:276] 0709 12:13:59.608665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.984976 (+1376311us) service_pool.cc:224] Handling call
0709 12:14:00.985274 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.130990 (+145716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.131195 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:01.179585  5569 connection.cc:256] RPC call timeout handler was delayed by -1.4784058560001085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 12:14:00.983634  5670 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:14:01.180830  8002 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:01.180832  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 396) took 1571 ms. Trace:
W20260709 12:14:01.184018  8104 log.cc:927] Time spent T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:14:01.186059  5501 catalog_manager.cc:5697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.109234  7799 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:01.128309  7806 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:01.224611  7806 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:00.975144  7817 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:01.117349  7818 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:01.193240  5718 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:00.964392  7934 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:01.218772  8100 consensus_queue.cc:1243] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer 831d76c5ee1045f0af923ce24fa4c301 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:01.219810  5501 catalog_manager.cc:5697] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 3, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
W20260709 12:14:01.218672  5670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1794) took 1550 ms (client timeout 1865 ms). Trace:
W20260709 12:14:01.042131  6322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 446) took 2264 ms (client timeout 2273 ms). Trace:
I20260709 12:14:01.226995  6324 raft_consensus.cc:3055] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:01.196236  5679 rpcz_store.cc:276] 0709 12:13:59.608934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.167424 (+1558490us) service_pool.cc:224] Handling call
0709 12:14:01.167799 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.180434 (+ 12635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.180464 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.180528 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:01.180574 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.180637 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.180743 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:01.454795  6324 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:01.338477  5570 leader_election.cc:336] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.910s (SENT)
I20260709 12:14:01.425928  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.330312  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:01.455672  6327 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:01.403072  5645 connection.cc:256] RPC call timeout handler was delayed by -1.494166438999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 12:14:01.382457  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.230523  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 69539.3us
W20260709 12:14:01.399160  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 440557us
I20260709 12:14:01.013315  7872 raft_consensus.cc:2764] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:14:01.401356  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 397) took 1792 ms. Trace:
W20260709 12:14:01.456300  5645 connection.cc:256] RPC call timeout handler was delayed by -1.4068664389999412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
I20260709 12:14:01.456996  5672 rpcz_store.cc:276] 0709 12:13:59.609202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.167642 (+1558440us) service_pool.cc:224] Handling call
0709 12:14:01.167922 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.400948 (+233026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.400983 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.401037 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:01.401087 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.401162 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.401294 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2938,"raft.queue_time_us":9988,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115}
I20260709 12:14:01.218508  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1793) took 3038 ms. Trace:
I20260709 12:14:01.089999  7924 consensus_queue.cc:1059] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.297s
I20260709 12:14:01.459198  5676 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:14:01.460460  5679 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:14:01.460851  5679 pending_rounds.cc:85] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 5
I20260709 12:14:01.461083  5679 pending_rounds.cc:107] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:14:01.461330  5679 raft_consensus.cc:2889] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:01.338305  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:01.464430  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 271247us
I20260709 12:14:01.465221  5718 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:01.468888  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 224249us
I20260709 12:14:01.369184  5716 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:01.459560  5501 catalog_manager.cc:5697] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 2, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 2 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:01.473461  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 276982us
I20260709 12:14:01.333474  7991 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:01.479768  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 78987.1us
W20260709 12:14:01.481411  5569 connection.cc:256] RPC call timeout handler was delayed by -1.4310964080000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 12:14:01.483132  5569 connection.cc:256] RPC call timeout handler was delayed by -1.4118681340000876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 12:14:01.483474  5569 connection.cc:256] RPC call timeout handler was delayed by -1.3542058560001351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 12:14:01.483588  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.484004  5569 connection.cc:256] RPC call timeout handler was delayed by -1.3147202520001429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 12:14:01.484315  5569 connection.cc:256] RPC call timeout handler was delayed by -1.2762964080000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 12:14:01.484613  5569 connection.cc:256] RPC call timeout handler was delayed by -1.1859058560000904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 12:14:01.484911  5569 connection.cc:256] RPC call timeout handler was delayed by -1.1386394390001442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
I20260709 12:14:01.484963  5675 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:01.485211  5569 connection.cc:256] RPC call timeout handler was delayed by -1.0683215420001488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32780000000000004s for a response
I20260709 12:14:01.458742  5597 rpcz_store.cc:276] 0709 12:13:58.125600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.768958 (+1643358us) service_pool.cc:224] Handling call
0709 12:14:00.023794 (+254836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.027794 (+  4000us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:00.899697 (+871903us) log.cc:844] Serialized 14 byte log entry
0709 12:14:01.163300 (+263603us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.163369 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:01.163424 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.163494 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.163600 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1513,"prepare.queue_time_us":940921,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":1761,"raft.queue_time_us":2589,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":39614,"spinlock_wait_cycles":16768,"thread_start_us":1068271,"threads_started":2,"wal-append.queue_time_us":319901}
I20260709 12:14:01.230139  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:01.425469  5670 rpcz_store.cc:269] 0709 12:13:59.668325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.772719 (+104394us) service_pool.cc:224] Handling call
0709 12:14:00.675922 (+903203us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:01.198183 (+522261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28018048}
I20260709 12:14:01.514572  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1206) took 1869 ms. Trace:
I20260709 12:14:01.520007  5679 rpcz_store.cc:276] 0709 12:13:59.615273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.459723 (+1844450us) service_pool.cc:224] Handling call
0709 12:14:01.460059 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.484022 (+ 23963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.484208 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:01.517109  5718 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:01.151221  6320 rpcz_store.cc:276] 0709 12:13:59.595896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.676009 (+ 80113us) service_pool.cc:224] Handling call
0709 12:14:00.949988 (+1273979us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15104}
I20260709 12:14:01.519389  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 399) took 1880 ms. Trace:
I20260709 12:14:01.528206  5675 rpcz_store.cc:276] 0709 12:13:59.656187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.247370 (+1591183us) service_pool.cc:224] Handling call
0709 12:14:01.430293 (+182923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.489613 (+ 59320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.489833 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160896}
I20260709 12:14:01.528702  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 402) took 1853 ms. Trace:
I20260709 12:14:01.529279  5671 rpcz_store.cc:276] 0709 12:13:59.667367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.472288 (+1804921us) service_pool.cc:224] Handling call
0709 12:14:01.484413 (+ 12125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.514301 (+ 29888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.514328 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.520894 (+  6566us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:01.520950 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.521011 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.521135 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:01.527987  5674 raft_consensus.cc:2410] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 9 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:14:01.532558  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 45450.1us
I20260709 12:14:01.543481  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1796) took 1874 ms. Trace:
I20260709 12:14:01.543928  5675 rpcz_store.cc:276] 0709 12:13:59.668966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.529287 (+1860321us) service_pool.cc:224] Handling call
0709 12:14:01.542861 (+ 13574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.543134 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.543159 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.543200 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:01.543248 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.543300 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.543424 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:01.545253  5675 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:01.547032  5501 catalog_manager.cc:5697] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:01.432096  6322 rpcz_store.cc:269] 0709 12:13:58.777251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.668310 (+891059us) service_pool.cc:224] Handling call
0709 12:14:01.041803 (+1373493us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54000942d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:01.042045 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761706240}
I20260709 12:14:01.532171  6324 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:01.551903  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1801) took 1408 ms. Trace:
I20260709 12:14:01.552342  5675 rpcz_store.cc:276] 0709 12:14:00.138832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.544815 (+1405983us) service_pool.cc:224] Handling call
0709 12:14:01.545098 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.545610 (+   512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.546903 (+  1293us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:01.554062  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 73617.1us
I20260709 12:14:01.560266  6327 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:01.561281  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1799) took 1891 ms. Trace:
I20260709 12:14:01.561743  5671 rpcz_store.cc:276] 0709 12:13:59.669726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.530198 (+1860472us) service_pool.cc:224] Handling call
0709 12:14:01.541170 (+ 10972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.560941 (+ 19771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.560969 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.561010 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:01.561065 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.561119 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.561227 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:01.575708  5675 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:01.576514  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 380373us
I20260709 12:14:01.578925  8109 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:01.579147  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1802) took 1440 ms. Trace:
I20260709 12:14:01.579569  5675 rpcz_store.cc:276] 0709 12:14:00.139111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.553150 (+1414039us) service_pool.cc:224] Handling call
0709 12:14:01.575493 (+ 22343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.578880 (+  3387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.579084 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:01.580549  8112 log.cc:927] Time spent T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260709 12:14:01.580948  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 44983.8us
I20260709 12:14:01.523589  7991 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:01.534581  7806 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.481912  7817 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.601576  6291 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:01.604203  7943 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:01.604701  7943 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.605069  7943 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:01.606056  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1797) took 1936 ms. Trace:
I20260709 12:14:01.606463  5678 rpcz_store.cc:276] 0709 12:13:59.669264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.940538 (+1271274us) service_pool.cc:224] Handling call
0709 12:14:01.605872 (+665334us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b54003575d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:01.605994 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81076480}
I20260709 12:14:01.608179  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1807) took 1467 ms. Trace:
I20260709 12:14:01.608503  5678 rpcz_store.cc:276] 0709 12:14:00.140524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.607228 (+1466704us) service_pool.cc:224] Handling call
0709 12:14:01.607563 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.607819 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.607843 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.607889 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:01.607934 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.607994 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.608100 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:01.611088  5678 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:01.611670  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1808) took 1470 ms. Trace:
I20260709 12:14:01.612001  5678 rpcz_store.cc:276] 0709 12:14:00.140793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.609325 (+1468532us) service_pool.cc:224] Handling call
0709 12:14:01.609605 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.611435 (+  1830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.611620 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:01.613211  5678 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:01.613797  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1809) took 1472 ms. Trace:
I20260709 12:14:01.614090  5678 rpcz_store.cc:276] 0709 12:14:00.141050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.612690 (+1471640us) service_pool.cc:224] Handling call
0709 12:14:01.613014 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.613548 (+   534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.613698 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:01.614630  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 693) took 1777 ms. Trace:
I20260709 12:14:01.616292  5678 raft_consensus.cc:1240] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:01.485405  7898 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:01.481302  7924 consensus_queue.cc:1243] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer c02ed29558db481589fd3db23e43a07f log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:01.534864  8002 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:14:01.579545  8109 raft_consensus.cc:697] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:01.625999  6324 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.615058  6328 rpcz_store.cc:276] 0709 12:13:59.837198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.912778 (+1075580us) service_pool.cc:224] Handling call
0709 12:14:00.913139 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:00.972645 (+ 59506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:00.972694 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:01.034502 (+ 61808us) log.cc:844] Serialized 26 byte log entry
0709 12:14:01.479803 (+445301us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:01.479844 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.479910 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:01.614401 (+134491us) raft_consensus.cc:1685] finished
0709 12:14:01.614419 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.614541 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4423,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":31107,"thread_start_us":283591,"threads_started":1,"wal-append.queue_time_us":383009}
I20260709 12:14:01.628453  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 398) took 2019 ms. Trace:
I20260709 12:14:01.825133  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:01.705493  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 237035us
I20260709 12:14:01.635905  7898 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.835983  7872 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:01.816695  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 231946us
W20260709 12:14:01.837360  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 235905us
W20260709 12:14:01.825693  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.820298  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1804) took 1680 ms. Trace:
I20260709 12:14:01.844092  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.631435  5677 rpcz_store.cc:276] 0709 12:13:59.609524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.204954 (+1595430us) service_pool.cc:224] Handling call
0709 12:14:01.615546 (+410592us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:01.615721 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.628054 (+ 12333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.628088 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.628154 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:01.628203 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.628261 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.628397 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55920512}
I20260709 12:14:01.845292  5678 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:01.845803  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.846310  8100 consensus_queue.cc:1059] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:01.846946  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.846329  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.844514  8081 raft_consensus.cc:3055] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:01.848034  8081 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:01.848628  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:01.848999  8081 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:01.849712  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.850042  8081 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.850850  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.852016  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.848701  8100 raft_consensus.cc:3055] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:01.852895  8100 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:01.853190  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:01.846787  5719 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:01.831151  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 276343us
I20260709 12:14:01.855006  5719 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:01.830603  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.863902  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.864409  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.864707  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.786540  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.667555  5716 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:01.646113  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1800) took 1925 ms. Trace:
I20260709 12:14:01.867164  5674 rpcz_store.cc:276] 0709 12:13:59.728060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.974203 (+1246143us) service_pool.cc:224] Handling call
0709 12:14:01.645887 (+671684us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54001b7e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:01.646040 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663668480}
I20260709 12:14:01.738433  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 688) took 5198 ms. Trace:
I20260709 12:14:01.869153  6326 rpcz_store.cc:276] 0709 12:13:56.540465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.716087 (+3175622us) service_pool.cc:224] Handling call
0709 12:13:59.744922 (+ 28835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.977848 (+1232926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.738153 (+760305us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400714b54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:01.738357 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788613888}
W20260709 12:14:01.786067  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 232869us
I20260709 12:14:01.855345  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:01.848007  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.783190  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1803) took 1643 ms. Trace:
W20260709 12:14:01.734167  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 64315.9us
I20260709 12:14:01.735423  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 401) took 2068 ms. Trace:
I20260709 12:14:01.872956  5675 rpcz_store.cc:276] 0709 12:14:00.139690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.580374 (+1440684us) service_pool.cc:224] Handling call
0709 12:14:01.708622 (+128248us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:01.708859 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.811774 (+102915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.811808 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.819940 (+  8132us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:01.820009 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.820077 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.820226 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3651456}
I20260709 12:14:01.873183  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:01.596586  7817 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.646036  5501 catalog_manager.cc:5697] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 3, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 3 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.874295  5676 rpcz_store.cc:276] 0709 12:13:59.667036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.460003 (+1792967us) service_pool.cc:224] Handling call
0709 12:14:01.460310 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.460596 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:01.460910 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 12:14:01.735032 (+274122us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.735091 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:01.735153 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.735221 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.735356 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24551,"prepare.queue_time_us":846,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3158,"raft.queue_time_us":50243,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":1943,"thread_start_us":244069,"threads_started":1,"wal-append.queue_time_us":383604}
I20260709 12:14:01.654814  5670 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:14:01.875257  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.795219  7999 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:01.875072  7806 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.885691  7806 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.886067  7806 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.876644  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.887070  5673 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:01.890244  7799 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:01.890705  7799 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:01.891121  7799 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.890928  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:01.875248  7924 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.892277  7924 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:01.892663  7924 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.893280  5677 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
W20260709 12:14:01.894263  5645 leader_election.cc:336] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.546s (SENT)
I20260709 12:14:01.631831  8065 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:01.894874  8065 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:14:01.895313  5645 leader_election.cc:336] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.730s (SENT)
W20260709 12:14:01.896008  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.895335  8065 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:01.882123  5602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1790) took 3757 ms (client timeout 2562 ms). Trace:
I20260709 12:14:01.905298  6324 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:14:01.870957  7898 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:01.896584  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.882493  5670 pending_rounds.cc:85] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 2
I20260709 12:14:01.799039  7991 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:01.655548  7934 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:01.793938  7944 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:01.872794  5671 rpcz_store.cc:276] 0709 12:14:00.139410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.562680 (+1423270us) service_pool.cc:224] Handling call
0709 12:14:01.597176 (+ 34496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.766370 (+169194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.766406 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.782821 (+ 16415us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:01.782890 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.782965 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.783116 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:01.836864  7872 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:01.872625  8100 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:01.904959  5602 rpcz_store.cc:269] 0709 12:13:58.124192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.580418 (+1456226us) service_pool.cc:224] Handling call
0709 12:14:01.880428 (+2300010us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400267fd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:01.882047 (+  1619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4764028160}
W20260709 12:14:01.884876  5567 connection.cc:256] RPC call timeout handler was delayed by -1.8260413880000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2485s for a response
I20260709 12:14:01.905843  6324 pending_rounds.cc:85] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 6
I20260709 12:14:01.918071  5670 pending_rounds.cc:107] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:14:01.924191  6324 pending_rounds.cc:107] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:14:01.924548  6324 raft_consensus.cc:2889] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:01.646339  5569 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:01.882234  7817 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.912273  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:01.913391  8111 raft_consensus.cc:3055] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:01.904673  5501 catalog_manager.cc:5697] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
W20260709 12:14:01.909204  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.935688  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 62585.3us
I20260709 12:14:01.889607  7943 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:01.937526  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 82260.7us
I20260709 12:14:01.939673  7991 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:01.936497  8111 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:01.941648  8100 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.939925  5501 catalog_manager.cc:5697] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 4 to 5, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 5 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:01.941915  8111 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:01.943174  8111 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.942972  5501 catalog_manager.cc:5697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 3, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:14:01.836071  8109 consensus_queue.cc:237] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:01.946657  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 403) took 2096 ms. Trace:
I20260709 12:14:01.947361  7872 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:01.949158  7806 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:01.939884  7934 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:01.937104  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:01.947053  5679 rpcz_store.cc:276] 0709 12:13:59.850140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.536753 (+1686613us) service_pool.cc:224] Handling call
0709 12:14:01.550966 (+ 14213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.597473 (+ 46507us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:01.732693 (+135220us) log.cc:844] Serialized 14 byte log entry
0709 12:14:01.922019 (+189326us) log.cc:844] Serialized 14 byte log entry
0709 12:14:01.946128 (+ 24109us) log.cc:844] Serialized 14 byte log entry
0709 12:14:01.946308 (+   180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.946351 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:01.946414 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.946475 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.946585 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18809,"prepare.queue_time_us":81484,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":125,"raft.queue_time_us":20291,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":134,"thread_start_us":133658,"threads_started":1,"wal-append.queue_time_us":183307}
W20260709 12:14:01.954269  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.961030  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 48834.5us
I20260709 12:14:01.927984  5670 raft_consensus.cc:2889] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:01.979122  5718 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:02.097581  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 119227us
W20260709 12:14:01.989020  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.096782  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 400) took 2430 ms. Trace:
W20260709 12:14:02.096261  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 120848us
W20260709 12:14:02.096089  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 506522us
I20260709 12:14:01.976169  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 510) took 3461 ms. Trace:
I20260709 12:14:02.099068  5672 rpcz_store.cc:276] 0709 12:13:59.666648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.461992 (+1795344us) service_pool.cc:224] Handling call
0709 12:14:01.462442 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.528317 (+ 65875us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:01.824746 (+296429us) log.cc:844] Serialized 14 byte log entry
0709 12:14:01.963099 (+138353us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.963160 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:02.096514 (+133354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.096593 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:02.096720 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29730,"prepare.queue_time_us":23773,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":41519,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":28012,"thread_start_us":351750,"threads_started":2,"wal-append.queue_time_us":185406}
I20260709 12:14:02.103891  8024 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:02.032502  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 386241us
I20260709 12:14:02.106593  5569 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:02.108119  8024 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:02.098634  5567 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.981s (SENT) [suppressed 39 similar messages]
I20260709 12:14:02.107630  5569 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:02.002151  8125 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:14:02.102836  6325 rpcz_store.cc:276] 0709 12:13:58.514777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.894273 (+2379496us) service_pool.cc:224] Handling call
0709 12:14:01.050108 (+155835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.159537 (+109429us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:01.703604 (+544067us) log.cc:844] Serialized 14 byte log entry
0709 12:14:01.920804 (+217200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.920849 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:01.920899 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.920963 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.975988 (+ 55025us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54000942d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:01.976112 (+   124us) inbound_call.cc:177] Queueing success response
0709 12:14:02.023764 (+ 47652us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180036f820. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e522 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
Metrics: {"mutex_wait_us":1090,"prepare.queue_time_us":209746,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":42,"raft.queue_time_us":10701,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":41059,"spinlock_wait_cycles":383998976,"thread_start_us":467576,"threads_started":2,"wal-append.queue_time_us":163133}
W20260709 12:14:02.125059  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 161531us
I20260709 12:14:01.966212  7966 raft_consensus.cc:2764] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:14:02.084780  8116 log.cc:927] Time spent T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:02.082976  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1218) took 2335 ms. Trace:
I20260709 12:14:02.063027  7943 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:01.976385  7934 raft_consensus.cc:697] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:02.137816  5567 connection.cc:256] RPC call timeout handler was delayed by -1.5806274529998063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3008s for a response
I20260709 12:14:02.113845  7806 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:02.138481  5567 connection.cc:256] RPC call timeout handler was delayed by -1.3376274529998682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32780000000000004s for a response
W20260709 12:14:02.153034  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.092089  7799 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:02.095021  8065 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:02.134555  7944 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:02.024009  7817 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:02.087620  7898 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:14:02.160576  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 222454us
I20260709 12:14:02.135186  8024 raft_consensus.cc:697] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:02.002805  7924 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:02.162685  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 61478.2us
I20260709 12:14:02.147187  8109 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:02.137935  8135 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:02.195171  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.194149  5569 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:02.191883  5642 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:02.191761  8136 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.210331  8136 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:02.211807  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:02.215206  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:02.218279  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:02.221383  7934 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:02.223827  7898 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:02.225093  6325 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:02.134460  5670 rpcz_store.cc:276] 0709 12:13:59.747973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.538624 (+1790651us) service_pool.cc:224] Handling call
0709 12:14:01.654390 (+115766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.058699 (+404309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.082722 (+ 24023us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b54001b7e50. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:02.082901 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146107776}
I20260709 12:14:02.195895  7806 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:02.194449  7944 raft_consensus.cc:697] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:02.196437  8135 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:14:02.217535  8123 log.cc:927] Time spent T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 12:14:02.217271  8108 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:02.353442  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:02.360342  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:02.345858  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:02.354054  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 71807.9us
W20260709 12:14:02.363574  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 203493us
W20260709 12:14:02.352201  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 100949us
W20260709 12:14:02.367636  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:02.255813  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 105415us
I20260709 12:14:02.369957  8146 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:14:02.389968  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 173941us
I20260709 12:14:02.194656  8134 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
W20260709 12:14:02.280668  8131 log.cc:927] Time spent T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:14:02.368752  7806 raft_consensus.cc:697] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:02.374863  8065 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:02.375541  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:02.376004  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.249943  8006 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:02.376050  7924 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:02.382748  8024 consensus_queue.cc:237] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:02.357095  8120 log.cc:927] Time spent T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
W20260709 12:14:02.400635  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 188970us
W20260709 12:14:02.401062  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:02.281260  8137 log.cc:927] Time spent T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:14:02.371022  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.253288  8135 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.243098  7898 consensus_queue.cc:1059] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 12:14:02.415513  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:02.417055  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:02.425860  5603 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:02.394240  5719 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:02.390301  5569 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:02.413414  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:02.390524  8143 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.430056  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 289) took 1209 ms. Trace:
I20260709 12:14:02.430428  5595 rpcz_store.cc:276] 0709 12:14:01.220934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.227566 (+  6632us) service_pool.cc:224] Handling call
0709 12:14:01.227947 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:01.425021 (+197074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.425053 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:01.488509 (+ 63456us) log.cc:844] Serialized 26 byte log entry
0709 12:14:01.706470 (+217961us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:01.706513 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.706588 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:02.429846 (+723258us) raft_consensus.cc:1685] finished
0709 12:14:02.429872 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:02.429999 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":52165,"thread_start_us":159623,"threads_started":1,"wal-append.queue_time_us":484043}
I20260709 12:14:02.398731  8006 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:02.432441  8006 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.429584  7924 consensus_queue.cc:1059] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:14:02.401273  5604 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:02.370976  8039 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:02.417785  7999 raft_consensus.cc:2764] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:14:02.388448  7944 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:02.418587  5597 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:02.419181  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:02.428581  8021 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.428398  7806 consensus_queue.cc:237] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:02.428763  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:02.429224  8136 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:02.396306  8109 raft_consensus.cc:697] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:02.439256  5598 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
W20260709 12:14:02.438251  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 64317.5us
I20260709 12:14:02.455240  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 293) took 1233 ms. Trace:
I20260709 12:14:02.399905  8147 consensus_queue.cc:1059] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 12:14:02.458218  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 56441.1us
W20260709 12:14:02.458674  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 67832.1us
I20260709 12:14:02.459195  5599 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:02.466001  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:02.457126  5596 rpcz_store.cc:276] 0709 12:14:01.222148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.222280 (+   132us) service_pool.cc:224] Handling call
0709 12:14:01.222657 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:01.223109 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:01.223139 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:01.400059 (+176920us) log.cc:844] Serialized 26 byte log entry
0709 12:14:01.703925 (+303866us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:01.703967 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.704035 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:02.435411 (+731376us) raft_consensus.cc:1685] finished
0709 12:14:02.435430 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:02.455176 (+ 19746us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1113,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":303444,"threads_started":1,"wal-append.queue_time_us":464630}
I20260709 12:14:02.466838  5597 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:02.468714  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:02.469341  6324 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 3.
I20260709 12:14:02.438936  7799 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:02.471150  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:02.474102  6325 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:02.471302  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 54326.7us
I20260709 12:14:02.414132  8144 consensus_queue.cc:1059] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:14:02.438305  8149 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:02.428432  7943 consensus_queue.cc:1059] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:14:02.476526  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:02.475914  6291 connection.cc:256] RPC call timeout handler was delayed by -2.6130416199998763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:14:02.478237  6291 connection.cc:256] RPC call timeout handler was delayed by -1.6503966419998051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
I20260709 12:14:02.479097  5716 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:02.413381  8108 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:02.479450  6291 connection.cc:256] RPC call timeout handler was delayed by -1.1085966419998385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
I20260709 12:14:02.470934  7817 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:02.473536  8148 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:02.489455  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 53896us
I20260709 12:14:02.492144  5719 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:02.476609  8149 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.496996  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:02.497612  5673 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.499048  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:02.499430  5596 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:02.501209  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:02.502525  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.502959  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:02.504072  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:02.504488  5678 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:14:02.505394  5678 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:02.507637  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:02.511215  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:02.511969  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:02.520589  5671 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.507506  5569 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:02.526849  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:02.500419  8111 raft_consensus.cc:3055] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:02.529727  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:02.525998  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:02.535231  5675 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.527562  5676 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:02.525317  8065 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:14:02.496253  8021 consensus_queue.cc:1059] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:14:02.537724  5673 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:02.533635  7943 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:02.508771  8134 raft_consensus.cc:3055] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:02.533218  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:02.501885  8149 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.521113  7924 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:02.544929  8134 raft_consensus.cc:740] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:02.555264  7943 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:02.534447  8111 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:02.556712  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:02.557523  5746 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:02.576972  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.601809  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:02.537832  8109 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:02.607306  5670 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:02.566219  7924 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.565563  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:02.617877  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.619798  5748 raft_consensus.cc:1240] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:14:02.624152  5570 leader_election.cc:336] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.578s (SENT)
I20260709 12:14:02.624290  7799 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:02.624785  7799 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:02.631210  5676 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:02.644351  5746 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:02.599123  8039 raft_consensus.cc:697] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:02.578454  7991 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:14:02.648344  8160 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.625687  7799 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:02.648952  8160 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:02.654287  7799 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.654695  5750 raft_consensus.cc:1240] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:14:02.620018  7924 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:02.656500  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 180675us
W20260709 12:14:02.652849  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 154289us
I20260709 12:14:02.667297  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:02.646858  5747 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:02.674240  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:02.682001  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:02.682837  5751 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:02.683211  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:02.684152  5745 raft_consensus.cc:2368] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7.
I20260709 12:14:02.675980  8108 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:02.686317  8160 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:02.672030  7943 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:02.692950  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:02.694294  5670 raft_consensus.cc:1240] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:02.757928  8065 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.758541  8065 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:02.760548  8065 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:02.680475  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:02.762894  5675 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:02.764586  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:02.694398  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:02.769521  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 93961.2us
I20260709 12:14:02.776775  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:02.776719  5676 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:02.694542  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:02.772105  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 95463.9us
I20260709 12:14:02.698390  5671 raft_consensus.cc:2410] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:14:02.780038  6325 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:02.689530  8006 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:02.781291  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 110040us
I20260709 12:14:02.782140  5716 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:02.782487  8006 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:02.783603  5672 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:02.768615  8159 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:02.670480  8111 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:02.762661  8160 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:02.679488  8165 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:02.787139  5718 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:02.647047  8134 consensus_queue.cc:260] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:02.801165  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:02.799072  5718 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:02.775561  8108 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.771970  8143 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.803428  5569 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:02.809197  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:02.809146  5718 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:02.785912  7944 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:02.811836  7934 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:14:02.797811  8162 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:02.808961  8159 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:02.817025  6291 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:02.812559  8136 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:02.881534  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:02.866606  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 63254.5us
I20260709 12:14:02.823074  8144 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:02.842556  5753 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:02.810595  8165 raft_consensus.cc:697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:14:02.882565  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.822831  7943 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.786579  8039 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:02.910274  7924 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:02.826551  8162 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.795475  8148 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:14:02.930028  5673 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:02.933109  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:02.899307  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:02.899995  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 83043.4us
I20260709 12:14:02.905282  8135 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:02.815099  8108 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:02.866587  8024 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:02.813329  8160 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:02.824766  8134 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:02.911518  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 117592us
I20260709 12:14:02.825927  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:02.899296  8159 raft_consensus.cc:697] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:02.882048  8111 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.948417  8159 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:02.945106  5719 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:02.964799  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:02.945315  8149 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:02.968042  8149 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:02.931542  8144 raft_consensus.cc:697] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:02.895035  8168 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.134s
W20260709 12:14:02.971827  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.913193  5752 raft_consensus.cc:2368] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5.
I20260709 12:14:02.937542  7924 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:02.937938  5746 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:02.938956  8135 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:02.939493  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:02.824295  7840 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
W20260709 12:14:02.925509  8163 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:14:02.928884  8136 raft_consensus.cc:697] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:02.976890  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.979777  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:02.934690  8162 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.931208  5745 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:02.941926  8024 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.984151  8149 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:02.984335  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:02.984510  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:02.984930  7799 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.969930  8144 consensus_queue.cc:237] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:02.984965  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:02.986348  8158 consensus_queue.cc:1059] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.237s
I20260709 12:14:03.223716  5678 raft_consensus.cc:2410] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:14:03.068240  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:03.124468  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 190079us
W20260709 12:14:03.058312  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.989126  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:03.228674  5744 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:03.230412  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:02.949172  8151 raft_consensus.cc:3055] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:03.224300  5674 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 3.
I20260709 12:14:03.232991  5675 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.991911  5747 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:03.242976  5716 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:03.243394  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:03.198362  8140 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:03.243996  5570 leader_election.cc:336] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.696s (SENT)
I20260709 12:14:03.247646  5570 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:03.249886  8168 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.231578  7840 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.250422  8100 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:03.250867  7840 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:03.251384  8155 log.cc:927] Time spent T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Append to log took a long time: real 0.645s	user 0.006s	sys 0.000s
I20260709 12:14:03.242688  8139 consensus_queue.cc:1059] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:14:03.253118  7840 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:03.080674  7944 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:03.226517  8024 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:03.259717  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:03.278985  5751 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:03.262006  5597 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:03.262157  8065 raft_consensus.cc:3055] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:03.077826  8108 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:03.254662  8147 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:03.280865  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 55582.3us
I20260709 12:14:03.281440  7943 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.283592  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:03.288064  6291 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:03.292098  5675 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:03.298399  5596 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:03.236678  8151 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:03.296759  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:03.303030  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:03.305081  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:03.306461  7966 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.186909  8165 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:03.294342  8178 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.565552  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 417) took 1191 ms. Trace:
I20260709 12:14:03.582981  5672 rpcz_store.cc:276] 0709 12:14:02.373888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.374041 (+   153us) service_pool.cc:224] Handling call
0709 12:14:02.392076 (+ 18035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.783871 (+391795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.559956 (+776085us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54001b7454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:03.565490 (+  5534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900120960}
I20260709 12:14:03.368345  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:03.345427  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.332026  5753 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 12:14:03.329959  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:03.319149  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.332955  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:03.334354  5570 leader_election.cc:336] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.785s (SENT)
I20260709 12:14:03.366532  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:03.575448  5716 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:03.333320  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:03.328960  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:03.361920  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:03.298556  7943 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:03.559963  8182 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:14:03.594008  5570 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:03.595445  5595 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:03.306864  5747 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 12:14:03.599231  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.287132  8065 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:03.596180  5675 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:03.340611  7872 raft_consensus.cc:3055] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:03.600596  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:03.427536  8160 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:03.601461  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:03.343395  8150 raft_consensus.cc:3055] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:03.603986  5678 raft_consensus.cc:2393] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:03.592445  8178 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:03.306885  7966 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.310642  8140 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:03.608431  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 274092us
I20260709 12:14:03.610357  5673 raft_consensus.cc:2410] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:03.300776  7806 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:03.599265  7943 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.309351  8147 raft_consensus.cc:697] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:03.605129  5747 pending_rounds.cc:85] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 3
I20260709 12:14:03.623459  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:03.664151  5601 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:03.613418  7872 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:03.665257  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:03.665390  7872 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:03.621555  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:03.666538  7872 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.665939  5601 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:03.624569  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:03.650488  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:03.668462  5604 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
W20260709 12:14:03.652818  5570 leader_election.cc:336] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.963s (SENT)
I20260709 12:14:03.619083  5569 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:03.314667  7944 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:03.680002  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 161323us
W20260709 12:14:03.636498  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.683748  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:03.532717  8024 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:14:03.639219  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 72408.5us
W20260709 12:14:03.709029  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:03.709780  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.584158  8151 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:03.613402  8149 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.622393  8178 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.670572  5747 pending_rounds.cc:107] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:14:03.309835  8136 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:03.625351  7966 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:03.731021  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 112012us
I20260709 12:14:03.748899  5569 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:03.617501  8150 raft_consensus.cc:740] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:03.743048  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:03.747260  5678 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:03.622292  8140 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:03.749341  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:03.750424  5716 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:03.763491  5595 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:03.710927  8002 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.708559  8111 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.771004  8149 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:03.771464  8149 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:03.771872  8149 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.772464  5604 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:03.743827  5747 raft_consensus.cc:2889] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:03.773666  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.765038  8166 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:03.768400  8140 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:03.858168  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:03.855355  5570 leader_election.cc:336] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.273s (SENT)
I20260709 12:14:03.677975  8147 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:03.731253  8133 consensus_queue.cc:1059] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:14:03.858837  5645 leader_election.cc:336] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.643s (SENT)
W20260709 12:14:03.863189  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 121133us
I20260709 12:14:03.773876  8002 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:03.872459  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 123657us
I20260709 12:14:03.857945  8144 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.874301  5716 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:03.864966  8192 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:03.878886  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1929) took 1187 ms. Trace:
I20260709 12:14:03.877506  8192 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:03.776379  8065 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:03.874030  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1928) took 1181 ms. Trace:
I20260709 12:14:03.906739  5716 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:03.879307  5744 rpcz_store.cc:276] 0709 12:14:02.691896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.311774 (+619878us) service_pool.cc:224] Handling call
0709 12:14:03.312153 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.312601 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:03.360022 (+ 47421us) log.cc:844] Serialized 14 byte log entry
0709 12:14:03.453958 (+ 93936us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.469715 (+ 15757us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.469978 (+   263us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:03.470017 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.470119 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.876591 (+406472us) raft_consensus.cc:1685] finished
0709 12:14:03.876613 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.878811 (+  2198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47827,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":412,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":231,"thread_start_us":93426,"threads_started":1,"wal-append.queue_time_us":245305}
I20260709 12:14:03.879612  8144 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:14:03.912799  6291 leader_election.cc:336] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.240s (SENT)
I20260709 12:14:03.913270  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:03.915419  8193 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:14:03.915720  8065 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:03.916348  8184 log.cc:927] Time spent T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 12:14:03.918854  5570 leader_election.cc:336] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.025s (SENT)
I20260709 12:14:03.932265  7817 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.934562  5716 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:03.934645  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1931) took 1242 ms. Trace:
I20260709 12:14:03.937031  5750 rpcz_store.cc:276] 0709 12:14:02.695568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.332530 (+636962us) service_pool.cc:224] Handling call
0709 12:14:03.332820 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.333085 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.333108 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.360328 (+ 27220us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.676377 (+316049us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:03.676433 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.676543 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.934430 (+257887us) raft_consensus.cc:1685] finished
0709 12:14:03.934450 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.934588 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":315573,"threads_started":1,"wal-append.queue_time_us":511979}
I20260709 12:14:03.913218  8144 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.938881  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:03.993954  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.901902  8150 consensus_queue.cc:260] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:04.070802  8150 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.933139  8202 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.087108  8204 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.087783  8204 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:04.088922  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 176131us
I20260709 12:14:04.089905  8143 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.090552  6291 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:04.090732  8143 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:04.091236  8143 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:04.091619  8143 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.091837  6291 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:04.092672  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:04.103680  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:04.106526  5642 connection.cc:256] RPC call timeout handler was delayed by -4.915441138999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 12:14:04.108959  5642 connection.cc:256] RPC call timeout handler was delayed by -4.8866411389999485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 12:14:03.910099  5747 rpcz_store.cc:276] 0709 12:14:02.691612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.306123 (+614511us) service_pool.cc:224] Handling call
0709 12:14:03.306451 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.858557 (+552106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.872547 (+ 13990us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:04.109583  5642 connection.cc:256] RPC call timeout handler was delayed by -4.7498411389999546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 12:14:04.175300  5642 connection.cc:256] RPC call timeout handler was delayed by -4.7210411389999081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 12:14:04.175673  5642 connection.cc:256] RPC call timeout handler was delayed by -4.6463411390000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 12:14:04.175945  5642 connection.cc:256] RPC call timeout handler was delayed by -4.5734411389998968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:14:04.176231  5642 connection.cc:256] RPC call timeout handler was delayed by -4.4249411389998841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
W20260709 12:14:04.176507  5642 connection.cc:256] RPC call timeout handler was delayed by -4.3349411389999659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 12:14:04.176807  5642 connection.cc:256] RPC call timeout handler was delayed by -4.2971411389999048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 12:14:04.177107  5642 connection.cc:256] RPC call timeout handler was delayed by -3.75963213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:14:04.177724  5642 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:04.124749  5645 leader_election.cc:336] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.216s (SENT)
W20260709 12:14:04.178658  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 53971.8us
I20260709 12:14:04.104385  6328 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:04.185869  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:04.187085  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.090801  8100 raft_consensus.cc:3055] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:04.189306  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1926) took 1498 ms. Trace:
I20260709 12:14:04.194034  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:04.194270  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:04.419373  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 468) took 1071 ms. Trace:
I20260709 12:14:04.192099  5751 rpcz_store.cc:276] 0709 12:14:02.691086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.300544 (+609458us) service_pool.cc:224] Handling call
0709 12:14:03.596808 (+296264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.598314 (+  1506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.598346 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.598830 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.727843 (+129013us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:03.727927 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.728172 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:04.189080 (+460908us) raft_consensus.cc:1685] finished
0709 12:14:04.189101 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.189248 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1047,"raft.queue_time_us":3239,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":11301,"thread_start_us":104897,"threads_started":1,"wal-append.queue_time_us":164046}
I20260709 12:14:04.191778  8100 raft_consensus.cc:740] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:04.460276  8204 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:04.176622  8202 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:04.643247  5716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.000s	sys 0.010s
W20260709 12:14:04.757859  5716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.005s	sys 0.011s
I20260709 12:14:04.178313  8133 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:04.514834  8180 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:04.193311  8205 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.515503  8185 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:14:04.744124  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:04.773362  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:04.773998  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.749405  6328 rpcz_store.cc:276] 0709 12:14:03.348315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.180936 (+832621us) service_pool.cc:224] Handling call
0709 12:14:04.419286 (+238350us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:04.745832  6327 consensus_meta.cc:287] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.652s	user 0.034s	sys 0.051s
I20260709 12:14:04.774708  6327 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
W20260709 12:14:04.775211  6327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 461) took 1428 ms (client timeout 1578 ms). Trace:
W20260709 12:14:04.749660  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:04.743875  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:04.752409  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.107955  8197 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.360s
W20260709 12:14:04.637570  7934 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.021s	sys 0.075s
W20260709 12:14:04.760433  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 572273us
W20260709 12:14:04.643517  8147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.001s	sys 0.011s
W20260709 12:14:04.764127  5673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.005s	sys 0.005s
W20260709 12:14:04.763185  8182 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.572s	user 0.004s	sys 0.010s
W20260709 12:14:04.775529  6327 rpcz_store.cc:269] 0709 12:14:03.346575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.346840 (+   265us) service_pool.cc:224] Handling call
0709 12:14:04.092495 (+745655us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:04.775153 (+682658us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2809088}
W20260709 12:14:04.778379  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 843814us
W20260709 12:14:04.789872  5673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.005s	sys 0.005s
W20260709 12:14:04.786518  7934 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.021s	sys 0.075s
W20260709 12:14:04.793352  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:04.793992  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.808660  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:04.810111  5676 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:04.809549  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 454) took 1469 ms. Trace:
I20260709 12:14:04.811915  6325 rpcz_store.cc:276] 0709 12:14:03.340155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.340309 (+   154us) service_pool.cc:224] Handling call
0709 12:14:04.808537 (+1468228us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:04.809490 (+   953us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2574976}
I20260709 12:14:04.814631  5716 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:04.815008  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:04.815785  6327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 464) took 1468 ms (client timeout 1785 ms). Trace:
I20260709 12:14:04.815919  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:04.816128  6327 rpcz_store.cc:269] 0709 12:14:03.347392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.814743 (+1467351us) service_pool.cc:224] Handling call
0709 12:14:04.815735 (+   992us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.818127  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 465) took 1470 ms. Trace:
I20260709 12:14:04.818449  6325 rpcz_store.cc:276] 0709 12:14:03.347620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.815693 (+1468073us) service_pool.cc:224] Handling call
0709 12:14:04.818067 (+  2374us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.821013  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:04.793584  8147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.006s	sys 0.012s
I20260709 12:14:04.821728  6328 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
W20260709 12:14:04.775466  5745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 1925) took 2084 ms (client timeout 1681 ms). Trace:
W20260709 12:14:04.821671  7943 consensus_meta.cc:287] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.143s	user 0.006s	sys 0.005s
I20260709 12:14:04.834770  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:04.835489  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:04.826261  6328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 475) took 1370 ms (client timeout 1639 ms). Trace:
W20260709 12:14:04.830307  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.828146  5642 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:04.825591  5674 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:04.859177  6325 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:14:04.860569  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 702) took 1111 ms. Trace:
I20260709 12:14:04.860776  6325 rpcz_store.cc:276] 0709 12:14:03.749641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.819045 (+1069404us) service_pool.cc:224] Handling call
0709 12:14:04.860520 (+ 41475us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:04.860913  6328 rpcz_store.cc:269] 0709 12:14:03.461785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.786759 (+1324974us) service_pool.cc:224] Handling call
0709 12:14:04.826196 (+ 39437us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:04.824713  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 80415.6us
I20260709 12:14:04.862087  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:04.862797  6325 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:14:04.826974  8109 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.019s	sys 0.008s
I20260709 12:14:04.771783  8180 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:04.885892  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:04.826045  8212 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.868355  8192 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:04.899621  6328 raft_consensus.cc:2368] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
W20260709 12:14:04.886132  8109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.020s	sys 0.008s
I20260709 12:14:04.822209  8100 consensus_queue.cc:260] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:04.952673  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 699) took 1348 ms. Trace:
I20260709 12:14:04.953101  6328 rpcz_store.cc:276] 0709 12:14:03.604667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.861901 (+1257234us) service_pool.cc:224] Handling call
0709 12:14:04.952594 (+ 90693us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:04.898725  8196 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.879s	user 0.002s	sys 0.006s
I20260709 12:14:04.861526  7943 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:05.065151  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1825) took 2090 ms. Trace:
I20260709 12:14:05.073315  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:05.014977  6325 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:05.072368  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:05.076191  5744 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
W20260709 12:14:05.074466  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 257498us
W20260709 12:14:05.078240  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 533) took 1712 ms (client timeout 2100 ms). Trace:
W20260709 12:14:05.078670  6325 rpcz_store.cc:269] 0709 12:14:03.365389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.861834 (+1496445us) service_pool.cc:224] Handling call
0709 12:14:05.077896 (+216062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:05.075701  5671 rpcz_store.cc:276] 0709 12:14:02.974484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.974638 (+   154us) service_pool.cc:224] Handling call
0709 12:14:02.974990 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:02.989291 (+ 14301us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:02.989589 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 12:14:03.864214 (+874625us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b18003ac7e0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fd5f34bc 00007f44fa94148b 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb23a
0709 12:14:04.062037 (+197823us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:04.167568 (+105531us) log.cc:844] Serialized 26 byte log entry
0709 12:14:04.167824 (+   256us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:04.167865 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.167944 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.048636 (+880692us) raft_consensus.cc:1685] finished
0709 12:14:05.064900 (+ 16264us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.065072 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":447,"raft.queue_time_us":231166,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":59179,"spinlock_wait_cycles":24149120,"thread_start_us":215135,"threads_started":2,"wal-append.queue_time_us":368279}
W20260709 12:14:05.080547  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 52806.7us
I20260709 12:14:05.023969  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:05.082098  5750 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:04.900799  8213 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:05.201460  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1983) took 1914 ms. Trace:
I20260709 12:14:05.201673  8226 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.201877  5597 rpcz_store.cc:276] 0709 12:14:03.288912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.295777 (+  6865us) service_pool.cc:224] Handling call
0709 12:14:03.373111 (+ 77334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.428014 (+ 54903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.428044 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.453807 (+ 25763us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.727889 (+274082us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:03.727922 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.729418 (+  1496us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.201250 (+1471832us) raft_consensus.cc:1685] finished
0709 12:14:05.201269 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.201398 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":190988,"threads_started":1,"wal-append.queue_time_us":329858}
W20260709 12:14:05.203039  8222 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:14:05.203157  5642 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:05.128189  5748 raft_consensus.cc:1240] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:05.200181  7934 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:05.204715  7934 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.205299  7934 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.206351  8147 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.943367  8200 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:05.207204  8200 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.207568  8200 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:05.081746  8140 consensus_meta.cc:287] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 1.212s	user 0.013s	sys 0.002s
I20260709 12:14:05.209489  8229 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:14:05.210466  8220 log.cc:927] Time spent T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.255s	user 0.002s	sys 0.000s
I20260709 12:14:05.210219  8140 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:05.213140  8140 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:05.121395  8162 consensus_meta.cc:287] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.885s	user 0.015s	sys 0.004s
I20260709 12:14:05.214136  8162 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:05.216032  5752 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:14:05.115816  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:04.835160  5745 rpcz_store.cc:269] 0709 12:14:02.690809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.694131 (+  3322us) service_pool.cc:224] Handling call
0709 12:14:04.762841 (+2068710us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400052dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:04.772586 (+  9745us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312380288}
W20260709 12:14:05.094308  5570 leader_election.cc:336] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.639s (SENT)
W20260709 12:14:05.086900  8150 consensus_meta.cc:287] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.010s	user 0.007s	sys 0.006s
I20260709 12:14:05.218902  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:04.901098  8197 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.216624  8162 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:05.281957  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 466) took 1934 ms (client timeout 2273 ms). Trace:
I20260709 12:14:05.086391  8109 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.955893  8192 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:05.737046  5717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.011s	sys 0.018s
W20260709 12:14:05.736835  5678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.000s	sys 0.030s
W20260709 12:14:05.766531  5678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.000s	sys 0.030s
W20260709 12:14:05.333314  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.282167  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1245) took 1598 ms. Trace:
W20260709 12:14:05.495366  5716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.003s	sys 0.021s
W20260709 12:14:05.770876  5716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.008s	sys 0.023s
W20260709 12:14:05.770380  6325 rpcz_store.cc:269] 0709 12:14:03.347851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.115507 (+1767656us) service_pool.cc:224] Handling call
0709 12:14:05.281890 (+166383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:05.106469  5718 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:05.390002  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 311658us
I20260709 12:14:05.765184  5751 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:04.898762  8210 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:05.765314  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 670998us
W20260709 12:14:05.764837  5717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.011s	sys 0.018s
I20260709 12:14:05.788355  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1984) took 2435 ms. Trace:
I20260709 12:14:05.772150  5603 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:14:05.816524  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 710119us
W20260709 12:14:05.121251  8149 consensus_meta.cc:287] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 1.332s	user 0.010s	sys 0.005s
W20260709 12:14:05.760702  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.822964  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.823266  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.812031  6291 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:05.769419  5673 rpcz_store.cc:276] 0709 12:14:03.683867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.684981 (+  1114us) service_pool.cc:224] Handling call
0709 12:14:03.685325 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.174606 (+489281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.174636 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:04.175161 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:14:04.793430 (+618269us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:04.793469 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.793530 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.209748 (+416218us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:05.221581 (+ 11833us) raft_consensus.cc:1685] finished
0709 12:14:05.221606 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.282082 (+ 60476us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":185721,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":10688,"spinlock_wait_cycles":31339264,"thread_start_us":1006301,"threads_started":2,"wal-append.queue_time_us":656075}
W20260709 12:14:05.808604  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 680991us
I20260709 12:14:05.291740  8213 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:05.158321  8202 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:05.529035  8189 log.cc:927] Time spent T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 1.671s	user 0.003s	sys 0.006s
W20260709 12:14:05.820176  5569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.017s	sys 0.024s
W20260709 12:14:05.109921  7872 consensus_meta.cc:287] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.443s	user 0.006s	sys 0.012s
W20260709 12:14:05.082003  8209 log.cc:927] Time spent T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.718s	user 0.004s	sys 0.005s
W20260709 12:14:05.121893  7966 consensus_meta.cc:287] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 1.359s	user 0.011s	sys 0.003s
W20260709 12:14:05.110006  8178 consensus_meta.cc:287] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 1.343s	user 0.011s	sys 0.003s
I20260709 12:14:05.219539  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:05.839572  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:05.844587  5673 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:04.901234  8212 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:05.121939  8143 consensus_meta.cc:287] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.018s	user 0.008s	sys 0.004s
W20260709 12:14:05.204001  8218 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.333s	user 0.000s	sys 0.000s
W20260709 12:14:05.086731  8065 consensus_meta.cc:287] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 1.170s	user 0.014s	sys 0.000s
W20260709 12:14:05.818063  5570 leader_election.cc:336] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.801s (SENT)
I20260709 12:14:05.712898  7934 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:05.470008  8208 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.850896  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1833) took 1060 ms. Trace:
W20260709 12:14:05.826473  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 700) took 2202 ms (client timeout 2045 ms). Trace:
W20260709 12:14:05.303220  8227 log.cc:927] Time spent T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 12:14:05.827070  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1988) took 2495 ms. Trace:
I20260709 12:14:05.819829  5596 rpcz_store.cc:276] 0709 12:14:03.329951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.334123 (+  4172us) service_pool.cc:224] Handling call
0709 12:14:04.771597 (+1437474us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:04.771814 (+   217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.772160 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.772186 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:04.777651 (+  5465us) log.cc:844] Serialized 26 byte log entry
0709 12:14:04.997923 (+220272us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:04.997970 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.998051 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.764566 (+766515us) raft_consensus.cc:1685] finished
0709 12:14:05.764588 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.764815 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2432,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":14950,"spinlock_wait_cycles":72628992,"thread_start_us":172860,"threads_started":1,"wal-append.queue_time_us":488643}
W20260709 12:14:05.828544  5569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.018s	sys 0.024s
I20260709 12:14:05.121130  8224 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:05.820422  8159 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:05.846406  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:05.845851  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:14:05.847743  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 1.03313e+06us
W20260709 12:14:05.849350  5675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.015s	sys 0.013s
I20260709 12:14:05.763233  8109 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:05.206856  8147 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:05.201380  8180 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:05.202260  8226 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:05.852957  6325 rpcz_store.cc:269] 0709 12:14:03.638445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.826276 (+2187831us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:05.826408 (+   132us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:05.852571  5570 leader_election.cc:336] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.391s (SENT)
I20260709 12:14:05.851090  8143 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:05.865785  5570 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:05.853518  5603 rpcz_store.cc:276] 0709 12:14:03.331182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.333320 (+  2138us) service_pool.cc:224] Handling call
0709 12:14:05.771761 (+2438441us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:05.771912 (+   151us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:05.820306 (+ 48394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.827013 (+  6707us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11273216}
W20260709 12:14:05.866578  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 470) took 2517 ms (client timeout 2391 ms). Trace:
W20260709 12:14:05.860726  5675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.015s	sys 0.013s
I20260709 12:14:05.303651  8229 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:05.861055  5751 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:05.861152  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 532) took 2525 ms. Trace:
I20260709 12:14:05.862779  5747 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:05.866209  8200 consensus_meta.cc:287] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.002s
I20260709 12:14:05.870081  8180 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:05.870527  8213 raft_consensus.cc:2764] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:14:05.867945  8211 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:05.873111  8147 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:05.873584  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1826) took 2898 ms. Trace:
I20260709 12:14:05.873955  5679 rpcz_store.cc:276] 0709 12:14:02.974793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.974887 (+    94us) service_pool.cc:224] Handling call
0709 12:14:05.872933 (+2898046us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:05.873117 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.873300 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.873324 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:05.873364 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:05.873396 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.873446 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.873535 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2536704}
I20260709 12:14:05.876811  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1241) took 2194 ms. Trace:
I20260709 12:14:05.829509  8150 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 12:14:05.866933  6325 rpcz_store.cc:269] 0709 12:14:03.348831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.865899 (+2517068us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:05.866528 (+   629us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:05.877179  5672 rpcz_store.cc:276] 0709 12:14:03.682370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.682512 (+   142us) service_pool.cc:224] Handling call
0709 12:14:03.727932 (+ 45420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.859005 (+131073us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:03.859034 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.862474 (+  3440us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.905049 (+ 42575us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:03.905083 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.908257 (+  3174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.876619 (+1968362us) raft_consensus.cc:1685] finished
0709 12:14:05.876638 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.876756 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":184621,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5300,"thread_start_us":51910,"threads_started":2,"wal-append.queue_time_us":49725}
I20260709 12:14:05.846748  7966 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:05.866032  8159 raft_consensus.cc:697] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:05.867676  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 1987) took 2536 ms. Trace:
I20260709 12:14:05.818341  8197 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:05.869297  5570 leader_election.cc:336] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.617s (SENT)
I20260709 12:14:05.824973  8149 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:05.880065  5716 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
W20260709 12:14:05.890676  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 78541.3us
I20260709 12:14:05.824581  8210 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:05.849555  8234 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:14:05.868896  6324 rpcz_store.cc:276] 0709 12:14:03.335924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.340313 (+  4389us) service_pool.cc:224] Handling call
0709 12:14:03.362172 (+ 21859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.583172 (+221000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.583201 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:03.583242 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:03.583278 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.860929 (+2277651us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54000942d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:05.860980 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.861097 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507805824}
W20260709 12:14:05.868363  8144 consensus_meta.cc:287] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.796s	user 0.006s	sys 0.005s
I20260709 12:14:05.902346  6327 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
W20260709 12:14:05.889380  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 476) took 2313 ms (client timeout 2192 ms). Trace:
W20260709 12:14:05.903119  6325 rpcz_store.cc:269] 0709 12:14:03.566290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.879147 (+2312857us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:05.879398 (+   251us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:05.871245  8226 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:05.863428  8239 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:05.908954  8210 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:05.909363  8239 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:05.910880  8143 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:05.911495  8239 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:05.911733  8024 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:05.912253  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 315) took 3220 ms. Trace:
I20260709 12:14:05.912654  5748 rpcz_store.cc:276] 0709 12:14:02.692171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.318088 (+625917us) service_pool.cc:224] Handling call
0709 12:14:03.318447 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:05.204282 (+1885835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.911989 (+707707us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54000131d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:05.912188 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4161425664}
I20260709 12:14:05.914140  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1832) took 1123 ms. Trace:
I20260709 12:14:05.914517  5675 rpcz_store.cc:276] 0709 12:14:04.790479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.790627 (+   148us) service_pool.cc:224] Handling call
0709 12:14:04.820490 (+ 29863us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:04.954002 (+133512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.954365 (+   363us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:05.127548 (+173183us) log.cc:844] Serialized 52 byte log entry
0709 12:14:05.867356 (+739808us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:05.867382 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.867436 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.913950 (+ 46514us) raft_consensus.cc:1685] finished
0709 12:14:05.913968 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.914090 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2359,"raft.queue_time_us":38798,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":84827,"thread_start_us":659537,"threads_started":2,"wal-append.queue_time_us":670235}
W20260709 12:14:05.916210  8238 log.cc:927] Time spent T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:14:05.916457  8159 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:05.917593  7966 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:05.917691  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 1933) took 3112 ms. Trace:
W20260709 12:14:05.861970  8065 raft_consensus.cc:2771] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 4 LEARNER]: Leader pre-election decision while not in active config. Result: Term 5: won. RaftConfig: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:05.918671  8147 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:05.918947  8212 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:05.860800  8208 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:05.923035  8197 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:05.923740  8147 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:05.923846  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:05.924219  8147 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:05.927956  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.928588  5645 leader_election.cc:336] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.117s (SENT)
W20260709 12:14:05.928978  5645 connection.cc:256] RPC call timeout handler was delayed by -1.6154478890000519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 12:14:05.929272  5645 connection.cc:256] RPC call timeout handler was delayed by -1.5709927790001075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:14:05.929821  8109 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:05.861598  8224 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:05.931459  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1829) took 2955 ms. Trace:
I20260709 12:14:05.932571  8224 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:05.905546  8144 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:05.936546  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:05.938951  7934 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:05.941151  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 76586.5us
W20260709 12:14:05.937698  6319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 458) took 2596 ms (client timeout 1696 ms). Trace:
I20260709 12:14:05.870199  8200 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:05.846943  8178 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:05.885555  5599 rpcz_store.cc:276] 0709 12:14:03.330911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.331008 (+    97us) service_pool.cc:224] Handling call
0709 12:14:03.331336 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.331719 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.331746 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.446463 (+114717us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.614723 (+168260us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:03.614772 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.614850 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.528244 (+1913394us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:05.863148 (+334904us) raft_consensus.cc:1685] finished
0709 12:14:05.863192 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.867610 (+  4418us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":275,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"spinlock_wait_cycles":8552320,"thread_start_us":158984,"threads_started":1,"wal-append.queue_time_us":288566}
I20260709 12:14:05.898716  8149 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:05.931923  5670 rpcz_store.cc:276] 0709 12:14:02.976348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.978046 (+  1698us) service_pool.cc:224] Handling call
0709 12:14:05.930559 (+2952513us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:05.930824 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.931042 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.931073 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:05.931125 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:05.931168 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.931232 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.931366 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14769536}
W20260709 12:14:05.904130  6324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 698) took 2314 ms (client timeout 2210 ms). Trace:
I20260709 12:14:05.871245  8211 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:05.904662  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 58941.2us
W20260709 12:14:05.974833  6324 rpcz_store.cc:269] 0709 12:14:03.582462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.897090 (+2314628us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:05.897175 (+    85us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:05.906600  8231 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:14:05.906862  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 474) took 2554 ms (client timeout 2510 ms). Trace:
I20260709 12:14:05.907285  8229 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:05.908135  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:05.918146  5752 rpcz_store.cc:276] 0709 12:14:02.805382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.341677 (+536295us) service_pool.cc:224] Handling call
0709 12:14:03.360454 (+ 18777us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:05.216434 (+1855980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.917452 (+701018us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54003638d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:05.917627 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4266833152}
I20260709 12:14:05.950373  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:05.973263  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:05.973837  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:05.980384  5679 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:05.943293  6319 rpcz_store.cc:269] 0709 12:14:03.341326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.342889 (+  1563us) service_pool.cc:224] Handling call
0709 12:14:05.936321 (+2593432us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:05.937584 (+  1263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151285632}
I20260709 12:14:05.953965  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:05.985107  5673 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:05.951764  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:05.985741  5672 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:05.891466  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:05.975474  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.975730  6324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 703) took 2192 ms (client timeout 2117 ms). Trace:
W20260709 12:14:05.986368  6324 rpcz_store.cc:269] 0709 12:14:03.783024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.975556 (+2192532us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:05.975663 (+   107us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:05.975302  5642 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:05.976969  6325 rpcz_store.cc:269] 0709 12:14:03.377129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.903790 (+2526661us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:05.903911 (+   121us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:05.983374  6326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 456) took 2642 ms (client timeout 2391 ms). Trace:
W20260709 12:14:05.987682  6326 rpcz_store.cc:269] 0709 12:14:03.340778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.340871 (+    93us) service_pool.cc:224] Handling call
0709 12:14:05.908000 (+2567129us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:05.983285 (+ 75285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2824448}
W20260709 12:14:05.988467  8134 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.077s	user 0.025s	sys 0.019s
W20260709 12:14:05.988907  8134 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.079s	user 0.025s	sys 0.019s
I20260709 12:14:05.936548  8144 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:05.998927  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 701) took 2289 ms (client timeout 2216 ms). Trace:
W20260709 12:14:05.999779  6326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 471) took 2650 ms (client timeout 2617 ms). Trace:
I20260709 12:14:06.000589  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:06.001799  6326 rpcz_store.cc:269] 0709 12:14:03.349071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.999628 (+2650557us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:05.999724 (+    96us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:06.001595  6325 rpcz_store.cc:269] 0709 12:14:03.709208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.998760 (+2289552us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:05.998862 (+   102us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:06.002050  6324 raft_consensus.cc:2368] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5.
I20260709 12:14:05.999073  8158 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.006134  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.006417  8244 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:06.006938  6319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 472) took 2657 ms (client timeout 2737 ms). Trace:
I20260709 12:14:06.000833  7934 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.008853  7934 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:06.003371  7799 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:14:06.005731  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:06.007835  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.008153  8178 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:06.008287  6324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 704) took 2145 ms (client timeout 2210 ms). Trace:
W20260709 12:14:06.005818  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 114420us
W20260709 12:14:06.022317  6326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 467) took 2674 ms (client timeout 2801 ms). Trace:
W20260709 12:14:06.022204  6324 rpcz_store.cc:269] 0709 12:14:03.862911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.000320 (+2137409us) service_pool.cc:224] Handling call
0709 12:14:06.008229 (+  7909us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:06.022889  6326 rpcz_store.cc:269] 0709 12:14:03.348079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.002585 (+2654506us) service_pool.cc:224] Handling call
0709 12:14:06.022252 (+ 19667us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:06.024060  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 534) took 2569 ms. Trace:
I20260709 12:14:06.024461  6324 rpcz_store.cc:276] 0709 12:14:03.454894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.023209 (+2568315us) service_pool.cc:224] Handling call
0709 12:14:06.023588 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.023766 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:06.023791 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:06.023830 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:06.023858 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.023907 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.024010 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:06.022379  6325 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:06.032080  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 473) took 2682 ms. Trace:
I20260709 12:14:06.032317  6325 rpcz_store.cc:276] 0709 12:14:03.349545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.002821 (+2653276us) service_pool.cc:224] Handling call
0709 12:14:06.022186 (+ 19365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:06.031869 (+  9683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.032033 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:06.032652  6324 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:06.034118  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:06.034333  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 59135.2us
I20260709 12:14:06.034725  5679 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:14:06.037015  6291 leader_election.cc:400] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5.
I20260709 12:14:06.037312  6291 leader_election.cc:403] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:06.003028  8212 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:06.034024  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:06.003618  8147 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:06.038731  5670 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
W20260709 12:14:06.021801  6319 rpcz_store.cc:269] 0709 12:14:03.349303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.003487 (+2654184us) service_pool.cc:224] Handling call
0709 12:14:06.006881 (+  3394us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:06.066766  8203 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.283s	user 0.003s	sys 0.008s
W20260709 12:14:06.067931  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 43955.6us
I20260709 12:14:06.071677  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 705) took 2167 ms. Trace:
I20260709 12:14:06.069186  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:06.072125  6324 rpcz_store.cc:276] 0709 12:14:03.866753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.025717 (+2158964us) service_pool.cc:224] Handling call
0709 12:14:06.026018 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.034246 (+  8228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.034422 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:06.073527  6324 raft_consensus.cc:1240] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:06.074689  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 706) took 2201 ms. Trace:
I20260709 12:14:06.075085  6324 rpcz_store.cc:276] 0709 12:14:03.873726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.073004 (+2199278us) service_pool.cc:224] Handling call
0709 12:14:06.073344 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.074415 (+  1071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.074600 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:06.078511  6291 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:06.079041  7806 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.079669  6291 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:06.079528  7806 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:06.082064  8242 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:06.006506  8158 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:06.082507  8242 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.082844  8242 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.084043  8158 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:06.085325  8210 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:06.085708  8210 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:06.086210  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 44347.8us
I20260709 12:14:06.077739  8178 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5.
I20260709 12:14:06.038133  8212 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:06.085952  8133 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:06.081631  7806 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:06.089432  5672 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
W20260709 12:14:06.100787  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 96335.8us
I20260709 12:14:06.087574  8210 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.042306  8229 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:14:06.106178  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.094359  8212 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:06.118968  5645 leader_election.cc:336] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.914s (SENT)
I20260709 12:14:06.115577  8208 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:06.126955  8158 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:14:06.128305  5570 leader_election.cc:336] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.737s (SENT)
I20260709 12:14:06.130283  5570 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:06.128960  8242 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:06.134537  8242 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:06.135062  8239 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:06.137457  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.140134  8239 consensus_queue.cc:1059] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:06.144810  5674 raft_consensus.cc:3055] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:06.142894  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:06.159638  5674 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:06.140409  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:06.160048  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:06.145352  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44956
I20260709 12:14:06.161140  5752 raft_consensus.cc:606] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 12:14:06.161499  5752 raft_consensus.cc:614] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:06.087477  8065 consensus_queue.cc:1059] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:14:06.150139  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:06.162946  5600 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:06.154872  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.142639  5642 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:06.131093  8100 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:06.156179  5645 leader_election.cc:400] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5.
I20260709 12:14:06.118912  7806 consensus_queue.cc:1059] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:14:06.158985  5671 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:06.163271  5569 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:06.163419  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1986) took 2832 ms (client timeout 2216 ms). Trace:
I20260709 12:14:06.169275  5645 leader_election.cc:403] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:14:06.111553  8133 raft_consensus.cc:697] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:06.170701  5600 rpcz_store.cc:269] 0709 12:14:03.330628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.333590 (+  2962us) service_pool.cc:224] Handling call
0709 12:14:06.149981 (+2816391us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:06.163355 (+ 13374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74562944}
I20260709 12:14:06.171175  5716 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:06.174497  5567 leader_election.cc:336] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.506s (SENT)
I20260709 12:14:06.175005  5567 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:06.163707  5674 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:06.191299  8192 raft_consensus.cc:2764] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:14:06.162627  8244 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:06.194345  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.193629  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 76297.9us
I20260709 12:14:06.171985  8149 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:06.193048  5674 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:06.199659  5567 connection.cc:256] RPC call timeout handler was delayed by -2.4078900150000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2801s for a response
I20260709 12:14:06.181644  8180 raft_consensus.cc:3055] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:06.201861  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 535) took 2734 ms. Trace:
W20260709 12:14:06.203226  5567 connection.cc:256] RPC call timeout handler was delayed by -2.3445184060001338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260709 12:14:06.203994  5567 leader_election.cc:336] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.596s (SENT)
I20260709 12:14:06.204653  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:06.188654  8242 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.200332  8208 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:06.202075  6319 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:06.194291  8202 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5.
I20260709 12:14:06.197467  8149 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:06.219082  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.219743  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 707) took 2342 ms. Trace:
I20260709 12:14:06.220479  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.220693  8133 consensus_queue.cc:237] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:06.202229  8180 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:06.188833  8109 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:14:06.205044  8239 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:06.223717  5570 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:06.224664  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:06.220142  6324 rpcz_store.cc:276] 0709 12:14:03.877259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.075878 (+2198619us) service_pool.cc:224] Handling call
0709 12:14:06.076288 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:06.078354 (+  2066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:06.078380 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:06.078815 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:14:06.164424 (+ 85609us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:06.164467 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.164534 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:06.219514 (+ 54980us) raft_consensus.cc:1685] finished
0709 12:14:06.219537 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.219676 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1676,"raft.queue_time_us":8532,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":65,"thread_start_us":69960,"threads_started":1,"wal-append.queue_time_us":110320}
I20260709 12:14:06.202637  8192 consensus_queue.cc:1059] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:14:06.211606  7806 consensus_queue.cc:1059] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:14:06.199079  8244 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:06.209328  8242 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:06.243003  5716 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:06.221642  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.217001  8149 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.247074  8262 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:06.251833  8159 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.254281  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.254595  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:06.255743  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:06.255483  8180 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:06.256675  8180 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.257320  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.258950  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:06.261966  6291 leader_election.cc:336] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.540s (SENT)
I20260709 12:14:06.265254  5674 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:14:06.266076  5674 pending_rounds.cc:85] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 4
I20260709 12:14:06.266630  5674 pending_rounds.cc:107] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:14:06.267156  5674 raft_consensus.cc:2889] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:06.270926  6324 raft_consensus.cc:2368] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
I20260709 12:14:06.272383  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:06.273526  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.247954  8202 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:06.295542  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:06.273475  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.259618  5745 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:06.302229  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.303903  5753 raft_consensus.cc:2393] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:06.304224  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.305047  5751 raft_consensus.cc:2410] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:06.303573  5748 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:06.304286  5752 raft_consensus.cc:2393] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:06.256915  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:06.308782  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 46812.2us
I20260709 12:14:06.309598  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:06.319453  8239 raft_consensus.cc:697] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:06.320062  8269 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:06.320873  8239 consensus_queue.cc:237] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:06.320940  8269 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:06.244347  8210 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:06.337846  6323 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:06.338524  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 455) took 2998 ms. Trace:
I20260709 12:14:06.338843  6323 rpcz_store.cc:276] 0709 12:14:03.340488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.340614 (+   126us) service_pool.cc:224] Handling call
0709 12:14:06.337235 (+2996621us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:06.337460 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.338289 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.338471 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154761088}
I20260709 12:14:06.341212  8147 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:06.342772  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 138803us
W20260709 12:14:06.343801  5567 connection.cc:256] RPC call timeout handler was delayed by -2.3193184060000931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 12:14:06.344220  5567 connection.cc:256] RPC call timeout handler was delayed by -2.2545184059999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 12:14:06.273018  8192 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:14:06.346851  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.351533  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.357053  5676 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:06.357241  5753 raft_consensus.cc:2393] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:06.362000  5567 connection.cc:256] RPC call timeout handler was delayed by -2.0838900149999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31610000000000005s for a response
W20260709 12:14:06.362411  5567 connection.cc:256] RPC call timeout handler was delayed by -1.9308900149999317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3331s for a response
W20260709 12:14:06.362699  5567 connection.cc:256] RPC call timeout handler was delayed by -1.8838475550001021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 12:14:06.362967  5567 connection.cc:256] RPC call timeout handler was delayed by -1.7281475550000778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 12:14:06.363798  6321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 459) took 3022 ms (client timeout 2025 ms). Trace:
W20260709 12:14:06.364248  6321 rpcz_store.cc:269] 0709 12:14:03.341600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.341721 (+   121us) service_pool.cc:224] Handling call
0709 12:14:06.351353 (+3009632us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:06.363720 (+ 12367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154069888}
I20260709 12:14:06.353729  8002 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:06.366107  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.366756  6319 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:06.367638  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:06.368173  8264 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:06.368645  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.369127  8242 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:06.365420  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:06.370941  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.375504  5567 connection.cc:256] RPC call timeout handler was delayed by -1.7263643779999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 12:14:06.375922  5567 connection.cc:256] RPC call timeout handler was delayed by -1.7263643779999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 12:14:06.376210  5567 connection.cc:256] RPC call timeout handler was delayed by -1.675964378000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
I20260709 12:14:06.313685  8212 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:06.363692  7872 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:06.382603  7872 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:06.383040  7872 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.383069  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.383877  6325 raft_consensus.cc:2393] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:06.384685  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.385217  6325 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:14:06.381206  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:06.378876  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 155208us
I20260709 12:14:06.386543  8111 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:06.387001  8111 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.387290  8212 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:06.387425  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.388389  8244 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:06.389108  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.383325  8192 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:06.395694  8210 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:06.398007  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:06.398861  5674 raft_consensus.cc:2410] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:06.399173  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:06.381348  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.397257  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:06.381739  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:06.400169  6322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 462) took 3053 ms (client timeout 2685 ms). Trace:
I20260709 12:14:06.400869  5745 raft_consensus.cc:2410] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:14:06.400573  6322 rpcz_store.cc:269] 0709 12:14:03.346887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.347004 (+   117us) service_pool.cc:224] Handling call
0709 12:14:06.381178 (+3034174us) spinlock_profiling.cc:243] Waited 65.7 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:06.400099 (+ 18921us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151107328}
I20260709 12:14:06.382118  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.397327  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.399667  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:06.380993  8148 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:06.376500  5567 connection.cc:256] RPC call timeout handler was delayed by -1.6642643780000981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 12:14:06.459381  5567 connection.cc:256] RPC call timeout handler was delayed by -1.6570643780000864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 12:14:06.459779  5567 connection.cc:256] RPC call timeout handler was delayed by -1.4374475550000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2477s for a response
W20260709 12:14:06.460052  5567 connection.cc:256] RPC call timeout handler was delayed by -1.4302475550000509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2485s for a response
W20260709 12:14:06.460346  5567 connection.cc:256] RPC call timeout handler was delayed by -1.180314031999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 12:14:06.460600  5567 connection.cc:256] RPC call timeout handler was delayed by -1.1232027319999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.251s for a response
W20260709 12:14:06.403146  5719 connection.cc:256] RPC call timeout handler was delayed by -1.1423228479998215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
W20260709 12:14:06.450290  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.461531  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:06.462177  5600 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.461161  6325 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:06.373858  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.471644  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:06.473948  5718 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:06.482362  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:06.483671  5752 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.379463  8134 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.488508  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:06.491194  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:06.498984  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:06.499704  5753 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.499017  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:06.500661  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:06.419729  8109 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:06.502568  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 203208us
W20260709 12:14:06.504102  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.514600  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:06.515205  5675 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:14:06.516284  5570 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:06.504709  5718 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:06.505455  6325 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:06.509090  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:06.509717  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:06.517529  5602 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
W20260709 12:14:06.520344  5602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 1989) took 3188 ms (client timeout 2112 ms). Trace:
I20260709 12:14:06.482211  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:06.520684  5602 rpcz_store.cc:269] 0709 12:14:03.331472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.333545 (+  2073us) service_pool.cc:224] Handling call
0709 12:14:06.509589 (+3176044us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:06.520272 (+ 10683us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73868672}
I20260709 12:14:06.527504  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:06.528259  5598 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:06.532414  5570 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:06.533681  5570 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:06.472900  8149 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:06.543931  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:06.553943  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.554284  5749 raft_consensus.cc:2393] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:06.516448  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:06.544900  5718 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:06.524979  6319 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:06.551556  6325 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:06.523061  8147 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:06.518143  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:06.567878  5599 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:06.545660  8239 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:06.584851  5595 raft_consensus.cc:1240] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:06.573192  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:06.471565  8148 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:06.574012  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:06.508512  8134 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:06.573947  6322 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:06.591809  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:06.515019  8109 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:06.598919  6328 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:06.572810  8243 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:06.529693  8162 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:14:06.535416  8208 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:14:06.635957  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:06.583575  8147 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.583964  8150 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.652067  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.652944  5749 raft_consensus.cc:2393] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:06.658159  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:06.658185  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 127489us
I20260709 12:14:06.658905  5597 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.629528  8065 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.629411  8269 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:06.592407  6320 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:14:06.632392  8211 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:06.633740  8243 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.661136  5718 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:06.661216  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 127596us
I20260709 12:14:06.650151  8147 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:06.676483  5752 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:06.664803  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:06.651778  6321 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:06.680605  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:06.683104  5599 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.669852  5747 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:06.685093  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:06.642022  8267 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:06.689448  5603 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.689752  5570 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:06.667569  8243 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.689597  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:06.667230  6320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 460) took 3323 ms (client timeout 3161 ms). Trace:
I20260709 12:14:06.685192  7924 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:06.664119  8065 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:06.688035  8159 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:06.713564  5567 leader_election.cc:336] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.639s (SENT)
I20260709 12:14:06.714109  5567 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:06.715343  8278 log.cc:927] Time spent T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:14:06.718782  8148 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:06.720489  5752 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:14:06.728080  8149 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:06.730441  8111 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:06.733830  8202 raft_consensus.cc:1064] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
W20260709 12:14:06.734334  8202 raft_consensus.cc:1068] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:14:06.739023  8111 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:06.746788  5602 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:06.754001  5750 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:14:06.743809  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:06.758414  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 58751us
W20260709 12:14:06.781299  8272 log.cc:927] Time spent T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:14:06.781692  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.783227  8109 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:06.785648  5600 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:06.788470  5599 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:06.706420  7924 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:06.790179  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.792589  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.793497  5752 raft_consensus.cc:2393] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:06.797488  8229 raft_consensus.cc:3055] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:06.797962  8229 raft_consensus.cc:740] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:06.798768  8229 consensus_queue.cc:260] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:06.799561  8178 raft_consensus.cc:3055] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:06.799973  8178 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:06.800957  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:06.790020  8147 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:06.804657  5746 raft_consensus.cc:2368] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8.
I20260709 12:14:06.811760  8200 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:06.815989  5744 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
W20260709 12:14:06.823760  8255 log.cc:927] Time spent T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.722s	user 0.002s	sys 0.000s
I20260709 12:14:06.791635  7924 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.828868  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:05.853466  5678 rpcz_store.cc:276] 0709 12:14:04.790761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.791602 (+   841us) service_pool.cc:224] Handling call
0709 12:14:04.791879 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.792069 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:05.767022 (+974953us) log.cc:844] Serialized 14 byte log entry
0709 12:14:05.850641 (+ 83619us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:05.850687 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:05.850721 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.850764 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.850850 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":411022,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":72,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4903,"thread_start_us":1057851,"threads_started":2}
W20260709 12:14:06.840745  8180 consensus_meta.cc:287] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.006s
W20260709 12:14:06.703933  6320 rpcz_store.cc:269] 0709 12:14:03.343415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.344207 (+   792us) service_pool.cc:224] Handling call
0709 12:14:06.508353 (+3164146us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:06.664121 (+155768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152447872}
I20260709 12:14:06.845332  5597 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:06.202839  6326 rpcz_store.cc:276] 0709 12:14:03.462460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.023547 (+2561087us) service_pool.cc:224] Handling call
0709 12:14:06.037291 (+ 13744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.037477 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:06.088427 (+ 50950us) log.cc:844] Serialized 14 byte log entry
0709 12:14:06.196190 (+107763us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:06.196255 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:06.196308 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.196379 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.196507 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50968,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":77,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4068,"spinlock_wait_cycles":1408,"thread_start_us":128598,"threads_started":2}
W20260709 12:14:07.093385  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.151788  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1841) took 1153 ms. Trace:
W20260709 12:14:07.008216  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 77431.2us
I20260709 12:14:06.883385  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:07.152661  5679 rpcz_store.cc:276] 0709 12:14:05.998409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.035316 (+ 36907us) service_pool.cc:224] Handling call
0709 12:14:06.035532 (+   216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:06.035786 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:06.035803 (+    17us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:06.046142 (+ 10339us) log.cc:844] Serialized 26 byte log entry
0709 12:14:06.101329 (+ 55187us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:06.101380 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.101461 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:06.823207 (+721746us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:07.151511 (+328304us) raft_consensus.cc:1685] finished
0709 12:14:07.151531 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.151730 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":2777,"spinlock_wait_cycles":37210880,"thread_start_us":15184,"threads_started":1,"wal-append.queue_time_us":15575}
I20260709 12:14:06.882957  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:06.890497  5753 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
W20260709 12:14:06.957715  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.955943  6321 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:06.971004  8281 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.187s
I20260709 12:14:06.846309  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:07.151849  8147 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:06.859887  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:07.157771  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.970566  8269 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.191s
I20260709 12:14:07.152987  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:06.883709  5603 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:06.966771  8134 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:06.958531  5642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.004s	sys 0.008s
I20260709 12:14:06.833626  8150 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:06.928644  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:06.970885  8108 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:06.967720  8219 log.cc:927] Time spent T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 2.015s	user 0.005s	sys 0.012s
I20260709 12:14:07.159559  5671 raft_consensus.cc:1275] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:07.164469  5672 raft_consensus.cc:2410] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:06.818977  8178 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:07.163251  5642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.006s	sys 0.018s
W20260709 12:14:06.970855  7872 consensus_meta.cc:287] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 12:14:06.978461  7934 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:07.035503  8185 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.163486  5749 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
W20260709 12:14:07.143602  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 430045us
W20260709 12:14:07.170662  5567 leader_election.cc:336] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.639s (SENT)
I20260709 12:14:07.170995  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:07.154318  5750 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:14:06.882958  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:06.999771  6328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 708) took 3122 ms (client timeout 1697 ms). Trace:
W20260709 12:14:07.170840  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.997826  8243 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:06.972503  8265 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:06.865439  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.174906  5567 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:07.172578  6328 rpcz_store.cc:269] 0709 12:14:03.877629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.954483 (+1076854us) service_pool.cc:224] Handling call
0709 12:14:06.999534 (+2045051us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400092ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:06.999681 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2716738432}
I20260709 12:14:07.164405  8108 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.169050  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:07.178580  5678 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:07.176214  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 866613us
I20260709 12:14:07.179071  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:07.179647  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:07.179745  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:06.971693  7943 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:07.177644  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:07.174449  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 483639us
I20260709 12:14:07.166494  8151 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:07.187857  5679 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:07.166558  8202 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.180305  5750 raft_consensus.cc:2368] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6.
W20260709 12:14:07.184587  5567 leader_election.cc:336] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.695s (SENT)
I20260709 12:14:07.166486  8229 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:07.181628  5671 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:07.166061  7872 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:07.187055  5570 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:07.192804  5672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:07.193403  5672 raft_consensus.cc:606] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:07.193751  5672 raft_consensus.cc:614] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:07.190891  5745 raft_consensus.cc:2368] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5.
I20260709 12:14:07.190511  8202 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:07.186995  5642 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:07.181360  8108 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:07.199757  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.202099  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 54312.7us
I20260709 12:14:07.179262  8185 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:07.180371  8269 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:14:07.217718  5750 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:07.220064  5678 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:07.185782  8273 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:07.222342  5567 leader_election.cc:336] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.708s (SENT)
I20260709 12:14:07.226604  5567 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:07.214661  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:07.189921  8264 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:07.223862  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:07.225204  5675 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:07.230279  5749 raft_consensus.cc:2393] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:07.233152  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:07.234218  8248 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 1.134s	user 0.006s	sys 0.000s
I20260709 12:14:07.234215  5750 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:07.207995  8150 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 12:14:07.236824  8275 log.cc:927] Time spent T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.641s	user 0.000s	sys 0.001s
I20260709 12:14:07.242795  8158 raft_consensus.cc:3055] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:07.243160  7924 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:07.243989  6327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 469) took 3895 ms (client timeout 2025 ms). Trace:
W20260709 12:14:07.244395  6327 rpcz_store.cc:269] 0709 12:14:03.348577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.816765 (+1468188us) service_pool.cc:224] Handling call
0709 12:14:07.243788 (+2427023us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54005717d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:07.243914 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2399035264}
I20260709 12:14:07.245374  7924 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:07.245707  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 709) took 1069 ms. Trace:
I20260709 12:14:07.246120  6324 rpcz_store.cc:276] 0709 12:14:06.176762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.255494 (+ 78732us) service_pool.cc:224] Handling call
0709 12:14:07.245500 (+990006us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b5400596ad4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:07.245645 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9211264}
I20260709 12:14:07.202692  8180 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:07.248145  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:07.248067  5567 leader_election.cc:336] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.716s (SENT)
I20260709 12:14:07.229713  5677 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:07.209474  8202 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:07.250458  5567 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:07.215204  8185 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:07.253949  5672 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:07.207891  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:07.256547  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 55771.3us
I20260709 12:14:07.256839  5679 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:07.257714  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:07.259565  5750 raft_consensus.cc:2393] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:07.252802  6323 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:07.247334  8158 raft_consensus.cc:740] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:07.262548  5673 raft_consensus.cc:1240] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:07.261891  5567 leader_election.cc:336] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.843s (SENT)
I20260709 12:14:07.263761  5567 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:07.268081  8273 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:07.268522  8273 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.268694  8185 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:07.268839  8273 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.269265  8185 raft_consensus.cc:697] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:07.270148  8185 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:07.260089  8150 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:14:07.261037  8268 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:07.258342  8230 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:07.221941  8147 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 12:14:07.277328  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 103322us
I20260709 12:14:07.277565  5673 raft_consensus.cc:1240] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:07.284230  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:07.284674  8267 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:07.284286  5567 leader_election.cc:336] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.871s (SENT)
I20260709 12:14:07.285588  5749 raft_consensus.cc:2393] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:07.285679  5567 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:07.257639  8290 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:07.287319  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:07.288184  7872 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:07.290095  8243 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:07.292287  8158 consensus_queue.cc:260] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:07.295843  5673 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:07.296181  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:07.298938  7924 consensus_queue.cc:1059] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:07.300959  5747 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:07.295408  8217 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:07.299595  8253 log.cc:927] Time spent T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 1.072s	user 0.007s	sys 0.000s
W20260709 12:14:07.356963  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 56911.1us
I20260709 12:14:07.304255  5677 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:07.306258  8230 raft_consensus.cc:697] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:07.348867  8264 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:07.348888  8217 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:07.357108  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 71425us
I20260709 12:14:07.373234  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:07.356575  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:07.374554  5679 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.368048  5673 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:07.375823  8230 consensus_queue.cc:237] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:07.376382  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.372277  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:07.443419  5748 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:07.389050  5679 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
W20260709 12:14:07.461534  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 177264us
I20260709 12:14:07.386822  5718 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:07.405056  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.499696  5567 leader_election.cc:336] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.903s (SENT)
I20260709 12:14:07.378219  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:07.516222  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 129494us
W20260709 12:14:07.519738  5567 leader_election.cc:336] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.943s (SENT)
I20260709 12:14:07.520226  5567 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:07.521777  5672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:07.522374  5672 raft_consensus.cc:606] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:07.522722  5672 raft_consensus.cc:614] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:07.528698  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:07.529433  5749 raft_consensus.cc:2393] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:07.379174  7924 raft_consensus.cc:3055] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:07.444711  8297 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:07.534472  5567 leader_election.cc:336] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.963s (SENT)
I20260709 12:14:07.535066  5567 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:07.532085  5718 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:07.522634  8158 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:07.538982  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.540218  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:07.517670  8204 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.524030  8162 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:07.578256  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 43810.5us
I20260709 12:14:07.353571  8273 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:07.580752  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:07.582300  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:07.586755  5675 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.458568  8151 consensus_queue.cc:1059] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 12:14:07.583397  5567 leader_election.cc:336] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.981s (SENT)
I20260709 12:14:07.584414  5677 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:07.458041  8282 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:14:07.518100  8243 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:14:07.535110  8267 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:07.581022  7934 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:07.600466  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 413537us
W20260709 12:14:07.599704  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 391837us
I20260709 12:14:07.533008  7924 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:07.582335  8281 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:07.581998  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:07.604604  5674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:07.622174  5674 raft_consensus.cc:606] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:07.622598  5674 raft_consensus.cc:614] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:07.619169  5642 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:07.620548  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.525830  8065 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:07.625615  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:07.627516  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:07.607329  5567 leader_election.cc:336] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.154s (SENT)
I20260709 12:14:07.622736  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:07.630475  5567 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:07.632671  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:07.584580  8204 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:07.658427  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 51139.3us
W20260709 12:14:07.659868  5567 leader_election.cc:336] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.477s (SENT)
I20260709 12:14:07.660256  5567 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:07.660312  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:07.560554  8297 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:07.670027  5675 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:07.651201  8162 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:07.630266  7872 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:07.630417  8202 raft_consensus.cc:2764] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:07.630561  6323 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
W20260709 12:14:07.684475  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 53180.3us
I20260709 12:14:07.713235  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:07.677281  8264 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:07.675156  8298 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:07.717859  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:07.719461  8309 raft_consensus.cc:670] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:07.722070  7943 raft_consensus.cc:3055] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:07.760074  7943 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:07.717602  5675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
W20260709 12:14:07.760885  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.761220  5675 raft_consensus.cc:606] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:07.761598  5675 raft_consensus.cc:614] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:14:07.724462  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 96064.1us
I20260709 12:14:07.728703  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 308) took 1259 ms. Trace:
I20260709 12:14:07.680931  7872 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:07.764832  6293 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:07.734306  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.680728  8294 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:07.716482  8065 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:07.737972  5567 leader_election.cc:336] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.485s (SENT)
I20260709 12:14:07.772341  5567 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:07.698173  8162 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:07.739761  5749 raft_consensus.cc:2393] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:07.744100  8273 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:07.744629  8300 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:07.753943  5753 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:07.762797  5596 rpcz_store.cc:276] 0709 12:14:06.468925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.469186 (+   261us) service_pool.cc:224] Handling call
0709 12:14:06.492177 (+ 22991us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:06.529861 (+ 37684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:06.529895 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:06.530394 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:14:07.258027 (+727633us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b180031f840. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:14:07.581332 (+323305us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:07.581371 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.581440 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:07.728417 (+146977us) raft_consensus.cc:1685] finished
0709 12:14:07.728436 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.728640 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37894,"raft.queue_time_us":16423,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4408,"spinlock_wait_cycles":2622848,"thread_start_us":323106,"threads_started":1,"wal-append.queue_time_us":1083892}
W20260709 12:14:07.777217  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.793648  8300 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:07.822235  8300 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:07.770303  7872 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.826956  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1300) took 1168 ms. Trace:
I20260709 12:14:07.827368  5746 rpcz_store.cc:276] 0709 12:14:06.658947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.659130 (+   183us) service_pool.cc:224] Handling call
0709 12:14:07.826752 (+1167622us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400052dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:07.826894 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285777152}
I20260709 12:14:07.828711  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1286) took 1574 ms. Trace:
I20260709 12:14:07.712159  8302 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 12:14:07.696955  7924 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:08.088873  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 354381us
W20260709 12:14:07.935654  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 306492us
W20260709 12:14:07.966322  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 203176us
I20260709 12:14:07.832957  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:08.065316  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.829084  5744 rpcz_store.cc:276] 0709 12:14:06.253868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.258152 (+  4284us) service_pool.cc:224] Handling call
0709 12:14:07.828540 (+1570388us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b540022a1d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:07.828653 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147148160}
W20260709 12:14:07.834504  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.833971  5750 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:08.092600  5678 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:07.831471  5675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
W20260709 12:14:08.087567  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 349614us
I20260709 12:14:08.089191  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:08.093978  5567 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.510s (SENT) [suppressed 37 similar messages]
I20260709 12:14:08.094830  5753 raft_consensus.cc:2368] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6.
I20260709 12:14:08.095091  5675 raft_consensus.cc:606] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:08.095443  5675 raft_consensus.cc:614] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:08.096194  5718 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:07.919354  8299 log.cc:927] Time spent T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
W20260709 12:14:07.879501  8108 consensus_meta.cc:287] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.656s	user 0.002s	sys 0.007s
I20260709 12:14:08.086375  7944 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:07.881767  8269 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:07.837392  7934 raft_consensus.cc:697] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:08.061898  8265 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:08.134536  8325 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:08.135479  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:08.102818  8200 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:08.096890  8202 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:07.829133  8297 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:08.143350  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:08.143826  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 379065us
W20260709 12:14:08.144330  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 53984.1us
I20260709 12:14:08.145622  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.150446  5749 raft_consensus.cc:2393] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:08.146430  8265 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.151849  8309 consensus_queue.cc:1059] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:08.147219  8325 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.145279  7934 consensus_queue.cc:237] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:07.788810  8298 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.112288  8065 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:07.818274  7943 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:08.159168  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 60839.2us
I20260709 12:14:08.136893  7944 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.136322  8108 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.221388  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:08.260298  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 44359us
I20260709 12:14:08.184705  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1863) took 1389 ms. Trace:
I20260709 12:14:08.262871  5744 raft_consensus.cc:2410] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:14:08.244553  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.187222  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.176142  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.283063  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:08.191509  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.290716  5753 raft_consensus.cc:2393] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:08.270710  5676 rpcz_store.cc:276] 0709 12:14:06.795462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.795658 (+   196us) service_pool.cc:224] Handling call
0709 12:14:06.796006 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:06.805637 (+  9631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:06.805666 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:07.181261 (+375595us) log.cc:844] Serialized 26 byte log entry
0709 12:14:07.521829 (+340568us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:07.521869 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.521935 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.184477 (+662542us) raft_consensus.cc:1685] finished
0709 12:14:08.184495 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.184644 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9384,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4812,"thread_start_us":331127,"threads_started":1,"wal-append.queue_time_us":430847}
I20260709 12:14:08.291605  8307 consensus_queue.cc:1059] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:08.292022  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:08.293246  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.294037  5746 raft_consensus.cc:2410] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:08.295281  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:08.157516  8303 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:08.239409  5745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1294) took 1851 ms (client timeout 1972 ms). Trace:
I20260709 12:14:08.242054  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:08.202696  7943 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.294827  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:08.297271  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.295949  5749 raft_consensus.cc:2376] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4. Re-sending same reply.
I20260709 12:14:08.304519  5753 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:08.159149  8202 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:08.305486  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.184597  8200 raft_consensus.cc:697] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:08.307794  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:08.265003  8265 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:08.320030  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.320218  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.321838  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:08.298127  8269 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:08.301899  8294 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:08.302979  8298 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:08.348850  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:08.215204  7799 consensus_queue.cc:1175] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a54957145d9647cb89f46531d107120c" responder_term: 6 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:08.355115  8325 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:08.355351  8158 consensus_meta.cc:287] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.000s
W20260709 12:14:08.358656  8318 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:08.359216  7944 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:08.361100  8217 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:08.309333  8185 consensus_queue.cc:1059] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:14:08.355118  8108 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:08.362942  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.363703  5598 raft_consensus.cc:2393] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:08.363912  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.364461  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.365193  5753 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:08.365736  5597 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:08.302570  8065 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:08.367062  7872 consensus_meta.cc:287] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.002s
I20260709 12:14:08.365103  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.367871  5603 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:08.366999  5748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1298) took 1816 ms (client timeout 1903 ms). Trace:
W20260709 12:14:08.370308  5748 rpcz_store.cc:269] 0709 12:14:06.550967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.551425 (+   458us) service_pool.cc:224] Handling call
0709 12:14:08.366850 (+1815425us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b5400011654. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:08.366944 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807714560}
I20260709 12:14:08.371356  5749 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:08.373368  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:08.376237  8328 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:08.376775  8328 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:08.377163  8328 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:08.381817  5597 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:08.386332  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.750730  5753 raft_consensus.cc:2393] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:08.751767  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.752468  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 547) took 1221 ms. Trace:
I20260709 12:14:08.340425  8294 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.387072  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.367463  7872 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:08.443934  8331 raft_consensus.cc:2764] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:08.414558  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:08.471491  8300 consensus_meta.cc:287] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.003s
W20260709 12:14:08.303042  5745 rpcz_store.cc:269] 0709 12:14:06.402737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.467522 (+ 64785us) service_pool.cc:224] Handling call
0709 12:14:08.239173 (+1771651us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b5400021cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:08.239342 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1432229632}
I20260709 12:14:08.409667  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:08.589409  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 302033us
W20260709 12:14:08.383252  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.385783  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.581974  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 288229us
W20260709 12:14:08.426882  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 332892us
I20260709 12:14:08.755643  5678 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:08.403955  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:08.756881  5751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1308) took 1830 ms (client timeout 2138 ms). Trace:
W20260709 12:14:08.771219  5751 rpcz_store.cc:269] 0709 12:14:06.926812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.157520 (+230708us) service_pool.cc:224] Handling call
0709 12:14:08.414393 (+1256873us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:08.756747 (+342354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5328768}
I20260709 12:14:08.383059  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:08.766978  5567 leader_election.cc:336] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 3.008s (SENT)
I20260709 12:14:08.766417  6293 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:08.759495  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:08.773269  5567 leader_election.cc:336] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 3.278s (SENT)
I20260709 12:14:08.770859  5604 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:08.761307  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:08.754779  5603 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:08.774247  6325 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.752528  5753 raft_consensus.cc:2393] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:08.762027  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.776216  5599 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.762615  5600 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:08.773643  5567 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:08.753611  6328 rpcz_store.cc:276] 0709 12:14:07.530631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.530803 (+   172us) service_pool.cc:224] Handling call
0709 12:14:07.531175 (+   372us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:07.630310 (+ 99135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.630340 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:07.630903 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 12:14:08.114328 (+483425us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:08.114371 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.114444 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.387159 (+272715us) raft_consensus.cc:1685] finished
0709 12:14:08.387180 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.752343 (+365163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45770,"raft.queue_time_us":118844,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":1087,"thread_start_us":528650,"threads_started":2,"wal-append.queue_time_us":524028}
I20260709 12:14:08.773650  5597 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
W20260709 12:14:08.400058  8319 log.cc:927] Time spent T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:14:08.414222  8229 consensus_meta.cc:287] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.211s	user 0.011s	sys 0.000s
I20260709 12:14:08.779139  6293 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:08.791806  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.793361  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:08.424129  8202 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:08.750310  8326 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:08.800827  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.808934  5598 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:08.805869  5673 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:08.799533  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.804035  6326 raft_consensus.cc:2393] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:08.798249  6325 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:08.339139  8269 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.757042  7872 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:08.768337  8289 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.799098  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.815270  5595 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.809211  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:08.791451  8065 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:08.813207  5601 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:08.816313  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 515945us
I20260709 12:14:08.818953  5602 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:08.820856  5599 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:08.821630  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.822384  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.822991  5603 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.791755  8324 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:08.825709  5599 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:08.822623  5602 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:08.822204  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:08.829120  5745 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:08.806885  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:08.832005  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.809940  8213 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.832610  5601 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.833290  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:08.834260  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.424333  8200 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:08.758136  8300 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:08.816620  8197 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.849195  8213 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.859175  8197 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:08.859975  8311 log.cc:927] Time spent T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.797s	user 0.009s	sys 0.001s
I20260709 12:14:08.860846  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.861555  5598 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:14:08.862686  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.822572  8065 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.863305  8065 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:08.867566  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.867920  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.850587  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.868572  5597 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:08.868963  5602 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.870016  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.871140  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.871636  5604 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.823024  8313 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:08.873896  5598 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.885021  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.824566  8215 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:08.888659  5595 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:08.858371  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.889405  5599 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.892838  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:08.849207  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 70140.7us
W20260709 12:14:08.886040  5747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 328) took 2025 ms (client timeout 1520 ms). Trace:
W20260709 12:14:08.895071  5747 rpcz_store.cc:269] 0709 12:14:06.860716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.860840 (+   124us) service_pool.cc:224] Handling call
0709 12:14:08.877302 (+2016462us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b5400181ad4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:08.885972 (+  8670us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13822848}
I20260709 12:14:08.896530  5599 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:08.814783  8326 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.897112  5602 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:08.898000  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.910056  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:08.907800  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.911849  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.912267  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.912992  5745 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:08.914969  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:08.915526  5567 connection.cc:256] RPC call timeout handler was delayed by -1.3088500000001204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 12:14:08.915737  5745 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:08.919096  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.920378  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:08.923839  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.924310  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.925668  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:08.908804  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.910262  5676 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:08.857084  5603 raft_consensus.cc:2410] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:08.910741  5595 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:08.909301  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 87310.5us
I20260709 12:14:08.912464  5602 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.932050  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:08.871656  8204 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:08.822448  8289 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.944600  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.945449  5597 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:08.934449  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:08.935737  5601 raft_consensus.cc:2410] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:08.935945  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.949414  5599 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:08.886374  8265 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:08.935420  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:08.943501  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 49388us
I20260709 12:14:08.952811  5598 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:08.953570  5676 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:08.954109  6293 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:08.955925  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.956045  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.956216  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:08.956702  5598 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:14:08.941880  5602 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:08.953141  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.950331  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.957588  5597 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.958119  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:08.958947  5602 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:08.956873  5601 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:08.962639  5674 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:08.833971  8324 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.967119  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:08.972818  5674 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:14:08.978194  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:08.968119  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 50683.2us
I20260709 12:14:08.969973  5595 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
W20260709 12:14:08.982221  5642 connection.cc:256] RPC call timeout handler was delayed by -4.7889589430001251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
I20260709 12:14:08.986591  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:08.988022  5597 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:08.887949  8197 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:08.991087  5597 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:14:08.991140  5599 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:08.993112  5602 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:09.031020  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:09.031906  5603 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:09.038318  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 84283.7us
I20260709 12:14:09.039389  6293 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:09.046605  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:09.048404  5601 raft_consensus.cc:2410] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:08.953459  8160 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.954989  8204 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.989176  8338 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:08.976121  5670 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:09.058594  8160 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.061612  8204 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:09.075325  5597 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:09.076256  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 94123.2us
W20260709 12:14:09.077325  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 103174us
I20260709 12:14:09.079136  5595 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:14:09.082048  5642 connection.cc:256] RPC call timeout handler was delayed by -4.75475894300007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
I20260709 12:14:09.082249  5598 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:14:09.082474  5642 connection.cc:256] RPC call timeout handler was delayed by -4.7277589430000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 12:14:08.990423  8329 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.990281  8202 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:08.990793  8346 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:08.990557  8322 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:08.910808  8215 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:09.082799  5642 connection.cc:256] RPC call timeout handler was delayed by -4.7025589429999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 12:14:08.972090  8265 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:09.099413  5642 connection.cc:256] RPC call timeout handler was delayed by -4.6899589429999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
W20260709 12:14:09.120285  5642 connection.cc:256] RPC call timeout handler was delayed by -4.5450589429999582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
W20260709 12:14:09.120645  5642 connection.cc:256] RPC call timeout handler was delayed by -4.4271589429999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 12:14:09.120924  5642 connection.cc:256] RPC call timeout handler was delayed by -4.3668589430001248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 12:14:09.121192  5642 connection.cc:256] RPC call timeout handler was delayed by -4.3272589430000608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 12:14:09.121440  5642 connection.cc:256] RPC call timeout handler was delayed by -4.2786589429999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:14:09.121747  5642 connection.cc:256] RPC call timeout handler was delayed by -4.1814589430000524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2318s for a response
W20260709 12:14:09.098959  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 118006us
I20260709 12:14:09.124495  5567 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:09.063781  8338 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.089143  8294 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.082739  8355 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:09.144833  5567 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:09.154863  5567 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:09.125015  8343 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:09.144088  8313 raft_consensus.cc:697] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:09.159423  5604 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
W20260709 12:14:09.193140  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:09.215011  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.140079  8180 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 12:14:09.161545  8341 log.cc:927] Time spent T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 12:14:09.099013  8202 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.217984  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:09.237828  5642 leader_election.cc:400] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7.
I20260709 12:14:09.155738  8269 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.128983  8357 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 12:14:09.168836  8345 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:09.095512  8329 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.288793  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:09.283699  5596 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:09.289098  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:09.289460  5674 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:09.291050  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:09.293957  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 139193us
W20260709 12:14:09.293860  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 56201.8us
W20260709 12:14:09.294770  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 148494us
I20260709 12:14:09.295552  5642 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:09.295261  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.294909  5567 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:09.122089  8322 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.306732  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:09.281860  8339 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.397s	user 0.001s	sys 0.001s
I20260709 12:14:09.239981  8366 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:09.120106  8346 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.274626  8343 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:09.313124  5674 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:09.326534  5671 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:14:09.333926  5671 pending_rounds.cc:85] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 5
I20260709 12:14:09.334178  5671 pending_rounds.cc:107] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:14:09.334406  5671 raft_consensus.cc:2889] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:09.166628  7872 consensus_queue.cc:1059] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 12:14:09.338274  5642 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:09.333277  7943 consensus_meta.cc:287] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.022s	user 0.005s	sys 0.005s
I20260709 12:14:09.270426  7806 consensus_queue.cc:1059] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:14:09.346936  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:09.349896  5676 raft_consensus.cc:2410] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:14:09.363103  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 68267.9us
I20260709 12:14:09.363981  5567 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:09.366437  5596 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:09.155020  8355 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.319584  8300 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:09.331921  8343 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.337188  8325 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:09.345345  8289 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.343734  8358 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.402386  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:09.405128  5596 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:09.391939  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 446970us
I20260709 12:14:09.404356  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:09.423285  5567 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:09.426342  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 88176.8us
I20260709 12:14:09.375105  5670 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:09.372336  8366 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:09.376865  8343 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.377947  8326 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:09.418658  8328 consensus_meta.cc:287] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.041s	user 0.009s	sys 0.003s
I20260709 12:14:09.414245  8300 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.459919  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:09.460582  5747 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.462544  5596 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:09.415602  8197 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.431887  8224 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:09.401000  7943 consensus_queue.cc:1059] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
W20260709 12:14:09.468354  6291 leader_election.cc:336] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.923s (SENT)
W20260709 12:14:09.470670  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 47496.1us
I20260709 12:14:09.455929  8357 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.473789  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:09.475656  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.471099  8197 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:09.455044  8265 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:09.478595  5603 raft_consensus.cc:1240] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:09.486836  5603 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:09.429808  8351 consensus_queue.cc:1059] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:14:09.484403  5747 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:09.489591  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:09.491122  5747 raft_consensus.cc:2376] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7. Re-sending same reply.
I20260709 12:14:09.487987  5567 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:09.364936  8313 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.471158  8139 raft_consensus.cc:3055] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:09.514564  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 167686us
I20260709 12:14:09.515631  5596 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:09.478140  8340 log.cc:927] Time spent T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
W20260709 12:14:09.517663  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 53828.3us
W20260709 12:14:09.515692  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 146015us
I20260709 12:14:09.431808  8358 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:09.472421  8324 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.545871  5747 raft_consensus.cc:3055] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:09.546257  5747 raft_consensus.cc:740] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:09.478895  8368 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:09.553642  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:09.550628  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:09.462011  8328 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.486356  8300 consensus_queue.cc:1059] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:14:09.518400  8139 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:09.520092  8371 raft_consensus.cc:3055] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:09.545681  8197 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:09.557581  8347 log.cc:927] Time spent T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.355s	user 0.003s	sys 0.000s
W20260709 12:14:09.561942  8349 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 12:14:09.563372  8361 consensus_queue.cc:1059] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:14:09.564217  8372 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 12:14:09.519906  8224 raft_consensus.cc:3055] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:14:09.551738  8342 log.cc:927] Time spent T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.400s	user 0.000s	sys 0.001s
I20260709 12:14:09.556753  8365 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:09.577230  5677 raft_consensus.cc:2393] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:14:09.517246  8200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.015s	sys 0.019s
W20260709 12:14:09.551569  8348 log.cc:927] Time spent T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 12:14:09.569888  8371 raft_consensus.cc:740] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:09.557212  8375 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:09.548481  8202 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.578285  8328 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.605198  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:09.614336  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:09.615823  6327 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.006s	sys 0.002s
I20260709 12:14:09.555570  8368 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.602797  8224 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:09.571447  7872 raft_consensus.cc:2764] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:09.521279  8338 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.567830  8329 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.571673  8322 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.617079  8224 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:09.618031  8224 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.624109  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:09.571910  8388 consensus_queue.cc:1059] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:14:09.579419  8324 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:14:09.611917  8297 raft_consensus.cc:3055] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:09.611794  8355 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:09.642349  8370 log.cc:927] Time spent T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:14:09.623574  8368 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.623713  8381 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:14:09.649859  8371 consensus_queue.cc:260] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:09.653971  8371 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.658895  8368 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.555356  5603 raft_consensus.cc:2376] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6. Re-sending same reply.
I20260709 12:14:09.526961  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:09.685465  5596 raft_consensus.cc:2376] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6. Re-sending same reply.
I20260709 12:14:09.687937  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:09.688655  5603 raft_consensus.cc:2376] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6. Re-sending same reply.
I20260709 12:14:09.547024  5747 consensus_queue.cc:260] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:09.700122  5675 raft_consensus.cc:1240] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:09.568243  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 47619.5us
I20260709 12:14:09.688146  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:09.608702  6293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.029s	sys 0.037s
I20260709 12:14:09.702821  5716 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
W20260709 12:14:09.703466  6293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.029s	sys 0.037s
I20260709 12:14:09.704326  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:09.705550  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.706926  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:09.708539  6324 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:09.710040  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:09.611649  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:09.722586  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 456) took 2183 ms. Trace:
I20260709 12:14:09.723690  5603 raft_consensus.cc:2368] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5.
I20260709 12:14:09.726583  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1315) took 2450 ms. Trace:
I20260709 12:14:09.737805  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:09.739050  6319 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:09.740106  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:09.735905  5750 rpcz_store.cc:276] 0709 12:14:07.276311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.276514 (+   203us) service_pool.cc:224] Handling call
0709 12:14:07.833545 (+557031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.093008 (+259463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.726201 (+1633193us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b540022a1d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:09.726410 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278064384}
W20260709 12:14:09.705497  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 666145us
W20260709 12:14:09.719424  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.702786  5596 raft_consensus.cc:2376] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6. Re-sending same reply.
I20260709 12:14:09.723145  5673 rpcz_store.cc:276] 0709 12:14:07.539280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.539412 (+   132us) service_pool.cc:224] Handling call
0709 12:14:07.539689 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.809449 (+1269760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.722039 (+912590us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002e8954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:09.722387 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2911283456}
I20260709 12:14:09.744921  5750 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:09.724022  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:09.725617  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1340) took 1432 ms. Trace:
I20260709 12:14:09.746047  5749 rpcz_store.cc:276] 0709 12:14:08.293180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.304282 (+ 11102us) service_pool.cc:224] Handling call
0709 12:14:09.725160 (+1420878us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b54002c83d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:09.725367 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80641280}
I20260709 12:14:09.746671  6321 raft_consensus.cc:3055] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:09.747093  6321 raft_consensus.cc:740] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:09.747843  5749 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:09.748490  6321 consensus_queue.cc:260] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.711474  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:09.750301  6293 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:09.750629  5752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1321) took 2155 ms (client timeout 2485 ms). Trace:
W20260709 12:14:09.751113  5752 rpcz_store.cc:269] 0709 12:14:07.598099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.605017 (+  6918us) service_pool.cc:224] Handling call
0709 12:14:09.750199 (+2145182us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003642d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:09.750439 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2967296256}
I20260709 12:14:09.751782  6321 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.713615  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:09.754449  5598 raft_consensus.cc:2376] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6. Re-sending same reply.
I20260709 12:14:09.755120  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:09.757387  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:09.763784  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.765775  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:09.767145  5642 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:09.768165  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:09.775743  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:09.780611  5719 connection.cc:256] RPC call timeout handler was delayed by -1.0345542250001927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 12:14:09.725720  5716 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:09.770009  6323 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:09.772114  5748 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:09.777022  6322 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 6 LEARNER]: Advancing to term 8
I20260709 12:14:09.717073  5599 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:09.521517  5569 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:09.728567  5603 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:09.770160  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:09.578305  8139 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:09.612962  8200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.016s	sys 0.020s
I20260709 12:14:09.642810  8297 raft_consensus.cc:740] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:09.790640  8139 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.792261  8297 consensus_queue.cc:260] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.793447  8297 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:09.641057  8346 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:09.735847  5567 leader_election.cc:336] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.972s (SENT)
W20260709 12:14:09.794780  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 59162.1us
W20260709 12:14:09.795691  5567 leader_election.cc:336] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.138s (SENT)
I20260709 12:14:09.796217  5567 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:09.798599  6320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 490) took 1035 ms. Trace:
I20260709 12:14:09.799219  6320 rpcz_store.cc:276] 0709 12:14:08.762497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.768175 (+  5678us) service_pool.cc:224] Handling call
0709 12:14:09.772226 (+1004051us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:09.772499 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.773211 (+   712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.773238 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.773964 (+   726us) log.cc:844] Serialized 26 byte log entry
0709 12:14:09.794480 (+ 20516us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:09.794537 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.794646 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:09.797978 (+  3332us) raft_consensus.cc:1685] finished
0709 12:14:09.798002 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.798342 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36039936,"thread_start_us":20017,"threads_started":1,"wal-append.queue_time_us":20448}
I20260709 12:14:09.802358  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:09.807538  8368 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.741547  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:09.788568  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1336) took 1496 ms. Trace:
I20260709 12:14:09.813715  8363 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:09.814810  8363 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:09.816250  6322 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 8 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:09.817142  7872 raft_consensus.cc:3055] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:09.817989  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:09.818326  8109 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:09.818769  8109 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.818953  5673 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:09.824156  8352 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:09.825434  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:09.826084  8361 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:09.827559  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:09.828174  8294 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:09.830976  8202 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:09.811339  5748 rpcz_store.cc:276] 0709 12:14:08.292082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.771053 (+1478971us) service_pool.cc:224] Handling call
0709 12:14:09.771514 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.787880 (+ 16366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.788516 (+   636us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.831845  8202 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:09.836256  7924 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.848915  8328 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:09.851012  8328 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:09.851852  8328 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:09.824249  5567 leader_election.cc:336] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.273s (SENT)
W20260709 12:14:09.850270  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 328665us
I20260709 12:14:09.852558  5567 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:09.850308  8329 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:09.853519  8329 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:09.854059  8329 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:09.854416  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 489) took 1092 ms. Trace:
I20260709 12:14:09.853787  5569 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:09.855172  8324 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:09.855772  8365 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:09.856267  8365 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:09.856060  8324 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:09.856724  8365 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.858239  8224 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.817745  7872 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:09.859452  5569 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:09.838614  8109 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:09.870497  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 145064us
I20260709 12:14:09.871083  8230 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:09.871560  8230 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:09.871987  8230 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.827229  8343 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:09.874423  8237 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:09.874523  5719 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:09.876139  8343 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:09.876770  8243 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:09.877188  8243 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.858150  8346 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:09.878345  8202 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:09.860864  7872 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:09.862053  6327 rpcz_store.cc:276] 0709 12:14:08.762203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.762307 (+   104us) service_pool.cc:224] Handling call
0709 12:14:08.762588 (+   281us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:08.769086 (+  6498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:08.769117 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:08.791573 (+ 22456us) log.cc:844] Serialized 52 byte log entry
0709 12:14:08.884698 (+ 93125us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:09.089228 (+204530us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.089626 (+   398us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.616338 (+526712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.616390 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:09.853859 (+237469us) raft_consensus.cc:1685] finished
0709 12:14:09.853901 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.854171 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24395,"prepare.queue_time_us":474097,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":85,"raft.queue_time_us":512674,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":41697,"thread_start_us":774080,"threads_started":3,"wal-append.queue_time_us":134364}
I20260709 12:14:09.873522  5716 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:09.866914  8108 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:09.867622  8215 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:09.880271  6324 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:09.864825  8178 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:09.887430  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 99363.8us
I20260709 12:14:09.877509  8243 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.881305  8108 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:09.890813  8215 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:09.893976  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:09.869202  5645 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:09.938582  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 51751.8us
I20260709 12:14:09.861620  8160 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:09.946269  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 59043us
I20260709 12:14:09.901140  8108 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:09.948746  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 79807.4us
I20260709 12:14:09.953958  5673 raft_consensus.cc:1240] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:09.961867  8374 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:14:09.950629  8202 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:09.951506  6321 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:09.958377  5677 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:09.966392  8356 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:09.973979  8356 raft_consensus.cc:697] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:09.953900  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:09.977838  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:09.977527  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:09.981881  5748 raft_consensus.cc:2393] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 4: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:09.975960  5671 raft_consensus.cc:1240] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:09.977463  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:09.966713  8202 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.984287  8202 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:09.968107  7872 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:09.985255  8364 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.520s	user 0.001s	sys 0.001s
W20260709 12:14:10.016124  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 142797us
I20260709 12:14:10.018257  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:10.021624  8024 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:10.022364  8024 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.023674  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:10.025452  8372 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:10.025967  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:10.021880  8298 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:14:10.028205  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 202672us
I20260709 12:14:10.028294  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:10.028678  8065 consensus_meta.cc:287] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 1.165s	user 0.003s	sys 0.012s
I20260709 12:14:10.030858  8204 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:10.031648  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:10.032464  5598 raft_consensus.cc:2393] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:10.027428  5595 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:10.027206  8372 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:09.952443  8368 consensus_queue.cc:1059] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 12:14:10.040057  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 47804.3us
I20260709 12:14:10.029170  8065 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.041110  8336 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:10.032375  8345 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.077901  8345 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.083312  8384 raft_consensus.cc:3055] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:10.084061  8384 raft_consensus.cc:740] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:10.077811  5748 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:10.086834  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:10.087476  8368 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:10.087951  8368 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:10.088207  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:10.089028  8368 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.047720  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:10.048164  5752 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:10.049629  5750 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:10.050652  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:10.050915  5745 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 7. Ops: [5.7-5.7]
I20260709 12:14:10.051571  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:10.051699  8378 raft_consensus.cc:3055] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:10.045394  8289 raft_consensus.cc:3055] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:10.052624  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:10.052883  5716 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:10.054085  8024 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:10.056665  5747 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:10.058360  8356 consensus_queue.cc:237] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.172495  5749 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:10.059372  8213 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:10.062062  5642 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:10.064420  5746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1335) took 1772 ms (client timeout 1972 ms). Trace:
I20260709 12:14:10.076781  5751 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:10.045742  8306 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:10.085275  8384 consensus_queue.cc:260] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.011379  8365 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.092947  6293 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:10.117318  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:10.089450  5748 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:10.097926  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2011) took 1154 ms. Trace:
I20260709 12:14:10.107944  5718 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:10.176564  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:10.089846  5570 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:10.111939  7944 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.111379  8039 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.173597  8289 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:10.196497  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.099458  8336 consensus_queue.cc:1243] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer 831d76c5ee1045f0af923ce24fa4c301 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:10.202116  8384 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.196302  8039 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:10.202317  8213 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:10.152477  8378 raft_consensus.cc:740] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:10.198125  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:10.202142  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1350) took 1841 ms. Trace:
I20260709 12:14:10.197032  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:10.213502  5601 raft_consensus.cc:2393] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:10.203438  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:10.214308  5750 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
W20260709 12:14:10.218425  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 168055us
I20260709 12:14:10.117820  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:10.220496  5677 raft_consensus.cc:2393] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:10.214211  5751 rpcz_store.cc:276] 0709 12:14:08.355926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.728608 (+1372682us) service_pool.cc:224] Handling call
0709 12:14:10.076380 (+347772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:10.183657 (+107277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.196681 (+ 13024us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400021cd0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:10.196825 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771710720}
W20260709 12:14:10.221714  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 113882us
W20260709 12:14:10.176206  5746 rpcz_store.cc:269] 0709 12:14:08.291823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.294593 (+  2770us) service_pool.cc:224] Handling call
0709 12:14:10.063952 (+1769359us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400021cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:10.064178 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3419670912}
I20260709 12:14:10.222455  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:10.217284  8399 log.cc:927] Time spent T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 12:14:10.231022  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 143396us
W20260709 12:14:10.233887  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 141040us
I20260709 12:14:10.230736  8361 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:10.236157  5678 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:10.217459  8139 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:10.239528  5677 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:10.186745  5604 rpcz_store.cc:276] 0709 12:14:08.943264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.335964 (+392700us) service_pool.cc:224] Handling call
0709 12:14:09.336544 (+   580us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:09.490653 (+154109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.490718 (+    65us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:09.519605 (+ 28887us) log.cc:844] Serialized 52 byte log entry
0709 12:14:10.012739 (+493134us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:10.095889 (+ 83150us) log.cc:844] Serialized 14 byte log entry
0709 12:14:10.096144 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.097388 (+  1244us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b54003e08d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:10.097430 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.097477 (+    47us) raft_consensus.cc:1685] finished
0709 12:14:10.097577 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.097744 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20930,"prepare.queue_time_us":33211,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":47,"raft.queue_time_us":32494,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":3526,"spinlock_wait_cycles":11579264,"thread_start_us":385124,"threads_started":2,"wal-append.queue_time_us":430243}
I20260709 12:14:10.249071  6293 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:14:10.252718  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 239847us
I20260709 12:14:10.253991  8315 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:10.236867  8024 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:10.223255  8213 raft_consensus.cc:697] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:10.093096  5500 catalog_manager.cc:5697] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 3, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 3 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.198928  7944 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.258880  5570 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:10.263901  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 211141us
I20260709 12:14:10.264876  5678 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:10.235445  8324 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:10.244961  8368 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:10.278065  8314 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:10.278630  8314 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:10.279050  8314 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:10.280237  5501 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45220 (request call id 292) took 24975 ms (client timeout 15000 ms). Trace:
W20260709 12:14:10.280817  5501 rpcz_store.cc:269] 0709 12:13:45.304929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.315214 (+ 10285us) service_pool.cc:224] Handling call
0709 12:14:10.279972 (+24964758us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:02.281388 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:02.384181 (+102793us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:02.384227 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:14:02.384261 (+    34us) tablet.cc:662] Decoding operations
0709 12:14:02.385845 (+  1584us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:02.385948 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:02.385976 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:14:02.387353 (+  1377us) tablet.cc:701] Row locks acquired
0709 12:14:02.387399 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:14:02.387573 (+   174us) write_op.cc:270] Start()
0709 12:14:02.387716 (+   143us) write_op.cc:276] Timestamp: P: 1783599242387513 usec, L: 0
0709 12:14:02.387738 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:14:02.388463 (+   725us) log.cc:844] Serialized 6715 byte log entry
0709 12:14:03.215556 (+827093us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:03.677231 (+461675us) op_driver.cc:464] REPLICATION: finished
0709 12:14:05.128079 (+1450848us) write_op.cc:301] APPLY: starting
0709 12:14:05.185178 (+ 57099us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:05.721265 (+536087us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:05.733625 (+ 12360us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:05.855978 (+122353us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:05.856457 (+   479us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:14:05.856514 (+    57us) write_op.cc:312] APPLY: finished
0709 12:14:05.856971 (+   457us) log.cc:844] Serialized 119 byte log entry
0709 12:14:05.978107 (+121136us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:05.982369 (+  4262us) write_op.cc:454] Released schema lock
0709 12:14:06.003363 (+ 20994us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:06.090718 (+ 87355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:06.092870 (+  2152us) write_op.cc:454] Released schema lock
0709 12:14:07.831756 (+1738886us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b180017fbc0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
Metrics: {"mutex_wait_us":199324,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":1370893,"apply.run_cpu_time_us":65278,"apply.run_wall_time_us":998196,"num_ops":17,"prepare.queue_time_us":194052,"prepare.run_cpu_time_us":20969,"prepare.run_wall_time_us":266886,"raft.queue_time_us":424439,"raft.run_cpu_time_us":20446,"raft.run_wall_time_us":105141,"replication_time_us":1289332,"spinlock_wait_cycles":28838144,"thread_start_us":689007,"threads_started":5,"wal-append.queue_time_us":369645,"wal-append.run_cpu_time_us":32292,"wal-append.run_wall_time_us":3267058}]]}
I20260709 12:14:10.285532  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:10.285948  8306 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:10.286425  6291 leader_election.cc:400] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5.
I20260709 12:14:10.289418  8328 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.289867  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:10.302958  5672 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.290397  8338 consensus_queue.cc:1059] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:10.291733  8273 consensus_queue.cc:1059] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:10.293538  8322 consensus_queue.cc:1059] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:10.294433  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:10.295415  8243 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.295974  5744 raft_consensus.cc:2410] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:14:10.296422  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.275204  8294 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:10.301146  6291 leader_election.cc:403] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:14:10.301775  5752 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.259621  8139 raft_consensus.cc:697] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:10.303825  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.298077  8108 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.297737  8202 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.321209  5673 raft_consensus.cc:1240] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:10.323091  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 88496.6us
W20260709 12:14:10.311726  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 66123.9us
I20260709 12:14:10.289746  8039 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:10.317101  8361 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:10.318277  8243 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:10.302232  8306 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.307802  8024 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:10.327118  8200 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.301239  8345 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:10.330574  5671 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:14:10.340320  5603 raft_consensus.cc:1240] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:10.302073  8109 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.325640  8202 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:10.338222  8306 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:10.339097  8065 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:10.347767  5679 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:10.313550  8324 consensus_queue.cc:1059] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:14:10.344893  5500 catalog_manager.cc:5697] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 2, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 2 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.351999  8213 consensus_queue.cc:237] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.343894  8369 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5.
W20260709 12:14:10.363334  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 77176.9us
I20260709 12:14:10.305361  8378 consensus_queue.cc:260] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.344722  8024 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.357939  8361 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.388434  8108 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:10.344043  8200 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.390951  8024 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:10.394479  7944 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:10.384776  5500 catalog_manager.cc:5697] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 3 to 4, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:10.404775  5672 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:10.342453  8329 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:10.407554  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:10.369931  8297 consensus_meta.cc:287] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.573s	user 0.006s	sys 0.019s
I20260709 12:14:10.396087  6323 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:10.414657  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:10.415593  8336 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:10.416165  8336 raft_consensus.cc:697] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:10.417198  8391 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:10.417469  5753 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:10.417224  8336 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.423861  8329 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:10.424475  8329 consensus_queue.cc:1059] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:10.425572  5678 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:10.356140  8289 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.429769  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:10.427486  8361 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:10.427978  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:10.428930  5752 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
W20260709 12:14:10.437047  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 77695.4us
W20260709 12:14:10.447299  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 106445us
I20260709 12:14:10.437745  5595 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:10.432868  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:10.438174  5500 catalog_manager.cc:5697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.380330  8365 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:10.437505  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:10.436728  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1345) took 2098 ms. Trace:
W20260709 12:14:10.450600  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 144908us
I20260709 12:14:10.439183  6293 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:10.432906  5744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1343) took 2109 ms (client timeout 2273 ms). Trace:
I20260709 12:14:10.359386  8230 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.452163  5642 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:10.499171  5672 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:10.510861  5671 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:10.500910  5677 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.511968  5716 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:10.437229  8328 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:10.513129  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:10.513511  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 58922.8us
I20260709 12:14:10.501353  5569 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:10.516993  5673 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:10.432315  8200 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:10.518709  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:10.431444  8358 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:10.524919  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:10.518718  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.436316  8289 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.498517  8109 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:10.510427  5753 rpcz_store.cc:276] 0709 12:14:08.338817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.752399 (+1413582us) service_pool.cc:224] Handling call
0709 12:14:09.752889 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:10.418991 (+666102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.436517 (+ 17526us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b5400052dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:10.436671 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382004608}
W20260709 12:14:10.535398  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 96292.9us
I20260709 12:14:10.538964  5747 raft_consensus.cc:1275] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:10.538107  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:10.513948  5744 rpcz_store.cc:269] 0709 12:14:08.323533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.350442 (+ 26909us) service_pool.cc:224] Handling call
0709 12:14:10.432699 (+2082257us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400258354. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:10.432853 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3513204480}
W20260709 12:14:10.548688  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 96568.1us
I20260709 12:14:10.550400  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 716) took 1538 ms. Trace:
I20260709 12:14:10.553747  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:10.553966  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:10.545666  8391 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:10.555071  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1353) took 1209 ms. Trace:
I20260709 12:14:10.555226  8391 raft_consensus.cc:697] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:10.555433  5747 rpcz_store.cc:276] 0709 12:14:09.345932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.515410 (+169478us) service_pool.cc:224] Handling call
0709 12:14:09.545732 (+ 30322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:10.034865 (+489133us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b58000b75d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9a70aa 00007f44fda29447 00007f44fda41fe7 00007f44fda437de 00007f44fda4db49 00007f44fda4e416 00007f44fda4ad8f 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4
0709 12:14:10.549248 (+514383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.555001 (+  5753us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348204416}
I20260709 12:14:10.556167  8391 consensus_queue.cc:237] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.554607  6321 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.558127  8415 raft_consensus.cc:3055] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:10.558563  8415 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:10.559732  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:10.559453  8415 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:10.560529  8178 consensus_meta.cc:287] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.003s
I20260709 12:14:10.561895  5645 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:10.563617  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:10.564226  5678 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.564765  5748 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:10.528004  8039 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.566430  5679 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:10.566195  8039 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.567528  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:10.568552  8039 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:10.569243  5679 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:10.519423  7924 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:10.574661  8308 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:10.574990  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 117286us
I20260709 12:14:10.575361  5748 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:10.576433  8267 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:10.576879  8267 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:10.577049  8365 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:10.578735  8202 raft_consensus.cc:3055] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:10.579147  8202 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:10.582629  5745 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:10.587786  8378 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.588922  8204 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.589434  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:10.589862  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:10.590190  7872 raft_consensus.cc:3055] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:10.590678  5603 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:10.589607  8204 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.591600  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:10.592175  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:10.592725  8204 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:10.579945  8202 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.595774  8202 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.595777  6321 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:10.585615  5678 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:10.589212  5595 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:10.524722  8338 raft_consensus.cc:3055] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:10.612315  5751 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:10.567469  5752 pending_rounds.cc:85] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 4
W20260709 12:14:10.615931  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 91130.9us
I20260709 12:14:10.440335  8363 consensus_queue.cc:1059] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 12:14:10.403167  8139 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.616992  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:10.624575  5677 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:10.604630  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:10.628525  5746 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:10.560488  8415 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.629382  5676 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:10.636238  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 91244.6us
I20260709 12:14:10.590646  7872 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:10.619831  5752 pending_rounds.cc:107] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:14:10.641394  5752 raft_consensus.cc:2889] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:10.638227  5500 catalog_manager.cc:5697] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:10.646327  5500 catalog_manager.cc:5697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 2 to 4, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:10.647356  5500 catalog_manager.cc:5697] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:10.613227  8267 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:10.653533  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:10.649571  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 137715us
I20260709 12:14:10.613842  7924 raft_consensus.cc:697] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:10.614903  8328 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:10.626958  8361 raft_consensus.cc:3055] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:10.659449  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:10.618198  8338 raft_consensus.cc:740] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:10.550778  6325 rpcz_store.cc:276] 0709 12:14:08.807790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.816335 (+  8545us) service_pool.cc:224] Handling call
0709 12:14:09.829635 (+1013300us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:09.830070 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.830615 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:09.946032 (+115417us) log.cc:844] Serialized 14 byte log entry
0709 12:14:10.342341 (+396309us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:10.342388 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:10.342433 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.342493 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.346268 (+  3775us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2518,"prepare.queue_time_us":353678,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":7016,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3610,"spinlock_wait_cycles":20598016,"thread_start_us":484958,"threads_started":2,"wal-append.queue_time_us":381783}
I20260709 12:14:10.626231  8308 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.676194  8388 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:10.676723  8388 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:10.677011  8267 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.661168  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:10.639441  8294 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:10.677295  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:10.677399  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.673740  6291 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:10.728837  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:10.731837  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 67577.8us
W20260709 12:14:10.728688  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 75239.5us
I20260709 12:14:10.733888  6293 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:10.736617  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 47263.4us
I20260709 12:14:10.737311  5748 raft_consensus.cc:1240] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:10.645524  8039 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:14:10.743530  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 58402.3us
I20260709 12:14:10.745203  5716 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
W20260709 12:14:10.747349  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 73619.5us
W20260709 12:14:10.749665  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.752162  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:10.645347  8345 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:14:10.679665  8267 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:10.668937  8361 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:10.677488  7799 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.679669  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:10.752381  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:10.677126  8388 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.667631  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:10.751741  8369 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:10.752807  8384 consensus_meta.cc:287] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.001s
W20260709 12:14:10.776283  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.742401  8065 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:10.740967  8273 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:10.760526  8350 consensus_queue.cc:1059] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 12:14:10.763726  7799 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.771358  7872 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.735340  8178 consensus_queue.cc:1059] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:14:10.678218  8313 consensus_queue.cc:1059] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:14:10.679858  8358 consensus_queue.cc:1059] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:14:10.776428  5675 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:10.786586  5642 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:10.787485  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:10.668790  8356 consensus_queue.cc:1059] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:14:10.776039  8109 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:10.797562  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 108506us
I20260709 12:14:10.746995  7944 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:14:10.756471  8039 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.785710  8273 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:10.807643  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 45786.8us
I20260709 12:14:10.810981  5570 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:10.680694  8338 consensus_queue.cc:260] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:10.816772  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.814030  6320 raft_consensus.cc:2410] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:10.820520  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:10.821357  6320 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:10.822027  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:10.823822  8267 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:10.824388  8267 raft_consensus.cc:697] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:10.824975  8109 raft_consensus.cc:697] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:10.825280  8267 consensus_queue.cc:237] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.825942  8243 raft_consensus.cc:3055] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:10.826344  8243 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:10.827333  8243 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.805840  8384 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:10.815824  8273 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:10.830051  8230 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:10.838671  8314 consensus_meta.cc:287] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.000s
I20260709 12:14:10.842757  8243 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.864153  5678 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:10.885079  5753 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:10.865665  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:10.888732  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 312057us
I20260709 12:14:10.845168  8298 consensus_queue.cc:1059] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:14:10.838377  7924 consensus_queue.cc:237] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.893352  7872 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:10.898499  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 81428.8us
I20260709 12:14:10.923184  8109 consensus_queue.cc:237] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:10.923666  5569 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:10.866545  8314 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.924621  5569 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:10.925810  8314 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:10.928448  8416 log.cc:927] Time spent T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:14:10.930209  8039 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:10.930850  8039 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:10.931154  8039 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.931449  8039 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.858217  8361 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:10.925650  5569 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:10.938301  5749 raft_consensus.cc:1240] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:10.940893  5716 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:10.949132  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:10.950192  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:10.938930  8024 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:10.925940  8365 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:14:10.961074  8352 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:10.961553  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:10.962054  8368 consensus_meta.cc:287] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.662s	user 0.003s	sys 0.006s
W20260709 12:14:10.932488  8306 consensus_meta.cc:287] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.003s
W20260709 12:14:10.981597  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 330529us
W20260709 12:14:10.993072  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 243418us
I20260709 12:14:10.975436  8294 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:11.193176  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.215672  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.974681  8306 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:11.219954  6327 raft_consensus.cc:2393] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:11.220101  8306 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:11.225041  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 231119us
I20260709 12:14:11.226610  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:11.234647  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:11.259547  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.275758  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 352707us
I20260709 12:14:11.277899  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:11.278705  5671 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:11.279393  5604 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:11.040980  8365 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:14:11.281747  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 47186.2us
I20260709 12:14:11.041940  7799 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:11.291759  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.295327  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.297560  5570 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:11.303196  5595 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:11.314607  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:11.283527  8178 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.223572  8230 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:11.302729  8289 consensus_meta.cc:287] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.753s	user 0.009s	sys 0.000s
W20260709 12:14:11.311272  8388 consensus_meta.cc:287] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.004s
I20260709 12:14:11.286088  8313 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:14:11.346690  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.318370  8368 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.312846  8065 raft_consensus.cc:697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:11.306926  8365 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:11.338321  8230 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:11.360900  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:11.361907  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 55341us
I20260709 12:14:11.353241  6322 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:14:11.354609  8423 log.cc:927] Time spent T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.371s	user 0.001s	sys 0.001s
W20260709 12:14:11.356644  8213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.013s	sys 0.027s
I20260709 12:14:11.342587  8388 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:11.365129  5595 raft_consensus.cc:1240] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:11.365233  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:11.365475  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:11.366879  5603 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:11.359403  8267 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.372668  8230 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:11.374166  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:11.368430  8202 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.375351  8365 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:11.370050  5599 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:11.382243  5716 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:11.370078  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:11.353809  8368 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:11.367990  8213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.013s	sys 0.027s
I20260709 12:14:11.407462  5600 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:11.402349  8419 log.cc:927] Time spent T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.338s	user 0.001s	sys 0.001s
I20260709 12:14:11.391048  8202 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:11.351401  8430 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:14:11.409880  5750 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
W20260709 12:14:11.391345  8273 consensus_meta.cc:287] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.002s
I20260709 12:14:11.372753  8388 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:11.382334  8024 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:11.430193  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.407672  8438 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.418056  5642 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:11.389477  8267 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:11.479372  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 181893us
I20260709 12:14:11.415381  8324 raft_consensus.cc:3055] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:11.444736  8430 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:11.483801  5570 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:11.473480  8289 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:11.495422  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 128251us
W20260709 12:14:11.488837  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.497179  8328 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:11.497882  8328 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:11.498636  8313 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:11.499708  8313 raft_consensus.cc:3055] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:11.500068  8313 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:11.500175  8328 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:11.501575  5603 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:11.499028  8391 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:14:11.475742  8024 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.415022  8273 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:11.485175  8430 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:11.484544  8324 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:14:11.533421  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 125473us
I20260709 12:14:11.495245  8230 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.501214  8313 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:11.554958  5603 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:11.555550  5595 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:11.560119  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:11.550745  5677 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:11.503722  8388 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:11.561661  5596 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:11.481238  8065 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:11.561383  5716 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:11.531442  8024 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:11.566354  8443 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:14:11.574806  5716 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:11.581733  8202 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:11.537392  8139 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:14:11.586516  8436 log.cc:927] Time spent T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:14:11.574904  8215 raft_consensus.cc:3055] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:11.584442  8361 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:11.574983  8289 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.561239  8328 consensus_queue.cc:1059] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:14:11.578235  8313 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:11.601702  8215 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:11.588275  8414 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.568011  8450 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:11.614581  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 556) took 1016 ms. Trace:
I20260709 12:14:11.618708  6323 rpcz_store.cc:276] 0709 12:14:10.598405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.612224 (+ 13819us) service_pool.cc:224] Handling call
0709 12:14:10.955100 (+342876us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:10.955266 (+   166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:10.955729 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:10.955756 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:11.294229 (+338473us) log.cc:844] Serialized 26 byte log entry
0709 12:14:11.485447 (+191218us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:11.496265 (+ 10818us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.496698 (+   433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.496864 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:11.609304 (+112440us) raft_consensus.cc:1685] finished
0709 12:14:11.613685 (+  4381us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:11.614498 (+   813us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10507,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":1352,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":175,"spinlock_wait_cycles":23716608,"thread_start_us":140463,"threads_started":1,"wal-append.queue_time_us":189218}
I20260709 12:14:11.615316  8230 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:11.617450  8215 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:11.625845  5716 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:11.611296  8368 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:11.632658  8267 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:11.633487  8215 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:11.636758  5600 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:11.622745  8328 consensus_queue.cc:1243] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Peer 831d76c5ee1045f0af923ce24fa4c301 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:11.637897  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 560) took 1028 ms. Trace:
I20260709 12:14:11.638054  8353 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:11.638676  8353 raft_consensus.cc:697] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:11.639627  8353 consensus_queue.cc:237] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:11.642563  8230 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:11.643636  8273 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:11.638268  6328 rpcz_store.cc:276] 0709 12:14:10.599617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.599741 (+   124us) service_pool.cc:224] Handling call
0709 12:14:10.611651 (+ 11910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:10.631480 (+ 19829us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:10.803678 (+172198us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.628140 (+824462us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:11.628190 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:11.628237 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.628296 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:11.628411 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45073,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":29,"raft.queue_time_us":22220,"spinlock_wait_cycles":7026048,"thread_start_us":949674,"threads_started":3,"wal-append.queue_time_us":558762}
W20260709 12:14:11.651284  7872 consensus_meta.cc:287] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.729s	user 0.010s	sys 0.000s
I20260709 12:14:11.652158  8430 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:11.653532  8430 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:11.628209  8435 log.cc:927] Time spent T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:14:11.622195  8365 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:11.694856  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.695436  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.698467  5569 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:11.712034  5569 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:11.712484  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 100634us
W20260709 12:14:11.688117  8448 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:14:11.690580  8289 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:11.718449  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:11.721441  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:11.727039  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:11.728124  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:11.713938  7872 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.715878  8368 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:11.716615  8450 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:11.742118  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:11.744810  6323 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 3.
I20260709 12:14:11.719112  8414 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:11.747866  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 187828us
I20260709 12:14:11.700484  8365 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:11.786386  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.743557  8368 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:11.749966  8109 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:11.863518  8442 log.cc:927] Time spent T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 12:14:11.875116  5716 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
W20260709 12:14:11.871447  8294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.029s	sys 0.063s
W20260709 12:14:11.865499  6319 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.063s	sys 0.079s
I20260709 12:14:11.748044  7872 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:11.877511  8415 consensus_meta.cc:287] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.238s	user 0.006s	sys 0.007s
I20260709 12:14:11.883738  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 346) took 1418 ms. Trace:
I20260709 12:14:11.875597  8368 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.888713  5749 rpcz_store.cc:276] 0709 12:14:10.465591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.465699 (+   108us) service_pool.cc:224] Handling call
0709 12:14:10.525271 (+ 59572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:10.941781 (+416510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.883474 (+941693us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400217fd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:11.883673 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936085248}
W20260709 12:14:11.889633  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.853355  8414 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:11.891278  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.892315  8445 log.cc:927] Time spent T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 12:14:11.897325  5670 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:11.898012  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:11.898767  5678 raft_consensus.cc:2393] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:11.876807  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:11.901198  8338 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:11.902132  8429 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.902679  8429 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:11.904731  8429 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:11.886086  6319 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.063s	sys 0.080s
I20260709 12:14:11.905975  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:11.915143  8336 raft_consensus.cc:3055] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:11.915539  8336 raft_consensus.cc:740] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:11.916371  8336 consensus_queue.cc:260] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:11.917336  8336 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:11.908121  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.921602  8024 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:11.890676  8289 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:11.922273  8289 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:11.923269  8289 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:11.910377  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 561) took 1299 ms. Trace:
W20260709 12:14:11.901062  8453 log.cc:927] Time spent T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 12:14:11.953815  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.957921  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 50919.1us
W20260709 12:14:11.924463  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.891342  8411 log.cc:927] Time spent T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 1.260s	user 0.007s	sys 0.010s
W20260709 12:14:11.883827  8294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.030s	sys 0.064s
I20260709 12:14:11.878785  8109 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.002401  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:11.966874  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 44558us
I20260709 12:14:11.991671  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 351) took 1195 ms. Trace:
I20260709 12:14:11.922223  8308 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:11.924736  6326 rpcz_store.cc:276] 0709 12:14:10.599942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.600042 (+   100us) service_pool.cc:224] Handling call
0709 12:14:10.631282 (+ 31240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:10.631715 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:10.941648 (+309933us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.721256 (+779608us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.721927 (+   671us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:11.735205 (+ 13278us) log.cc:844] Serialized 26 byte log entry
0709 12:14:11.735358 (+   153us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:11.754192 (+ 18834us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.851802 (+ 97610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.851885 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:11.899241 (+ 47356us) raft_consensus.cc:1685] finished
0709 12:14:11.899254 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:11.899338 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144579,"prepare.queue_time_us":61397,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":5749,"raft.queue_time_us":140888,"raft.run_cpu_time_us":563,"raft.run_wall_time_us":41890,"spinlock_wait_cycles":1655936,"thread_start_us":1025603,"threads_started":3,"wal-append.queue_time_us":443790}
I20260709 12:14:12.003374  5744 rpcz_store.cc:276] 0709 12:14:10.763379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.957401 (+1194022us) service_pool.cc:224] Handling call
0709 12:14:11.957819 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.958009 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:11.958034 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:11.958076 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:11.958126 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.958177 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:11.958292 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:11.965976  8215 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:12.001017  8435 log.cc:927] Time spent T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:14:11.920298  8368 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:12.001637  8039 consensus_meta.cc:287] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 1.063s	user 0.008s	sys 0.008s
I20260709 12:14:11.967197  8455 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:14:12.021281  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:11.994133  8024 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.019091  5675 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:11.966636  6319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 558) took 1367 ms. Trace:
I20260709 12:14:11.993973  8369 raft_consensus.cc:3055] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:12.025539  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 559) took 1426 ms. Trace:
I20260709 12:14:12.056334  6322 rpcz_store.cc:276] 0709 12:14:10.599313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.622046 (+ 22733us) service_pool.cc:224] Handling call
0709 12:14:11.340743 (+718697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:11.366558 (+ 25815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.025336 (+658778us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540062e150. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:12.025478 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611203840}
I20260709 12:14:12.003913  8294 raft_consensus.cc:697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:12.058115  8294 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.059198  8368 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:12.029542  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 280138us
W20260709 12:14:12.033970  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.015847  8457 log.cc:927] Time spent T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:14:12.002750  8353 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.063438  6325 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:12.043916  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 51065.6us
I20260709 12:14:12.071707  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 350) took 1559 ms. Trace:
I20260709 12:14:12.045507  5718 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:12.045960  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:12.046573  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:12.049168  8024 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:12.051620  8461 log.cc:927] Time spent T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:14:12.029022  8215 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.018473  8456 consensus_queue.cc:1059] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:14:12.072114  5752 rpcz_store.cc:276] 0709 12:14:10.512419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.566848 (+ 54429us) service_pool.cc:224] Handling call
0709 12:14:10.567208 (+   360us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:10.735718 (+168510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:10.735783 (+    65us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:10.741256 (+  5473us) log.cc:844] Serialized 78 byte log entry
0709 12:14:11.284925 (+543669us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:11.484827 (+199902us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.486747 (+  1920us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.489864 (+  3117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.490016 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:12.071495 (+581479us) raft_consensus.cc:1685] finished
0709 12:14:12.071516 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:12.071649 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1538,"prepare.queue_time_us":371136,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":1586,"raft.queue_time_us":15527,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":38038,"spinlock_wait_cycles":23653504,"thread_start_us":669233,"threads_started":2,"wal-append.queue_time_us":723902}
I20260709 12:14:12.098901  8024 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:12.079116  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 75743.8us
I20260709 12:14:12.080863  7872 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.082360  5716 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:12.047104  6319 rpcz_store.cc:276] 0709 12:14:10.598991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.599120 (+   129us) service_pool.cc:224] Handling call
0709 12:14:10.599503 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:10.599807 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:10.814524 (+214717us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.920952 (+1106428us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.966268 (+ 45316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:11.966323 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:11.966375 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.966446 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:11.966573 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44533,"prepare.queue_time_us":76629,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":81950,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":5020160,"thread_start_us":1211532,"threads_started":3,"wal-append.queue_time_us":530356}
I20260709 12:14:12.061932  8415 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:12.047425  8308 consensus_queue.cc:1059] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:14:12.091488  8215 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:12.049515  8369 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:12.108807  5642 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:12.109988  8109 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:12.114965  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 73580us
I20260709 12:14:12.081578  8365 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:12.120179  5750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 1949) took 1677 ms (client timeout 1964 ms). Trace:
W20260709 12:14:12.120633  5750 rpcz_store.cc:269] 0709 12:14:10.442449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.452418 (+  9969us) service_pool.cc:224] Handling call
0709 12:14:12.120027 (+1667609us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54003633d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:12.120124 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865024896}
I20260709 12:14:12.045176  8039 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:12.105059  8361 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:12.107520  8415 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:12.081295  8414 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.101008  8338 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.119532  8369 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.121943  8289 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:12.127187  8324 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.127621  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:14:12.128165  8313 consensus_meta.cc:287] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.002s
I20260709 12:14:12.128502  7872 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.128809  8345 raft_consensus.cc:3055] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:12.149219  8215 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:12.102051  8353 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:12.158358  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 76099.6us
I20260709 12:14:12.151228  8415 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:12.163503  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:12.167830  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:12.168540  5750 raft_consensus.cc:2410] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:14:12.169291  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:12.124131  8336 consensus_queue.cc:1059] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:14:12.172070  5600 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:12.154667  8289 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.174717  5603 raft_consensus.cc:1240] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:12.163008  8430 consensus_meta.cc:287] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.509s	user 0.005s	sys 0.004s
I20260709 12:14:12.180063  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:12.159670  8345 raft_consensus.cc:740] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:12.185652  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.185223  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:12.183288  8289 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.150876  8361 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.171299  8414 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:12.176576  8378 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.154199  7799 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:14:12.166157  8215 raft_consensus.cc:697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:12.195112  5598 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
W20260709 12:14:12.198156  5567 leader_election.cc:336] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.510s (SENT)
I20260709 12:14:12.154170  8338 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:12.203212  5567 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:12.195253  8324 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.196188  8455 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:12.195427  8414 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:12.189635  8109 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.016s
W20260709 12:14:12.226894  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.232107  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:12.234061  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:12.235229  8308 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:12.235783  8308 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.237834  8345 consensus_queue.cc:260] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.238548  8353 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:12.239940  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.240589  5670 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:12.241891  6293 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:12.242676  8306 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:12.212412  8455 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:12.246484  6328 consensus_meta.cc:287] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.526s	user 0.000s	sys 0.008s
I20260709 12:14:12.246954  6328 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:12.251277  8338 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.225942  8414 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:12.252638  5744 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:12.258790  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.265959  5749 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:12.267210  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 476) took 1518 ms. Trace:
I20260709 12:14:12.269006  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 504) took 1645 ms. Trace:
I20260709 12:14:12.276443  6325 rpcz_store.cc:276] 0709 12:14:10.623523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.823000 (+199477us) service_pool.cc:224] Handling call
0709 12:14:10.823314 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.073944 (+1250630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.268759 (+194815us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400572954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:12.268938 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2851530112}
I20260709 12:14:12.243072  8306 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:12.275245  5677 rpcz_store.cc:276] 0709 12:14:10.748446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.756277 (+  7831us) service_pool.cc:224] Handling call
0709 12:14:10.770016 (+ 13739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.563964 (+793948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.266954 (+702990us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54001b7954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:12.267143 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1795047680}
I20260709 12:14:12.252664  8455 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.269483  8338 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:12.286767  8338 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:12.235496  8215 consensus_queue.cc:237] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.287606  8338 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.283468  8471 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.252889  8308 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.260022  7799 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:12.320986  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.328598  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 98327.5us
W20260709 12:14:12.329183  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.329382  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.331892  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.332391  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.332906  5645 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:12.331142  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.261839  8361 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.335314  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:12.333819  5645 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:12.346930  5748 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:12.289436  8306 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.350260  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:12.351128  8462 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:12.286791  8243 raft_consensus.cc:1064] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
W20260709 12:14:12.350713  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 118707us
I20260709 12:14:12.346365  8378 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.351545  8462 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:12.356532  8462 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.356927  5745 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:14:12.356648  5746 raft_consensus.cc:1240] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:12.351554  5642 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:12.358897  5749 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:12.362283  5678 raft_consensus.cc:1275] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:12.364331  5751 raft_consensus.cc:1240] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:12.365561  5747 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:12.365887  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.384756  6325 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:12.352406  8328 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:12.391974  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.392139  5642 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:12.394403  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.397848  5746 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:12.361817  8378 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.396564  8353 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:14:12.404415  5678 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:12.406157  8313 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:12.410104  5716 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:12.418303  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 84559.7us
I20260709 12:14:12.420893  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.387423  8039 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.390036  8328 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:12.421474  5671 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:12.431027  8378 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.437124  6324 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:12.358426  7799 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.437819  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.440191  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:12.443142  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.443835  5672 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:12.444736  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.443142  6291 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:12.445348  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.447880  5675 raft_consensus.cc:2410] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:12.449018  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.423872  8493 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:12.448199  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.453159  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.449656  5674 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:12.456817  8497 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.457136  8496 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:12.423419  8313 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.472802  8493 raft_consensus.cc:697] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:12.474905  8298 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:12.475009  8313 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.475479  8298 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.475576  8493 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.477313  8313 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:14:12.477440  8298 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.461772  7872 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.445785  8328 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:12.472632  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.472434  5746 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:14:12.474205  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.439154  8178 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:12.477973  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.409147  8414 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.478962  5744 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:12.479442  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.480400  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:12.424655  8429 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.524132  5745 raft_consensus.cc:2410] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:14:12.429674  6320 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:12.481405  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.458568  8378 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.489365  5677 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:12.442736  8444 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:12.459641  8065 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:12.454110  5670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:12.492645  5672 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:12.495535  8306 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:12.514799  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.526258  5679 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:12.531685  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:12.463442  8460 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:14:12.558637  8415 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.559736  8414 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.534713  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.560618  8415 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.536060  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:12.537326  8306 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.537869  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.566030  5677 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
W20260709 12:14:12.538578  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.543402  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 133374us
W20260709 12:14:12.543648  8488 log.cc:927] Time spent T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:14:12.543903  8243 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:12.545089  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.546270  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.570020  5718 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:12.546032  8289 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.573647  8289 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:12.574290  8289 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.574935  8289 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:12.523419  8178 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.578953  8178 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.549955  8444 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.581112  8444 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.551296  8462 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.583232  8462 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.532225  8429 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.586817  8429 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.553040  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:12.587531  5673 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.553809  6323 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:12.595608  8470 consensus_queue.cc:1059] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:12.596765  8470 raft_consensus.cc:3055] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:12.597083  8470 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:12.599716  8470 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.602008  5673 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:12.545167  8485 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.608688  6293 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:12.610911  6293 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:12.613843  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 221769us
W20260709 12:14:12.620010  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 48383.9us
I20260709 12:14:12.618005  8475 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:14:12.485841  8496 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.620707  5718 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:12.613974  8429 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:12.626291  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.616649  8178 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:12.629017  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.634471  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.632689  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:12.633937  5716 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:12.607549  8215 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:14:12.634703  5678 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:12.636472  7799 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:12.638942  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.639407  5752 raft_consensus.cc:1240] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:12.639532  5749 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:12.642545  8496 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.642916  8345 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:12.621511  8470 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.652379  5671 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:12.649325  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.654377  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:12.655040  5671 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:12.654935  5550 auto_rebalancer.cc:893] Removing replace marker failed: Replica 831d76c5ee1045f0af923ce24fa4c301 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:14:12.634651  8353 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:12.652271  8178 raft_consensus.cc:697] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:12.672083  8178 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.673498  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:12.674161  5672 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:12.675679  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:12.628412  8429 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.664042  8498 consensus_queue.cc:1059] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:12.664995  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:12.655561  8308 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:14:12.667747  6320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 511) took 1370 ms. Trace:
W20260709 12:14:12.668762  5550 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:14:12.678002  5672 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:12.620306  8328 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.655743  8475 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:12.680218  6320 rpcz_store.cc:276] 0709 12:14:11.297713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.298270 (+   557us) service_pool.cc:224] Handling call
0709 12:14:11.874389 (+576119us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:12.128410 (+254021us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b5400505ba8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f45038285f4 00007f4502a11227 00007f4502a10ab8 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:12.667565 (+539155us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b540053acd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:12.667669 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269764992}
I20260709 12:14:12.679379  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.682369  6291 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:12.683610  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.657827  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.688429  5752 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:12.684893  5746 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:12.678107  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:12.691274  8438 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.691727  6326 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 8 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:12.692215  8459 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.692853  5675 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:14:12.704026  5675 pending_rounds.cc:85] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 2
I20260709 12:14:12.704279  5675 pending_rounds.cc:107] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:14:12.704493  5675 raft_consensus.cc:2889] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:12.692649  8422 consensus_queue.cc:1059] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:12.696583  5569 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:12.680874  5550 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:14:12.691666  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 348805us
W20260709 12:14:12.691496  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 497235us
I20260709 12:14:12.687865  8350 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:12.707805  5671 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
W20260709 12:14:12.709408  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.680469  8429 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:12.717502  5671 raft_consensus.cc:3055] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:12.720350  5671 raft_consensus.cc:740] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:12.732695  5671 consensus_queue.cc:260] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.702725  8065 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:12.690308  8455 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.735884  5671 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.738976  5675 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:12.714320  8475 raft_consensus.cc:697] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:12.736240  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 71337.5us
I20260709 12:14:12.716612  8350 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:12.727569  8493 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:12.744141  8484 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:14:12.722425  8459 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.744712  8328 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:12.771881  5671 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:14:12.733300  8422 consensus_queue.cc:1243] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer c02ed29558db481589fd3db23e43a07f log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:12.716950  8336 consensus_queue.cc:1059] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:14:12.771883  5642 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:12.773313  5674 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:12.772351  5671 pending_rounds.cc:85] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 2
I20260709 12:14:12.780732  5671 pending_rounds.cc:107] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:14:12.781052  5671 raft_consensus.cc:2889] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:12.742843  8108 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:12.782058  8108 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.782459  8108 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:12.783042  8489 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.783614  8489 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.785049  5671 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:14:12.775527  5567 leader_election.cc:336] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.801s (SENT)
I20260709 12:14:12.785715  8489 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:12.786818  5567 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:12.788638  8422 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:12.789041  5567 leader_election.cc:336] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.851s (SENT)
I20260709 12:14:12.789461  5567 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:12.790163  8422 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:12.787240  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.792804  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:12.793483  5671 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
W20260709 12:14:12.801447  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.807597  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.747897  8350 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:12.744957  8294 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:14:12.832271  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:12.840525  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.772969  8438 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.841478  8438 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.841874  8455 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.791898  8493 raft_consensus.cc:697] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:12.846596  8493 consensus_queue.cc:237] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:12.850610  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.838955  5746 raft_consensus.cc:2393] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:12.867998  8475 consensus_queue.cc:237] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.869511  8438 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.879294  8459 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.879819  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:12.878329  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 106520us
I20260709 12:14:12.882592  5752 raft_consensus.cc:2376] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5. Re-sending same reply.
I20260709 12:14:12.880970  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.884087  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.790197  8365 consensus_queue.cc:1059] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:14:12.838948  8338 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:12.887286  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 190765us
I20260709 12:14:12.888492  5569 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:12.901717  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.902508  5752 raft_consensus.cc:2393] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:12.903678  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:12.902956  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 187789us
I20260709 12:14:12.912199  5642 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:12.913642  8391 raft_consensus.cc:3055] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:12.914065  8391 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:12.914844  8391 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.919163  8498 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.921311  8429 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:12.923569  8429 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:14:12.924783  8328 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:12.925505  5673 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:12.928308  5570 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:12.886826  8438 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.934473  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.935117  5642 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:12.938395  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:12.943400  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 208075us
I20260709 12:14:12.944098  6291 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:12.925715  8328 raft_consensus.cc:3055] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:12.935395  5569 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:12.933236  8459 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:12.910243  8338 raft_consensus.cc:697] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:12.897938  8108 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.961509  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.960767  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.962383  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:12.965116  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.965000  5569 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:12.938095  8462 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:12.968075  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:12.966137  5752 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:12.966019  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:12.966190  5569 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:12.969624  5749 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.949254  8498 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:12.951747  8429 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:12.953912  8459 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.972971  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.978834  5748 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:12.946870  8328 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:12.980693  8328 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.981604  8498 raft_consensus.cc:697] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:12.982101  8328 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.982537  8498 consensus_queue.cc:237] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.974047  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:12.962996  8511 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:12.972450  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.970772  8503 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.989115  8503 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.973419  8414 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.989998  8414 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.990401  8108 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:12.991429  8494 log.cc:927] Time spent T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.455s	user 0.003s	sys 0.000s
I20260709 12:14:12.992009  8414 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:12.993623  6325 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:12.993300  8338 consensus_queue.cc:237] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:12.993891  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:12.995071  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:12.995575  5748 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:12.995489  5670 raft_consensus.cc:606] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:12.978224  8429 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.996256  5670 raft_consensus.cc:614] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:12.996356  8429 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.996886  5678 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:12.987458  8422 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:12.986057  8459 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.969640  8455 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:14:12.972241  8519 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.987001  5642 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:12.939282  8438 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:13.002688  8511 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.003181  8511 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:12.988657  8462 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:12.978693  7944 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:13.003621  8462 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:13.004190  8462 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:13.018422  8415 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:13.018553  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 52445.8us
I20260709 12:14:13.022356  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:13.019538  8108 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:13.031438  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.032214  5751 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:13.040957  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:13.045576  5748 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:13.052592  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.081314  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.082145  5752 raft_consensus.cc:2368] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7.
I20260709 12:14:13.081923  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.083299  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:13.083352  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.986835  8350 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.087718  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:13.018723  8515 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.025506  8422 raft_consensus.cc:697] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:13.089887  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.037653  8378 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:13.096799  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.097328  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.019433  8517 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:14:13.079074  8353 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.101723  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:13.106998  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 127268us
I20260709 12:14:13.107813  6323 raft_consensus.cc:1240] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:13.108037  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.108318  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.108968  5748 raft_consensus.cc:2393] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:13.088233  8415 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:13.119307  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.093827  8414 raft_consensus.cc:2764] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:13.096969  8515 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.119998  5752 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:13.123946  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.018576  8519 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.125051  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.143368  8517 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:13.118289  8415 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:13.150938  8350 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:13.153652  5745 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:13.176633  5751 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:13.185700  8414 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.186353  8414 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.191367  8514 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.192042  8514 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.127331  8515 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.123741  7944 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:13.202777  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.117501  8353 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:13.226172  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.226972  5751 raft_consensus.cc:2393] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:13.152622  8415 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:13.239647  5749 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:13.249847  8108 raft_consensus.cc:697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:13.252350  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.254006  8514 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:13.258548  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 141164us
I20260709 12:14:13.258476  5749 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:13.248910  8503 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:13.268047  5596 raft_consensus.cc:1240] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:13.250639  8438 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:13.272130  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 251343us
I20260709 12:14:13.273911  5672 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:13.276876  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:13.276997  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.277729  5671 raft_consensus.cc:2410] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:14:13.278077  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.277712  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:13.275976  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:13.280089  5674 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:13.281881  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:13.282558  5678 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:13.283601  5676 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:13.280720  5672 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:13.285523  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:13.288244  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.288911  8353 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:13.254509  8108 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:13.289048  5603 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:13.292057  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.276536  8519 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:13.296181  5602 raft_consensus.cc:1240] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:14:13.283710  8530 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.247614  8422 consensus_queue.cc:237] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:13.297677  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:13.351352  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.372314  5600 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:13.373227  5601 raft_consensus.cc:3055] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:13.373631  5601 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:13.373831  5600 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:13.373735  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:13.374636  5604 raft_consensus.cc:2393] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:13.375840  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.376490  5597 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:13.377640  5595 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:14:13.378157  8496 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 12:14:13.372510  8526 log.cc:927] Time spent T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:14:13.372637  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.379310  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:13.382412  5567 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.579s (SENT) [suppressed 20 similar messages]
I20260709 12:14:13.381863  5601 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:13.357383  8523 log.cc:927] Time spent T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:14:13.384243  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.382323  5602 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:13.387506  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.405685  5746 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:13.405910  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.285300  8527 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:14:13.406662  5747 raft_consensus.cc:2393] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:13.387992  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:13.407526  5603 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.408275  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.408766  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.408826  5746 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.409402  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.409873  5753 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:13.411083  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.413046  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.413573  5749 raft_consensus.cc:2393] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:13.407837  8525 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:14:13.413862  5569 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:13.416699  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.424885  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.373404  8528 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:14:13.418627  8533 consensus_queue.cc:1059] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 12:14:13.422822  8520 log.cc:927] Time spent T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:14:13.423063  8459 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:13.423801  5567 leader_election.cc:336] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 3.161s (SENT)
I20260709 12:14:13.299314  8530 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.295312  7944 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.425192  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.425446  5751 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:13.424575  8496 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.426517  5678 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:14:13.433295  5567 leader_election.cc:336] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 3.331s (SENT)
I20260709 12:14:13.402770  8438 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.435537  5602 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:13.429497  8517 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:13.437673  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.442394  5598 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:13.439165  8517 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.443715  8517 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:13.446826  8353 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.447412  8353 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:13.449458  8353 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:13.449951  8484 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.450490  8484 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.452603  8484 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:13.447896  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:13.446884  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.455881  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.458411  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.459465  5751 raft_consensus.cc:2376] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5. Re-sending same reply.
I20260709 12:14:13.458395  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.459609  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.460378  5750 raft_consensus.cc:2368] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7.
W20260709 12:14:13.462304  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.466631  5746 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:13.470810  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.458550  8429 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.474920  8415 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:13.475994  8530 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:13.477186  8415 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:13.479671  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:13.480139  5599 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.439069  8496 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:13.483273  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.484395  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.482220  8470 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:13.441558  8438 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.490464  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.491060  5750 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:13.492738  8489 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:14:13.495908  6324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 730) took 1796 ms (client timeout 2077 ms). Trace:
I20260709 12:14:13.496031  8489 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:13.496335  6324 rpcz_store.cc:269] 0709 12:14:11.699885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.700004 (+   119us) service_pool.cc:224] Handling call
0709 12:14:13.495723 (+1795719us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54000938d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:13.495849 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994840832}
I20260709 12:14:13.498303  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.499498  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1305) took 1080 ms. Trace:
I20260709 12:14:13.499902  5679 rpcz_store.cc:276] 0709 12:14:12.419200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.419325 (+   125us) service_pool.cc:224] Handling call
0709 12:14:12.419636 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.531851 (+112215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.499241 (+967390us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54001e4e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:13.499438 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239429376}
I20260709 12:14:13.504184  5750 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:13.488315  8484 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:14:13.486651  8475 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:14:13.488605  8289 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:14:13.509020  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.513679  8496 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:13.513921  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40398 (request call id 27) took 1123 ms. Trace:
I20260709 12:14:13.514343  5670 rpcz_store.cc:276] 0709 12:14:12.398897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.400413 (+  1516us) service_pool.cc:224] Handling call
0709 12:14:13.513701 (+1113288us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b5400063e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda45853 00007f4502a1360a 00007f44fbf997d4 00007f44fbf99762 00007f44fbf99691 00007f44fbf9960c 00007f44fbf988c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:13.513852 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036472576}
W20260709 12:14:13.517591  8462 consensus_meta.cc:287] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260709 12:14:13.518071  8462 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:13.518625  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1921) took 1057 ms. Trace:
I20260709 12:14:13.509500  8429 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:13.511178  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:13.521154  5645 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:13.521955  8415 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:13.522445  8415 raft_consensus.cc:697] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:13.518990  5677 rpcz_store.cc:276] 0709 12:14:12.460876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.517802 (+1056926us) service_pool.cc:224] Handling call
0709 12:14:13.518148 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.518329 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.518353 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.518392 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:13.518426 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.518476 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.518571 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:13.523530  5751 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:13.523272  8415 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.529579  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:13.529896  5567 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:13.530750  8537 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.523178  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.531562  5567 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:13.532119  5602 raft_consensus.cc:2393] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:13.532784  5567 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:13.534113  8537 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.533715  8528 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:13.533104  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:13.533803  8496 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:13.535626  5567 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:13.543911  5567 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:13.546272  5567 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:13.536026  5677 raft_consensus.cc:606] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:13.547021  5677 raft_consensus.cc:614] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:13.535630  5602 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:13.547113  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 56408.5us
I20260709 12:14:13.541781  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.548084  5718 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:13.556684  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.557413  5567 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:13.557610  5750 raft_consensus.cc:2393] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:13.502983  8511 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:13.564581  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:13.568377  8459 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:13.567395  8484 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:14:13.571189  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:13.571811  5677 raft_consensus.cc:606] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:13.572135  5677 raft_consensus.cc:614] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:13.574824  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:13.575357  5677 raft_consensus.cc:606] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:13.575666  5677 raft_consensus.cc:614] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:13.561770  8504 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.577534  8504 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.562613  8528 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:13.561621  8533 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:14:13.578137  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:13.578552  7944 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.578660  5677 raft_consensus.cc:606] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:13.579291  5677 raft_consensus.cc:614] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:13.579900  8484 consensus_queue.cc:1243] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:13.580360  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:13.582499  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:13.561437  8530 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.586779  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:13.594816  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.589507  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:13.595348  5677 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:13.595728  5746 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:13.590780  5602 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:13.577914  8504 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.600384  5677 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:14:13.600678  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:13.602406  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.603751  5596 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:13.543113  8515 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:13.608076  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:13.614079  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 49565.3us
I20260709 12:14:13.615336  5567 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:13.616734  5567 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:13.622437  5603 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:13.624060  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:13.624235  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.624691  5674 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:13.627956  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:13.628561  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.629112  5602 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:13.630119  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:13.561650  8517 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:13.609377  8533 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:13.633628  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 99338.4us
I20260709 12:14:13.634092  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:13.627976  8542 log.cc:927] Time spent T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:14:13.635268  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.623284  8528 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.636786  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:13.626821  8530 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.636291  8496 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:13.669860  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:13.672820  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:13.706746  5602 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:13.666044  5567 leader_election.cc:400] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7.
I20260709 12:14:13.707456  5567 leader_election.cc:403] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:14:13.708644  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 51885.4us
I20260709 12:14:13.664990  5603 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:13.713008  8515 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:13.710145  5567 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:13.754979  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 44907.7us
I20260709 12:14:13.756844  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:13.763486  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.756165  5567 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:13.767887  5567 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:13.771430  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.772315  5602 raft_consensus.cc:2393] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:13.773198  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.789073  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:13.790236  8527 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:13.790961  8527 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.791441  8527 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.791613  8215 consensus_queue.cc:1059] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:13.793452  8527 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:13.795183  8298 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:13.806317  8298 raft_consensus.cc:697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:13.807374  8298 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.776213  8484 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:13.809108  8484 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.809499  8484 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:13.811815  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:13.769495  8528 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.817217  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.802637  8517 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:13.802842  5675 pending_rounds.cc:85] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 3
I20260709 12:14:13.818382  5675 pending_rounds.cc:107] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:14:13.818665  5675 raft_consensus.cc:2889] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:13.679037  8496 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.819721  8531 raft_consensus.cc:3055] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:13.820189  8531 raft_consensus.cc:740] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:13.821059  8496 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:13.803755  8215 raft_consensus.cc:3055] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:13.824375  8215 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:13.826875  8544 log.cc:927] Time spent T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 12:14:13.827585  8511 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:13.831334  8215 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:13.770149  8546 log.cc:927] Time spent T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:14:13.833019  8215 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:13.774941  8365 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.849058  5599 raft_consensus.cc:2410] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:13.850590  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.851811  5674 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:13.828655  8528 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7.
I20260709 12:14:13.818116  5602 raft_consensus.cc:2410] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:13.804581  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:13.782495  8462 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:13.838514  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 70716.9us
I20260709 12:14:13.859009  6293 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:13.859333  5567 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:13.705506  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:13.765259  8515 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:13.885438  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.833823  8489 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:13.848239  8365 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.898979  8365 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.902365  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.782017  8533 consensus_queue.cc:1059] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 12:14:13.887934  8521 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:13.855337  8537 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:13.894018  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.896413  7944 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.897997  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:13.889482  8459 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.862591  8517 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:13.907699  8513 log.cc:927] Time spent T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:14:13.921005  5678 raft_consensus.cc:1275] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:13.935948  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.940910  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.909719  8455 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:13.862339  8511 consensus_queue.cc:1059] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 12:14:13.957103  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.957628  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.967656  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 330935us
I20260709 12:14:13.910019  8489 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.987066  5678 raft_consensus.cc:1240] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:13.916733  8521 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:13.929777  8459 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.003386  8561 consensus_queue.cc:1059] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:13.954682  8455 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:14.023952  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.972054  8548 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:14:14.028795  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 167512us
I20260709 12:14:14.005904  8298 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:14.013227  8553 log.cc:927] Time spent T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:14:14.032251  6293 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:14.044981  8552 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.045614  8552 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:14.044011  8178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.268s	user 0.014s	sys 0.006s
I20260709 12:14:14.029479  8496 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:14.007464  8484 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:14.083566  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 51421.6us
I20260709 12:14:14.037798  8298 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:14.090834  6293 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:14.093974  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 125536us
I20260709 12:14:14.009146  8504 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:14.095108  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:14.086215  8178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.015s	sys 0.006s
I20260709 12:14:14.110698  5750 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:14.096617  8298 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:14.119761  8551 log.cc:927] Time spent T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:14:14.306996  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:14.093463  8567 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:14.309312  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:14.311064  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:14.326205  5746 raft_consensus.cc:2410] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:14:14.312558  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:14.095482  8496 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:14.329330  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.303349  8511 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:14.331257  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:14.331456  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:14.336838  5747 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
W20260709 12:14:14.324733  8530 consensus_meta.cc:287] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.653s	user 0.020s	sys 0.000s
I20260709 12:14:14.354408  5752 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:14.308296  8561 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:14.323315  8576 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:14.392233  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.302950  8109 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:14.305540  8574 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.310737  8297 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:14.330687  8511 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.398793  5598 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
W20260709 12:14:14.405474  8565 log.cc:927] Time spent T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:14:14.417702  8560 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.305s	user 0.000s	sys 0.000s
I20260709 12:14:14.360194  8530 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:14.427572  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.444749  8065 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:14.423166  8297 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:14.446843  8365 consensus_meta.cc:287] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.547s	user 0.014s	sys 0.005s
I20260709 12:14:14.447335  8365 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.448565  5603 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:14.449610  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 516) took 1734 ms. Trace:
I20260709 12:14:14.449990  6323 rpcz_store.cc:276] 0709 12:14:12.714839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.714956 (+   117us) service_pool.cc:224] Handling call
0709 12:14:12.728066 (+ 13110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.108299 (+380233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.449350 (+1341051us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b540068ea54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:14.449535 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872876800}
I20260709 12:14:14.450730  8504 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:14.404174  8109 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.335104  8567 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.456005  8531 consensus_queue.cc:260] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:14.459496  8308 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:14.460083  8308 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.463631  8308 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:14.455875  8575 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:14.470835  8575 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.471218  8575 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:14.359107  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 264035us
I20260709 12:14:14.636569  8455 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:14.446856  8297 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:14.642052  8577 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:14.645260  8459 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:14.645855  8391 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.407876  8574 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:14.670310  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 45482.8us
I20260709 12:14:14.642699  8577 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:14.730581  6293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.013s	sys 0.028s
W20260709 12:14:14.724540  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 53371.7us
I20260709 12:14:14.784118  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1942) took 1169 ms. Trace:
W20260709 12:14:14.765169  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.803804  6293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.016s	sys 0.060s
I20260709 12:14:14.794279  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1945) took 1038 ms. Trace:
W20260709 12:14:14.805883  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 707010us
I20260709 12:14:14.651618  8065 raft_consensus.cc:697] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:14.402648  8576 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.810933  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:14.811220  8558 raft_consensus.cc:3055] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:14.811861  8558 raft_consensus.cc:740] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:14.812508  5674 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:14.813076  5670 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:14.812685  8558 consensus_queue.cc:260] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.813982  8558 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:14.814095  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:14.815539  5672 raft_consensus.cc:2393] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:14.813592  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:14.816998  5674 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:14.817505  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:14.818374  5678 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:14.807704  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:14.698308  8109 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:14.802645  8567 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:14.806021  5675 rpcz_store.cc:276] 0709 12:14:13.756283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.802101 (+ 45818us) service_pool.cc:224] Handling call
0709 12:14:13.802593 (+   492us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:13.822622 (+ 20029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.822664 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:13.823442 (+   778us) log.cc:844] Serialized 52 byte log entry
0709 12:14:13.953089 (+129647us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:13.953127 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.953198 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:14.419306 (+466108us) raft_consensus.cc:1685] finished
0709 12:14:14.419327 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.794199 (+374872us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2804,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":129143,"threads_started":1,"wal-append.queue_time_us":225801}
I20260709 12:14:14.805167  5677 rpcz_store.cc:276] 0709 12:14:13.614530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.614657 (+   127us) service_pool.cc:224] Handling call
0709 12:14:13.614964 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.615334 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.615360 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:13.627401 (+ 12041us) log.cc:844] Serialized 26 byte log entry
0709 12:14:14.026234 (+398833us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:14.026274 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.026361 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:14.783880 (+757519us) raft_consensus.cc:1685] finished
0709 12:14:14.783902 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.784050 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1360,"raft.queue_time_us":486,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":5892,"thread_start_us":358478,"threads_started":1,"wal-append.queue_time_us":805400}
W20260709 12:14:14.822455  5642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.013s	sys 0.039s
I20260709 12:14:14.782768  8574 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:14.811213  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.826373  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 510575us
W20260709 12:14:14.826668  5642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.013s	sys 0.040s
W20260709 12:14:14.831102  5644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.013s	sys 0.015s
W20260709 12:14:14.831491  5644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.014s	sys 0.015s
W20260709 12:14:14.830706  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.833264  8139 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:14.833721  8139 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:14.834154  8139 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:14.834409  8298 consensus_meta.cc:287] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.000s
I20260709 12:14:14.834823  8298 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.816974  8552 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:14.846041  8578 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:14.846673  8578 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.848709  8577 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:14.850805  8577 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:14.836999  8585 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.851512  8585 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.853929  8504 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.827629  8581 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.850883  8489 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:14.819213  8576 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:14.853946  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.845005  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.669181  8561 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.854524  8504 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.825817  8567 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:14.863395  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:14.856289  8578 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:14.868299  8584 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:14.867002  8065 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.866039  8353 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:14.869143  5747 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:14.858251  8585 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:14.869315  5595 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:14.857667  8581 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.867188  8567 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.871882  8561 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:14.873157  5604 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:14.920475  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1869) took 1498 ms. Trace:
I20260709 12:14:14.878120  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:14.878651  8289 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:14.880705  8489 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.880764  8504 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:14.885746  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:14.888427  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 501) took 1265 ms. Trace:
I20260709 12:14:14.889150  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:14.867986  8583 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:14.890283  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:14.890888  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:14.893086  8584 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:14.866197  8575 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.860302  8577 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:14.917701  8422 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:14.920842  5604 rpcz_store.cc:276] 0709 12:14:13.422172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.872644 (+1450472us) service_pool.cc:224] Handling call
0709 12:14:14.872967 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.920232 (+ 47265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.920424 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:14.921350  5500 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44240 (request call id 204) took 28994 ms (client timeout 15000 ms). Trace:
I20260709 12:14:14.899724  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:14.923108  6293 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:14.920578  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2046) took 1515 ms. Trace:
W20260709 12:14:14.916462  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 108833us
I20260709 12:14:14.920238  8353 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.925354  8581 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:15.121850  6291 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:15.122804  8353 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:15.123045  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:15.123597  5670 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:14:15.123886  8578 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:14.924041  6319 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:15.124524  8578 raft_consensus.cc:697] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:15.125255  5674 raft_consensus.cc:2393] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
W20260709 12:14:15.085621  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 218666us
I20260709 12:14:15.127044  5677 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.127918  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:14.930541  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 368) took 1555 ms. Trace:
I20260709 12:14:15.128633  5678 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:14.947347  5673 rpcz_store.cc:276] 0709 12:14:13.623229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.623734 (+   505us) service_pool.cc:224] Handling call
0709 12:14:13.636052 (+ 12318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.821731 (+185679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.821792 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.821845 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:13.821890 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.888220 (+1066330us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54001b7454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:14.888266 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.888373 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426428672}
W20260709 12:14:15.131788  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 208721us
I20260709 12:14:14.923831  8289 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.132612  6293 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:15.134439  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:15.132366  5595 rpcz_store.cc:276] 0709 12:14:13.405322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.868692 (+1463370us) service_pool.cc:224] Handling call
0709 12:14:14.869022 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.919359 (+ 50337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.920524 (+  1165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.135288  5674 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.128654  5603 rpcz_store.cc:276] 0709 12:14:13.374924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.804228 (+429304us) service_pool.cc:224] Handling call
0709 12:14:14.930282 (+1126054us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b540048e754. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:14.930443 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362078976}
W20260709 12:14:14.929484  8570 log.cc:927] Time spent T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.945s	user 0.000s	sys 0.013s
I20260709 12:14:15.139235  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:15.138770  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.140507  5672 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.923693  8588 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.141232  5604 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:15.035913  8558 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.931814  8298 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:15.140465  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:15.145148  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:15.146478  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:15.150269  5603 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:15.133833  8587 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:15.143538  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:15.131984  8567 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:15.154417  6325 raft_consensus.cc:2410] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:15.155140  8593 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:15.155424  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:15.155712  8593 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:14.948799  8583 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.139927  8581 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:15.139921  8552 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:15.159216  8552 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:15.159605  8552 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:15.160171  6325 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 4 LEARNER]: Advancing to term 6
I20260709 12:14:15.158701  8581 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.163286  8581 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.153585  8558 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:14.929913  8585 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.214s
I20260709 12:14:15.168790  8558 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:15.158334  8139 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.170961  8577 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:15.125378  8578 consensus_queue.cc:237] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.171918  8139 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:15.153201  8588 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.173657  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:15.136919  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:15.174283  5595 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:15.177475  5670 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:14:15.178171  8517 raft_consensus.cc:3055] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:15.182004  8517 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:15.182870  8517 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:15.179142  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1404) took 1294 ms. Trace:
I20260709 12:14:15.180312  8588 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:15.158154  8593 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:15.184439  5750 rpcz_store.cc:276] 0709 12:14:13.884430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.889415 (+  4985us) service_pool.cc:224] Handling call
0709 12:14:15.178958 (+1289543us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54002c83d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:15.179085 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477367552}
I20260709 12:14:15.183889  8517 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.185658  8576 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.188184  8581 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.189378  6326 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:15.190447  8584 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:14.923476  8529 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.231s
I20260709 12:14:15.193325  8289 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:15.193748  5598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1879) took 1725 ms (client timeout 2153 ms). Trace:
W20260709 12:14:15.194139  5598 rpcz_store.cc:269] 0709 12:14:13.468556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.811526 (+342970us) service_pool.cc:224] Handling call
0709 12:14:15.193583 (+1382057us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b54003cee54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:15.193691 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217553664}
I20260709 12:14:15.195205  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:15.195779  5598 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.197620  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 369) took 1822 ms. Trace:
I20260709 12:14:15.198011  5599 rpcz_store.cc:276] 0709 12:14:13.375209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.856963 (+481754us) service_pool.cc:224] Handling call
0709 12:14:13.857236 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.891556 (+ 34320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.891589 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.910504 (+ 18915us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:13.910563 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.197377 (+1286814us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b54003e1554. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:15.197423 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.197540 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74358528}
I20260709 12:14:15.199308  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:15.199878  5599 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.200510  5602 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:14.923727  8489 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:15.204993  6325 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 6 LEARNER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:15.205180  5674 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:15.211015  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:15.206939  5598 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:15.208880  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:15.209606  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1403) took 1328 ms. Trace:
I20260709 12:14:15.212469  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.211975  5751 rpcz_store.cc:276] 0709 12:14:13.880921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.881049 (+   128us) service_pool.cc:224] Handling call
0709 12:14:13.893565 (+ 12516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.914693 (+ 21128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.914727 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:13.919140 (+  4413us) log.cc:844] Serialized 26 byte log entry
0709 12:14:13.983992 (+ 64852us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:13.984035 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.984107 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:14.928596 (+944489us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:15.209315 (+280719us) raft_consensus.cc:1685] finished
0709 12:14:15.209335 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.209543 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15696,"raft.queue_time_us":18992,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":16158,"spinlock_wait_cycles":11428096,"thread_start_us":16871,"threads_started":1,"wal-append.queue_time_us":42048}
I20260709 12:14:15.214406  5673 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:15.125970  5500 rpcz_store.cc:269] 0709 12:13:45.924779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.924966 (+   187us) service_pool.cc:224] Handling call
0709 12:14:14.919576 (+28994610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:11.488338 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:11.624402 (+136064us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:11.628718 (+  4316us) write_op.cc:435] Acquired schema lock
0709 12:14:11.628739 (+    21us) tablet.cc:662] Decoding operations
0709 12:14:11.922687 (+293948us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:11.922764 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:11.922789 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:14:11.923514 (+   725us) tablet.cc:701] Row locks acquired
0709 12:14:11.923560 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:14:11.923714 (+   154us) write_op.cc:270] Start()
0709 12:14:11.923854 (+   140us) write_op.cc:276] Timestamp: P: 1783599251923652 usec, L: 0
0709 12:14:11.923873 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:14:12.022115 (+ 98242us) log.cc:844] Serialized 2793 byte log entry
0709 12:14:12.637749 (+615634us) op_driver.cc:464] REPLICATION: finished
0709 12:14:12.924652 (+286903us) write_op.cc:301] APPLY: starting
0709 12:14:12.924748 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:12.924951 (+   203us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:12.925069 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:12.977982 (+ 52913us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:13.000100 (+ 22118us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:14:13.000146 (+    46us) write_op.cc:312] APPLY: finished
0709 12:14:13.000464 (+   318us) log.cc:844] Serialized 59 byte log entry
0709 12:14:13.000661 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:13.000801 (+   140us) write_op.cc:454] Released schema lock
0709 12:14:13.000863 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:13.001302 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:13.001331 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2274560,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":263038,"apply.run_cpu_time_us":3717,"apply.run_wall_time_us":76669,"num_ops":7,"prepare.queue_time_us":442575,"prepare.run_cpu_time_us":19132,"prepare.run_wall_time_us":726870,"raft.queue_time_us":369715,"raft.run_cpu_time_us":37686,"raft.run_wall_time_us":119097,"replication_time_us":713719,"thread_start_us":859591,"threads_started":4,"wal-append.queue_time_us":170682,"wal-append.run_cpu_time_us":22749,"wal-append.run_wall_time_us":1856462}]]}
I20260709 12:14:15.215653  5674 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:15.216421  5599 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
W20260709 12:14:15.217514  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.217901  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.219458  5677 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:15.220530  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:15.221189  5677 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:15.221482  5595 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:15.171525  8577 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.228303  5672 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:15.214694  5603 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:15.227056  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.226814  5674 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:15.158735  8583 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:15.230168  5604 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:15.228909  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.133966  8422 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.236371  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.236896  5599 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:14:15.237331  5599 pending_rounds.cc:85] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 2
I20260709 12:14:15.217195  8581 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:15.237720  5599 pending_rounds.cc:107] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:14:15.239089  5603 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:15.227800  8109 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:15.227913  8548 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.209592  8567 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:14:15.239634  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:15.633051  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:15.342945  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 118526us
I20260709 12:14:15.651199  5746 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:15.651589  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1874) took 2228 ms. Trace:
I20260709 12:14:15.652431  5677 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:15.255810  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.292111  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 172026us
I20260709 12:14:15.653487  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:15.654158  5677 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:15.242782  5678 raft_consensus.cc:2410] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:14:15.262230  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.229157  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.279747  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:15.654314  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:15.658053  5604 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:15.657012  5598 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:15.650897  5599 raft_consensus.cc:2889] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:15.658999  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:15.657038  5678 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:15.652119  5603 rpcz_store.cc:276] 0709 12:14:13.423593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.238578 (+1814985us) service_pool.cc:224] Handling call
0709 12:14:15.238880 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:15.651233 (+412353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.651511 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:15.652345  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.660533  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.655128  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:15.315502  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:15.661831  5677 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:15.662024  5747 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:15.437881  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:15.305109  5595 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:15.665081  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1875) took 2241 ms. Trace:
I20260709 12:14:15.665434  5595 rpcz_store.cc:276] 0709 12:14:13.423862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.240679 (+1816817us) service_pool.cc:224] Handling call
0709 12:14:15.304863 (+ 64184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:15.664810 (+359947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.665019 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.264767  5673 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:15.232643  8558 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.670478  5677 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:15.671105  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:15.672776  5677 raft_consensus.cc:1240] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:15.672595  5642 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:15.673519  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:15.675954  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:15.675886  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:15.677222  5603 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:15.679805  5598 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:15.687201  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:15.688155  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:15.688248  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1873) took 2265 ms. Trace:
I20260709 12:14:15.689270  5599 rpcz_store.cc:276] 0709 12:14:13.423307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.236340 (+1813033us) service_pool.cc:224] Handling call
0709 12:14:15.236584 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.688011 (+451427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.688196 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.689980  5677 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:15.687376  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1877) took 2256 ms. Trace:
I20260709 12:14:15.690702  5598 rpcz_store.cc:276] 0709 12:14:13.430535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.679255 (+2248720us) service_pool.cc:224] Handling call
0709 12:14:15.679535 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.687040 (+  7505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.687304 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.692518  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:15.692878  5598 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:15.693382  6327 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:15.678318  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1878) took 2238 ms. Trace:
W20260709 12:14:15.362430  8592 log.cc:927] Time spent T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:14:15.676147  8415 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:15.698756  5599 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:15.695219  5603 rpcz_store.cc:276] 0709 12:14:13.439526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.676652 (+2237126us) service_pool.cc:224] Handling call
0709 12:14:15.676927 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.678072 (+  1145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.678263 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.239744  6319 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:15.403049  8422 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:15.684137  8588 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:15.703923  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:15.316346  8576 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:15.706009  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:15.706652  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:15.706895  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:15.668078  8489 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:15.692499  8514 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:15.737978  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:15.684031  8593 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.688714  8558 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.684655  8594 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:15.668656  8353 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.715118  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.725322  8414 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:15.715991  8583 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:15.676107  8109 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:15.233060  8577 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:15.684648  8584 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:15.668886  8470 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:15.703857  8415 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:15.677191  8548 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.725546  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1864) took 2423 ms. Trace:
I20260709 12:14:15.764559  5596 rpcz_store.cc:276] 0709 12:14:13.276166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.276459 (+   293us) service_pool.cc:224] Handling call
0709 12:14:13.287071 (+ 10612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.604207 (+317136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.699003 (+2094796us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540009c9d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:15.699146 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727774080}
I20260709 12:14:15.765915  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.767028  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:15.767745  5596 raft_consensus.cc:2410] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:15.768519  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.769222  5596 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:15.726683  5599 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:15.773433  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.497292  8575 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:15.236567  6321 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:14:15.742045  8594 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:15.735927  6327 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:15.642534  8552 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.715438  8517 consensus_queue.cc:1059] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:15.746083  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.790196  5598 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:15.791079  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.791611  5598 raft_consensus.cc:2376] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7. Re-sending same reply.
I20260709 12:14:15.792351  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.792855  5598 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:15.731670  8588 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:15.775285  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:15.795450  5751 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.777719  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:15.796252  6323 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:15.730530  5595 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:15.797334  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1880) took 2322 ms. Trace:
I20260709 12:14:15.763566  8584 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:15.797663  5595 rpcz_store.cc:276] 0709 12:14:13.475286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.676581 (+2201295us) service_pool.cc:224] Handling call
0709 12:14:15.730372 (+ 53791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.797109 (+ 66737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.797284 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.743006  8514 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:15.804492  8514 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:15.784356  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.743396  8596 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:15.805955  8596 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:15.806358  8596 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.806675  8422 raft_consensus.cc:3055] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:15.789518  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:15.794353  5598 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:14:15.769989  8415 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:15.783735  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 399416us
I20260709 12:14:15.797824  8588 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.776192  8470 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:15.806710  5599 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:15.810624  5751 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:15.814172  5596 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:15.814553  6324 raft_consensus.cc:1240] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:15.748234  8353 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:15.807096  8422 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:15.788345  8594 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.819211  5599 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:15.820327  5598 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:14:15.822343  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 135288us
I20260709 12:14:15.823087  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:15.799966  8584 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.824043  5596 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:15.824525  5599 raft_consensus.cc:1240] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:15.824062  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:15.834452  6328 raft_consensus.cc:1240] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:15.853859  5601 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.821074  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:15.858356  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 152444us
I20260709 12:14:15.861202  5569 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:15.864434  5751 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:15.864857  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:15.864993  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:15.866101  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:15.864269  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:15.832031  8414 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:15.867764  5748 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
W20260709 12:14:15.873903  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 116212us
I20260709 12:14:15.867383  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:15.876226  5746 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:15.866751  5750 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:15.895386  8605 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:15.895998  8605 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:15.898281  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:15.927942  5601 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:14:15.929033  8267 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:15.933439  5601 pending_rounds.cc:85] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 6
I20260709 12:14:15.886516  8583 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:15.934167  5601 pending_rounds.cc:107] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 12:14:15.939633  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 78634.2us
I20260709 12:14:15.913331  6321 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:15.939985  5601 raft_consensus.cc:2889] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:15.932667  8608 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.942857  8109 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:15.942826  8583 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:15.897138  8414 raft_consensus.cc:697] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:15.885968  8422 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:15.946521  8558 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:15.943459  8353 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:16.013518  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 366) took 2655 ms. Trace:
W20260709 12:14:16.026350  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 151528us
I20260709 12:14:16.031809  5601 rpcz_store.cc:276] 0709 12:14:13.358256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.372825 (+ 14569us) service_pool.cc:224] Handling call
0709 12:14:13.373104 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.853413 (+2480309us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b58007712d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9a70aa 00007f44fda29447 00007f44fda41fe7 00007f44fda437de 00007f44fda4db49 00007f44fda4e416 00007f44fda4ad8f 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4
0709 12:14:16.012779 (+159366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.013443 (+   664us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468770176}
W20260709 12:14:16.119431  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.042176  8414 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:14:16.140125  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 96602.3us
I20260709 12:14:16.017817  8294 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.142058  5569 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:16.144375  8605 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:16.161863  5569 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:16.046950  8548 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:16.031518  8267 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 12:14:16.030756  8577 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:16.139263  8422 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.047667  8593 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:16.147266  8552 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:16.182945  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 378) took 1012 ms. Trace:
I20260709 12:14:16.163347  8511 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:16.185606  5604 rpcz_store.cc:276] 0709 12:14:15.170316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.696580 (+526264us) service_pool.cc:224] Handling call
0709 12:14:15.696871 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.697055 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:15.825073 (+128018us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.182596 (+357523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.182647 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:16.182693 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.182763 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.182885 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":168608,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":6651,"thread_start_us":475882,"threads_started":2}
I20260709 12:14:16.166810  8470 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:16.198859  5677 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:16.160826  8294 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:16.006801  8608 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:14:16.202139  8599 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:14:16.202217  8369 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.215345  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.245167  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 515) took 1068 ms. Trace:
I20260709 12:14:16.217113  8039 raft_consensus.cc:2764] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:16.245517  5672 rpcz_store.cc:276] 0709 12:14:15.176888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.215020 (+1038132us) service_pool.cc:224] Handling call
0709 12:14:16.245103 (+ 30083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.217868  6293 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:16.218667  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:16.253710  5678 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:14:16.222465  8547 log.cc:927] Time spent T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 2.558s	user 0.020s	sys 0.017s
W20260709 12:14:16.225035  8555 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.897s	user 0.007s	sys 0.010s
W20260709 12:14:16.228286  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.230990  5676 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:16.256034  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.234820  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:16.170620  8623 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:16.238557  8415 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.241276  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1961) took 1010 ms. Trace:
I20260709 12:14:16.243827  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 523) took 1099 ms. Trace:
I20260709 12:14:16.262377  5677 rpcz_store.cc:276] 0709 12:14:15.230788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.698224 (+467436us) service_pool.cc:224] Handling call
0709 12:14:15.698481 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.239703 (+541222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.241008 (+  1305us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b5400490f54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:16.241206 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150230272}
I20260709 12:14:16.262892  6324 rpcz_store.cc:276] 0709 12:14:15.143973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.144203 (+   230us) service_pool.cc:224] Handling call
0709 12:14:15.155382 (+ 11179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.816984 (+661602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.243597 (+426613us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54005c6cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:16.243764 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515516160}
I20260709 12:14:16.258458  6293 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:16.263839  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:16.225199  8596 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.260154  8350 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:16.252043  8567 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.282555  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1940) took 2695 ms. Trace:
I20260709 12:14:16.278911  5678 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
W20260709 12:14:16.274448  5642 connection.cc:256] RPC call timeout handler was delayed by -1.51206088500021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 12:14:16.278210  8350 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:16.281239  8361 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:16.273911  8368 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:14:16.281879  8552 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:16.284248  5642 connection.cc:256] RPC call timeout handler was delayed by -1.3698608850002074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 12:14:16.286533  5642 connection.cc:256] RPC call timeout handler was delayed by -1.2969608850000895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 12:14:16.286885  5642 connection.cc:256] RPC call timeout handler was delayed by -1.1862608850001379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 12:14:16.287159  5642 connection.cc:256] RPC call timeout handler was delayed by -1.1295608850000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
I20260709 12:14:16.288270  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:16.289695  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:16.184973  8583 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.282924  5679 rpcz_store.cc:276] 0709 12:14:13.586995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.587120 (+   125us) service_pool.cc:224] Handling call
0709 12:14:13.587432 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.587826 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.587856 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:13.597860 (+ 10004us) log.cc:844] Serialized 26 byte log entry
0709 12:14:13.620151 (+ 22291us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:13.620195 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.624992 (+  4797us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.221889 (+2596897us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:16.282292 (+ 60403us) raft_consensus.cc:1685] finished
0709 12:14:16.282313 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.282495 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4716,"spinlock_wait_cycles":2680576,"thread_start_us":20727,"threads_started":1,"wal-append.queue_time_us":21092}
I20260709 12:14:16.291965  5642 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:16.286056  8350 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.294092  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:16.296098  8588 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.297026  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1943) took 2665 ms. Trace:
I20260709 12:14:16.290453  8361 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:16.284746  8567 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.297389  5671 rpcz_store.cc:276] 0709 12:14:13.631470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.632151 (+   681us) service_pool.cc:224] Handling call
0709 12:14:13.632381 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.636624 (+  4243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.636655 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:13.637144 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:14:13.967540 (+330396us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:13.967579 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.967648 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.224479 (+2256831us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:16.294246 (+ 69767us) raft_consensus.cc:1685] finished
0709 12:14:16.294271 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.296961 (+  2690us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3927,"raft.queue_time_us":4095,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":27766,"spinlock_wait_cycles":5319552,"thread_start_us":295713,"threads_started":1,"wal-append.queue_time_us":437170}
I20260709 12:14:16.291482  8593 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:16.292979  8462 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:16.344340  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:16.345225  8438 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:16.345324  6319 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:16.346350  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:16.349993  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:16.351627  8549 log.cc:927] Time spent T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 2.344s	user 0.013s	sys 0.029s
I20260709 12:14:16.291613  8552 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:16.294950  8577 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:16.296694  8415 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:16.298854  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:16.361891  8593 raft_consensus.cc:697] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:16.297593  8605 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:14:16.363197  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 64429.7us
I20260709 12:14:16.368784  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:16.363824  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 84544us
I20260709 12:14:16.366987  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 374) took 2782 ms. Trace:
W20260709 12:14:16.351658  8621 log.cc:927] Time spent T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:14:16.333618  8608 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:16.373256  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:16.372138  5745 rpcz_store.cc:276] 0709 12:14:13.584803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.584959 (+   156us) service_pool.cc:224] Handling call
0709 12:14:13.585346 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.602196 (+ 16850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.602227 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:13.615028 (+ 12801us) log.cc:844] Serialized 26 byte log entry
0709 12:14:13.857563 (+242535us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:13.889786 (+ 32223us) log.cc:844] Serialized 14 byte log entry
0709 12:14:13.901958 (+ 12172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.902148 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.351354 (+2449206us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b24002573d8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa7e49c4 00007f44fa7e2acb 00007f44fa99ddc9 00007f44fa99da55 00007f44fa99d09d 00007f44fd5cf10e 00007f44fd5e688c 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221
0709 12:14:16.353370 (+  2016us) raft_consensus.cc:1685] finished
0709 12:14:16.366773 (+ 13403us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.366924 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28322,"prepare.queue_time_us":30131,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":66723,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":7802,"spinlock_wait_cycles":9664896,"thread_start_us":224343,"threads_started":1,"wal-append.queue_time_us":310841}
I20260709 12:14:16.384891  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:16.387305  5642 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:16.388356  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:16.389081  6321 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:16.368848  8361 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:16.369771  8593 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:16.392938  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 231166us
I20260709 12:14:16.399401  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.401826  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:16.371336  8414 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:16.402920  5569 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:16.373570  8588 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:16.395828  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:16.402355  6327 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
W20260709 12:14:16.393977  8584 consensus_meta.cc:287] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
I20260709 12:14:16.404645  5569 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:14:16.415329  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.415751  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.415302  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:16.392704  8577 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:16.417697  5749 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:16.420998  5645 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:16.369560  8350 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:16.422359  6319 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:16.403038  8605 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:16.424021  5642 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:16.424664  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:16.424705  5645 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:16.425079  8556 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.409893  8438 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:16.403306  8361 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:14:16.418159  8414 raft_consensus.cc:697] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:16.432237  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.434974  5595 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:16.435679  6327 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:16.440060  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.440598  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:16.440984  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:16.441202  5749 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:16.426275  8630 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:16.443522  5750 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:16.439256  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:16.442780  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:16.410408  8462 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:14:16.426154  8588 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:16.427585  8605 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:16.447813  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.427240  8614 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:16.457499  5672 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:16.420156  8584 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.422593  8415 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:14:16.433805  8556 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:16.456480  8630 raft_consensus.cc:697] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:16.459730  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:16.460738  5601 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:16.461400  8531 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.432301  8511 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:16.463408  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.497156  5603 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:16.463547  5597 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:16.498030  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1958) took 1304 ms. Trace:
I20260709 12:14:16.498435  5673 rpcz_store.cc:276] 0709 12:14:15.193717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.691490 (+497773us) service_pool.cc:224] Handling call
0709 12:14:15.691795 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.756001 (+ 64206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:15.756029 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:15.756068 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:15.756101 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.497822 (+741721us) spinlock_profiling.cc:243] Waited 64 ms on lock 0x7b54002d3a54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:16.497861 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.497981 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147120384}
I20260709 12:14:16.499769  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:16.500468  8556 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:16.501236  8414 consensus_queue.cc:237] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.502166  8521 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:16.502825  6323 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:16.425477  8552 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:16.506764  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1325) took 1623 ms. Trace:
I20260709 12:14:16.507274  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:16.507814  8496 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:16.507186  5675 rpcz_store.cc:276] 0709 12:14:14.883037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.883164 (+   127us) service_pool.cc:224] Handling call
0709 12:14:14.915236 (+ 32072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.140236 (+225000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:15.140264 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:15.140305 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:15.140336 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.506528 (+1366192us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54001b7e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:16.506573 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.506705 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516968832}
I20260709 12:14:16.432399  8627 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:16.435514  8577 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:16.442307  8623 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.456614  8438 raft_consensus.cc:697] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:16.454723  8588 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:16.445333  8596 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:16.481154  8484 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:16.446095  8624 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:16.487351  5718 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:16.536739  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 49485.9us
W20260709 12:14:16.538224  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.445509  8613 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:16.490085  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 733) took 1330 ms. Trace:
I20260709 12:14:16.493250  5671 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.494417  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:16.494639  8625 log.cc:927] Time spent T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:14:16.496173  8361 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:16.501869  8564 log.cc:927] Time spent T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 2.520s	user 0.014s	sys 0.024s
I20260709 12:14:16.427090  8583 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:14:16.512553  5597 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:16.513093  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:16.458474  8605 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.458314  8614 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:16.528147  8608 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:16.566141  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 53129.1us
I20260709 12:14:16.567209  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1336) took 1678 ms. Trace:
I20260709 12:14:16.543766  6328 rpcz_store.cc:276] 0709 12:14:15.160004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.161888 (+  1884us) service_pool.cc:224] Handling call
0709 12:14:15.162176 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.834906 (+672730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.482417 (+647511us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b540060c054. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:16.490024 (+  7607us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1545676032}
I20260709 12:14:16.545905  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.547219  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.548877  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.551132  5598 raft_consensus.cc:1240] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:16.525559  8588 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:16.524986  8627 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:16.543990  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.557416  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.552403  8109 consensus_queue.cc:1059] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:14:16.558477  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.557359  8470 consensus_queue.cc:1059] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:14:16.558975  8350 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:16.575788  5604 raft_consensus.cc:2368] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
W20260709 12:14:16.560745  8635 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:16.560998  8573 consensus_queue.cc:1059] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:16.562070  8614 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.561916  8617 consensus_queue.cc:1059] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:16.564150  5569 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:16.584915  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.564654  8438 consensus_queue.cc:237] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.566412  8616 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:16.587707  5671 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:14:16.552480  8613 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.557054  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.568132  5670 rpcz_store.cc:276] 0709 12:14:14.888610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.133401 (+244791us) service_pool.cc:224] Handling call
0709 12:14:16.567041 (+1433640us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b540037a0d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:16.567149 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63451392}
I20260709 12:14:16.574818  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:16.592401  5598 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.591734  5596 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:16.580489  8039 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.551411  8612 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:16.578857  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.582592  5595 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:16.586333  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:16.585530  5601 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:16.564215  8584 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:16.566919  8567 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:16.591878  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 522) took 1453 ms. Trace:
I20260709 12:14:16.601377  6326 rpcz_store.cc:276] 0709 12:14:15.138514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.138637 (+   123us) service_pool.cc:224] Handling call
0709 12:14:16.591685 (+1453048us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b540024f4d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:16.591824 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89996672}
I20260709 12:14:16.576362  8610 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.577641  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:16.602766  5603 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:16.589470  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 156763us
I20260709 12:14:16.604493  6291 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:16.592156  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 1.53339e+06us
I20260709 12:14:16.577258  8627 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.580749  8484 consensus_queue.cc:1059] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:14:16.597450  5596 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:16.589745  8616 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.535876  8623 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.606706  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.610504  5601 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:16.612836  5599 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:16.551688  8624 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:16.612582  8616 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.595041  8531 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:14:16.592991  8630 consensus_queue.cc:237] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:16.627010  8594 consensus_meta.cc:287] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.800s	user 0.008s	sys 0.001s
I20260709 12:14:16.627326  8559 raft_consensus.cc:3055] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:16.627753  8559 raft_consensus.cc:740] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:16.625809  8617 consensus_queue.cc:1059] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:16.589774  8368 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:16.567454  8361 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:16.637006  5598 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:16.613111  8475 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:16.651084  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2045) took 3246 ms. Trace:
W20260709 12:14:16.643940  5570 connection.cc:256] RPC call timeout handler was delayed by -1.4120156430001316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
I20260709 12:14:16.663496  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.671320  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.651965  5600 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.678658  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.680162  5570 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:16.683349  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.685293  5603 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:16.686673  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:16.686863  5716 connection.cc:256] RPC call timeout handler was delayed by -1.534502522999901s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260709 12:14:16.687294  5603 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:16.688210  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.689919  6327 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:16.599030  8612 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:16.676993  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 100214us
W20260709 12:14:16.692062  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.676927  5602 rpcz_store.cc:276] 0709 12:14:13.404970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.868816 (+463846us) service_pool.cc:224] Handling call
0709 12:14:15.200392 (+1331576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.222273 (+ 21881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.650889 (+1428616us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54003cee50. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:16.651027 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3061594496}
I20260709 12:14:16.691468  5570 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:16.740293  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.733057  6293 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:16.723412  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.769500  5671 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:16.769402  5677 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:16.725193  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.770642  5674 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
W20260709 12:14:16.771512  5674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 513) took 1616 ms (client timeout 2038 ms). Trace:
I20260709 12:14:16.737715  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:16.771947  5674 rpcz_store.cc:269] 0709 12:14:15.154847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.724956 (+1570109us) service_pool.cc:224] Handling call
0709 12:14:16.771455 (+ 46499us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.718855  8619 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:16.721714  8584 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.739188  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:16.773456  8584 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:16.774793  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 56382.4us
I20260709 12:14:16.775583  8584 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:16.742520  5675 raft_consensus.cc:3055] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:16.776400  5675 raft_consensus.cc:740] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:16.776762  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.777154  5675 consensus_queue.cc:260] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:16.778147  5675 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.732003  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:16.779645  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 47713us
I20260709 12:14:16.766031  8267 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:16.781976  8414 consensus_queue.cc:1059] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:16.742066  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:16.708463  6324 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:16.784819  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.785460  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.608584  8039 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.706630  8294 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:16.723555  8353 raft_consensus.cc:3055] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:16.735773  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:16.798696  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 65700.5us
I20260709 12:14:16.800402  5748 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
W20260709 12:14:16.798519  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 194099us
I20260709 12:14:16.795903  5569 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:16.801431  6291 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:16.795349  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:16.803709  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.804412  5597 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:16.674477  8521 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.785782  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:16.814545  5642 leader_election.cc:400] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
I20260709 12:14:16.814889  5642 leader_election.cc:403] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:14:16.767334  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 75874.1us
I20260709 12:14:16.816116  6291 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:16.712576  8489 raft_consensus.cc:3055] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:16.651346  8600 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.627434  8594 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.786345  8484 raft_consensus.cc:3055] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:16.802448  5569 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:16.651196  8365 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:16.650672  8475 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:16.842198  8475 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.843370  8475 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:16.629323  8610 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:16.811093  5716 connection.cc:256] RPC call timeout handler was delayed by -1.0791025229998468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
I20260709 12:14:16.847342  5746 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:16.847675  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:16.628597  8559 consensus_queue.cc:260] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.806721  8353 raft_consensus.cc:740] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:16.786834  8612 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.820581  8545 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:16.834031  5598 raft_consensus.cc:2410] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:16.824174  8556 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:16.785712  8422 consensus_queue.cc:1059] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.156s
I20260709 12:14:16.831400  5642 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:16.837852  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.837970  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.839257  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.772307  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.851509  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:16.797902  8415 raft_consensus.cc:3055] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:16.854260  6293 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:16.875373  5672 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:16.829102  5600 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:16.811383  8552 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:16.880023  8328 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:16.855145  8624 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:16.859650  5746 raft_consensus.cc:1275] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:16.860215  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:16.885962  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.886547  5753 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:16.887408  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.867117  8639 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:16.863806  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:16.820309  8350 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:16.642300  8108 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.822463  8489 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:16.795810  8361 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:16.868821  5751 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:16.824819  8583 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:16.871143  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:16.796027  8414 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:14:16.849943  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:16.799034  8605 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:16.873587  8556 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:16.813867  8267 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:16.876569  5745 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:16.847067  8593 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6.
I20260709 12:14:16.835577  8484 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:16.876569  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.880301  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.886544  8552 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.866947  8608 raft_consensus.cc:697] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:16.869701  8365 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:16.863078  5675 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:14:17.003942  5675 pending_rounds.cc:85] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 5
I20260709 12:14:17.004191  5675 pending_rounds.cc:107] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:14:17.004429  5675 raft_consensus.cc:2889] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:16.892604  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:16.824267  8521 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:16.872798  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:16.878844  8415 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:16.890671  8363 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:16.839092  8600 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:16.872526  8653 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:14:16.907809  8353 consensus_queue.cc:260] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:16.910607  8641 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:14:16.869894  8294 consensus_queue.cc:1059] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:14:17.030547  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 228162us
I20260709 12:14:17.001853  8552 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.917182  8489 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:16.919312  8605 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:16.910998  8267 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.004266  8350 raft_consensus.cc:697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:16.875298  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 43994us
W20260709 12:14:16.968757  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.887514  8328 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:17.011525  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 194969us
W20260709 12:14:17.014551  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 143582us
I20260709 12:14:16.887382  8616 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.041662  5595 raft_consensus.cc:2410] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:16.916272  8556 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:17.016579  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:17.043942  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 179404us
I20260709 12:14:16.898787  8108 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.046558  5601 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
W20260709 12:14:17.047181  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.007638  8369 consensus_meta.cc:287] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.756s	user 0.015s	sys 0.000s
I20260709 12:14:16.921341  5672 raft_consensus.cc:2393] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:17.009729  8363 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.003793  8365 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.016742  8648 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:17.098456  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:17.060281  8328 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:17.102093  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:17.102593  8622 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:17.103149  8584 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:17.099997  8572 consensus_queue.cc:1059] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:14:17.106803  8545 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:17.108304  8649 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:17.109057  8608 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.111405  5716 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:17.108317  5674 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:17.051481  8267 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:17.029824  8583 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.042762  8588 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:17.122655  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.047609  8484 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.103605  8521 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:17.118258  8350 consensus_queue.cc:237] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.065138  8415 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.138386  5674 raft_consensus.cc:1240] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:17.338785  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 240390us
I20260709 12:14:17.215601  8610 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:17.163281  8470 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.220079  8616 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:17.332700  8361 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.178737  8414 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:17.354709  8361 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.355010  8414 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.356022  5677 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:17.356806  8361 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.130762  8363 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.194067  8531 raft_consensus.cc:3055] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:17.358444  8531 raft_consensus.cc:740] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:17.359244  8531 consensus_queue.cc:260] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.360241  8531 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.130964  8554 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.362895  8554 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.364404  6320 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:17.260215  8552 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.368364  8552 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.162629  8655 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.216s
I20260709 12:14:17.133733  8365 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.118652  8657 consensus_queue.cc:1059] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.271s
I20260709 12:14:17.373450  8657 raft_consensus.cc:3055] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:17.387398  8657 raft_consensus.cc:740] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:17.388365  8657 consensus_queue.cc:260] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.373889  8489 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.372612  8517 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.413368  8363 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.379961  8584 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:17.380849  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:17.421887  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:17.423055  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:17.423681  8639 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:17.356946  8414 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.424615  8414 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:17.425017  8414 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:17.425366  8414 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:17.426232  8657 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.433671  8363 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:17.341015  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.441881  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.442358  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.443404  8521 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.444000  8521 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.339619  5716 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:17.446393  8608 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:17.447916  8521 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:17.416152  8365 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.437531  8361 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:17.439049  8548 consensus_queue.cc:1059] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:17.232334  5675 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:17.450673  5602 raft_consensus.cc:2393] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:17.450743  8605 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:17.451315  8605 raft_consensus.cc:697] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:17.452090  8365 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.452248  8605 consensus_queue.cc:237] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:17.446512  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 106964us
I20260709 12:14:17.466485  5716 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:17.468480  5670 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:17.256069  8664 log.cc:927] Time spent T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:14:17.455112  8614 consensus_meta.cc:287] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.865s	user 0.014s	sys 0.000s
I20260709 12:14:17.137179  8594 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.351424  5674 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:17.479303  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:17.440416  8639 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.435443  8353 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:17.471485  8627 consensus_meta.cc:287] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.840s	user 0.004s	sys 0.007s
W20260709 12:14:17.492681  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 69698.2us
I20260709 12:14:17.495949  5675 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.484187  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:17.509090  6327 raft_consensus.cc:2393] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:17.509372  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:17.466926  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:17.513118  5676 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.519909  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:17.523399  5716 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:17.524359  5675 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:17.538219  5675 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:14:17.538575  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.543865  5675 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:17.507340  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 445484us
I20260709 12:14:17.537308  6293 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:17.448560  8583 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.587370  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:17.586948  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:17.591369  5603 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:17.587743  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:17.588640  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:17.480355  8415 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.262398  8612 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:17.609797  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.597666  5716 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:17.616676  6327 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:17.615272  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 78092.8us
I20260709 12:14:17.619877  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:17.620000  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:17.620625  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:17.620899  6328 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:17.621285  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:17.621826  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:17.622033  6325 raft_consensus.cc:1217] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 12:14:17.622524  6325 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:17.622829  6322 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:17.623169  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 113879us
I20260709 12:14:17.623523  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:17.624825  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:17.625134  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:17.625835  5752 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:17.626114  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:17.621345  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:17.626788  6321 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 4.
I20260709 12:14:17.548866  8655 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:17.628377  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:17.634073  6327 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:14:17.549996  8584 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:17.518277  8608 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:17.637319  6327 pending_rounds.cc:85] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 6
I20260709 12:14:17.590230  8470 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:17.637337  5752 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:17.640066  5570 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.013s	sys 0.024s
I20260709 12:14:17.493033  8614 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.613219  8531 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.609452  8648 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:17.655498  5570 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.013s	sys 0.024s
I20260709 12:14:17.656740  5749 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:14:17.672139  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 552973us
I20260709 12:14:17.658504  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:17.479880  8556 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.657080  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:17.664333  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:17.665941  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 527) took 1200 ms. Trace:
I20260709 12:14:17.593544  8572 consensus_queue.cc:1059] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:14:17.632439  8638 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:17.673678  5679 rpcz_store.cc:276] 0709 12:14:16.465633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.465879 (+   246us) service_pool.cc:224] Handling call
0709 12:14:16.466282 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.588853 (+122571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.588952 (+    99us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:16.591925 (+  2973us) log.cc:844] Serialized 26 byte log entry
0709 12:14:17.040542 (+448617us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:17.040588 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.040678 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.665687 (+625009us) raft_consensus.cc:1685] finished
0709 12:14:17.665707 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.665880 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2192,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":528247,"threads_started":2,"wal-append.queue_time_us":565653}
I20260709 12:14:17.677862  5676 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:17.679037  5674 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 12:14:17.626434  8651 consensus_queue.cc:1059] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:14:17.639037  6327 pending_rounds.cc:107] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 12:14:17.694778  6327 raft_consensus.cc:2917] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 12:14:17.683678  5747 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:17.683732  6291 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:17.695223  6327 raft_consensus.cc:2889] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 9 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:17.643191  8470 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:17.693379  5671 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:17.640583  8594 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.679924  8655 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.697995  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1901) took 1019 ms. Trace:
I20260709 12:14:17.709568  5601 rpcz_store.cc:276] 0709 12:14:16.663101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.663239 (+   138us) service_pool.cc:224] Handling call
0709 12:14:17.681959 (+1018720us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400434ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:17.682069 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848761088}
I20260709 12:14:17.682250  8521 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:17.707141  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 591) took 1212 ms. Trace:
I20260709 12:14:17.717021  6324 rpcz_store.cc:276] 0709 12:14:16.494278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.500631 (+  6353us) service_pool.cc:224] Handling call
0709 12:14:16.708249 (+207618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.784128 (+ 75879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.706895 (+922767us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400596ad0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:17.707059 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476722048}
I20260709 12:14:17.548645  8627 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.712286  5752 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
W20260709 12:14:17.710451  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 118067us
I20260709 12:14:17.720743  5645 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:17.700608  8593 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:17.697103  8659 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:17.703214  8470 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.697825  8638 raft_consensus.cc:697] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:17.703012  8572 raft_consensus.cc:3055] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:17.679679  8531 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.744769  5673 raft_consensus.cc:1240] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:17.684427  8578 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:14:17.721447  8521 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:17.750373  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 152816us
I20260709 12:14:17.738829  8438 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.728940  8552 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:17.754647  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 97371.3us
I20260709 12:14:17.741724  8588 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.742910  8572 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:17.746038  8659 raft_consensus.cc:697] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:17.758574  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 74908.1us
I20260709 12:14:17.758757  6293 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:17.761142  6291 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:17.763680  6291 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:17.764410  8683 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:17.764694  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:17.765004  8616 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:17.765288  5716 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:17.767138  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:17.754671  8552 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:17.768990  5672 raft_consensus.cc:2393] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 4: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:17.772320  8689 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:17.772464  5716 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:17.772797  8689 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.773183  8583 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.773949  8612 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:17.766698  8350 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:17.778661  8613 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.759650  8668 consensus_queue.cc:1059] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:14:17.780174  8521 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:17.782218  8671 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:14:17.782847  8328 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.766155  8369 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.762760  8655 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:14:17.785950  8556 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.753110  8438 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.786494  8572 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.787335  8627 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.771402  8638 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.831249  8572 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.832183  8438 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.790434  8614 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:17.792356  8584 raft_consensus.cc:697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:17.793303  8639 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:17.795460  8688 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.838605  8328 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:17.804390  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:17.839632  5752 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:17.805933  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:17.840612  5748 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:17.807890  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:17.841617  5749 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:17.808008  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:17.810173  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 89534.4us
I20260709 12:14:17.813066  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:17.842521  5746 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.843492  8639 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.843660  8415 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:17.844076  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:17.813069  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:17.797179  8414 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.781112  8659 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.808736  8675 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:17.809996  8353 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:17.829875  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:17.808957  8689 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:17.770383  8552 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.790319  8267 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.813144  8594 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.809419  8686 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:17.815904  8350 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:17.837093  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.822598  8613 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:17.843495  5645 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:17.850667  5746 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:17.851692  6291 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:17.821575  8554 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:17.855281  8675 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.859004  8613 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.860649  8531 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.861438  8613 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.863305  8267 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:17.864538  8350 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.866084  8554 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:17.869800  8583 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.870334  8583 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.853411  8353 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:17.875029  8627 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.878237  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:17.857645  8686 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:17.883761  5642 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:17.882165  8470 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.882109  8353 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:17.904582  8663 log.cc:927] Time spent T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.684s	user 0.014s	sys 0.011s
I20260709 12:14:17.858711  8688 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:14:17.915570  8470 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:17.916299  8594 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:17.883692  8415 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.930445  8678 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.931030  8678 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:17.933341  8678 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:17.884786  8692 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:17.883169  8686 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.946090  5642 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:17.945051  8552 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.948083  8639 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:17.887642  8694 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:14:17.938243  8415 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.951151  8552 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:17.949812  8353 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:17.952679  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.953153  8415 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:17.912423  8614 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:17.954600  8692 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.959029  8692 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.886495  8584 consensus_queue.cc:237] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:17.961577  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.962069  8614 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:17.962565  8614 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.964066  5716 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:17.965375  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:17.966313  5601 raft_consensus.cc:2410] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:17.968376  5716 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:17.969730  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:17.970310  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:17.970657  5601 raft_consensus.cc:2410] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:17.973872  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:17.974769  5603 raft_consensus.cc:2410] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:17.970921  5599 raft_consensus.cc:2376] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7. Re-sending same reply.
I20260709 12:14:17.982121  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:17.982592  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:17.982798  5603 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.972605  5716 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:17.985049  5716 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:17.954195  8583 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:18.021127  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 141416us
I20260709 12:14:17.956107  8678 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.032254  8328 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:18.032998  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:18.052007  5597 raft_consensus.cc:2410] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:14:18.034385  8696 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:14:18.023797  8612 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.023610  8655 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:18.070300  8559 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.078833  8655 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:18.079387  8655 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.967149  8368 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:18.038802  8695 log.cc:927] Time spent T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:14:18.042649  5601 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:14:18.098461  8368 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:18.100592  8368 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:18.104822  8627 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.105641  8484 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.105927  8614 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.047266  5599 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:18.107889  5599 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:14:17.991643  8647 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:18.058290  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 73318.4us
I20260709 12:14:18.110718  5716 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:18.111894  5716 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:18.112927  5716 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:18.113215  8689 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:18.113937  8612 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:18.114449  8612 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:18.115325  8689 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:18.115851  8612 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.058959  5603 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:18.061650  8414 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:18.065029  8619 raft_consensus.cc:3055] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:18.055166  8353 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:18.070158  8328 raft_consensus.cc:697] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:18.072046  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1903) took 1389 ms. Trace:
I20260709 12:14:18.074656  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2063) took 1524 ms. Trace:
I20260709 12:14:18.055590  8678 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:17.981163  8470 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:18.060891  8692 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.106289  8623 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:18.113646  8643 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.315s	user 0.006s	sys 0.012s
I20260709 12:14:18.063288  8593 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:18.042821  6291 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:18.133936  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 91206.3us
I20260709 12:14:18.119764  5716 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:18.109651  8647 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.121778  5595 rpcz_store.cc:276] 0709 12:14:16.682896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.683098 (+   202us) service_pool.cc:224] Handling call
0709 12:14:18.071844 (+1388746us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54002abf54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:18.071984 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821750528}
I20260709 12:14:18.113564  8289 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.124257  8328 consensus_queue.cc:237] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:18.121992  5604 rpcz_store.cc:276] 0709 12:14:16.550653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.579445 (+ 28792us) service_pool.cc:224] Handling call
0709 12:14:16.579744 (+   299us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:16.580100 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.580127 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:16.594054 (+ 13927us) log.cc:844] Serialized 52 byte log entry
0709 12:14:17.049280 (+455226us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:17.120559 (+ 71279us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.372398 (+251839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.372488 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.903966 (+531478us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:18.074364 (+170398us) raft_consensus.cc:1685] finished
0709 12:14:18.074449 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:18.074597 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6481,"prepare.queue_time_us":76203,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":7746,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":22266,"spinlock_wait_cycles":9794688,"thread_start_us":373134,"threads_started":1,"wal-append.queue_time_us":549683}
I20260709 12:14:18.141304  6291 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:18.108047  8614 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:18.120817  8651 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:18.104692  8600 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:18.143316  5716 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:18.151829  5716 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:18.152814  5716 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:18.120645  8619 raft_consensus.cc:740] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:18.149196  6291 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:18.140784  8593 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:18.156126  5602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2070) took 1374 ms (client timeout 1602 ms). Trace:
W20260709 12:14:18.156796  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.158959  5602 rpcz_store.cc:269] 0709 12:14:16.793470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.863537 (+ 70067us) service_pool.cc:224] Handling call
0709 12:14:18.155962 (+1292425us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54003e08d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:18.156080 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278669056}
I20260709 12:14:18.161244  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:18.162416  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:18.162528  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:18.140707  8647 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:18.163395  5675 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:18.163532  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:18.140069  8353 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.164637  5595 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:18.144989  8552 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.161041  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:18.161624  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:18.168541  5672 raft_consensus.cc:2393] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:18.168629  5670 raft_consensus.cc:2410] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:18.169328  5679 raft_consensus.cc:2410] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:18.170717  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:18.171087  5604 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:18.172047  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:18.172883  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:18.174147  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:18.174997  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:18.175758  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:18.176656  5570 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:18.179463  5604 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:14:18.180243  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:18.181567  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:18.182313  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:18.182394  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:18.183449  6319 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:18.184423  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:18.185307  6321 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:18.178344  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:18.186062  5672 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:18.186283  5679 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:18.155110  8689 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:18.187233  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1341) took 1747 ms. Trace:
I20260709 12:14:18.157632  8648 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:18.188086  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:18.155143  8470 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:18.190645  6319 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:14:18.158670  8651 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:18.148880  8616 consensus_queue.cc:1059] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:14:18.191140  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:18.189625  5678 rpcz_store.cc:276] 0709 12:14:16.439962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.441615 (+  1653us) service_pool.cc:224] Handling call
0709 12:14:16.441940 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.442309 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.442339 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:16.449959 (+  7620us) log.cc:844] Serialized 26 byte log entry
0709 12:14:16.581905 (+131946us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:16.581946 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.582013 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:18.112994 (+1530981us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:18.177426 (+ 64432us) raft_consensus.cc:1685] finished
0709 12:14:18.177449 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:18.187171 (+  9722us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5982,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":13799,"spinlock_wait_cycles":22077184,"thread_start_us":94449,"threads_started":1,"wal-append.queue_time_us":168945}
I20260709 12:14:18.194187  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:18.147884  8575 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:14:18.194092  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:18.193606  5604 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:18.195715  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:18.195866  5595 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:18.188257  8531 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.157510  8683 consensus_queue.cc:1059] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:14:18.189442  8689 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.244253  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:18.244308  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:18.241842  6326 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:18.245826  5595 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:18.246549  5604 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:18.251921  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:18.261138  8701 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 9 LEARNER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:18.188990  8511 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:14:18.187260  8691 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:14:18.268450  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:18.241933  8588 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:18.267938  5604 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:18.198572  8414 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:14:18.243830  8627 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.251415  8689 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.243678  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:18.265177  8289 raft_consensus.cc:3055] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:18.263880  8648 raft_consensus.cc:697] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:18.264999  8470 raft_consensus.cc:697] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:18.308015  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:18.318321  8673 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.318951  8673 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.283713  8588 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:18.308776  8368 consensus_queue.cc:1059] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 12:14:18.365197  8706 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:14:18.308948  8289 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:18.370673  8289 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.374176  5751 raft_consensus.cc:2410] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:18.242177  8619 consensus_queue.cc:260] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:18.315897  8686 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:18.408128  8572 consensus_meta.cc:287] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.007s
I20260709 12:14:18.292694  8627 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:18.486814  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:18.412125  8707 log.cc:927] Time spent T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:14:18.487413  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:18.492496  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:18.496459  5570 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:18.412029  8594 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.498812  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:18.501509  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:18.494138  8289 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.505951  6324 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:18.417888  8692 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:18.498407  8583 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:18.494356  8678 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:18.498906  8680 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:18.524425  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.494019  8415 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:14:18.486980  8593 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.546660  8683 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.459623  8648 consensus_queue.cc:237] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.570302  8655 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.502974  8594 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.571205  8686 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:18.571951  8715 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.572402  8593 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:18.543467  8680 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.575644  8627 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:18.576619  8588 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:18.577566  8614 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.586282  8673 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:18.595238  8647 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:18.597550  5750 raft_consensus.cc:3055] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:18.638351  5750 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:18.589061  8689 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:18.465924  8470 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.605659  8267 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.639165  5750 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.645299  5750 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:18.648406  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:18.650810  6323 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
W20260709 12:14:18.650971  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.637018  8717 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:18.652659  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:18.633901  8683 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.656819  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:18.661815  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 165414us
I20260709 12:14:18.663184  5570 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:18.643692  8588 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:18.668747  5750 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:18.670177  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:18.671775  5602 raft_consensus.cc:2393] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:18.641335  8614 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.685638  8614 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:18.673612  5598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1899) took 2012 ms (client timeout 1718 ms). Trace:
I20260709 12:14:18.635995  8715 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:18.646682  8267 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:18.675051  8692 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:18.675443  8109 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:14:18.677366  8719 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:18.666525  8583 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:14:18.658183  7944 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.682487  8594 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:18.683914  8689 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:18.687069  5595 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:18.656294  8593 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:18.706473  8267 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:18.707861  5718 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.042s	sys 0.079s
W20260709 12:14:18.708230  5718 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.043s	sys 0.080s
W20260709 12:14:18.708520  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 754984us
I20260709 12:14:18.709751  8655 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:18.711351  8680 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:18.707762  7944 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.714287  7944 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:18.689678  5598 rpcz_store.cc:269] 0709 12:14:16.661036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.678405 (+ 17369us) service_pool.cc:224] Handling call
0709 12:14:18.673428 (+1995023us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54003e1a54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:18.673549 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353485184}
I20260709 12:14:18.717273  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:18.691233  5642 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:18.651458  8673 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:14:18.700310  6328 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 12:14:18.702311  8723 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:14:18.672721  8511 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.660984  8627 consensus_queue.cc:1059] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:14:18.686335  8415 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:18.673022  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2004) took 1030 ms. Trace:
I20260709 12:14:18.715142  8556 raft_consensus.cc:3055] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:18.746454  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1416) took 1898 ms. Trace:
I20260709 12:14:18.746284  5750 rpcz_store.cc:276] 0709 12:14:17.642613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.642776 (+   163us) service_pool.cc:224] Handling call
0709 12:14:17.654714 (+ 11938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:18.597449 (+942735us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b54001057a0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9c2dc0 00007f44fda4d1c0 00007f44fda4e231 00007f44fda4ad8f 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c
0709 12:14:18.672257 (+ 74808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.672968 (+   711us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108146560}
I20260709 12:14:18.686908  8588 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:18.730494  8647 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:18.731844  8715 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:18.734843  5718 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:18.742130  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 50948us
I20260709 12:14:18.750622  8415 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.750682  8511 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.751739  8556 raft_consensus.cc:740] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:18.752123  8627 raft_consensus.cc:3055] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:18.748903  5744 rpcz_store.cc:276] 0709 12:14:16.848291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.856332 (+  8041us) service_pool.cc:224] Handling call
0709 12:14:16.856620 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:16.867286 (+ 10666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.867316 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:16.872285 (+  4969us) log.cc:844] Serialized 52 byte log entry
0709 12:14:18.635542 (+1763257us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b1800116a40. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:14:18.686301 (+ 50759us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:18.686344 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.686409 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:18.737254 (+ 50845us) raft_consensus.cc:1685] finished
0709 12:14:18.737269 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:18.746375 (+  9106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1013,"raft.queue_time_us":31851,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":9874,"spinlock_wait_cycles":21328640,"thread_start_us":50550,"threads_started":1,"wal-append.queue_time_us":1833344}
I20260709 12:14:18.756695  5718 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:18.760656  5598 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:14:18.762719  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.746387  8678 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:18.766292  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:18.761075  8415 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:18.767174  8556 consensus_queue.cc:260] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:18.768177  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:18.761219  8548 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:18.762280  8627 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:18.788779  8627 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:18.804623  5670 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:18.794402  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:18.809244  5672 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 5: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:18.778645  8647 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.125018  8328 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:18.981551  5570 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:19.138356  8613 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:19.138489  8328 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.095988  8267 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:18.986931  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.122334  8627 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.141774  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:19.142426  5602 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.986198  8721 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:19.143117  8531 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:19.142989  8721 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.143669  8531 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:19.144742  8531 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.145843  8531 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.146517  8328 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:19.155447  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 173956us
I20260709 12:14:18.813792  8556 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.145191  8721 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:19.122895  8683 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:19.147094  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1351) took 2100 ms. Trace:
I20260709 12:14:19.159730  5674 rpcz_store.cc:276] 0709 12:14:17.046837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.525630 (+478793us) service_pool.cc:224] Handling call
0709 12:14:17.678769 (+153139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:17.679445 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.146903 (+1467458us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400367750. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:19.147037 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351212288}
W20260709 12:14:19.023599  8703 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.832s	user 0.002s	sys 0.000s
I20260709 12:14:18.989262  8039 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:18.977828  8415 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:19.151242  8361 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:19.161928  8361 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.164198  8361 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:18.989892  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2068) took 2426 ms (client timeout 1828 ms). Trace:
W20260709 12:14:18.991626  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.166234  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:19.166551  5600 rpcz_store.cc:269] 0709 12:14:16.563466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.575689 (+ 12223us) service_pool.cc:224] Handling call
0709 12:14:18.989630 (+2413941us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b5400194954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:18.989785 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119168768}
I20260709 12:14:19.169250  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:19.136981  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 380317us
I20260709 12:14:19.169907  5601 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:19.142716  8353 raft_consensus.cc:3055] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:19.171098  8353 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:19.171299  5718 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:19.172035  8353 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:19.155064  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.172678  8617 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:19.172935  8647 consensus_queue.cc:1059] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:19.174077  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:18.927801  8710 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.261s	user 0.003s	sys 0.000s
W20260709 12:14:19.150537  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.141706  8267 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.179116  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:19.202309  5600 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:19.207098  5598 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:19.179821  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1426) took 1372 ms. Trace:
I20260709 12:14:19.180672  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2075) took 1015 ms. Trace:
I20260709 12:14:18.833022  5678 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:14:19.201853  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.208602  5603 rpcz_store.cc:276] 0709 12:14:18.165049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.165183 (+   134us) service_pool.cc:224] Handling call
0709 12:14:18.165488 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:18.173524 (+  8036us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:18.475955 (+302431us) log.cc:844] Serialized 14 byte log entry
0709 12:14:18.650683 (+174728us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:18.659107 (+  8424us) log.cc:844] Serialized 52 byte log entry
0709 12:14:18.659291 (+   184us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:18.659540 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 12:14:18.659697 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.659769 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:18.683094 (+ 23325us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b18000d7380. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:18.902661 (+219567us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b18000d7380. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:19.180475 (+277814us) raft_consensus.cc:1685] finished
0709 12:14:19.180496 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:19.180619 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27312,"prepare.queue_time_us":337877,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":24409,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":19567,"spinlock_wait_cycles":20549632,"thread_start_us":367209,"threads_started":2,"wal-append.queue_time_us":181642}
W20260709 12:14:19.125065  6291 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.566s (SENT) [suppressed 18 similar messages]
I20260709 12:14:19.182647  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:19.149379  5602 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:19.208546  5751 rpcz_store.cc:276] 0709 12:14:17.807357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.807485 (+   128us) service_pool.cc:224] Handling call
0709 12:14:19.179635 (+1372150us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54002297d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:19.179762 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215820160}
I20260709 12:14:18.990074  5597 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:18.965462  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1350) took 2184 ms. Trace:
I20260709 12:14:18.898756  8675 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:19.201881  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:19.218022  5674 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:19.208088  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:19.210927  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:19.188282  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:19.218772  5598 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:19.218962  5603 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:19.219072  5604 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:19.213099  5671 rpcz_store.cc:276] 0709 12:14:16.780650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.780778 (+   128us) service_pool.cc:224] Handling call
0709 12:14:16.781028 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.703885 (+922857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.965143 (+1261258us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b5400065254. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:18.965383 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097680128}
I20260709 12:14:19.220983  6320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 518) took 6268 ms. Trace:
I20260709 12:14:19.221725  6320 rpcz_store.cc:276] 0709 12:14:12.952296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.952439 (+   143us) service_pool.cc:224] Handling call
0709 12:14:12.967756 (+ 15317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.364779 (+4397023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.220759 (+1855980us) spinlock_profiling.cc:243] Waited 4.4 s on lock 0x7b540068f454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:19.220928 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10110497024}
I20260709 12:14:19.221652  5718 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:19.200150  8584 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:19.232084  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:19.231647  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:18.834380  8588 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:19.197026  8622 consensus_queue.cc:1059] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:14:19.262149  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:19.262629  5679 raft_consensus.cc:1240] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:19.227423  5600 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
W20260709 12:14:19.262862  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.264008  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:19.265257  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:19.266345  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:19.262914  5745 raft_consensus.cc:2393] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:19.268200  5645 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:19.269546  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:19.270227  6321 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 9 LEARNER]: Advancing to term 10
I20260709 12:14:19.222483  8353 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.233750  5601 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:19.212180  8328 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.231020  8701 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:14:19.236207  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:19.237118  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:19.283093  5677 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:19.237941  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:19.238499  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:19.239017  8675 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:19.239384  8617 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:19.288762  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:19.237857  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1913) took 1264 ms. Trace:
I20260709 12:14:19.239918  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:19.290457  5602 raft_consensus.cc:2393] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:19.207594  8683 consensus_queue.cc:1175] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a54957145d9647cb89f46531d107120c" responder_term: 6 status { last_received { term: 5 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:19.242837  8647 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:19.243130  8612 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.216130  8673 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:19.222533  8721 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.244136  8608 raft_consensus.cc:3055] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:19.244761  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.166320  8415 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:19.248896  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:19.260522  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:19.310568  5675 raft_consensus.cc:2393] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:19.261025  5746 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:19.261226  5747 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:19.272913  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:19.312503  5600 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:19.273669  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.313695  5752 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:19.275305  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:19.314858  5679 raft_consensus.cc:2410] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:14:19.238956  8365 raft_consensus.cc:3055] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:19.318607  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:19.319489  5679 raft_consensus.cc:2410] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:19.322956  5679 raft_consensus.cc:1240] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:19.289948  8328 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.258863  8584 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.283694  5645 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:19.284155  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.290920  5604 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:14:19.329500  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 45945.2us
I20260709 12:14:19.330545  5645 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:19.293337  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:19.293746  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:19.289433  5596 rpcz_store.cc:276] 0709 12:14:17.973711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.973840 (+   129us) service_pool.cc:224] Handling call
0709 12:14:17.974159 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:17.981222 (+  7063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:17.981256 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:17.981753 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:14:18.734170 (+752417us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b180045ba40. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:14:18.970250 (+236080us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:18.973313 (+  3063us) log.cc:844] Serialized 14 byte log entry
0709 12:14:18.973879 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.973953 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:19.237566 (+263613us) raft_consensus.cc:1685] finished
0709 12:14:19.237659 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:19.237801 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6629,"prepare.queue_time_us":2623,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":6935,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":33133,"spinlock_wait_cycles":8373120,"thread_start_us":235865,"threads_started":1,"wal-append.queue_time_us":1196565}
I20260709 12:14:19.305495  5744 raft_consensus.cc:2368] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10.
I20260709 12:14:19.315786  5670 raft_consensus.cc:2393] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:19.316154  8622 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:19.317344  5602 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: [8.6-9.7]
I20260709 12:14:19.281590  6321 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 LEARNER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:19.285502  8605 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.326159  5679 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:19.335175  5600 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
W20260709 12:14:19.233619  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.339819  5671 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:19.340541  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:19.340965  5671 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:19.341555  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:19.342344  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:19.343024  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:19.343803  5677 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:19.345044  5677 raft_consensus.cc:1275] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:14:19.346706  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.348253  5750 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4.
I20260709 12:14:19.354518  5679 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:19.304179  8608 raft_consensus.cc:740] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:19.352280  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:19.317931  8365 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:19.292883  8678 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:14:19.323868  8267 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:19.293735  8588 consensus_queue.cc:1059] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 12:14:19.360085  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 188462us
I20260709 12:14:19.360219  5676 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:19.359010  5670 raft_consensus.cc:1275] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:19.296692  8673 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.297521  8612 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.360353  5679 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:19.329509  8415 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:19.297336  8647 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.374192  5671 raft_consensus.cc:1240] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:19.306725  8721 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.365199  8605 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:19.390755  8734 log.cc:927] Time spent T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:14:19.406891  5749 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:19.407395  5675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:19.395740  8108 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:19.356904  8622 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.410104  5675 raft_consensus.cc:606] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:19.415081  5675 raft_consensus.cc:614] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:19.389297  8678 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:19.388299  8415 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.398262  8605 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.408315  8613 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:19.411255  8675 raft_consensus.cc:3055] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:19.429857  8108 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.430090  8415 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.468314  5602 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:19.468875  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 230440us
I20260709 12:14:19.447500  8605 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:19.412416  8573 consensus_queue.cc:1059] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:14:19.490085  5672 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
W20260709 12:14:19.493896  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 368842us
I20260709 12:14:19.466332  8675 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:19.396484  8608 consensus_queue.cc:260] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:19.499619  8613 raft_consensus.cc:1064] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:14:19.501962  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:19.502547  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:19.509589  5751 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:19.430226  8365 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:19.506623  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 159629us
W20260709 12:14:19.491716  8737 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:14:19.502718  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.521884  5750 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:19.525105  5748 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:19.526599  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1344) took 2804 ms. Trace:
I20260709 12:14:19.527068  5673 rpcz_store.cc:276] 0709 12:14:16.722448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.722562 (+   114us) service_pool.cc:224] Handling call
0709 12:14:16.722879 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.745289 (+1022410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.526352 (+1781063us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001e4454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:19.526533 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349598976}
I20260709 12:14:19.531253  5751 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:19.536271  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.482288  8108 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:19.537608  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.541466  5750 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:19.543097  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:19.543720  5747 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.542681  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.519680  8573 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:19.546721  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 216229us
I20260709 12:14:19.549470  8584 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:19.550012  8584 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:19.543556  8744 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.554198  8744 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.555315  8108 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:19.556269  8744 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:19.555923  8675 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.556833  8744 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:19.557286  8675 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:19.538582  8608 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.561134  5718 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:19.562211  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:19.562808  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 45249.9us
I20260709 12:14:19.566416  5747 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:19.568827  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.576074  5750 raft_consensus.cc:2393] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:19.577065  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.578742  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:19.581013  8605 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.582135  8744 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.582654  8744 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:19.539849  8365 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:19.516872  8521 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 12:14:19.584046  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.582978  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:19.685374  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:19.599972  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.690335  5747 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.691690  5748 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:19.550454  8584 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.689589  5750 raft_consensus.cc:2393] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:19.699725  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:19.683111  8737 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:14:19.702281  5750 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:19.658445  8647 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:19.657979  8673 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:19.749541  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:19.732277  8531 consensus_meta.cc:287] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.586s	user 0.005s	sys 0.005s
I20260709 12:14:19.697800  8748 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.685029  8721 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:19.749249  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.747972  5747 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:19.701093  8617 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:19.753289  8622 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:19.682574  8108 consensus_queue.cc:1059] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:14:19.776453  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.760025  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.573086  8573 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:19.777993  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:19.762622  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 201551us
W20260709 12:14:19.764432  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 65126.1us
I20260709 12:14:19.773814  5748 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:19.775008  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 217006us
I20260709 12:14:19.780759  5718 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:19.786098  5716 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:19.787909  5716 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:19.788694  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.789531  5752 raft_consensus.cc:2393] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:19.787817  5750 raft_consensus.cc:2410] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:19.703833  8517 consensus_queue.cc:1059] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 12:14:19.813416  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 243803us
I20260709 12:14:19.753826  8647 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.841622  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.846275  8749 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.774184  8751 raft_consensus.cc:3055] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:19.846997  8751 raft_consensus.cc:740] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:19.741945  8623 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:14:19.847774  8622 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.848467  8622 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:19.849120  8617 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:19.849637  8617 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.850062  8617 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:19.774376  8748 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:19.842571  8531 consensus_queue.cc:1059] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:14:19.842396  8521 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:14:19.846511  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.853960  5748 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:19.855638  8573 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:19.843379  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:19.856395  6321 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:19.845007  6326 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 LEARNER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:14:19.858206  5747 raft_consensus.cc:2410] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:19.741007  8039 consensus_queue.cc:1059] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 12:14:19.846482  8741 log.cc:927] Time spent T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:14:19.861195  8415 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:19.924428  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.960390  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:19.887509  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 106807us
I20260709 12:14:20.025044  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2087) took 1830 ms. Trace:
I20260709 12:14:19.958707  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:20.026211  5595 rpcz_store.cc:276] 0709 12:14:18.194937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.259215 (+ 64278us) service_pool.cc:224] Handling call
0709 12:14:18.673554 (+414339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:18.706083 (+ 32529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.024808 (+1318725us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54003e1a50. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:20.024975 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951997312}
I20260709 12:14:19.976261  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:20.026296  5718 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:19.958304  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:20.001518  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 213656us
I20260709 12:14:20.028930  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:19.958985  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:20.031708  6326 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:19.959344  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:19.974399  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:19.849747  8759 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.862881  8584 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:20.034857  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:20.035660  6326 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:19.934021  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:20.031847  6320 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
W20260709 12:14:19.955173  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 155645us
W20260709 12:14:20.044073  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:20.064066  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 328327us
W20260709 12:14:20.078748  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.080003  6320 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:20.034888  8759 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:20.039428  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:19.975927  8511 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:19.974957  8531 raft_consensus.cc:3055] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:14:20.114482  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 77637.4us
I20260709 12:14:20.086002  8475 raft_consensus.cc:3055] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:20.089062  8605 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:20.031883  8744 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:20.121500  5674 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:20.089599  8619 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:20.091552  5744 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:20.065598  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:20.044574  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:20.130446  5746 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:20.043587  8328 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:20.110430  5678 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:20.112705  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:20.116092  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.038827  8683 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:20.118242  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:19.898377  8647 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:20.083662  8353 consensus_meta.cc:287] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.797s	user 0.004s	sys 0.006s
I20260709 12:14:19.898664  8749 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:20.131248  8109 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:20.138939  6293 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:19.905427  8617 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:20.112097  8039 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:19.945698  8751 consensus_queue.cc:260] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:20.102784  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:20.747438  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2108) took 1532 ms. Trace:
I20260709 12:14:20.807085  5602 rpcz_store.cc:276] 0709 12:14:19.214893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.337753 (+122860us) service_pool.cc:224] Handling call
0709 12:14:19.362911 (+ 25158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:19.470964 (+108053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.746897 (+1275933us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540008c5d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:20.747244 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241925504}
I20260709 12:14:20.790548  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 401) took 1530 ms. Trace:
I20260709 12:14:20.744524  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1915) took 2769 ms. Trace:
W20260709 12:14:20.795347  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 645373us
I20260709 12:14:20.817399  5598 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.817978  5719 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:20.144667  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:20.113981  8622 raft_consensus.cc:697] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:20.821238  8723 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.774746  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:20.822325  8723 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:20.822866  8622 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:20.114279  8531 raft_consensus.cc:740] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:20.827950  8531 consensus_queue.cc:260] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:20.794147  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 767914us
I20260709 12:14:20.774199  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:20.773445  5750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.004s
W20260709 12:14:20.833739  5750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.006s	sys 0.011s
I20260709 12:14:20.835194  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 413) took 1296 ms. Trace:
I20260709 12:14:20.835366  5753 raft_consensus.cc:2393] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:20.835821  8752 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.836736  8752 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:20.153875  8762 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.840564  8762 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:20.841883  6320 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:20.131717  8722 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.843677  8722 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:20.323451  8748 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:20.784866  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2009) took 1283 ms. Trace:
W20260709 12:14:20.826237  5569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.011s	sys 0.003s
I20260709 12:14:20.863155  5598 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:20.855963  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1433) took 1315 ms. Trace:
I20260709 12:14:20.815109  5749 rpcz_store.cc:276] 0709 12:14:19.259530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.259638 (+   108us) service_pool.cc:224] Handling call
0709 12:14:19.259912 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:19.409828 (+149916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.789892 (+1380064us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400257e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:20.790301 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337202560}
W20260709 12:14:20.879904  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:20.881083  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.881539  8759 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:20.882436  8759 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:20.882756  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:20.883867  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.884946  8715 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.883440  8108 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.885905  8722 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:20.883347  8759 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:20.886096  8108 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:20.825574  8723 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:20.880275  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2035) took 1030 ms. Trace:
I20260709 12:14:20.815753  5597 rpcz_store.cc:276] 0709 12:14:17.974926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.066394 (+ 91468us) service_pool.cc:224] Handling call
0709 12:14:18.989806 (+923412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:19.212766 (+222960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.743954 (+1531188us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b5400194950. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:20.744271 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122516864}
I20260709 12:14:20.889001  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:20.899063  5601 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 12:14:20.900204  5601 pending_rounds.cc:85] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 8
I20260709 12:14:20.890866  8715 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:20.891919  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.760329  5678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:20.855259  8748 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:20.875748  5747 rpcz_store.cc:276] 0709 12:14:19.539936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.787877 (+1247941us) service_pool.cc:224] Handling call
0709 12:14:20.854662 (+ 66785us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:20.855081 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.855487 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.855509 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:20.855565 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:20.855599 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.855650 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:20.855766 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35126016}
I20260709 12:14:20.857336  8752 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:20.899032  8108 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:20.899643  5753 rpcz_store.cc:276] 0709 12:14:19.849514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.139644 (+290130us) service_pool.cc:224] Handling call
0709 12:14:20.880042 (+740398us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b54001e6c54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:20.880209 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7585536}
W20260709 12:14:20.890412  5569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.011s	sys 0.007s
I20260709 12:14:20.900437  5600 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 5: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:20.850596  8762 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:20.848431  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:20.886873  8531 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:20.885183  8749 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:20.900501  5601 pending_rounds.cc:107] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 12:14:20.182193  8353 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.930891  5601 raft_consensus.cc:2889] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:20.119807  8475 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:20.855743  5744 rpcz_store.cc:276] 0709 12:14:19.501496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.501642 (+   146us) service_pool.cc:224] Handling call
0709 12:14:20.784408 (+1282766us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400011b54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:20.784646 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673083648}
I20260709 12:14:20.900750  5498 catalog_manager.cc:5697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 5, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 5 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:14:20.928764  5676 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.000s	sys 0.009s
I20260709 12:14:20.932832  8647 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:20.184037  8612 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:20.933706  5744 raft_consensus.cc:1240] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:20.901588  8751 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:20.937425  8613 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:20.938091  5498 catalog_manager.cc:5697] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 5, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 5 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:14:20.939577  8759 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:20.940016  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2021) took 1382 ms. Trace:
I20260709 12:14:20.940423  5744 rpcz_store.cc:276] 0709 12:14:19.555385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.932733 (+1377348us) service_pool.cc:224] Handling call
0709 12:14:20.933311 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.937187 (+  3876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.937443 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.941936  5678 raft_consensus.cc:606] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:20.933969  8475 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:20.942953  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 803913us
I20260709 12:14:20.943928  8475 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.460335  8368 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.942447  5678 raft_consensus.cc:614] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:20.945884  8368 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:20.946326  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:20.389917  8721 raft_consensus.cc:3055] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:20.947731  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:20.870151  5750 rpcz_store.cc:276] 0709 12:14:19.538617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.916336 (+377719us) service_pool.cc:224] Handling call
0709 12:14:19.916688 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:19.916925 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:20.239570 (+322645us) log.cc:844] Serialized 14 byte log entry
0709 12:14:20.834503 (+594933us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:20.834617 (+   114us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:20.834732 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.834855 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:20.835117 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52231,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":232,"thread_start_us":916613,"threads_started":2}
I20260709 12:14:20.936105  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:20.935118  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.391891  8600 raft_consensus.cc:3055] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:20.954298  8108 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:20.954627  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 78870.6us
I20260709 12:14:20.276747  8678 raft_consensus.cc:3055] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:20.954975  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:20.955443  8678 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:20.939886  5498 catalog_manager.cc:5697] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 5, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 5 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:14:20.956560  8514 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:20.957187  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:20.151908  8683 raft_consensus.cc:697] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:20.937475  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:20.957212  5602 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
W20260709 12:14:20.961988  5676 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.001s	sys 0.010s
I20260709 12:14:20.963016  8600 raft_consensus.cc:740] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:20.934953  8619 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:20.880106  8517 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:20.967940  8108 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:20.972684  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:20.974629  5600 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:20.975320  8353 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:20.975701  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:20.149392  8761 consensus_queue.cc:1059] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.829s
I20260709 12:14:20.977522  8600 consensus_queue.cc:260] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:20.947803  8721 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:14:20.967871  5751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1431) took 1430 ms (client timeout 1815 ms). Trace:
I20260709 12:14:20.980646  5678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:20.972126  5498 catalog_manager.cc:5697] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:14:20.983155  5678 raft_consensus.cc:606] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:20.983682  5678 raft_consensus.cc:614] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:20.936285  5569 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:20.974160  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:20.974221  8683 consensus_queue.cc:237] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:20.981048  5751 rpcz_store.cc:269] 0709 12:14:19.537100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.216889 (+679789us) service_pool.cc:224] Handling call
0709 12:14:20.967777 (+750888us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4352}
W20260709 12:14:20.994246  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 50263.6us
I20260709 12:14:20.998770  5598 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:20.961623  8514 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:21.006518  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:20.977727  8353 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:21.005522  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 109409us
I20260709 12:14:21.017313  5750 raft_consensus.cc:1275] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:21.018123  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1435) took 1461 ms. Trace:
I20260709 12:14:21.018493  5750 rpcz_store.cc:276] 0709 12:14:19.556901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.969205 (+1412304us) service_pool.cc:224] Handling call
0709 12:14:21.016829 (+ 47624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.017826 (+   997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.018040 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:21.012926  5752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.007s	sys 0.002s
I20260709 12:14:20.979341  8039 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.024168  8517 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.025300  8039 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:21.000553  8619 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.026553  8721 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.027681  8619 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:21.027880  8721 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.030197  8715 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:21.031450  8368 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.032908  5751 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:21.033679  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2029) took 1474 ms. Trace:
I20260709 12:14:21.034082  5751 rpcz_store.cc:276] 0709 12:14:19.559249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.014642 (+1455393us) service_pool.cc:224] Handling call
0709 12:14:21.032390 (+ 17748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.033339 (+   949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.033574 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:21.003507  8748 raft_consensus.cc:697] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:21.037468  8748 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.038205  5748 raft_consensus.cc:1275] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:14:21.035949  8108 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.022373  5602 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:21.010632  8514 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:21.020251  5645 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:21.048570  8778 consensus_queue.cc:1059] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:14:21.051304  6319 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:21.051893  5567 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:20.957223  8678 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.058312  8678 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:21.062294  8776 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.004s
I20260709 12:14:21.065192  8617 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:21.039067  5748 pending_rounds.cc:85] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 4
I20260709 12:14:21.025866  8415 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:21.054787  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 101957us
I20260709 12:14:21.075856  8521 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:21.076649  8521 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.077970  8415 consensus_queue.cc:1059] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:21.079080  8521 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:21.056807  8759 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:21.080018  8759 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.057271  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:21.080235  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 71086.5us
I20260709 12:14:21.080744  5745 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:21.080523  8752 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:21.081069  8749 raft_consensus.cc:3055] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:21.081489  8749 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:21.082588  8749 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.079027  8415 raft_consensus.cc:3055] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:21.083516  8415 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:21.084084  8749 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.057575  5597 raft_consensus.cc:2410] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:21.066421  5498 catalog_manager.cc:5697] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:21.000907  8647 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.069123  5749 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:14:21.071499  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 135459us
I20260709 12:14:21.072510  5748 pending_rounds.cc:107] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:14:21.074494  6326 raft_consensus.cc:1240] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:21.090632  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2032) took 1349 ms. Trace:
I20260709 12:14:21.092753  5748 raft_consensus.cc:2889] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:21.093072  5749 rpcz_store.cc:276] 0709 12:14:19.741235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.009424 (+1268189us) service_pool.cc:224] Handling call
0709 12:14:21.056018 (+ 46594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.090310 (+ 34292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.090568 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:21.095458  5745 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:21.096244  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2038) took 1245 ms. Trace:
I20260709 12:14:21.026506  8517 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:21.084909  8415 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:21.090669  8521 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.098814  8623 raft_consensus.cc:3055] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:21.105222  8623 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:21.105741  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2031) took 1410 ms. Trace:
I20260709 12:14:21.098671  8363 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:21.099721  8647 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.106225  5753 rpcz_store.cc:276] 0709 12:14:19.695425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.005697 (+1310272us) service_pool.cc:224] Handling call
0709 12:14:21.055623 (+ 49926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.104933 (+ 49310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.105314 (+   381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:21.105371 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:21.105442 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.105518 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.105660 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46168}
I20260709 12:14:21.107575  8761 raft_consensus.cc:3055] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:21.107970  8761 raft_consensus.cc:740] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:21.108489  8647 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.109396  5567 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.085932  8600 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:21.090829  8108 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:21.031672  8762 raft_consensus.cc:670] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } [suppressed 4 similar messages]
I20260709 12:14:21.101987  5751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:14:21.106344  8623 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.113833  8109 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.117851  8363 consensus_queue.cc:1059] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:14:21.120692  8774 log.cc:927] Time spent T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:14:21.090363  8759 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:21.108963  8761 consensus_queue.cc:260] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.097581  5745 rpcz_store.cc:276] 0709 12:14:19.850447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.786484 (+936037us) service_pool.cc:224] Handling call
0709 12:14:21.047100 (+260616us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:21.096184 (+ 49084us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38133120}
I20260709 12:14:21.123795  5751 raft_consensus.cc:606] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:21.135218  5751 raft_consensus.cc:614] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:21.122961  8108 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.128744  5603 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:21.137144  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1434) took 1592 ms. Trace:
I20260709 12:14:21.137632  5748 rpcz_store.cc:276] 0709 12:14:19.548290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.789110 (+1240820us) service_pool.cc:224] Handling call
0709 12:14:20.925231 (+136121us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:20.959040 (+ 33809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.134283 (+175243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.137066 (+  2783us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32549760}
I20260709 12:14:21.134357  8109 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.146584  5746 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:21.138818  8108 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.141333  8517 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:21.148159  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2016) took 1600 ms. Trace:
I20260709 12:14:21.148849  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.151098  5746 rpcz_store.cc:276] 0709 12:14:19.547936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.823403 (+1275467us) service_pool.cc:224] Handling call
0709 12:14:21.095278 (+271875us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:21.130414 (+ 35136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.147889 (+ 17475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.148100 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59320576}
I20260709 12:14:21.155128  5678 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:21.139268  5498 catalog_manager.cc:5697] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 4, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 4 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.163650  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.159890  8415 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:21.230382  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 276396us
I20260709 12:14:21.232052  5642 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:14:21.232978  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 400166us
I20260709 12:14:21.245051  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2014) took 1707 ms. Trace:
I20260709 12:14:21.233034  8715 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.246735  8517 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:21.270596  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 453002us
I20260709 12:14:21.270339  8715 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.274228  8752 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:21.274669  8752 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.274020  5498 catalog_manager.cc:5697] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 7, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 7 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:21.275017  8752 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.276217  5498 catalog_manager.cc:5697] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 5, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 5 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:21.274065  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 126503us
W20260709 12:14:21.264271  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 148447us
I20260709 12:14:21.273456  8715 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:21.274163  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.251979  5752 rpcz_store.cc:276] 0709 12:14:19.537315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.839468 (+302153us) service_pool.cc:224] Handling call
0709 12:14:19.839897 (+   429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:20.038143 (+198246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.038172 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:20.082139 (+ 43967us) log.cc:844] Serialized 52 byte log entry
0709 12:14:20.333322 (+251183us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b1800364600. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:14:21.058682 (+725360us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:21.126597 (+ 67915us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:21.220904 (+ 94307us) log.cc:844] Serialized 14 byte log entry
0709 12:14:21.221196 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.237161 (+ 15965us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.237202 (+    41us) raft_consensus.cc:1685] finished
0709 12:14:21.237213 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.244970 (+  7757us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89705,"prepare.queue_time_us":162091,"prepare.run_wall_time_us":53,"raft.queue_time_us":32594,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":20542,"spinlock_wait_cycles":54380416,"thread_start_us":848599,"threads_started":2,"wal-append.queue_time_us":1021869}
I20260709 12:14:21.337908  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.338956  5678 raft_consensus.cc:2410] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:21.339134  5567 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.342542  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.344740  5567 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.345685  8715 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:21.346117  8715 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.345574  8619 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.346572  8715 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.347719  8761 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.354328  5498 catalog_manager.cc:5697] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 7, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 7 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.355911  5567 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.356285  5498 catalog_manager.cc:5697] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 3, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 3 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:21.360136  8619 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:21.360587  8619 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.360997  8619 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.362107  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 559) took 1253 ms. Trace:
I20260709 12:14:21.362499  5676 rpcz_store.cc:276] 0709 12:14:20.108465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.110360 (+  1895us) service_pool.cc:224] Handling call
0709 12:14:20.110640 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.110841 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:20.971896 (+861055us) log.cc:844] Serialized 14 byte log entry
0709 12:14:21.267246 (+295350us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:21.280035 (+ 12789us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:21.323588 (+ 43553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.361874 (+ 38286us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.362021 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1923,"prepare.queue_time_us":1002796,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":13884,"thread_start_us":1110793,"threads_started":2,"wal-append.queue_time_us":283816}
I20260709 12:14:21.365165  5567 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:21.371515  8619 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.374075  8784 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:21.375669  5567 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:21.377230  8715 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:21.377944  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 53982.7us
W20260709 12:14:21.381302  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 57432.5us
W20260709 12:14:21.381982  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.382299  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.382558  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.386307  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 154383us
I20260709 12:14:21.390673  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.391031  8723 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.392004  5673 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:21.392995  8759 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.386094  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.386518  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:21.391652  8723 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.386871  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.396405  5602 raft_consensus.cc:2410] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:14:21.387102  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:21.399380  5677 raft_consensus.cc:606] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:21.399729  5677 raft_consensus.cc:614] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:21.385874  8784 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:21.411680  5673 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:21.413189  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.414183  5671 raft_consensus.cc:2393] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:21.415066  8475 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.415771  8475 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.416143  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.418022  8475 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:21.418756  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:21.419466  5670 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:21.419672  8475 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.420466  8475 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.422082  8788 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.422490  8475 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.422713  8788 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.423674  5751 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:21.415321  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.426008  5751 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:21.431140  5498 catalog_manager.cc:5697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 4, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 4 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:21.435866  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.436728  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2018) took 1882 ms. Trace:
I20260709 12:14:21.385712  8762 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:14:21.442364  8109 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.443255  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.444388  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.445111  5678 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:21.455127  5599 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:21.454245  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:21.445935  8772 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.447423  5600 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:21.448441  5601 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:21.448710  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.449365  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.441085  8619 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.450336  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.450524  8723 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:21.447539  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.447494  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.454178  5674 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:21.454826  5597 raft_consensus.cc:2393] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:21.461038  5679 raft_consensus.cc:2410] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:21.400938  8778 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.463020  5670 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
W20260709 12:14:21.440791  8751 consensus_meta.cc:287] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.000s
I20260709 12:14:21.464711  5603 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:21.463927  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.437145  5747 rpcz_store.cc:276] 0709 12:14:19.554458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.933670 (+1379212us) service_pool.cc:224] Handling call
0709 12:14:20.934219 (+   549us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:21.006073 (+ 71854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.006108 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:21.050039 (+ 43931us) log.cc:844] Serialized 52 byte log entry
0709 12:14:21.221650 (+171611us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:21.429072 (+207422us) log.cc:844] Serialized 14 byte log entry
0709 12:14:21.435868 (+  6796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.436513 (+   645us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.436551 (+    38us) raft_consensus.cc:1685] finished
0709 12:14:21.436561 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.436675 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116498,"prepare.queue_time_us":24453,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":5296,"raft.queue_time_us":77529,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":9138,"thread_start_us":366510,"threads_started":2,"wal-append.queue_time_us":159902}
I20260709 12:14:21.461498  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:21.470405  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.473740  5677 raft_consensus.cc:2410] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:14:21.471243  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:21.468464  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:21.477321  8781 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.365s	user 0.002s	sys 0.000s
W20260709 12:14:21.477752  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 144704us
I20260709 12:14:21.439435  8784 raft_consensus.cc:697] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:21.481848  5498 catalog_manager.cc:5697] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 5, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 5 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.484661  5567 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.499467  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.490751  8109 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.503545  8109 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.503387  5498 catalog_manager.cc:5697] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:21.504737  8752 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.505885  8109 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.502993  5673 raft_consensus.cc:2393] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:21.503993  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 406) took 1391 ms. Trace:
I20260709 12:14:21.502971  6319 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:21.506987  8752 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:21.507742  5672 raft_consensus.cc:1240] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:21.505508  5498 catalog_manager.cc:5697] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 4, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 4 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.508723  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.506719  5595 rpcz_store.cc:276] 0709 12:14:20.112683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.113186 (+   503us) service_pool.cc:224] Handling call
0709 12:14:20.113452 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:20.881719 (+768267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.881808 (+    89us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:21.067600 (+185792us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b2c00057948. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fc344a11 00007f44fc354372 00007f44fda86a01 00007f44fda4b43a 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2
0709 12:14:21.068133 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.224065 (+155932us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:21.404702 (+180637us) log.cc:844] Serialized 14 byte log entry
0709 12:14:21.404965 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.503582 (+ 98617us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54002ff154. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:21.503633 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.503681 (+    48us) raft_consensus.cc:1685] finished
0709 12:14:21.503692 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.503837 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36392,"prepare.queue_time_us":5583,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":37092,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":22394,"spinlock_wait_cycles":1739006720,"thread_start_us":332018,"threads_started":2,"wal-append.queue_time_us":155885}
I20260709 12:14:21.509227  5671 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
W20260709 12:14:21.509902  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.524341  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.524792  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.489634  8723 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:21.531787  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 552) took 1197 ms. Trace:
I20260709 12:14:21.482308  8788 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.532505  8475 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.532796  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.532208  6328 rpcz_store.cc:276] 0709 12:14:20.334549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.334783 (+   234us) service_pool.cc:224] Handling call
0709 12:14:21.105290 (+770507us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:21.105592 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:21.106213 (+   621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.106241 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:21.106844 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.323461 (+216617us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:21.332165 (+  8704us) log.cc:844] Serialized 14 byte log entry
0709 12:14:21.433018 (+100853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.433093 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.531367 (+ 98274us) raft_consensus.cc:1685] finished
0709 12:14:21.531465 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.531599 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32094,"prepare.queue_time_us":8437,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":54,"raft.queue_time_us":48696,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":231,"spinlock_wait_cycles":142047488,"thread_start_us":271077,"threads_started":2,"wal-append.queue_time_us":329177}
I20260709 12:14:21.534584  8691 raft_consensus.cc:3055] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:21.535014  8691 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:21.535956  8691 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.524577  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.538455  5602 raft_consensus.cc:2410] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:14:21.538590  8769 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.424s	user 0.000s	sys 0.002s
I20260709 12:14:21.528470  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:21.539630  6319 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:21.541808  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 403) took 1440 ms. Trace:
I20260709 12:14:21.542203  5604 rpcz_store.cc:276] 0709 12:14:20.101259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.101870 (+   611us) service_pool.cc:224] Handling call
0709 12:14:20.102241 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:21.260906 (+1158665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.260951 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:21.261607 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.427011 (+165404us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:21.442483 (+ 15472us) log.cc:844] Serialized 14 byte log entry
0709 12:14:21.442667 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.442763 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.541491 (+ 98728us) raft_consensus.cc:1685] finished
0709 12:14:21.541507 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.541639 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":714313,"prepare.queue_time_us":15511,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":715698,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":334,"spinlock_wait_cycles":33152,"thread_start_us":586193,"threads_started":2,"wal-append.queue_time_us":209962}
I20260709 12:14:21.544482  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.545387  5670 raft_consensus.cc:2410] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:21.547113  8623 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.548233  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:21.548602  8778 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.530030  8514 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.550736  5675 raft_consensus.cc:1240] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:21.552302  8475 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.554299  8715 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.554590  8475 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:21.555315  8759 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.556944  8784 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.561978  8517 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.562315  8514 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:21.562765  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 88137.1us
I20260709 12:14:21.563627  5567 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.564951  5567 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:21.565351  6319 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:21.550808  8778 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:21.569303  8531 consensus_meta.cc:287] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 12:14:21.572954  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:21.573714  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:21.574460  5679 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:21.530136  8779 log.cc:927] Time spent T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.399s	user 0.002s	sys 0.002s
I20260709 12:14:21.577672  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.579152  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 401) took 1478 ms. Trace:
I20260709 12:14:21.565615  8619 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:21.549876  8751 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.586795  8751 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.588660  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.589123  8751 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.589444  5673 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:21.590600  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:21.591045  8678 consensus_meta.cc:287] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.001s
I20260709 12:14:21.591212  5673 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:21.592253  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.593290  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.544137  8772 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.581400  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2040) took 1730 ms. Trace:
I20260709 12:14:21.594208  5718 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.594338  5599 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:21.537250  8691 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.614255  5744 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:21.594761  5750 rpcz_store.cc:276] 0709 12:14:19.850993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.019329 (+1168336us) service_pool.cc:224] Handling call
0709 12:14:21.019739 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:21.090180 (+ 70441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.090209 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:21.135278 (+ 45069us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.403321 (+268043us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:21.403373 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.403441 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.581245 (+177804us) raft_consensus.cc:1685] finished
0709 12:14:21.581257 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.581358 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11987,"raft.queue_time_us":69912,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2809,"thread_start_us":246863,"threads_started":1,"wal-append.queue_time_us":363418}
I20260709 12:14:21.612221  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:21.613422  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.619663  6326 raft_consensus.cc:1240] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:21.617396  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.623165  5675 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
W20260709 12:14:21.624044  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 174761us
W20260709 12:14:21.624543  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 93530.9us
I20260709 12:14:21.625560  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.579527  5596 rpcz_store.cc:276] 0709 12:14:20.100642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.103621 (+  2979us) service_pool.cc:224] Handling call
0709 12:14:20.104039 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:20.816670 (+712631us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:20.816733 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:20.877867 (+ 61134us) log.cc:844] Serialized 26 byte log entry
0709 12:14:20.928437 (+ 50570us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:20.928480 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.960061 (+ 31581us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.529363 (+569302us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:21.578765 (+ 49402us) raft_consensus.cc:1685] finished
0709 12:14:21.578785 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.578973 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":709341,"raft.queue_time_us":713249,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":390,"spinlock_wait_cycles":9461376,"thread_start_us":48755,"threads_started":1,"wal-append.queue_time_us":175838}
I20260709 12:14:21.631346  5679 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:21.632216  5677 raft_consensus.cc:1240] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:21.565239  8108 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.634677  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.635589  5716 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:21.621539  5498 catalog_manager.cc:5697] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 2 to 3, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 3 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:21.629644  8721 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:21.643414  8721 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:21.643957  8721 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:21.645887  8475 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:21.646160  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.649065  5671 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:14:21.649441  5671 pending_rounds.cc:85] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 4
I20260709 12:14:21.649662  5671 pending_rounds.cc:107] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:14:21.649920  5671 raft_consensus.cc:2889] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:21.650038  5673 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:21.651738  8761 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.652014  8109 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.652583  8109 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.653518  8617 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:21.654426  8761 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.656215  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:21.656435  8761 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:21.656862  5750 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:21.657332  5678 raft_consensus.cc:1240] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:21.657903  8647 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.620362  8619 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:21.643455  6328 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
W20260709 12:14:21.661480  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 67348.9us
I20260709 12:14:21.668938  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.670395  8108 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.672750  5569 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:21.675629  5498 catalog_manager.cc:5697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 6, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 6 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:21.676295  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.676551  8683 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:21.677627  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.678668  8784 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:21.679113  8784 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.679275  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.680318  5719 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.680584  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.668694  8619 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.680872  8617 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:21.681939  8778 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.682632  8778 consensus_queue.cc:1059] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:21.683856  8788 raft_consensus.cc:3055] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:21.684234  8788 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:21.685122  8788 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:21.686203  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 61013.6us
I20260709 12:14:21.687490  5645 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:21.687896  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.688504  8778 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:21.688933  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.689702  8751 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.676244  8772 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.690313  8470 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:21.690546  5569 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:21.690902  8785 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.691267  6324 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:21.691618  8772 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:21.691448  8785 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.642855  6293 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:21.692024  8470 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:21.691697  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:21.692729  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 49977.1us
I20260709 12:14:21.692945  6319 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:21.692323  8784 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:21.658591  8647 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.695251  8647 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:21.659032  8475 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:21.696178  8678 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:21.696676  8678 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.697031  8678 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:21.697180  8788 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:21.691466  5569 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:21.682644  8619 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:21.699271  8619 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:21.699632  8619 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.699972  8619 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:21.700402  5718 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:21.701264  8647 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:21.658438  8715 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:21.706137  8715 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.706488  8715 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.709187  8784 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.712182  8784 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.629278  8749 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:21.714171  8749 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.716430  8749 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.717044  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:21.717994  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 153189us
I20260709 12:14:21.696081  8475 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.720707  5716 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:21.740535  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.748597  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:21.737251  8805 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.761209  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.761483  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.690706  8109 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:21.761936  5567 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:21.692114  8772 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.761418  8803 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:21.769821  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.770228  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:21.776129  5673 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:21.770814  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:21.772917  5498 catalog_manager.cc:5697] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 2 to 4, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 4 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.778939  5678 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:21.748515  8749 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:21.814854  8749 raft_consensus.cc:697] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:21.815768  8749 consensus_queue.cc:237] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:21.824215  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.779858  8803 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.830176  8803 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.835920  8721 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.784076  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2022) took 2228 ms. Trace:
I20260709 12:14:21.846784  5744 rpcz_store.cc:276] 0709 12:14:19.555628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.941210 (+1385582us) service_pool.cc:224] Handling call
0709 12:14:20.941729 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.614779 (+673050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.783846 (+169067us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54002175d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:21.784018 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531888512}
I20260709 12:14:21.761292  8805 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.850320  8805 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:21.781849  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:21.858274  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 118308us
I20260709 12:14:21.859172  5567 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:21.860466  5567 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:21.861235  8108 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:21.863171  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:21.784459  5718 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:21.778739  8623 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:21.785207  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.861963  8517 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.785060  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.878811  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.879418  5602 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:21.880327  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.881031  5602 raft_consensus.cc:2410] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:14:21.882633  8785 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:21.785662  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 68713.3us
I20260709 12:14:21.795220  5673 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:21.883224  8785 consensus_queue.cc:1059] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:21.884058  8748 raft_consensus.cc:3055] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:21.769443  8415 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:21.814321  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.885489  5569 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:21.886861  6293 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:21.888355  8623 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:21.888890  8623 raft_consensus.cc:697] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:21.889881  8623 consensus_queue.cc:237] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.890372  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.892740  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.868649  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.861706  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:21.870064  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:21.898293  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 190502us
I20260709 12:14:21.869721  5597 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:21.868368  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.869974  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.899852  5718 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:21.896772  5716 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:21.875463  6319 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:21.884447  8748 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:21.900159  5595 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:21.777870  8772 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.906699  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.884212  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:21.868975  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:21.928175  6323 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:21.906615  5600 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:14:21.942432  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.942788  8531 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:21.942994  8647 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.942788  8785 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:21.906844  8514 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:14:21.942454  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:21.809558  8715 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.950063  5599 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:21.943197  6320 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:21.954969  8619 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:21.957085  8795 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:21.896772  5498 catalog_manager.cc:5697] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 6, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 6 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:14:21.960008  5498 catalog_manager.cc:5697] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 7, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 7 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.961745  5498 catalog_manager.cc:5697] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
W20260709 12:14:21.982292  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:22.034147  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.033666  5498 catalog_manager.cc:5697] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 5, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 5 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:21.862535  8721 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:21.903178  8109 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.911132  8788 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:21.962899  8806 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:22.079049  5498 catalog_manager.cc:5697] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 1 to 6, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 6 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.866707  8108 consensus_queue.cc:1059] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.191s
I20260709 12:14:21.906736  8363 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.173s
I20260709 12:14:21.866632  8678 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:21.892992  8803 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.105545  5498 catalog_manager.cc:5697] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.114178  8782 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:22.140739  8748 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.146431  8678 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:22.108479  8806 raft_consensus.cc:697] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:22.148954  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 249177us
I20260709 12:14:22.149870  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:22.150456  5677 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:22.151676  8715 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:22.153523  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:22.153658  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:22.154812  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 258119us
I20260709 12:14:22.154139  5673 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:14:22.156584  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 294962us
I20260709 12:14:22.156841  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:22.158149  5716 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:22.162506  5716 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:22.172473  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 288344us
I20260709 12:14:22.163869  8109 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:22.160786  8748 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:22.178329  5673 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
W20260709 12:14:22.179620  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.162428  8517 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:22.180543  8617 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:22.176636  8619 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:22.174350  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:22.187471  6325 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:22.195775  5677 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:22.206300  8806 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.176760  8803 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:22.223687  8475 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.165284  8715 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:22.233059  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 83427.8us
W20260709 12:14:22.225992  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 339192us
I20260709 12:14:22.180136  8778 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:22.238288  5567 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:22.242812  5716 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:22.243942  5716 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:22.244726  5718 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:22.246150  5642 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:22.245113  5716 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:22.251029  5716 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:22.261075  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:22.240605  8778 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:22.260643  8109 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:22.252928  8517 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:22.255870  8788 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:22.235736  8715 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:22.258704  8617 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:14:22.258912  8785 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:22.259963  8749 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:22.337134  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 84261.3us
I20260709 12:14:22.268486  8782 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:22.337884  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:22.338636  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:22.342243  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 97887.6us
I20260709 12:14:22.275707  8778 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:22.340368  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 106059us
I20260709 12:14:22.342388  5569 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:22.344005  5670 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:22.339864  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:22.342949  5642 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:22.299412  8475 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:22.343710  6325 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:22.346450  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:22.348145  5676 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:22.349486  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:22.337726  8788 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.350641  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:22.340368  8785 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.339582  8619 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.346925  8623 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:22.332453  8751 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:14:22.340690  8109 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:22.341564  8782 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.368631  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:22.354598  8788 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.353155  8785 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.357028  8826 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.369267  6326 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:22.374320  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:22.365706  8415 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:22.398207  8475 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:14:22.411885  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 67415.2us
I20260709 12:14:22.369546  8782 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.415844  8826 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:22.372357  8751 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.429261  8751 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:22.430301  8821 log.cc:927] Time spent T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:14:22.371582  8814 log.cc:927] Time spent T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:14:22.437211  8831 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.427947  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:22.431403  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 89113.9us
I20260709 12:14:22.437978  6328 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.437722  8831 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:22.431991  5645 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:22.435081  5570 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:22.366267  8784 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:14:22.439967  8831 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:22.440656  8831 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:22.441488  8784 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:22.441908  8784 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.442251  8784 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.375763  8623 raft_consensus.cc:697] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:22.372020  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:22.368040  8619 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:22.447265  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 147361us
I20260709 12:14:22.443454  5570 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:22.479182  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:22.448232  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 91466.4us
I20260709 12:14:22.412200  8829 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:22.445060  6328 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:22.369644  8823 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 12:14:22.474370  8830 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.488440  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:22.430408  8715 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:22.467561  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:22.484148  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.496099  6326 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:22.485044  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.485343  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:22.486939  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 142767us
I20260709 12:14:22.447381  8475 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:22.492204  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 53223.2us
I20260709 12:14:22.492201  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.495980  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.484717  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.497437  5747 raft_consensus.cc:2410] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:22.497884  5751 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:22.498010  5718 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:22.502599  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:22.505091  5746 raft_consensus.cc:2410] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 12:14:22.513904  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 81995.4us
W20260709 12:14:22.516673  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.516373  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.522379  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:22.519519  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.521209  5753 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:22.526343  5673 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:22.526490  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:22.517958  8818 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 12:14:22.530166  8824 log.cc:927] Time spent T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:14:22.531728  5642 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:22.532233  8762 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:22.534617  8619 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:22.535599  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.535998  5569 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:22.525890  8715 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:22.541374  5596 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:22.535403  8109 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:22.545590  8531 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:22.578414  8531 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.578830  8531 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:22.546208  8825 log.cc:927] Time spent T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:14:22.543145  8762 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.547317  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.558951  8475 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:22.501586  8830 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.522941  8751 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:22.566563  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:22.545630  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:22.519135  8623 consensus_queue.cc:237] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.582577  5601 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:22.588368  8785 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:22.589874  8517 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:22.591049  5748 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:22.599229  6326 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:22.599628  5676 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:14:22.612438  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.613445  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.621824  5746 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:22.641258  5598 raft_consensus.cc:1240] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:22.596408  8823 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.645895  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.598150  8837 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.652105  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:22.653465  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 155523us
I20260709 12:14:22.653674  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:22.654317  5601 raft_consensus.cc:2376] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8. Re-sending same reply.
I20260709 12:14:22.670490  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:22.671442  5601 raft_consensus.cc:2410] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:22.666882  5718 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:22.649562  8415 raft_consensus.cc:697] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:22.687623  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:22.685959  5753 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:22.687584  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:22.648660  8838 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:22.689307  5745 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:22.691499  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:22.697081  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 253712us
I20260709 12:14:22.701397  8838 raft_consensus.cc:697] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:22.704051  8838 consensus_queue.cc:237] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.704299  8778 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.705927  8848 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:22.707094  8788 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:22.709120  8788 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:22.709187  8830 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:22.680965  8829 raft_consensus.cc:697] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:14:22.711344  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 229648us
I20260709 12:14:22.713304  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:22.717795  5753 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.673750  8839 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:22.714110  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 182447us
I20260709 12:14:22.712298  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.718679  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:22.673925  8751 consensus_queue.cc:1059] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:14:22.723759  5677 raft_consensus.cc:3055] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:22.722465  5570 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:22.721961  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:22.720506  5676 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:22.665424  8823 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:22.726028  5752 raft_consensus.cc:2368] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7.
W20260709 12:14:22.717144  8772 consensus_meta.cc:287] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.631s	user 0.004s	sys 0.006s
I20260709 12:14:22.739775  8772 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.740293  8803 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:22.741796  8772 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:22.726572  8839 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.744478  8839 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:22.744212  8803 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:14:22.747841  8823 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:22.696924  8844 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:22.727494  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:22.724400  5677 raft_consensus.cc:740] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:22.726919  5570 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:22.727550  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:22.728638  8846 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:22.729132  8751 raft_consensus.cc:3055] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:22.730547  5678 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:22.732167  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:22.732985  5674 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:22.756734  5753 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:22.737017  8531 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:22.738255  8782 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.701495  8784 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:22.756615  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:22.700254  8475 consensus_queue.cc:1059] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:14:22.759618  5679 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:22.764169  5745 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:22.766722  6291 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:22.760042  8751 raft_consensus.cc:740] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:22.770435  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:22.770808  8751 consensus_queue.cc:260] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:22.665652  8837 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:14:22.774060  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 47198.7us
I20260709 12:14:22.775038  6328 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:22.775555  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.778271  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:22.786963  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:22.787940  5676 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.774758  5570 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:22.790735  5673 raft_consensus.cc:1275] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:22.791994  5745 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:22.770891  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:22.794377  6321 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:22.732203  8415 consensus_queue.cc:237] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:22.751241  8803 consensus_queue.cc:1059] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:14:22.818344  5674 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:22.816829  5642 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:22.768016  6322 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:22.720342  8788 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:14:22.768106  8109 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:22.820190  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:22.787607  8617 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.822386  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:22.791441  8613 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:22.791721  8795 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 12:14:22.823484  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 70316us
I20260709 12:14:22.823621  8678 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:22.824607  5679 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:22.825522  8782 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:22.820006  8475 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.827343  5750 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:22.773720  8837 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:22.818655  8751 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.831873  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.795562  8772 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:22.819969  8514 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:22.821002  8839 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:22.820323  8846 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.874430  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:22.926903  5676 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:22.829694  8613 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.827732  8778 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:22.840520  6291 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:22.877282  5745 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:23.008522  8846 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:23.011291  8846 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:22.825459  8109 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:22.879930  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:23.012138  5747 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:22.881639  8762 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:23.012356  8678 raft_consensus.cc:2764] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
W20260709 12:14:23.012471  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 138320us
I20260709 12:14:22.928608  8514 raft_consensus.cc:697] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:23.014043  8514 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:23.015187  8782 consensus_queue.cc:1059] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:23.016086  8782 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:23.016928  8837 raft_consensus.cc:3055] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:22.835065  8617 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:23.018488  8838 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:23.019032  8617 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:23.019178  5747 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:23.019666  8617 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:23.020937  8109 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:23.021701  8109 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.874186  8839 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:23.017320  8837 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:23.022221  8109 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:23.022387  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:23.023556  8678 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:23.023361  8837 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:23.024086  8678 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:23.024279  8109 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:23.024597  8837 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.025053  8678 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:23.030999  8839 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.043738  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:23.044955  5679 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:23.042536  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:23.046969  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:23.052807  8852 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:14:23.053349  8833 raft_consensus.cc:3055] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:23.053735  8833 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:22.875766  8475 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:23.043883  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:22.835482  8829 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:23.054018  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:23.084134  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:23.145550  5746 raft_consensus.cc:2410] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:14:23.143790  8835 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:23.142750  8856 log.cc:927] Time spent T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:14:23.149914  8835 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:23.150609  8857 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:14:23.155543  5749 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:23.145151  5751 raft_consensus.cc:2376] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 4. Re-sending same reply.
I20260709 12:14:23.066628  5750 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:23.090896  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:23.164047  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 328173us
I20260709 12:14:23.164880  6291 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:23.004830  8721 raft_consensus.cc:3055] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:23.179986  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:23.008194  8613 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.194999  8866 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:23.195420  8866 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.190845  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:23.191790  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:23.193599  8475 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:23.166700  8721 raft_consensus.cc:740] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:23.166497  8531 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:23.194360  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 152254us
I20260709 12:14:23.194602  5749 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:23.198408  5751 raft_consensus.cc:1240] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:23.198779  5676 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:14:23.200053  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 372612us
I20260709 12:14:23.201225  5718 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:23.202224  6291 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:23.206661  5718 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:23.104360  8803 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.195739  8866 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.208860  5718 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:23.214805  8860 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.215304  8860 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:23.215839  8647 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:23.216423  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 47465.6us
I20260709 12:14:23.202823  8363 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:23.219177  5718 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:23.217737  8647 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 12:14:23.241954  8855 log.cc:927] Time spent T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 12:14:23.243747  8785 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:23.244719  8847 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:23.243774  8721 consensus_queue.cc:260] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:23.246074  8721 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.204504  8784 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:23.207003  8762 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:23.254287  5718 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:23.255160  5567 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:23.208016  8691 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:23.211313  8109 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:23.295882  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.296819  5645 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:23.223645  8475 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:23.299733  5596 raft_consensus.cc:1240] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:23.309599  5599 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:14:23.313512  5745 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:23.314584  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:23.316169  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:23.321409  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:23.322937  5601 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:23.321221  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:23.292982  8749 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.324774  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:23.324292  5745 raft_consensus.cc:2376] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 7. Re-sending same reply.
I20260709 12:14:23.248818  8647 consensus_queue.cc:1243] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:23.329519  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:23.331053  5751 raft_consensus.cc:2410] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:14:23.143471  8833 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:23.333014  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:23.333642  5595 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:23.308396  8778 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:23.342053  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:23.343202  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:23.344673  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:23.333874  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:23.346907  5598 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:23.212316  8803 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:23.334160  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 79954.7us
I20260709 12:14:23.311604  8623 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.335521  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:23.352469  5604 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:23.221925  8678 consensus_queue.cc:1059] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 12:14:23.336946  5596 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:23.337576  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:23.349851  8784 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:23.350132  8869 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:23.365625  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:23.350510  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:23.366634  5595 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:23.343859  5597 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:23.355970  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:23.367627  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.373132  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:23.300053  8762 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:23.388309  8868 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:23.389003  8868 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:23.346396  8778 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:23.397979  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 101225us
I20260709 12:14:23.386368  8784 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:23.413734  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:23.416663  8832 raft_consensus.cc:3055] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:23.417181  8832 raft_consensus.cc:740] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:23.420884  8862 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.210s
I20260709 12:14:23.364542  8109 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:23.358359  8823 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:23.367383  8715 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:23.475879  8828 log.cc:927] Time spent T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.913s	user 0.005s	sys 0.000s
I20260709 12:14:23.409895  8778 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.425307  8415 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:23.351361  8749 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:14:23.559458  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.541882  5645 leader_election.cc:336] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.528s (SENT)
W20260709 12:14:23.597359  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 139938us
I20260709 12:14:23.597687  5748 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
W20260709 12:14:23.600715  8864 log.cc:927] Time spent T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.297s	user 0.000s	sys 0.000s
W20260709 12:14:23.600881  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.601817  8838 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.602371  8838 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:23.604336  8838 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:23.606052  8858 log.cc:927] Time spent T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.557s	user 0.002s	sys 0.000s
W20260709 12:14:23.606684  8854 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.561s	user 0.001s	sys 0.001s
I20260709 12:14:23.536026  8715 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:23.535200  8415 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.367833  8623 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:23.539528  8839 consensus_meta.cc:287] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.003s
W20260709 12:14:23.624927  6322 consensus_meta.cc:287] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.793s	user 0.003s	sys 0.007s
I20260709 12:14:23.600759  8782 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.629653  5745 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.661657  6322 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:23.621090  5595 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:23.644914  8415 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:23.688841  8839 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:23.690230  5674 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:23.671821  8806 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:23.746843  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:23.766853  8826 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:23.776353  5745 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
W20260709 12:14:23.788779  8872 log.cc:927] Time spent T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
W20260709 12:14:23.789693  8873 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:14:23.798084  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:23.798880  5673 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:23.799937  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:23.800457  5673 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:23.815456  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.836093  5753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.006s	sys 0.027s
W20260709 12:14:23.836519  5753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.006s	sys 0.027s
I20260709 12:14:23.556676  8832 consensus_queue.cc:260] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:23.785291  8613 consensus_meta.cc:287] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.002s
I20260709 12:14:23.665521  8678 consensus_queue.cc:1243] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [LEADER]: Peer 831d76c5ee1045f0af923ce24fa4c301 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:23.690299  8866 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:23.898547  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:23.907311  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 539436us
I20260709 12:14:23.735605  8782 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:23.935911  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:23.935848  5600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.021s	sys 0.014s
W20260709 12:14:23.942099  5600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.022s	sys 0.014s
W20260709 12:14:23.937536  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 682374us
I20260709 12:14:23.944113  5567 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:23.929208  6291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.010s	sys 0.014s
I20260709 12:14:23.939281  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:23.880125  5673 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
W20260709 12:14:23.944711  6291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.010s	sys 0.014s
I20260709 12:14:23.944934  5597 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:23.941787  8860 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:23.945935  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:23.946519  5673 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.901463  8833 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.940791  8868 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:23.958493  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:23.959461  8782 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:23.959754  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:23.960423  5671 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:23.963528  5671 raft_consensus.cc:1240] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:23.967185  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:23.968171  6322 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:23.970248  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:23.897311  8415 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:23.904961  5642 connection.cc:256] RPC call timeout handler was delayed by -3.0025851339999008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 12:14:23.974661  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:14:23.977584  5642 connection.cc:256] RPC call timeout handler was delayed by -2.954885134000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260709 12:14:23.983237  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:23.983157  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:23.983938  6323 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.977136  6328 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:23.987017  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:23.989714  6325 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:23.939915  8869 raft_consensus.cc:697] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:23.994652  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:23.995870  5678 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:14:23.991863  5642 connection.cc:256] RPC call timeout handler was delayed by -2.6722031769998011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 12:14:23.996547  5642 connection.cc:256] RPC call timeout handler was delayed by -2.3752031769997757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
W20260709 12:14:23.996933  5642 connection.cc:256] RPC call timeout handler was delayed by -2.1790851339999335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2535s for a response
W20260709 12:14:23.997164  5642 connection.cc:256] RPC call timeout handler was delayed by -2.1025851340000372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.262s for a response
W20260709 12:14:23.997423  5642 connection.cc:256] RPC call timeout handler was delayed by -1.9536206259999744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 12:14:23.997678  5642 connection.cc:256] RPC call timeout handler was delayed by -1.7502206259998729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:14:23.997948  5642 connection.cc:256] RPC call timeout handler was delayed by -1.5908022399999027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 12:14:23.998215  5642 connection.cc:256] RPC call timeout handler was delayed by -1.5422022399998241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:14:23.998487  5642 connection.cc:256] RPC call timeout handler was delayed by -1.4788851339999383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33130000000000004s for a response
W20260709 12:14:23.998766  5642 connection.cc:256] RPC call timeout handler was delayed by -1.3168762989998868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2988s for a response
I20260709 12:14:23.973639  8832 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.983575  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:24.002108  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:24.004647  6321 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:23.995311  5674 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:23.992161  5673 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:24.003875  5671 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:23.999812  5569 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:23.928562  8613 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:24.009802  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 65762.1us
I20260709 12:14:24.006702  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:24.011080  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:24.011369  6326 raft_consensus.cc:2376] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 10. Re-sending same reply.
I20260709 12:14:24.012481  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:24.013265  6320 raft_consensus.cc:2410] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:23.978029  8846 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:23.989969  8782 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:24.016042  6326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 772) took 1294 ms (client timeout 1528 ms). Trace:
I20260709 12:14:24.018055  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:24.012095  6324 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:23.994488  8108 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:24.018332  6326 rpcz_store.cc:269] 0709 12:14:22.717074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.717316 (+   242us) service_pool.cc:224] Handling call
0709 12:14:24.006541 (+1289225us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:24.011830 (+  5289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5576064}
I20260709 12:14:23.995661  8839 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:24.001113  8762 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:24.032217  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:14:24.018253  8721 consensus_meta.cc:287] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.772s	user 0.007s	sys 0.003s
I20260709 12:14:24.042464  5674 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:24.045559  5671 pending_rounds.cc:85] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 6
I20260709 12:14:24.051083  5671 pending_rounds.cc:107] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:14:24.051367  5671 raft_consensus.cc:2889] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:24.052593  5603 raft_consensus.cc:2410] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:24.032873  8749 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:24.035063  8840 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:24.052855  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 82257.9us
W20260709 12:14:24.064810  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.077363  5675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1400) took 1540 ms (client timeout 1841 ms). Trace:
I20260709 12:14:24.110532  6291 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:24.037825  8846 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:24.126145  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 115125us
W20260709 12:14:24.109663  5675 rpcz_store.cc:269] 0709 12:14:22.522349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.522447 (+    98us) service_pool.cc:224] Handling call
0709 12:14:24.062950 (+1540503us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b540024f9d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:24.063126 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986723584}
I20260709 12:14:24.129330  5567 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:24.034489  8782 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.137516  8762 raft_consensus.cc:2764] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:14:24.138114  5567 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:24.142400  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:24.144232  5567 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:24.146050  5674 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:24.146142  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 579) took 1626 ms. Trace:
I20260709 12:14:24.066970  8876 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:24.053404  8803 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:24.115918  8840 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.139999  8846 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:24.146520  5672 rpcz_store.cc:276] 0709 12:14:22.519404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.519540 (+   136us) service_pool.cc:224] Handling call
0709 12:14:22.531363 (+ 11823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:22.531538 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:23.983854 (+1452316us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.145817 (+161963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:24.145868 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:24.145909 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.145972 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.146089 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1537006,"prepare.queue_time_us":1457899,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":161648,"threads_started":1}
W20260709 12:14:24.170106  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 59669.6us
W20260709 12:14:24.172569  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 140448us
I20260709 12:14:24.147665  8721 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:24.176424  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 176633us
I20260709 12:14:24.178609  5569 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:24.079726  8108 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:24.185927  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 580) took 1666 ms. Trace:
I20260709 12:14:24.199455  5670 rpcz_store.cc:276] 0709 12:14:22.519718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.519816 (+    98us) service_pool.cc:224] Handling call
0709 12:14:22.531875 (+ 12059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:22.532037 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:23.989589 (+1457552us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.185452 (+195863us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:24.185534 (+    82us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:24.185605 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.185714 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.185865 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1446771,"prepare.queue_time_us":1520288,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"thread_start_us":195410,"threads_started":1}
I20260709 12:14:24.159906  8840 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.138753  8869 consensus_queue.cc:237] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:24.207103  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 62971.7us
I20260709 12:14:24.209362  5567 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:24.210505  5567 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:24.176380  8866 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:24.175832  8531 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:24.221453  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:24.222211  5745 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.244861  8846 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:24.198881  8415 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:24.246891  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:24.203680  8623 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:24.250913  8531 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:24.251044  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:24.251644  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:24.249583  6328 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:24.260103  6326 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.160331  8876 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:24.260805  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:24.262257  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:24.199843  8803 consensus_queue.cc:1059] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:14:24.202387  8860 consensus_queue.cc:1059] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:14:24.272421  5745 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:24.258188  8531 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:24.286206  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:24.265508  8613 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:24.265805  8623 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.242918  8901 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 12:14:24.287782  8881 log.cc:927] Time spent T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:14:24.288527  8897 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:24.289626  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:24.291706  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 428) took 1244 ms. Trace:
I20260709 12:14:24.295679  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 427) took 1250 ms. Trace:
I20260709 12:14:24.315732  5750 rpcz_store.cc:276] 0709 12:14:23.044868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.159097 (+114229us) service_pool.cc:224] Handling call
0709 12:14:23.159445 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.159822 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.159850 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.167619 (+  7769us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.808587 (+640968us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b180014a3a0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:14:23.938442 (+129855us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:23.938485 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.938554 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.295336 (+356782us) raft_consensus.cc:1685] finished
0709 12:14:24.295361 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.295617 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":8226,"spinlock_wait_cycles":5957504,"thread_start_us":129670,"threads_started":1,"wal-append.queue_time_us":1099543}
I20260709 12:14:24.297389  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 585) took 1206 ms. Trace:
I20260709 12:14:24.317449  5679 rpcz_store.cc:276] 0709 12:14:23.091168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.091341 (+   173us) service_pool.cc:224] Handling call
0709 12:14:23.117599 (+ 26258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.134062 (+ 16463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.134096 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.196028 (+ 61932us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.358789 (+162761us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:23.358839 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.358920 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.297159 (+938239us) raft_consensus.cc:1685] finished
0709 12:14:24.297180 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.297330 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6258,"raft.queue_time_us":2952,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":10902,"thread_start_us":145086,"threads_started":1,"wal-append.queue_time_us":1010143}
I20260709 12:14:24.321046  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:24.321647  5750 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.314450  5746 rpcz_store.cc:276] 0709 12:14:23.046986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.203185 (+156199us) service_pool.cc:224] Handling call
0709 12:14:23.210469 (+  7284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.214194 (+  3725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.214238 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.297642 (+ 83404us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.669301 (+371659us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:23.669344 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.669418 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.291458 (+622040us) raft_consensus.cc:1685] finished
0709 12:14:24.291483 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.291638 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47802,"raft.queue_time_us":3476,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":21458,"thread_start_us":332803,"threads_started":1,"wal-append.queue_time_us":974305}
I20260709 12:14:24.299738  6323 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:24.324008  5642 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:24.324384  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:24.300825  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:24.273871  8415 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:24.302577  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 92130.2us
I20260709 12:14:24.335009  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 423) took 1090 ms. Trace:
I20260709 12:14:24.335109  5567 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:24.314278  8875 log.cc:927] Time spent T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:14:24.300014  8531 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.330791  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2050) took 1038 ms. Trace:
I20260709 12:14:24.339672  5567 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:24.334271  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2045) took 1109 ms. Trace:
I20260709 12:14:24.342504  5752 rpcz_store.cc:276] 0709 12:14:23.225029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.324127 (+1099098us) service_pool.cc:224] Handling call
0709 12:14:24.334205 (+ 10078us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:24.343703  5567 leader_election.cc:400] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7.
I20260709 12:14:24.343964  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:24.344334  5745 rpcz_store.cc:276] 0709 12:14:23.292138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.273271 (+981133us) service_pool.cc:224] Handling call
0709 12:14:24.330711 (+ 57440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:24.344019  5567 leader_election.cc:403] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:24.345314  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:24.345649  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 432) took 1209 ms. Trace:
I20260709 12:14:24.346377  5746 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:24.347329  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:24.348127  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2052) took 1028 ms. Trace:
I20260709 12:14:24.348429  5747 rpcz_store.cc:276] 0709 12:14:23.319613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.322155 (+1002542us) service_pool.cc:224] Handling call
0709 12:14:24.348063 (+ 25908us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:24.349416  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:24.346107  5752 rpcz_store.cc:276] 0709 12:14:23.136162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.344855 (+1208693us) service_pool.cc:224] Handling call
0709 12:14:24.345145 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.345321 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.345349 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:24.345398 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:24.345430 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.345482 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.345592 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:24.320724  8867 raft_consensus.cc:3055] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:24.329910  8795 raft_consensus.cc:2764] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:24.359944  5567 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:24.319259  8891 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:24.335558  5600 rpcz_store.cc:276] 0709 12:14:23.244801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.245415 (+   614us) service_pool.cc:224] Handling call
0709 12:14:23.245770 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:23.246117 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.246143 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:23.246751 (+   608us) log.cc:844] Serialized 52 byte log entry
0709 12:14:23.942554 (+695803us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:24.204051 (+261497us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.334628 (+130577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.334701 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.334739 (+    38us) raft_consensus.cc:1685] finished
0709 12:14:24.334752 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.334957 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25062,"prepare.queue_time_us":353209,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":99462,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":16145,"thread_start_us":1049138,"threads_started":3,"wal-append.queue_time_us":929100}
W20260709 12:14:24.367379  5569 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.66:33011 timed out after 1.841s (SENT) [suppressed 15 similar messages]
I20260709 12:14:24.364770  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 433) took 1186 ms. Trace:
I20260709 12:14:24.342373  8415 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:24.337888  8613 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:24.344753  8895 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:24.368146  5745 rpcz_store.cc:276] 0709 12:14:23.178250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.345256 (+1167006us) service_pool.cc:224] Handling call
0709 12:14:24.364262 (+ 19006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.364442 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.364468 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:24.364510 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:24.364548 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.364597 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.364712 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:24.376291  8415 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.377126  5745 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:24.378054  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2056) took 1012 ms. Trace:
I20260709 12:14:24.378471  5745 rpcz_store.cc:276] 0709 12:14:23.365468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.376379 (+1010911us) service_pool.cc:224] Handling call
0709 12:14:24.376874 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.377691 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.377984 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:24.368777  5567 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:24.384879  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:24.385982  6291 leader_election.cc:336] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.808s (SENT)
I20260709 12:14:24.386477  6291 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:24.389375  5750 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:24.358412  8867 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:24.375586  8613 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:24.360790  8897 raft_consensus.cc:2764] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:24.394435  5567 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:24.396983  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:24.372872  8475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.015s	sys 0.021s
I20260709 12:14:24.372953  8782 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:24.367460  8908 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:24.417542  5567 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:24.418802  5677 consensus_queue.cc:260] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.419435  6326 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:24.420042  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:24.421607  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:24.422114  8613 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:24.397871  8895 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:24.433255  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 60001.4us
I20260709 12:14:24.466919  5678 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:24.426695  8860 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:14:24.429512  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 43561.2us
I20260709 12:14:24.465827  5595 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.423493  8901 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:24.466998  5675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
W20260709 12:14:24.468773  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 51314.8us
I20260709 12:14:24.474571  5675 raft_consensus.cc:606] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:24.469842  8876 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:24.475013  5675 raft_consensus.cc:614] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:24.440407  8908 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:24.484424  5677 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.462592  8831 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:24.492486  8918 log.cc:927] Time spent T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:14:24.494029  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2055) took 1163 ms. Trace:
W20260709 12:14:24.491565  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 124206us
I20260709 12:14:24.494424  5752 rpcz_store.cc:276] 0709 12:14:23.334866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.351546 (+1016680us) service_pool.cc:224] Handling call
0709 12:14:24.351882 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.352102 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.352128 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.356160 (+  4032us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.381744 (+ 25584us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:24.381811 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.381917 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.493665 (+111748us) raft_consensus.cc:1685] finished
0709 12:14:24.493686 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.493946 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493376,"thread_start_us":21356,"threads_started":1,"wal-append.queue_time_us":74120}
I20260709 12:14:24.504376  5677 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:24.507009  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2011) took 1787 ms. Trace:
I20260709 12:14:24.508314  8916 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.511797  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:24.512710  5599 raft_consensus.cc:2393] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:24.521751  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:24.522630  5597 raft_consensus.cc:2368] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7.
I20260709 12:14:24.484061  8895 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:14:24.523447  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 48623.3us
I20260709 12:14:24.485953  8613 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:24.507550  5677 rpcz_store.cc:276] 0709 12:14:22.720019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.720494 (+   475us) service_pool.cc:224] Handling call
0709 12:14:22.720772 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:23.445806 (+725034us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b4c002b0f40. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fbd17a20 00007f44fbd28a29 00007f44fbcee644 00007f44fbd15f2d 00007f44fbd15b93 00007f44fda4618b 00007f44fda46cb5 00007f44fda41f30 00007f44fda437de 00007f44fda4db49 00007f44fda4e416
0709 12:14:24.418481 (+972675us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b540029d9a0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9c906f 00007f44fda41f60 00007f44fda437de 00007f44fda4db49 00007f44fda4e416 00007f44fda4ad8f 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62
0709 12:14:24.506641 (+ 88160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.506930 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130633344}
I20260709 12:14:24.527570  5567 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:24.527983  5595 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:24.485219  8908 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.532496  8897 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:24.533828  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:24.535174  8848 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:24.543434  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:24.543710  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:24.544376  5599 raft_consensus.cc:2410] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:14:24.544431  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:24.491062  8831 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.545043  5604 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.545969  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:24.546770  5601 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.546022  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:24.556509  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:24.558363  5595 raft_consensus.cc:1275] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:24.558753  5599 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:24.558419  5598 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:24.562331  8926 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:24.563416  8926 raft_consensus.cc:697] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:24.564397  8926 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.565029  8923 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:24.581632  5601 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:24.584612  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:24.586717  5604 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:24.598399  8895 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:24.477036  8867 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:24.600373  8911 log.cc:927] Time spent T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:14:24.604852  8623 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:24.582736  8613 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.546347  8831 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:24.582540  8912 log.cc:927] Time spent T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:14:24.582509  8878 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:24.593852  8832 consensus_meta.cc:287] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.001s
I20260709 12:14:24.597633  5672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:24.636359  5672 raft_consensus.cc:606] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:24.637161  5672 raft_consensus.cc:614] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:14:24.634287  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 175197us
W20260709 12:14:24.634536  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 50030.9us
I20260709 12:14:24.628118  8848 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.644758  5642 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:24.635991  8833 consensus_meta.cc:287] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.004s
I20260709 12:14:24.581678  8415 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.632994  8929 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:24.654126  5744 raft_consensus.cc:2410] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:14:24.650786  8913 log.cc:927] Time spent T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:14:24.636770  8613 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.641528  8878 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.649387  8867 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.661648  5746 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:24.704267  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2051) took 1410 ms. Trace:
I20260709 12:14:24.704686  5746 rpcz_store.cc:276] 0709 12:14:23.293646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.322409 (+1028763us) service_pool.cc:224] Handling call
0709 12:14:24.704183 (+381774us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:24.681568  5642 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:24.648358  8901 raft_consensus.cc:697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:24.652709  8623 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:24.667074  8919 log.cc:927] Time spent T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:14:24.671918  8415 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:24.662694  8914 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:24.666985  8925 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:24.754055  6291 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:24.768488  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 87015.3us
I20260709 12:14:24.770506  5604 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:24.771308  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:24.674037  8531 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.720129  8848 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:24.774194  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:24.673321  8908 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.775869  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:24.776098  5599 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:24.781306  5601 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:24.767998  8914 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:24.788487  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 148291us
I20260709 12:14:24.774329  8837 raft_consensus.cc:2764] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:24.742560  8623 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.775791  8848 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:24.663705  8929 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:24.783715  8839 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:24.799777  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 58157.9us
I20260709 12:14:24.799834  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:24.805106  6291 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:24.808755  5642 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:24.796370  8914 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.813822  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:24.798251  8926 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.800021  8920 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:24.815790  5601 raft_consensus.cc:2393] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:24.801903  8848 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:24.808637  8778 consensus_meta.cc:287] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.225s	user 0.012s	sys 0.000s
I20260709 12:14:24.810549  8897 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:24.817395  8936 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.823318  5599 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:24.823637  8929 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:24.825868  8926 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.830499  8623 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:24.831727  5748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 420) took 1837 ms (client timeout 1808 ms). Trace:
I20260709 12:14:24.832080  8908 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:24.774741  8925 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:24.834086  8762 raft_consensus.cc:3055] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:24.836791  8878 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:24.837622  8613 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:24.842375  8108 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:24.815204  8837 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:24.859999  8937 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:24.871263  8837 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.871687  8837 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.872195  8925 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:24.872920  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:24.873356  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:24.852608  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2046) took 1627 ms. Trace:
I20260709 12:14:24.804286  8839 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:24.860404  5748 rpcz_store.cc:269] 0709 12:14:22.994564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.994731 (+   167us) service_pool.cc:224] Handling call
0709 12:14:24.831546 (+1836815us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54000a8054. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:24.831655 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342860672}
I20260709 12:14:24.830706  8721 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:24.858219  8840 consensus_meta.cc:287] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
I20260709 12:14:24.797195  8901 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:24.876900  5601 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.879848  5744 rpcz_store.cc:276] 0709 12:14:23.225260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.322682 (+1097422us) service_pool.cc:224] Handling call
0709 12:14:24.852386 (+529704us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54000532d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:24.852542 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698668800}
I20260709 12:14:24.880472  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:24.861406  8916 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7.
I20260709 12:14:24.863096  8897 raft_consensus.cc:697] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:24.866267  8762 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:24.858745  8778 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.935240  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:24.884616  8839 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:24.938661  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1963) took 1542 ms. Trace:
I20260709 12:14:24.884521  8891 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.882112  8937 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:24.949862  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:24.950464  5600 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.942664  5602 rpcz_store.cc:276] 0709 12:14:23.396206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.837721 (+1441515us) service_pool.cc:224] Handling call
0709 12:14:24.838052 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.838254 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:24.838512 (+   258us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.938335 (+ 99823us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:24.938384 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:24.938429 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.938489 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.938607 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4407,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":79,"thread_start_us":99435,"threads_started":1}
W20260709 12:14:24.953126  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 77090.2us
I20260709 12:14:24.883527  8831 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.933501  8929 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:24.936535  8888 raft_consensus.cc:2764] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:14:24.884202  8908 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 12:14:24.963507  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 83023.2us
I20260709 12:14:24.970206  5642 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:24.964977  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 149733us
I20260709 12:14:24.945266  8878 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:24.972543  8878 raft_consensus.cc:697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:24.973574  6291 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:24.882759  8935 consensus_queue.cc:1059] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:14:24.862898  8936 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.973522  8878 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:24.975890  8831 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:24.945993  8721 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:24.952701  8937 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.977831  8936 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:24.955188  8891 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.981746  8914 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:24.978282  8935 consensus_queue.cc:1243] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:24.990072  5601 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:24.981310  8867 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.982661  5642 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:24.954438  5645 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:24.986516  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:24.936157  8840 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:24.992354  8721 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.182349  5596 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:25.102949  5600 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:24.996131  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2029) took 1060 ms. Trace:
I20260709 12:14:25.004326  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:24.995793  6321 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:25.174760  5602 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:25.003199  8926 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:25.158491  8837 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.187745  8876 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:25.188241  8876 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.188417  5672 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:25.182325  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 227952us
I20260709 12:14:25.192504  5570 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:25.183969  5673 rpcz_store.cc:276] 0709 12:14:23.935488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.014781 (+ 79293us) service_pool.cc:224] Handling call
0709 12:14:24.015087 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.124740 (+109653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.124774 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.835646 (+710872us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b2c00025bc8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fc344a11 00007f44fc354372 00007f44fda86a01 00007f44fda4b43a 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2
0709 12:14:24.836036 (+   390us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.936108 (+100072us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:24.936148 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.936228 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.995857 (+ 59629us) raft_consensus.cc:1685] finished
0709 12:14:24.995875 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.996068 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141185,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":17965,"spinlock_wait_cycles":53183232,"thread_start_us":203396,"threads_started":2,"wal-append.queue_time_us":158177}
I20260709 12:14:25.006042  8849 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.197511  5570 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:25.158349  8943 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:14:25.154768  8935 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.199025  8935 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.198446  8849 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:24.994633  8879 log.cc:927] Time spent T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Append to log took a long time: real 0.856s	user 0.006s	sys 0.000s
I20260709 12:14:25.194479  8876 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.203742  8849 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:25.204419  8849 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:25.196270  8721 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:25.201552  8935 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:25.210109  8848 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.212435  8876 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.212812  8848 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:24.994302  8891 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:25.215095  8837 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.216114  8926 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:25.216814  5570 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:25.216773  8926 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:25.217784  5570 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:25.217999  8721 raft_consensus.cc:2764] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:14:25.218683  8613 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:25.219185  8613 raft_consensus.cc:697] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:14:25.219318  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 236824us
I20260709 12:14:25.220039  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:25.221213  5642 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:25.233259  8613 consensus_queue.cc:237] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.233963  8838 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:25.234681  8838 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:25.237461  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 46152.6us
I20260709 12:14:25.238296  5645 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:24.997347  8914 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.161451  8944 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:25.001443  8885 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:24.990921  8920 consensus_queue.cc:1059] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.258s
I20260709 12:14:24.968467  8929 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.003225  8778 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:25.251725  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:25.282851  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.282464  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.279827  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:25.282790  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.291458  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:25.282578  6324 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:25.282202  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.253577  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:25.292714  6325 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:25.296340  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.296326  6328 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.268535  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:25.297659  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.299618  5679 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:25.298710  5600 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:25.201486  8839 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:25.301095  8871 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 1.700s	user 0.003s	sys 0.010s
I20260709 12:14:25.303236  8762 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.304332  8762 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.307305  8848 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:14:25.307942  8848 consensus_queue.cc:1243] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:25.293226  8837 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:25.309357  8837 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:24.994416  8897 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.280274  8840 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.248889  8891 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:25.299574  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:25.313022  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:25.333415  6324 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:25.337646  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:25.358420  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:25.361209  8885 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:25.362165  8885 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.279413  8944 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.281188  8937 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.599964  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1458) took 2768 ms. Trace:
I20260709 12:14:25.617807  6326 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.617903  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.362066  8837 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:25.602429  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 1.2584e+06us
I20260709 12:14:25.598670  8826 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.605060  8847 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:25.619702  8826 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.620060  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:25.619802  8847 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:25.604931  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2057) took 1631 ms. Trace:
I20260709 12:14:25.619196  5677 raft_consensus.cc:2393] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:25.622184  8749 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:25.621920  8751 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:25.605365  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2058) took 1606 ms. Trace:
I20260709 12:14:25.600605  8862 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:25.622864  8749 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.625272  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:25.598860  8109 raft_consensus.cc:697] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:25.625561  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.603912  8896 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:25.603883  5716 connection.cc:256] RPC call timeout handler was delayed by -1.10347673199999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
I20260709 12:14:25.625586  8749 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.624599  6326 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:25.549551  8885 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.617924  5753 rpcz_store.cc:276] 0709 12:14:22.832029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.832214 (+   185us) service_pool.cc:224] Handling call
0709 12:14:22.832516 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.005352 (+172836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.005385 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.007704 (+  2319us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.836874 (+829170us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:23.986947 (+150073us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.599635 (+1612688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.599719 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.599760 (+    41us) raft_consensus.cc:1685] finished
0709 12:14:25.599772 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.599902 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1629011,"prepare.queue_time_us":199007,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1802970,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":151,"thread_start_us":946115,"threads_started":3,"wal-append.queue_time_us":892055,"wal-append.run_cpu_time_us":3732,"wal-append.run_wall_time_us":1484244}
I20260709 12:14:25.604344  8917 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.478821  6322 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:25.627977  8917 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:25.604672  8869 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.604488  8844 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:25.366407  5604 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:25.606189  8839 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.626385  5672 raft_consensus.cc:2410] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:25.630203  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.422350  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2125) took 2085 ms. Trace:
I20260709 12:14:25.381515  6328 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:25.425748  5597 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:25.631496  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:25.621074  5745 rpcz_store.cc:276] 0709 12:14:23.973882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.379446 (+405564us) service_pool.cc:224] Handling call
0709 12:14:24.379982 (+   536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.380291 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:24.380667 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.604564 (+1223897us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.604623 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:25.604674 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.604751 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.604869 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1069715,"prepare.queue_time_us":603,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":1284,"raft.queue_time_us":1070023,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":141611,"threads_started":1,"wal-append.queue_time_us":158869,"wal-append.run_cpu_time_us":1230,"wal-append.run_wall_time_us":1005480}
W20260709 12:14:25.571127  5751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2049) took 2280 ms (client timeout 1949 ms). Trace:
W20260709 12:14:25.594924  5642 leader_election.cc:336] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.949s (SENT)
W20260709 12:14:25.638051  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.644038  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:25.652415  5752 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:25.656410  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:25.451522  8900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.000s	sys 0.021s
I20260709 12:14:25.661327  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 429) took 2574 ms. Trace:
I20260709 12:14:25.697108  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:25.701617  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:25.702677  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:25.599363  8868 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.630080  8826 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:25.695778  5751 rpcz_store.cc:269] 0709 12:14:23.291049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.570838 (+2279789us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:25.571008 (+   170us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:25.697274  5603 rpcz_store.cc:276] 0709 12:14:23.326992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.327111 (+   119us) service_pool.cc:224] Handling call
0709 12:14:25.344257 (+2017146us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b540021bbd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:25.412637 (+ 68380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621269248}
I20260709 12:14:25.704629  5642 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:25.695582  5600 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.661259  8751 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:25.714346  8751 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.707765  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:25.344444  8891 raft_consensus.cc:697] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:25.734119  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.734251  8891 consensus_queue.cc:237] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.715438  8868 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:25.736096  5752 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.736775  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.653846  8944 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:25.660458  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:25.628980  8833 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.710573  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.739787  5672 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:14:25.625133  8862 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.595100  8876 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:25.714679  8952 log.cc:927] Time spent T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 12:14:25.695605  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.704030  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.723410  5746 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:25.722833  5600 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:25.706395  5749 rpcz_store.cc:276] 0709 12:14:23.087282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.205395 (+118113us) service_pool.cc:224] Handling call
0709 12:14:23.213176 (+  7781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.215217 (+  2041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.215246 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.215701 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.298649 (+ 82948us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:23.492687 (+194038us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.294563 (+1801876us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:25.542813 (+248250us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b18003e0260. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa8d8c0a 00007f4504018219 00007f44fa960a40 00007f44fa95b4e4 00007f44fa95b455 00007f44fda43060 00007f44fda55716 00007f44fda66287 00007f44fda66208
0709 12:14:25.660876 (+118063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.660959 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.661092 (+   133us) raft_consensus.cc:1685] finished
0709 12:14:25.661105 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.661264 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":508234,"prepare.queue_time_us":698018,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":952,"raft.queue_time_us":2107688,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":179,"spinlock_wait_cycles":19185792,"thread_start_us":338170,"threads_started":3,"wal-append.queue_time_us":206947}
I20260709 12:14:25.694855  8844 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.731711  5604 raft_consensus.cc:1240] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:25.732374  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 137469us
I20260709 12:14:25.732865  8839 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:25.693439  8617 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.734846  5678 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:25.710162  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.737442  8868 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:25.737991  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:25.705554  8900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.272s	user 0.008s	sys 0.026s
I20260709 12:14:25.591393  8929 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.710860  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.743680  8957 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.707784  8715 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.744352  8960 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.626410  8109 consensus_queue.cc:237] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.699851  8778 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:25.699046  8896 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.749155  5752 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:25.781564  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.783864  8844 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.786640  5745 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 4.
I20260709 12:14:25.785450  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.789331  5642 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:25.707945  8840 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.791332  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:25.798198  5673 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:14:25.795271  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 165557us
I20260709 12:14:25.794013  8898 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.779402  8835 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.665041  8869 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.745074  5718 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:25.801113  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:25.801294  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:25.838400  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.838785  5600 raft_consensus.cc:2393] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:25.839766  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:25.840396  5600 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:25.794267  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:25.841358  5604 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:25.801795  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.842314  5716 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:25.838096  5603 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:25.744405  8826 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.807802  8937 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:25.808030  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.847653  5716 leader_election.cc:400] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7.
I20260709 12:14:25.811285  8868 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.811684  8960 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:25.802512  8617 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.805491  8957 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:25.778021  8784 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.818112  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.821681  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:25.858330  5672 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.823495  8749 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.823383  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:25.767515  8833 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.845049  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.856637  5597 pending_rounds.cc:85] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 4
I20260709 12:14:25.866362  5597 pending_rounds.cc:107] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:14:25.866629  5597 raft_consensus.cc:2889] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:25.848026  5716 leader_election.cc:403] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:25.849509  5673 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
W20260709 12:14:25.851316  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 375956us
I20260709 12:14:25.855298  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.866889  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:25.868098  5751 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:25.868291  6291 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:25.868717  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.869170  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.867516  8897 consensus_queue.cc:1059] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:14:25.869812  5751 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:25.869737  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:25.870296  8897 consensus_queue.cc:1243] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:25.839289  8876 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:25.870963  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:25.873962  8954 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:25.883152  5751 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:25.857386  8748 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:25.885341  5746 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:25.885974  5748 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:25.843611  8415 consensus_queue.cc:1059] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:14:25.851433  8958 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:25.834046  8778 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:25.834722  8896 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:25.840317  8840 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:25.891842  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:25.888856  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:25.894443  5603 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:25.851246  8837 consensus_queue.cc:1059] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 12:14:25.897472  5596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1966) took 1387 ms (client timeout 1512 ms). Trace:
W20260709 12:14:25.918776  5596 rpcz_store.cc:269] 0709 12:14:24.509935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.525381 (+ 15446us) service_pool.cc:224] Handling call
0709 12:14:25.897281 (+1371900us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400207454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:25.897408 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895806080}
I20260709 12:14:25.882838  8954 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.854208  8878 consensus_queue.cc:1059] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:14:25.921425  8415 consensus_queue.cc:1243] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:25.857681  8826 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:25.889703  8839 raft_consensus.cc:3055] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:25.887806  8748 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.889535  8835 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7.
I20260709 12:14:25.858544  8868 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:25.888178  8876 raft_consensus.cc:697] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:25.928416  8896 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:25.928496  5672 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:25.930563  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:26.015434  5596 raft_consensus.cc:2368] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8.
I20260709 12:14:25.930819  8475 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:25.931967  8837 raft_consensus.cc:3055] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:25.922501  5678 raft_consensus.cc:2393] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:25.938946  8617 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:25.943696  8953 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:14:25.944478  8961 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:14:25.951051  8957 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:25.952417  8869 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:25.954308  8960 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:25.844421  8898 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:26.140530  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:26.147395  5678 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:25.963712  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1974) took 1424 ms. Trace:
I20260709 12:14:25.966450  5569 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:25.979085  8974 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:14:25.985580  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 240555us
I20260709 12:14:26.149240  5718 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:25.986194  8975 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:25.987468  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:25.988025  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 83908us
W20260709 12:14:26.151618  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.152495  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:25.999145  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2031) took 2058 ms. Trace:
I20260709 12:14:26.148306  5595 rpcz_store.cc:276] 0709 12:14:24.539337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.559131 (+ 19794us) service_pool.cc:224] Handling call
0709 12:14:24.606558 (+ 47427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.606764 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:24.631678 (+ 24914us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.717073 (+ 85395us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.806978 (+ 89905us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b180045bc80. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa92c2a6 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa92c2a6 00007f44fa92c240
0709 12:14:24.964934 (+157956us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b180045bc80. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa92c2a6 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1
0709 12:14:25.823869 (+858935us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b180045bc80. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95b455 00007f44fda43060 00007f44fda55716 00007f44fda66287 00007f44fda66208
0709 12:14:25.963294 (+139425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.963369 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:25.963420 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.963496 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.963649 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3317,"prepare.queue_time_us":27002,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":114839,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":9512,"spinlock_wait_cycles":22737280,"thread_start_us":224131,"threads_started":2,"wal-append.queue_time_us":147951}
I20260709 12:14:25.966988  8954 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.126696  5749 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.131352  5673 raft_consensus.cc:3055] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:26.156278  5673 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:26.131889  8980 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:26.132927  5603 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:14:25.971364  8883 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:26.135818  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 287813us
I20260709 12:14:25.976001  8748 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.970897  8839 raft_consensus.cc:740] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:26.137936  5753 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:26.120136  8837 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:26.161196  5642 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:26.163713  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:26.164446  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:26.134321  8916 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:26.169137  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:26.171545  5718 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:26.157075  5673 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:26.179001  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:26.179419  5752 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:26.180045  5673 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:26.180498  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:26.181051  5752 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:26.181890  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:26.182711  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:26.183174  5752 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:26.153258  5671 rpcz_store.cc:276] 0709 12:14:23.940678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.020646 (+ 79968us) service_pool.cc:224] Handling call
0709 12:14:24.037285 (+ 16639us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:24.145517 (+108232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.145554 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:24.844440 (+698886us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4800002dd8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4502974aa1 00007f450296bb37 00007f450296b9ca 00007f4502a6326f 00007f4502a62f37 00007f4502a7755c 00007f4502a77508 00007f4502a77488 00007f4502a77443 00007f4502a766ec 00007f45019a0a96
0709 12:14:25.824654 (+980214us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b2c00025bc8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fc344a11 00007f44fc354372 00007f44fda86a01 00007f44fda4b43a 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2
0709 12:14:25.825572 (+   918us) log.cc:844] Serialized 574 byte log entry
0709 12:14:25.996726 (+171154us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:25.996779 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.996840 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.998884 (+  2044us) raft_consensus.cc:1685] finished
0709 12:14:25.998905 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.999073 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61248,"raft.queue_time_us":82862,"raft.run_cpu_time_us":2523,"raft.run_wall_time_us":679902,"spinlock_wait_cycles":20619904,"thread_start_us":170703,"threads_started":1,"wal-append.queue_time_us":171029}
I20260709 12:14:26.140964  8917 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:26.178984  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:26.179313  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:26.184089  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:26.184676  5751 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:26.184231  6323 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.186345  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:26.125308  8475 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:26.187618  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:26.155333  8869 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:26.192250  5603 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:26.192730  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:26.188859  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:26.200429  5752 raft_consensus.cc:2376] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 7. Re-sending same reply.
I20260709 12:14:26.201841  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:26.202272  8827 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:26.202849  8827 raft_consensus.cc:697] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:26.203780  8827 consensus_queue.cc:237] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:26.205260  8960 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:26.205019  8839 consensus_queue.cc:260] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:26.162083  8975 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:26.206727  8963 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
W20260709 12:14:26.207986  8964 log.cc:927] Time spent T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:26.208359  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:26.175657  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 209385us
I20260709 12:14:26.176156  8896 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:26.233451  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2054) took 2904 ms. Trace:
I20260709 12:14:26.233630  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:26.233448  5645 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:26.235764  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:26.236066  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.236634  5752 raft_consensus.cc:2410] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:26.233932  5747 rpcz_store.cc:276] 0709 12:14:23.328792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.349054 (+1020262us) service_pool.cc:224] Handling call
0709 12:14:24.363441 (+ 14387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.602769 (+1239328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.602806 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:25.603394 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.658675 (+ 55281us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:25.658717 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.658799 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.233245 (+574446us) raft_consensus.cc:1685] finished
0709 12:14:26.233271 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.233393 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1238845,"raft.queue_time_us":1240332,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"thread_start_us":54868,"threads_started":1,"wal-append.queue_time_us":223651}
I20260709 12:14:26.238402  6323 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
W20260709 12:14:26.242719  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 50070.6us
I20260709 12:14:26.241566  5673 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:26.243508  5718 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:26.244310  8617 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.245052  8784 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:26.245465  8784 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.245820  8784 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.148078  8888 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 12:14:26.252211  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.251750  8415 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:26.190002  8916 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:26.255113  8917 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:26.255126  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:26.252843  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:26.256578  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 409380us
I20260709 12:14:26.219363  8878 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:26.258512  5751 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:26.209197  8862 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:26.265074  5718 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:26.249147  8896 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.173985  8980 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:26.176316  8883 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:26.273732  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:26.277700  5747 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:14:26.278262  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 44902.9us
I20260709 12:14:26.278640  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:26.266851  8826 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:26.261828  8749 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:26.255146  8868 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:26.279393  5645 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:26.230888  8869 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:26.279347  5747 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:26.273674  8896 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.268100  8878 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.285565  5645 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:26.208649  8876 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:26.301353  8994 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:26.353207  5749 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:26.283226  8826 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:14:26.361097  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 65953.7us
I20260709 12:14:26.360551  8989 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:26.546319  8898 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:26.302211  8868 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:26.298919  8878 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:26.558693  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 196926us
I20260709 12:14:26.360013  8826 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.562335  8826 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:26.546542  8989 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:26.566486  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:26.567054  5673 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 4.
I20260709 12:14:26.548112  8981 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:26.607771  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:26.621601  5672 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:26.612581  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:26.622923  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:26.613441  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:26.559203  8973 log.cc:927] Time spent T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 12:14:26.615283  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:26.642858  5679 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:26.623819  5678 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:26.347350  8985 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.265s
I20260709 12:14:26.646299  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:26.647313  5677 raft_consensus.cc:2410] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:26.662637  5642 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:26.668027  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:26.668784  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 383222us
I20260709 12:14:26.669066  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:26.670856  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:26.670904  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 444029us
I20260709 12:14:26.671495  5671 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:26.566388  8888 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:26.563040  8868 raft_consensus.cc:697] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:26.672760  5569 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:26.688406  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:26.691988  5670 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:26.667948  8981 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:26.694883  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 428357us
I20260709 12:14:26.700484  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:26.796389  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 95982.5us
I20260709 12:14:26.797451  5716 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:26.679558  8937 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:26.693979  8846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.448s	user 0.022s	sys 0.052s
I20260709 12:14:26.794023  8888 raft_consensus.cc:697] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:14:26.808032  8846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.558s	user 0.022s	sys 0.052s
I20260709 12:14:26.693796  8974 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:14:26.806097  8917 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:26.810281  8995 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:26.810043  8996 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:26.810497  8990 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:26.800637  8981 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:26.833972  8980 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:26.807509  8937 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:26.843538  8960 raft_consensus.cc:2955] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Committing config change with OpId 8.7: config changed from index 3 to 7, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:26.865139  8989 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:26.867420  8883 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:26.867916  8975 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:26.872764  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 596) took 1881 ms. Trace:
W20260709 12:14:26.873198  8748 consensus_meta.cc:287] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.683s	user 0.006s	sys 0.002s
I20260709 12:14:26.848312  8898 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:26.873631  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1475) took 1036 ms. Trace:
I20260709 12:14:26.946517  5749 rpcz_store.cc:276] 0709 12:14:25.836884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.869519 (+ 32635us) service_pool.cc:224] Handling call
0709 12:14:26.873475 (+1003956us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54000140d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:26.873572 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588437888}
I20260709 12:14:26.947736  5749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:14:26.948302  5749 raft_consensus.cc:606] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:26.948612  5749 raft_consensus.cc:614] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:26.949024  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59380 (request call id 19) took 1156 ms. Trace:
I20260709 12:14:26.949296  5749 rpcz_store.cc:276] 0709 12:14:25.792447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.947590 (+1155143us) service_pool.cc:224] Handling call
0709 12:14:26.948969 (+  1379us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:26.875571  8617 consensus_meta.cc:287] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.002s
I20260709 12:14:26.950165  8617 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:26.835518  8868 consensus_queue.cc:237] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:26.876504  8751 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:26.877686  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:26.878026  8974 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.883334  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:26.886937  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.888831  8837 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:26.833554  8846 raft_consensus.cc:697] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:26.898212  9002 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:26.857995  8916 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:26.970392  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1473) took 1134 ms. Trace:
I20260709 12:14:26.972404  5747 rpcz_store.cc:276] 0709 12:14:25.836429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.877380 (+1040951us) service_pool.cc:224] Handling call
0709 12:14:26.970327 (+ 92947us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:26.911217  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 246248us
I20260709 12:14:26.849548  8990 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.942230  5674 rpcz_store.cc:276] 0709 12:14:24.991501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.991670 (+   169us) service_pool.cc:224] Handling call
0709 12:14:24.991966 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.360372 (+368406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.360402 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.360445 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:25.360474 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.872479 (+1512005us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54003cdcd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:26.872531 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.872689 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846798208}
I20260709 12:14:26.954916  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:26.851816  8995 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:26.956071  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:26.890561  8869 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:26.960413  6323 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 6 LEARNER]: Advancing to term 7
I20260709 12:14:26.957301  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:26.866096  8888 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:26.946018  8989 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.961344  8898 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:26.961737  6324 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:26.987998  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 582) took 1630 ms. Trace:
I20260709 12:14:26.974800  5749 raft_consensus.cc:1217] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Deduplicated request from leader. Original: 6.4->[7.5-7.5]   Dedup: 7.5->[]
W20260709 12:14:26.945511  8784 consensus_meta.cc:287] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.001s
I20260709 12:14:26.981168  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:26.990274  8784 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:26.991096  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:26.992333  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:26.993446  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:26.982659  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 134349us
I20260709 12:14:26.974787  8883 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.988395  6324 rpcz_store.cc:276] 0709 12:14:25.357287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.361558 (+  4271us) service_pool.cc:224] Handling call
0709 12:14:26.883176 (+1521618us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:26.987927 (+104751us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39161728}
I20260709 12:14:26.997566  5642 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:26.995543  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:26.997789  5747 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:26.989490  5749 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:26.999003  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2064) took 1367 ms. Trace:
I20260709 12:14:26.998438  5599 raft_consensus.cc:2376] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7. Re-sending same reply.
I20260709 12:14:26.975900  8990 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.980702  8837 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.999852  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2066) took 1367 ms. Trace:
I20260709 12:14:26.999549  5749 rpcz_store.cc:276] 0709 12:14:25.631729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.974305 (+1342576us) service_pool.cc:224] Handling call
0709 12:14:26.974678 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.998760 (+ 24082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.998949 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.003011  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:26.956907  8748 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:27.004981  5567 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:27.005573  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:27.006019  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:27.004694  5747 rpcz_store.cc:276] 0709 12:14:25.632185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.980117 (+1347932us) service_pool.cc:224] Handling call
0709 12:14:26.997428 (+ 17311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.999603 (+  2175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.999800 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.008080  5567 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:27.008455  5749 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:27.009523  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:27.010584  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:27.011188  5567 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:27.012504  5567 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:27.011494  5603 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:27.014487  5567 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:27.014930  8916 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:27.019510  8916 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:26.999512  8996 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:26.970286  8974 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.017350  8995 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:27.017907  9000 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:26.976090  9002 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:26.994171  8989 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.018020  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:27.018620  8878 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.015375  9004 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:27.012684  6323 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 7 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:27.000854  8883 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:26.999243  9006 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 12:14:27.021880  5599 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:26.996240  9003 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:27.062748  5744 raft_consensus.cc:2393] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:27.200249  5645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.006s	sys 0.015s
W20260709 12:14:27.083505  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 123177us
W20260709 12:14:27.075466  5601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2133) took 2243 ms (client timeout 1612 ms). Trace:
W20260709 12:14:27.368155  5645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.006s	sys 0.030s
W20260709 12:14:27.233120  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 234316us
I20260709 12:14:27.368424  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:27.019937  8954 consensus_meta.cc:287] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.844s	user 0.004s	sys 0.004s
W20260709 12:14:27.368440  5601 rpcz_store.cc:269] 0709 12:14:24.816620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.866023 (+ 49403us) service_pool.cc:224] Handling call
0709 12:14:27.060058 (+2194035us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b54003ce954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:27.060216 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7809920}
I20260709 12:14:27.369336  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:27.369525  5599 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:27.372789  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:27.372882  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:27.009827  8784 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:27.022476  5718 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:27.377480  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 363044us
I20260709 12:14:27.378744  5567 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:27.376986  8832 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:14:27.026140  8896 consensus_meta.cc:287] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.001s
W20260709 12:14:27.188432  8826 consensus_meta.cc:287] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.004s
I20260709 12:14:27.019923  8916 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:27.379640  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 357243us
I20260709 12:14:27.023085  8996 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:27.392810  5678 raft_consensus.cc:2393] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:27.251242  9011 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.393622  5718 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:27.388139  5567 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:27.392066  8784 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:27.386356  8995 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:27.386463  5595 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:27.395675  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:27.026602  8981 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:27.023835  8937 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:27.401880  5718 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:27.187628  9010 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:27.411612  5718 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:27.395310  8896 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.023972  8846 consensus_queue.cc:237] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:27.420522  5745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2068) took 1787 ms (client timeout 1574 ms). Trace:
W20260709 12:14:27.434689  5745 rpcz_store.cc:269] 0709 12:14:25.632618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.696005 (+ 63387us) service_pool.cc:224] Handling call
0709 12:14:27.420319 (+1724314us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b54000541d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:27.420455 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106760064}
I20260709 12:14:27.418620  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:27.378173  8954 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.414224  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:27.386516  9004 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:27.444844  5599 raft_consensus.cc:2393] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:27.255152  8990 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.419328  9016 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:27.395642  8826 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:27.526106  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 114647us
I20260709 12:14:27.398479  8996 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:27.403453  8832 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:27.526809  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:27.555586  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:27.409051  8999 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:27.410502  8995 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:27.420989  8784 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:27.559140  6291 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:27.422855  8883 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:27.415993  8751 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:27.630865  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 71796.5us
I20260709 12:14:27.650065  6291 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:27.650470  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 281201us
I20260709 12:14:27.651749  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:27.426468  8981 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:27.654809  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:27.423892  8989 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:27.407927  8906 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:27.628925  6328 raft_consensus.cc:2368] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8.
I20260709 12:14:27.528196  9017 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.526173  9004 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:27.443111  8748 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:27.422821  9027 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:27.688424  9027 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.691488  9027 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:27.655469  6323 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:27.703194  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:27.652215  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:27.628638  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 240550us
I20260709 12:14:27.024776  8898 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.585482  5745 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:27.553382  8975 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:27.661530  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:27.658928  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:27.418489  9022 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:27.677147  8883 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:27.426237  9020 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:27.425467  9000 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:27.692998  5601 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:27.555655  9010 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:27.409693  9011 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.558220  8996 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:27.713317  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 50899.8us
I20260709 12:14:27.766085  5601 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:14:27.767648  5601 pending_rounds.cc:85] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 5
I20260709 12:14:27.768045  5601 pending_rounds.cc:107] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.6
I20260709 12:14:27.768357  5601 raft_consensus.cc:2917] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Aborting config change with OpId 6.6: Aborted: Op aborted by new leader
I20260709 12:14:27.654101  8995 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:27.649729  8999 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.685669  8784 raft_consensus.cc:697] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:27.677485  8981 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.651079  9016 raft_consensus.cc:697] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:27.699163  9004 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.720757  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:27.719317  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:27.763342  9002 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:27.736874  8531 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:27.802325  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:27.716256  8868 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.752442  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 436) took 2064 ms. Trace:
I20260709 12:14:27.806121  5745 rpcz_store.cc:276] 0709 12:14:25.688048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.435607 (+1747559us) service_pool.cc:224] Handling call
0709 12:14:27.526066 (+ 90459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.752188 (+226122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.752388 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.753912  5676 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:14:27.756982  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 95514.3us
I20260709 12:14:27.808561  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:27.771241  8878 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:27.735409  8974 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:27.694978  8906 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.762868  9010 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.764719  9025 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.765592  8826 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:27.765810  9011 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:27.715745  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:27.796059  8989 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:27.769955  5601 raft_consensus.cc:2889] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:27.816392  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:27.770510  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.749936  9003 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:14:27.763540  8837 consensus_meta.cc:287] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.752s	user 0.008s	sys 0.001s
I20260709 12:14:27.766255  9000 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.713069  8832 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.756191  8883 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:27.653164  8751 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.797426  5674 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:27.766837  9028 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:27.784801  5570 connection.cc:256] RPC call timeout handler was delayed by -1.0549119400000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 12:14:27.848578  5570 connection.cc:256] RPC call timeout handler was delayed by -1.0530856740001582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 12:14:27.848932  5570 connection.cc:256] RPC call timeout handler was delayed by -1.0233856740001102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 12:14:27.742123  8867 raft_consensus.cc:3055] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:27.700035  9017 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.769070  9018 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:27.796262  8929 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.782331  8999 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.818316  9031 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:14:27.819010  9026 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:27.819491  9015 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:27.819921  9008 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:27.821378  8997 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:27.825166  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 109527us
I20260709 12:14:27.826131  5745 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:27.767823  9020 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.843163  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:27.856743  9023 log.cc:927] Time spent T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:14:27.808130  8990 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:27.854031  8867 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:27.844492  5642 connection.cc:256] RPC call timeout handler was delayed by -1.5783986559999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 12:14:27.833951  8896 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:27.837618  8974 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:27.856254  5570 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:27.836755  8981 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:27.858335  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:27.871608  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:27.812100  8868 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.849015  8883 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.847896  8954 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:27.848306  8751 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:27.843580  8885 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:14:27.858085  8832 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:27.825268  8916 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.843498  9003 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:27.867484  5642 connection.cc:256] RPC call timeout handler was delayed by -1.544198655999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 12:14:27.854851  9018 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:27.836994  8989 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:27.866433  9012 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:14:27.847247  8784 consensus_queue.cc:237] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.873242  8867 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.875648  5745 raft_consensus.cc:2393] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:27.874486  9017 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:27.874761  8846 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:27.877696  5601 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:27.877183  9000 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:27.858626  8929 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.926914  5749 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:27.895553  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:27.928340  8929 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:27.872009  5570 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:27.929172  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 57241.2us
I20260709 12:14:27.837499  9025 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.929877  5570 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:27.930562  8785 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:27.931098  8785 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.931381  9025 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:27.892225  8885 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:27.933015  5570 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:27.864858  9015 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.857728  9034 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:14:27.918612  5603 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:27.892326  9018 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:27.939018  8531 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:27.936592  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 440) took 2247 ms. Trace:
I20260709 12:14:27.940315  5745 rpcz_store.cc:276] 0709 12:14:25.688955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.925458 (+2236503us) service_pool.cc:224] Handling call
0709 12:14:27.936076 (+ 10618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.936271 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.936299 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.936342 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:27.936372 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.936422 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.936536 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.931106  8990 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:27.952107  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2138) took 3066 ms. Trace:
I20260709 12:14:27.866597  9016 consensus_queue.cc:237] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.940376  8885 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:27.959476  8785 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:27.964756  8751 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.863703  9026 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:27.987694  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2053) took 1316 ms. Trace:
I20260709 12:14:27.936378  9000 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:14:27.974478  5746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2071) took 2235 ms (client timeout 1971 ms). Trace:
I20260709 12:14:27.937847  8974 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:27.978058  5602 rpcz_store.cc:276] 0709 12:14:24.885347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.187522 (+302175us) service_pool.cc:224] Handling call
0709 12:14:25.187976 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.188497 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.188923 (+   426us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:27.030229 (+1841306us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b18003b0b00. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa92c2a6 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fc344a11 00007f44fc354372 00007f44fda86a01 00007f44fda4b43a
0709 12:14:27.030686 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:14:27.404172 (+373486us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:27.409887 (+  5715us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.437942 (+ 28055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.438354 (+   412us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.944143 (+505789us) raft_consensus.cc:1685] finished
0709 12:14:27.951865 (+  7722us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.952041 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15113,"prepare.queue_time_us":5534,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":10906,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":2387,"spinlock_wait_cycles":14941568,"thread_start_us":373058,"threads_started":1,"wal-append.queue_time_us":625827}
I20260709 12:14:27.989001  5745 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:28.001569  5746 rpcz_store.cc:269] 0709 12:14:25.738579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.781281 (+ 42702us) service_pool.cc:224] Handling call
0709 12:14:27.974152 (+2192871us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b5400011b54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:27.974350 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127865088}
I20260709 12:14:27.992559  9042 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:27.937443  9031 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:14:27.989944  5679 rpcz_store.cc:276] 0709 12:14:26.671711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.671838 (+   127us) service_pool.cc:224] Handling call
0709 12:14:26.672163 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.951160 (+278997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.951192 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.951668 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:14:27.255814 (+304146us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:27.654948 (+399134us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.657993 (+  3045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.658086 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.987481 (+329395us) raft_consensus.cc:1685] finished
0709 12:14:27.987500 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.987637 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19855,"prepare.queue_time_us":540086,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":3198,"raft.queue_time_us":198764,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":25114,"thread_start_us":843816,"threads_started":3,"wal-append.queue_time_us":602163}
I20260709 12:14:28.002274  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 441) took 2296 ms. Trace:
I20260709 12:14:28.007457  5745 rpcz_store.cc:276] 0709 12:14:25.706301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.967239 (+2260938us) service_pool.cc:224] Handling call
0709 12:14:27.988839 (+ 21600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.001979 (+ 13140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.002210 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.952929  8867 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:27.993615  9026 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:27.994377  8990 raft_consensus.cc:697] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:27.993637  9020 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:28.015735  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:28.006254  9011 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:28.005995  8826 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:28.008834  9042 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:28.023554  9015 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:28.025032  9044 log.cc:927] Time spent T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:14:28.026875  8778 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:28.039383  6324 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:28.031656  8826 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.043289  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:28.042121  9018 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:28.045621  5670 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:28.045186  8891 raft_consensus.cc:3055] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:28.047459  8891 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:28.048290  8891 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:28.049271  8891 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.050192  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:28.050930  5597 raft_consensus.cc:2393] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:28.051700  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:28.052407  5597 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:28.052846  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:28.053078  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:28.052927  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.054040  5597 raft_consensus.cc:2410] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:14:28.054368  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.054814  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:28.055375  6323 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:28.100445  8897 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:27.996788  8996 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.030370  9011 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:28.104660  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:28.452818  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:28.453024  5597 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.623898  5750 rpcz_store.cc:276] 0709 12:14:23.999134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.390162 (+391028us) service_pool.cc:224] Handling call
0709 12:14:24.390457 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.390647 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:24.423709 (+ 33062us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.825504 (+401795us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18000487c0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb23a 00007f44fda55a2a
0709 12:14:25.605063 (+779559us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.605111 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:25.605149 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.605209 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.605314 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":657112,"prepare.queue_time_us":25407,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":11066,"raft.queue_time_us":657615,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"spinlock_wait_cycles":3178368,"thread_start_us":122217,"threads_started":1,"wal-append.queue_time_us":572489}
W20260709 12:14:28.451009  6326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 781) took 3465 ms (client timeout 2740 ms). Trace:
W20260709 12:14:28.448388  5595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1978) took 1533 ms (client timeout 1564 ms). Trace:
I20260709 12:14:28.290459  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 435) took 2602 ms. Trace:
W20260709 12:14:28.454463  6326 rpcz_store.cc:269] 0709 12:14:24.985292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.985411 (+   119us) service_pool.cc:224] Handling call
0709 12:14:28.450826 (+3465415us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b540051e354. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.450938 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995316480}
I20260709 12:14:28.457963  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:28.352227  6328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 785) took 2188 ms (client timeout 2033 ms). Trace:
W20260709 12:14:28.454555  5595 rpcz_store.cc:269] 0709 12:14:26.914728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.914842 (+   114us) service_pool.cc:224] Handling call
0709 12:14:28.448219 (+1533377us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54003cfd54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.448329 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942553344}
I20260709 12:14:28.447062  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:28.454939  5752 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:28.195398  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 142612us
I20260709 12:14:28.459203  5749 rpcz_store.cc:276] 0709 12:14:25.687813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.012172 (+1324359us) service_pool.cc:224] Handling call
0709 12:14:27.012434 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.927419 (+914985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.290154 (+362735us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54002184d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:28.290378 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102612864}
I20260709 12:14:28.461505  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 443) took 2743 ms. Trace:
I20260709 12:14:28.351799  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 585) took 2993 ms. Trace:
I20260709 12:14:28.462230  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:28.461876  5749 rpcz_store.cc:276] 0709 12:14:25.718133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.460787 (+2742654us) service_pool.cc:224] Handling call
0709 12:14:28.461054 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.461221 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.461242 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:28.461279 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:28.461314 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.461363 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.461458 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:28.457086  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:28.456037  6320 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:28.453365  5719 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:28.166237  5602 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:28.463323  6328 rpcz_store.cc:269] 0709 12:14:26.163910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.164223 (+   313us) service_pool.cc:224] Handling call
0709 12:14:28.351962 (+2187739us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540024f4d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.352129 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3338701056}
W20260709 12:14:28.447714  5753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2072) took 2656 ms (client timeout 1762 ms). Trace:
W20260709 12:14:28.464411  5753 rpcz_store.cc:269] 0709 12:14:25.791084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.796334 (+  5250us) service_pool.cc:224] Handling call
0709 12:14:28.447500 (+2651166us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54000546d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.447628 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643494656}
W20260709 12:14:28.142056  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 85715.2us
I20260709 12:14:28.406448  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:28.465744  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.466382  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:28.465294  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2153) took 1053 ms. Trace:
I20260709 12:14:28.463413  5750 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:28.158169  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1982) took 1242 ms. Trace:
I20260709 12:14:28.467070  5602 rpcz_store.cc:276] 0709 12:14:27.411483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.082064 (+670581us) service_pool.cc:224] Handling call
0709 12:14:28.166043 (+ 83979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.463909 (+297866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.465244 (+  1335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:28.462496  6322 rpcz_store.cc:276] 0709 12:14:25.358366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.358516 (+   150us) service_pool.cc:224] Handling call
0709 12:14:25.358814 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.627923 (+269109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.351472 (+2723549us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54001c8ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:28.351699 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275185024}
I20260709 12:14:28.467391  5596 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:28.468046  5603 rpcz_store.cc:276] 0709 12:14:26.915898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.014176 (+ 98278us) service_pool.cc:224] Handling call
0709 12:14:28.158003 (+1143827us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b540009d8d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.158112 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268502784}
I20260709 12:14:28.470084  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:28.054492  8960 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.471158  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:28.033869  8906 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:28.472148  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:28.478001  5752 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:28.478478  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:28.479132  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.472415  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:28.473932  9008 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:28.474326  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:28.479487  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:28.195499  9049 log.cc:927] Time spent T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 12:14:28.482283  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.057948  8778 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.474709  5753 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:14:28.457657  8996 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:28.487048  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1466) took 2652 ms. Trace:
I20260709 12:14:28.487389  5753 rpcz_store.cc:276] 0709 12:14:25.834655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.474147 (+2639492us) service_pool.cc:224] Handling call
0709 12:14:28.474417 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.486791 (+ 12374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.486999 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:28.480265  6322 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:28.479502  5749 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:28.189997  9042 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:28.480679  5595 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
W20260709 12:14:28.481276  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.271889  9018 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:28.466701  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:28.483331  5677 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:28.280824  8840 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:28.550035  8778 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.282727  8999 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:28.556017  8778 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:28.149085  9004 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.556963  5600 raft_consensus.cc:1240] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:28.155495  8990 consensus_queue.cc:237] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.470213  8891 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 12:14:28.484282  5716 leader_election.cc:336] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.512s (SENT)
I20260709 12:14:28.558231  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:28.563416  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 79135.4us
I20260709 12:14:28.564746  6322 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:28.457935  8826 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:28.311280  9015 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:28.470256  8985 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:28.529332  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1463) took 2695 ms. Trace:
I20260709 12:14:28.589432  5749 rpcz_store.cc:276] 0709 12:14:25.833856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.463217 (+2629361us) service_pool.cc:224] Handling call
0709 12:14:28.479215 (+ 15998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.529006 (+ 49791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.529255 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:28.590468  9007 consensus_queue.cc:1059] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:28.326191  8883 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.591671  9007 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:28.592024  9007 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.592325  8999 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:28.592507  8883 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:28.592995  9001 raft_consensus.cc:3055] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:28.593389  9001 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:28.594601  9004 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:28.595422  5748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2060) took 2965 ms (client timeout 3167 ms). Trace:
I20260709 12:14:28.589367  8985 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.596134  8985 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:28.596446  5748 rpcz_store.cc:269] 0709 12:14:25.629857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.629967 (+   110us) service_pool.cc:224] Handling call
0709 12:14:28.595244 (+2965277us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54000a8054. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.595369 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436390656}
I20260709 12:14:28.593317  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:28.597703  8751 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:28.598794  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:28.599354  5676 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:14:28.600087  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:28.600924  5676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:28.601378  5676 raft_consensus.cc:606] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:28.477768  8960 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.601686  5676 raft_consensus.cc:614] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:28.563355  5671 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:28.155299  8995 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.606926  5752 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:28.584662  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:28.611006  5674 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:28.586979  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:28.590128  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 123471us
I20260709 12:14:28.611600  5677 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.587190  5670 raft_consensus.cc:1240] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:28.582175  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:28.604161  6293 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:28.617146  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 2050) took 2005 ms. Trace:
I20260709 12:14:28.617460  5678 rpcz_store.cc:276] 0709 12:14:26.611511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.667760 (+ 56249us) service_pool.cc:224] Handling call
0709 12:14:28.617001 (+1949241us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54002d4e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.617101 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664910080}
I20260709 12:14:28.618000  8995 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:28.618476  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:28.620241  5671 raft_consensus.cc:1240] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:28.618643  5747 raft_consensus.cc:1240] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:28.592332  9007 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.623986  6293 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:28.612804  8896 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.630043  8896 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:28.632027  8896 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:28.632480  8937 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:28.632894  8937 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:28.619136  8867 raft_consensus.cc:2764] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:14:28.634485  5597 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:28.638583  8806 consensus_queue.cc:1059] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:28.613118  8946 consensus_queue.cc:1059] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:14:28.603909  9015 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.646138  5677 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:28.633226  8937 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.647361  6293 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:28.647426  5678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:14:28.640108  8806 raft_consensus.cc:3055] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:28.650166  5678 raft_consensus.cc:606] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:28.650573  5678 raft_consensus.cc:614] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:28.653861  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:28.652006  8867 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:28.637166  8795 consensus_queue.cc:1059] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:14:28.650642  8806 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:28.657007  8806 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.658157  8806 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:28.660240  5751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1465) took 2825 ms (client timeout 2706 ms). Trace:
W20260709 12:14:28.660609  5751 rpcz_store.cc:269] 0709 12:14:25.834420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.185258 (+350838us) service_pool.cc:224] Handling call
0709 12:14:28.660079 (+2474821us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b5400053cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.660180 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91236736}
I20260709 12:14:28.661643  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:28.663204  5751 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:28.664474  8946 raft_consensus.cc:3055] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:28.664786  8946 raft_consensus.cc:740] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:28.665516  8946 consensus_queue.cc:260] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.666770  8946 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:28.667369  8840 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.667829  8840 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:28.649991  9001 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.674820  9001 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.678066  8867 raft_consensus.cc:697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:28.679009  8867 consensus_queue.cc:237] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.690653  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 442) took 2980 ms. Trace:
I20260709 12:14:28.691121  5746 rpcz_store.cc:276] 0709 12:14:25.710964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.003039 (+2292075us) service_pool.cc:224] Handling call
0709 12:14:28.664492 (+661453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.664652 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.664677 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:28.664714 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:28.664743 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.664791 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.690447 (+ 25656us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b5400053cd0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.690579 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519400320}
I20260709 12:14:28.696947  9004 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.697499  9004 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:28.698992  9015 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:28.699347  9004 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:28.700059  5751 raft_consensus.cc:1240] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:28.700778  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:28.706640  8985 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.706990  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:28.707652  5595 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.708858  8985 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:28.720289  8937 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.669636  8840 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:28.786049  5671 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:28.787624  8989 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:28.788240  8937 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:28.788833  8937 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:28.789542  5718 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:28.789381  8937 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.790769  8986 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:28.791155  8986 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.791512  8986 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:28.791613  8785 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:28.792328  9007 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:28.793540  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:28.794525  9007 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:28.794914  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:28.796211  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:28.797255  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:28.809051  5671 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:28.809351  5595 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:28.810426  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:28.810981  5595 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.814702  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 443) took 2932 ms. Trace:
W20260709 12:14:28.721917  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 256850us
I20260709 12:14:28.737985  8833 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:28.742051  5673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 2048) took 2131 ms (client timeout 1765 ms). Trace:
W20260709 12:14:28.815820  5673 rpcz_store.cc:269] 0709 12:14:26.611044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.622667 (+ 11623us) service_pool.cc:224] Handling call
0709 12:14:28.741731 (+2119064us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003575d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.741932 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2440682752}
I20260709 12:14:28.816874  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:28.815146  5600 rpcz_store.cc:276] 0709 12:14:25.881851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.881967 (+   116us) service_pool.cc:224] Handling call
0709 12:14:27.421805 (+1539838us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:27.422022 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.557293 (+1135271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.814449 (+257156us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003e1f54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:28.814634 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2614717056}
I20260709 12:14:28.817457  5673 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.748522  5748 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:28.749677  8885 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:28.748436  5744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1467) took 2913 ms (client timeout 2119 ms). Trace:
I20260709 12:14:28.755407  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:28.833962  5597 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:28.757365  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:28.834069  5744 rpcz_store.cc:269] 0709 12:14:25.834897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.172648 (+337751us) service_pool.cc:224] Handling call
0709 12:14:28.748198 (+2575550us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54003638d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.748351 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996268928}
I20260709 12:14:28.758028  8916 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:28.758850  8415 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:28.834297  6327 raft_consensus.cc:2376] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 10. Re-sending same reply.
I20260709 12:14:28.760071  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:28.760912  9010 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:28.764389  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:28.845940  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 81643.1us
I20260709 12:14:28.765859  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:28.767620  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1480) took 1873 ms. Trace:
I20260709 12:14:28.766917  8475 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:28.773010  8782 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.774559  9018 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.775820  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:28.779533  9021 log.cc:927] Time spent T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 1.194s	user 0.004s	sys 0.005s
I20260709 12:14:28.782748  8868 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:28.784744  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:28.864828  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:28.819075  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:28.865653  5601 raft_consensus.cc:2393] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:28.822865  8989 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:28.823887  8840 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:28.759065  5604 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:28.840862  5595 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:28.842905  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:28.844650  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:28.846041  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.839751  6327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 784) took 2676 ms (client timeout 1948 ms). Trace:
I20260709 12:14:28.771958  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 434) took 3106 ms. Trace:
I20260709 12:14:28.846511  5752 rpcz_store.cc:276] 0709 12:14:26.894629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.478683 (+1584054us) service_pool.cc:224] Handling call
0709 12:14:28.481109 (+  2426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.610731 (+129622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.767398 (+156667us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540022a1d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:28.767563 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288291200}
I20260709 12:14:28.847093  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:28.851418  5673 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:28.857895  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:28.858676  6321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 583) took 3501 ms (client timeout 1935 ms). Trace:
I20260709 12:14:28.862334  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:28.865023  5603 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.791582  8937 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:28.865600  5750 raft_consensus.cc:2376] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7. Re-sending same reply.
I20260709 12:14:28.820376  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:28.961905  5671 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:28.962406  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:28.845392  8415 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.955835  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:28.963990  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:28.965413  5604 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:28.967378  5595 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.963933  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:28.968834  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:28.969551  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.958315  5600 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:28.974807  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 445) took 1979 ms. Trace:
I20260709 12:14:28.859570  8885 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:28.957587  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:28.957510  6327 rpcz_store.cc:269] 0709 12:14:26.163631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.164130 (+   499us) service_pool.cc:224] Handling call
0709 12:14:28.448821 (+2284691us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:28.755271 (+306450us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926e9c 00007f44fa926a5b 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:28.839679 (+ 84408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6189056}
I20260709 12:14:28.978137  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:28.979233  5601 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:28.958983  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:28.959247  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:28.980264  5752 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:28.959663  5747 rpcz_store.cc:276] 0709 12:14:25.687421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.010196 (+1322775us) service_pool.cc:224] Handling call
0709 12:14:27.420448 (+410252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.621301 (+1200853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.771342 (+150041us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000541d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:28.771780 (+   438us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54000541d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:28.771905 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3679513600}
I20260709 12:14:28.833856  8984 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:28.957005  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 110003us
W20260709 12:14:28.961290  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 116694us
I20260709 12:14:28.975770  5749 rpcz_store.cc:276] 0709 12:14:26.995550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.590217 (+1594667us) service_pool.cc:224] Handling call
0709 12:14:28.590530 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.590715 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:28.730290 (+139575us) log.cc:844] Serialized 14 byte log entry
0709 12:14:28.973983 (+243693us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:28.974119 (+   136us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:28.974259 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.974446 (+   187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.974675 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18667,"prepare.queue_time_us":139794,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"thread_start_us":354177,"threads_started":2}
W20260709 12:14:28.970798  6321 rpcz_store.cc:269] 0709 12:14:25.357678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.362027 (+  4349us) service_pool.cc:224] Handling call
0709 12:14:28.765640 (+3403613us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:28.858581 (+ 92941us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97263488}
I20260709 12:14:28.980732  5750 raft_consensus.cc:2393] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:28.985435  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:28.986593  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:28.986778  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:28.987179  5750 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:28.987612  6328 raft_consensus.cc:2410] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:28.988111  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:28.988572  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:28.966873  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:28.980332  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.991969  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:28.992564  5673 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.988732  5750 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.981273  5598 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:28.811133  8986 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:28.994796  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:28.961161  9003 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:29.000134  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:28.861059  9018 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:28.854009  8833 consensus_queue.cc:1059] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 12:14:28.867259  8782 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:29.001147  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:29.024407  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:28.973553  8868 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:29.065894  5750 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:29.066726  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.113951  5642 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:29.115540  6324 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.060011  6328 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:29.071182  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 444) took 2081 ms. Trace:
I20260709 12:14:29.062979  6319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 586) took 3704 ms. Trace:
I20260709 12:14:29.017254  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.072013  5673 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:29.005645  5595 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:29.116225  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.151481  9003 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:29.152010  9003 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:29.151938  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:29.152798  6293 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:29.154871  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.156023  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.157065  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.154364  5753 rpcz_store.cc:276] 0709 12:14:26.995154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.570777 (+1575623us) service_pool.cc:224] Handling call
0709 12:14:28.571077 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.571262 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:28.958576 (+387314us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.070801 (+112225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:29.070866 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:29.070915 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.070985 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.071112 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":159037,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":96,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":10475,"thread_start_us":467767,"threads_started":2}
I20260709 12:14:29.024868  6327 raft_consensus.cc:2955] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:29.158533  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.159112  5747 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
W20260709 12:14:29.100628  9057 log.cc:927] Time spent T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:14:28.978070  8885 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:29.120440  6319 rpcz_store.cc:276] 0709 12:14:25.358702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.359583 (+   881us) service_pool.cc:224] Handling call
0709 12:14:26.867160 (+1507577us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:26.867363 (+   203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.995670 (+128307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.995702 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:27.000463 (+  4761us) log.cc:844] Serialized 26 byte log entry
0709 12:14:27.216866 (+216403us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:27.216909 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.216984 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.778952 (+1561968us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:29.062756 (+283804us) raft_consensus.cc:1685] finished
0709 12:14:29.062777 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.062916 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87140,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5488,"spinlock_wait_cycles":191773696,"thread_start_us":288934,"threads_started":2,"wal-append.queue_time_us":389705}
I20260709 12:14:29.153702  8937 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:29.150986  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:29.171077  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:29.172230  5753 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:29.174628  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:29.106103  9058 log.cc:927] Time spent T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:14:29.026216  8996 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.159140  8891 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:29.153826  9031 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:29.175910  5752 raft_consensus.cc:2393] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:29.107326  8986 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:29.187824  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.181603  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:29.188656  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:29.176584  5747 raft_consensus.cc:1240] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:29.186389  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:29.107676  8415 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:29.224718  5677 raft_consensus.cc:2393] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:29.160883  8897 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.176100  8868 raft_consensus.cc:697] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:29.214148  9031 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:29.207221  8937 raft_consensus.cc:697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:29.224519  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:29.232797  5753 raft_consensus.cc:2368] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8.
I20260709 12:14:29.227847  5750 raft_consensus.cc:2393] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:29.226626  5744 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:29.174834  8885 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.311859  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.312173  8986 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.312714  8986 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:29.314774  8986 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:29.315610  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.307806  5716 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:29.308355  9018 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:29.162169  8906 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:14:29.308720  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:29.308732  8937 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.025727  8984 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.310524  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.401822  5747 raft_consensus.cc:2393] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 5: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:29.307384  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.231376  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:29.372352  5570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.589s (SENT) [suppressed 36 similar messages]
I20260709 12:14:29.232357  9031 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:29.399430  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 91706.7us
I20260709 12:14:29.403654  5716 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:29.402326  5753 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 5.
I20260709 12:14:29.404783  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.405459  5753 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 11: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:29.221065  8996 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:29.401489  5677 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:29.408524  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:29.409204  5752 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.406195  5671 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:29.411110  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.411628  5750 raft_consensus.cc:2376] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 8. Re-sending same reply.
I20260709 12:14:29.411849  5716 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:29.410491  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:29.414433  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:29.414932  5671 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:29.415520  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:29.415730  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:29.417096  5716 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:29.416287  5671 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:29.417999  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:29.418239  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:29.419132  5671 raft_consensus.cc:2410] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:14:29.419555  5673 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:29.419564  8833 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:29.450595  9065 log.cc:927] Time spent T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 12:14:29.452095  8996 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:29.453068  5747 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:29.458947  9067 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
W20260709 12:14:29.466298  9056 log.cc:927] Time spent T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:14:29.468272  8415 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:29.470278  8984 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:29.471959  8960 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:29.446864  5716 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:29.256203  8897 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.423243  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:29.482299  5677 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.484828  5747 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:29.405910  8986 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:29.482396  5603 consensus_meta.cc:287] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.000s
I20260709 12:14:29.485992  5603 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:29.483543  6324 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:29.414606  9007 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.488355  5676 raft_consensus.cc:2955] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:29.450616  8833 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:29.418944  8475 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:29.297715  8868 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.497025  5752 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:29.421615  8839 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.484313  8844 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:29.529337  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2083) took 1470 ms. Trace:
I20260709 12:14:29.529793  5746 rpcz_store.cc:276] 0709 12:14:28.058943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.715986 (+657043us) service_pool.cc:224] Handling call
0709 12:14:28.716325 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.716672 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.716698 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.717191 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.956321 (+239130us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:28.956360 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.956422 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.529105 (+572683us) raft_consensus.cc:1685] finished
0709 12:14:29.529126 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.529269 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5957,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":238762,"threads_started":1,"wal-append.queue_time_us":440893}
I20260709 12:14:29.487941  8869 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:14:29.497867  8475 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:29.555090  5677 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:29.553099  8984 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:29.569314  8984 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:29.498032  9007 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.572984  5677 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:29.543146  8475 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:29.575037  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 94249.3us
W20260709 12:14:29.575506  5751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.010s	sys 0.018s
I20260709 12:14:29.575932  9072 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.576504  5751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.010s	sys 0.019s
I20260709 12:14:29.576457  9072 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.577520  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2082) took 1518 ms. Trace:
I20260709 12:14:29.578612  9072 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:29.578675  8984 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:29.577924  5751 rpcz_store.cc:276] 0709 12:14:28.058690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.700849 (+642159us) service_pool.cc:224] Handling call
0709 12:14:28.701142 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.701351 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:28.970055 (+268704us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.577082 (+607027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:29.577133 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:29.577190 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.577366 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.577469 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29336,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":332,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":875100,"threads_started":2}
I20260709 12:14:29.580408  5716 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:29.581734  9062 log.cc:927] Time spent T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:14:29.581959  8844 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:29.582525  8844 raft_consensus.cc:697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:29.583453  8844 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:29.584388  8896 raft_consensus.cc:3055] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:29.584774  8896 raft_consensus.cc:740] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:29.586571  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.587507  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.588249  5751 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:29.588496  8885 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.588433  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.590206  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.588923  5746 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:29.590776  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.591900  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:29.581784  5677 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:29.545924  8891 raft_consensus.cc:697] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:29.593591  5716 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:29.609161  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:29.609949  5642 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:29.614549  8885 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:29.617137  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:29.591043  8996 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.620882  5716 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:29.623503  5642 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:29.628146  8869 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:29.628720  8869 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:29.629199  8869 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.632122  9077 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:29.634266  8984 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:29.634992  8984 raft_consensus.cc:697] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:29.635955  8984 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.617949  8994 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:29.585507  8896 consensus_queue.cc:260] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.621732  8986 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:29.611691  8957 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:14:29.649302  5674 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:29.626585  8906 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:29.621992  8996 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:29.626986  9003 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:29.647640  9016 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:14:29.658331  8986 raft_consensus.cc:697] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:29.678346  5671 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:29.663731  8896 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.653481  8891 consensus_queue.cc:237] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:29.669775  8897 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:29.706775  8996 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:29.672207  8867 consensus_queue.cc:1059] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:14:29.720733  9007 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:29.734334  9007 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.734814  9007 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.737411  9007 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:29.738034  8994 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:29.738852  8847 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:29.743471  9029 log.cc:927] Time spent T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 1.994s	user 0.005s	sys 0.015s
I20260709 12:14:29.744741  9008 raft_consensus.cc:3055] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:29.746727  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 1996) took 1043 ms. Trace:
I20260709 12:14:29.744966  8869 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.747120  5597 rpcz_store.cc:276] 0709 12:14:28.703444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.705092 (+  1648us) service_pool.cc:224] Handling call
0709 12:14:28.705335 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.834543 (+129208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.746498 (+911955us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54002ffb54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:29.746667 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295253760}
W20260709 12:14:29.775535  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 131178us
I20260709 12:14:29.777158  5676 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:29.780462  5676 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:29.750561  9008 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:29.787217  9008 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.788271  9008 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:29.707660  8986 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:29.781255  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:29.776535  9080 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:14:29.774479  9003 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:29.806100  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:29.818342  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.820094  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:29.822975  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:29.826037  8869 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:29.827868  9011 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:29.821863  8994 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.831050  8994 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.831800  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:29.832494  6325 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:14:29.832868  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 627) took 1779 ms (client timeout 1765 ms). Trace:
I20260709 12:14:29.833055  8994 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:29.835157  8475 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.838433  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2065) took 1026 ms. Trace:
I20260709 12:14:29.838603  8906 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:29.835302  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 1.22335e+06us
I20260709 12:14:29.840713  5671 rpcz_store.cc:276] 0709 12:14:28.811929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.446279 (+634350us) service_pool.cc:224] Handling call
0709 12:14:29.446589 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.678801 (+232212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.838211 (+159410us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400490f54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:29.838378 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532555136}
I20260709 12:14:29.843659  5671 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:29.840184  6325 rpcz_store.cc:269] 0709 12:14:28.053826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.054515 (+   689us) service_pool.cc:224] Handling call
0709 12:14:29.831706 (+1777191us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5800003998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:29.832796 (+  1090us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793721984}
I20260709 12:14:29.839704  9088 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.819648  8867 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 12:14:29.850317  5675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1415) took 4569 ms (client timeout 5119 ms). Trace:
I20260709 12:14:29.851171  8475 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:29.850757  5675 rpcz_store.cc:269] 0709 12:14:25.280554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.282234 (+  1680us) service_pool.cc:224] Handling call
0709 12:14:29.849405 (+4567171us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b5400063e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:29.850239 (+   834us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578861824}
I20260709 12:14:29.860497  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2004) took 1077 ms. Trace:
I20260709 12:14:29.860881  5596 rpcz_store.cc:276] 0709 12:14:28.782607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.782716 (+   109us) service_pool.cc:224] Handling call
0709 12:14:28.783009 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.783216 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:28.857433 (+ 74217us) log.cc:844] Serialized 14 byte log entry
0709 12:14:28.975254 (+117821us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.858479 (+883225us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b18003da020. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:29.860036 (+  1557us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18003da020. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa8d8c0a 00007f4504018219 00007f44fa960a40 00007f44fa95b4e4 00007f44fa95b455 00007f44fda43060 00007f44fda55716 00007f44fda66287 00007f44fda66208
0709 12:14:29.860165 (+   129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:29.860224 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:29.860274 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.860344 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.860447 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5836,"prepare.queue_time_us":223942,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":2887,"raft.run_wall_time_us":15680,"spinlock_wait_cycles":103424768,"thread_start_us":190058,"threads_started":2,"wal-append.queue_time_us":317166}
I20260709 12:14:29.878595  5716 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:29.838462  9031 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.901415  5672 raft_consensus.cc:2410] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:29.912298  9073 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.912973  9090 log.cc:927] Time spent T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:14:29.920900  9008 consensus_queue.cc:1059] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:29.922699  9092 log.cc:927] Time spent T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:14:29.932916  9007 raft_consensus.cc:3055] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:29.933385  9007 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:29.933634  8833 consensus_queue.cc:1059] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:14:29.936053  8833 raft_consensus.cc:3055] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:29.936445  8833 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:29.913887  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 66344.4us
I20260709 12:14:29.916999  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2079) took 1859 ms. Trace:
I20260709 12:14:29.886894  8475 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:29.845880  9088 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:29.961391  5748 rpcz_store.cc:276] 0709 12:14:28.057474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.597228 (+539754us) service_pool.cc:224] Handling call
0709 12:14:28.748323 (+151095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.818040 (+ 69717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.916786 (+1098746us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003638d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:29.916934 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346739456}
I20260709 12:14:29.934208  9007 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:30.004966  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.990131  9070 log.cc:927] Time spent T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:14:29.912935  9073 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.068111  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 638) took 1082 ms. Trace:
I20260709 12:14:30.068660  6327 rpcz_store.cc:276] 0709 12:14:28.986124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.989321 (+  3197us) service_pool.cc:224] Handling call
0709 12:14:29.024451 (+ 35130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.024748 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:29.596563 (+571815us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.886598 (+290035us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.067741 (+181143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:30.067799 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:30.067850 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.067916 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.068051 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":1357,"thread_start_us":463311,"threads_started":3,"wal-append.queue_time_us":81496}
I20260709 12:14:29.991513  8475 raft_consensus.cc:697] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:30.085359  8782 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.082798  8833 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.089772  8475 consensus_queue.cc:237] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.059382  8997 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:30.093457  8997 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:30.188010  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 52061.2us
I20260709 12:14:30.189580  8997 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:30.194522  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 261652us
I20260709 12:14:30.203599  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:30.205560  5569 connection.cc:256] RPC call timeout handler was delayed by -1.0969907920000423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.5119s for a response
I20260709 12:14:30.205596  5678 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:30.208110  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:30.208624  5678 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.210032  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.211544  5718 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:30.192636  8833 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.213469  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.214799  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:30.215642  5671 raft_consensus.cc:2410] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 12:14:30.218201  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.219249  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.221004  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.222685  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.198936  9031 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:30.225191  5673 raft_consensus.cc:2393] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:30.225572  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.228467  5718 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:30.229394  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 267177us
I20260709 12:14:30.205176  8867 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.236140  5718 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:30.230675  5676 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:30.237612  6322 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:30.238257  6320 raft_consensus.cc:1240] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:30.232337  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:30.232888  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.240109  6327 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:30.232975  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.234197  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.241005  6324 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:30.229199  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.238723  5718 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.243330  5718 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:30.249173  5718 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.255914  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.256731  5718 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.257099  5677 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:30.231209  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.258442  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.260286  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.260846  6324 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:30.255889  9011 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:30.269577  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:30.268424  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.271610  6324 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:30.271814  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.227626  8475 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:30.267328  8868 raft_consensus.cc:2764] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:14:30.280992  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.229612  9088 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.289916  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.290717  5677 raft_consensus.cc:2393] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:30.256170  8869 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.259701  9084 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.292145  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:30.334100  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 77435.7us
I20260709 12:14:30.365222  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.407310  6327 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:30.407371  5718 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.259258  8867 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:30.396739  5677 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:30.266729  9099 consensus_queue.cc:1059] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:14:30.401422  5678 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:30.402614  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.403569  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.258896  8986 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:30.417832  8976 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:30.414943  9084 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:30.419385  8976 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:30.420809  8867 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:30.419418  9084 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.421666  8976 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:30.422816  9099 raft_consensus.cc:3055] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:30.400185  8475 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.428790  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.429630  5670 raft_consensus.cc:2393] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:30.430172  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.430766  6324 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:30.435395  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 2051) took 3823 ms. Trace:
I20260709 12:14:30.435870  5672 rpcz_store.cc:276] 0709 12:14:26.611732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.648039 (+ 36307us) service_pool.cc:224] Handling call
0709 12:14:30.434880 (+3786841us) spinlock_profiling.cc:243] Waited 3.21 s on lock 0x7b540024f9d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:30.435328 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7385748352}
W20260709 12:14:30.436928  6293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.010s	sys 0.002s
I20260709 12:14:30.437909  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:30.438400  6293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.010s	sys 0.002s
W20260709 12:14:30.439153  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 591850us
I20260709 12:14:30.439781  5679 raft_consensus.cc:1275] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:14:30.441138  5679 pending_rounds.cc:85] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 3
I20260709 12:14:30.441385  5679 pending_rounds.cc:107] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:14:30.441704  5679 raft_consensus.cc:2889] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:30.443874  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.445006  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.431905  8475 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.428881  9099 raft_consensus.cc:740] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:30.445941  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.432559  8986 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:30.444535  5670 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
W20260709 12:14:30.449448  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.451148  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.434007  9011 consensus_queue.cc:1059] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:14:30.437282  8868 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:14:30.453169  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.447192  8475 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.457811  5676 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:30.459604  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.460369  5674 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:30.462967  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:30.463765  5670 raft_consensus.cc:2368] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8.
W20260709 12:14:30.465435  6291 connection.cc:256] RPC call timeout handler was delayed by -1.4289973900001769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 12:14:30.465854  6291 connection.cc:256] RPC call timeout handler was delayed by -1.1823973900000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 12:14:30.467885  5672 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:30.477278  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 48518.7us
W20260709 12:14:30.478545  5645 leader_election.cc:336] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.948s (SENT)
I20260709 12:14:30.478471  5718 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:30.471289  6293 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:30.472390  9088 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.507265  5672 raft_consensus.cc:1240] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:30.515249  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:30.517961  8869 consensus_queue.cc:1059] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:30.501274  9011 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:30.479338  8976 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:30.479441  9085 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:30.524791  8976 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:30.526994  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 47269.1us
I20260709 12:14:30.506151  9096 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:30.529289  5645 connection.cc:256] RPC call timeout handler was delayed by -1.23401716699982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 12:14:30.530067  5645 connection.cc:256] RPC call timeout handler was delayed by -1.0951305089997732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 12:14:30.522142  9011 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:30.531116  5645 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.533595  5718 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.524250  8867 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:30.531430  9031 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.527518  9097 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:30.543316  5748 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11. Ops: [10.4-10.4]
W20260709 12:14:30.543610  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 70029.9us
I20260709 12:14:30.546422  5745 raft_consensus.cc:1275] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:30.546949  6291 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.537920  8869 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.548108  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.538424  8888 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:30.548761  8888 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:30.548954  9111 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:30.548658  9097 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:30.549255  8888 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.551496  9097 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.548126  5744 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:14:30.554836  8976 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.534613  9011 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.558802  6291 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.531965  9096 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.508674  9088 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:30.564226  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.526786  9085 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.565482  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.565635  9108 consensus_queue.cc:1059] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:30.565929  5672 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:30.560150  9097 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.558079  9103 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:30.567936  5718 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.570611  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:30.571134  5676 raft_consensus.cc:2376] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11. Re-sending same reply.
I20260709 12:14:30.572041  9097 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:30.573446  9084 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.575699  9084 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:30.575977  8888 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:30.577975  9111 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:14:30.579238  5677 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:30.579381  9088 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.580124  8958 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:30.560380  9096 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:30.563047  9112 raft_consensus.cc:3055] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:30.581806  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.580535  8958 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:30.581848  9112 raft_consensus.cc:740] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:30.547832  9031 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.547713  8867 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:30.584975  8958 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:30.562995  9100 consensus_queue.cc:1059] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:14:30.591717  5744 raft_consensus.cc:1240] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:30.594218  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:30.595211  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.595140  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.596910  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:30.597555  5751 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.598565  6324 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 7 LEARNER]: Advancing to term 8
I20260709 12:14:30.598692  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:30.599821  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:30.602239  5749 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:30.603750  8415 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.604442  9007 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.604259  8415 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.605489  8867 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.606313  8415 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.606849  9073 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.608050  8475 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:30.610405  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.604133  9031 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.614006  5747 raft_consensus.cc:1240] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:30.617081  6324 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 8 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:30.629657  5751 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:30.627045  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:30.631565  5674 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:30.632072  8888 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:30.635490  8958 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.637787  8958 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:30.638447  6319 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:30.640766  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.599812  9112 consensus_queue.cc:260] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.610354  9085 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.642232  9112 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:30.642767  8986 raft_consensus.cc:3055] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:30.643138  8986 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:30.643916  8986 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.644824  8986 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.646751  9103 raft_consensus.cc:3055] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:30.647240  9103 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:30.655495  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 1988) took 3709 ms. Trace:
I20260709 12:14:30.655946  5599 rpcz_store.cc:276] 0709 12:14:26.946060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.526545 (+580485us) service_pool.cc:224] Handling call
0709 12:14:30.655303 (+3128758us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400480654. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:30.655433 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3360692992}
I20260709 12:14:30.658528  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2008) took 1874 ms. Trace:
W20260709 12:14:30.659713  9107 log.cc:927] Time spent T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.150s	user 0.003s	sys 0.000s
I20260709 12:14:30.658931  5600 rpcz_store.cc:276] 0709 12:14:28.783787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.971283 (+187496us) service_pool.cc:224] Handling call
0709 12:14:28.971596 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:28.971991 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.972019 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:28.972568 (+   549us) log.cc:844] Serialized 52 byte log entry
0709 12:14:29.159583 (+187015us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:29.295145 (+135562us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.902191 (+607046us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.658001 (+755810us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b18003da080. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa8d8c0a 00007f4504018219 00007f44fa960a40 00007f44fa95b4e4 00007f44fa95b455 00007f44fda43060 00007f44fda55716 00007f44fda66287 00007f44fda66208
0709 12:14:30.658149 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.658227 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.658327 (+   100us) raft_consensus.cc:1685] finished
0709 12:14:30.658342 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.658474 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1466455,"prepare.queue_time_us":244549,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":12401,"raft.queue_time_us":587639,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":13980,"spinlock_wait_cycles":5653760,"thread_start_us":190626,"threads_started":2,"wal-append.queue_time_us":238956}
I20260709 12:14:30.648320  9103 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:30.662345  9103 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.665959  9010 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.666601  9010 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.669342  9010 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:30.669940  5569 connection.cc:256] RPC call timeout handler was delayed by -1.0224547259999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 12:14:30.670234  8475 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:30.671463  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.672194  5596 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:30.672119  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.672761  5600 raft_consensus.cc:2376] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7. Re-sending same reply.
I20260709 12:14:30.673583  5603 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:30.674618  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.674872  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:30.676179  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.696262  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.740839  5597 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
W20260709 12:14:30.677652  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 247686us
I20260709 12:14:30.707614  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:30.696671  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.730556  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:30.720389  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:30.751341  5599 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.677301  5601 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:30.698374  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:30.723138  5671 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:30.713848  5677 raft_consensus.cc:3055] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:30.758195  5677 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:30.764560  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.765303  5596 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:30.766391  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:30.767124  5596 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:30.769896  5671 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:30.771711  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:30.771853  5674 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:30.773588  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.774813  5597 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:30.772686  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.775674  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:30.776789  5597 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.782184  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.759083  5677 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:30.794579  5677 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.798975  5678 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:30.800473  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.671969  8840 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.677446  8991 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.648205  8869 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:30.827402  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 58447.5us
I20260709 12:14:30.828931  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.816434  5673 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:30.818023  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.830799  5601 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:30.831616  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:30.671289  9010 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:30.822852  5596 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:30.823493  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.823768  5677 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:14:30.834437  5677 pending_rounds.cc:85] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 5
I20260709 12:14:30.695787  8784 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:30.824062  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 262297us
I20260709 12:14:30.825321  5597 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:30.771888  8989 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.835553  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.834537  5602 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:30.834712  5677 pending_rounds.cc:107] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:14:30.839815  5677 raft_consensus.cc:2889] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:30.840924  5744 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:30.837075  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:30.841938  6319 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:30.834702  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:30.843075  5596 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:30.832134  5601 raft_consensus.cc:2376] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8. Re-sending same reply.
I20260709 12:14:30.839452  5597 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:30.659777  9011 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:30.843954  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:30.847702  5596 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.851039  5719 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.854293  5599 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:30.854857  5597 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:30.856088  5597 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:30.856309  6291 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:30.857355  5719 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:30.861387  5716 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.866115  5719 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:30.808169  8715 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:14:30.862998  6293 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:30.868652  9111 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.838649  8991 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:30.829685  8840 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.870498  8991 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.871482  8840 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:30.872014  8840 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:30.872778  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.873409  5746 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:30.874266  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.869364  9008 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:30.874800  5746 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
W20260709 12:14:30.875532  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.876216  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.876549  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:30.874752  9007 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:30.875734  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.878829  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:30.879144  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.880190  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.880492  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:30.874259  5716 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:30.880093  5595 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:30.882534  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.883021  5716 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:30.883246  5603 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:14:30.881093  5602 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.884835  5678 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.880004  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:30.892812  5678 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:30.869131  8958 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.838603  8916 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.895637  8888 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:30.839663  8833 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:30.867615  6291 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:30.824436  9084 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:14:30.907076  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:30.916062  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 48522.5us
I20260709 12:14:30.885600  8475 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:30.878403  8957 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.919605  6291 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:30.843464  9104 consensus_queue.cc:1059] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:14:30.900107  9007 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:30.845525  8989 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.846983  8784 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:30.844252  9010 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:30.905725  5596 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:30.861101  8869 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:14:30.913918  9113 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:30.948753  5749 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:30.948658  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:30.973433  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:30.916302  8833 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:30.918365  8888 raft_consensus.cc:697] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:30.922034  8990 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.912907  9111 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:14:30.971892  5598 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:30.921964  9117 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.000985  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:31.001829  5752 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:30.974253  6291 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:30.926031  9034 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.946287  8937 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.910056  8916 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:30.928617  9007 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:30.984409  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:30.976114  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 148047us
W20260709 12:14:30.984156  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.913442  9115 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.929780  8475 raft_consensus.cc:697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:30.975297  5604 raft_consensus.cc:2955] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:30.924715  9008 consensus_queue.cc:1059] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:14:30.970932  8957 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.994580  8867 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:31.038031  5745 raft_consensus.cc:1240] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:31.036819  5752 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:31.036574  9119 consensus_queue.cc:1059] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:14:31.048218  8475 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.054497  9008 raft_consensus.cc:3055] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:31.055047  9008 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:30.951231  9099 consensus_queue.cc:260] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:30.999284  8990 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:31.177906  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 203711us
I20260709 12:14:31.181022  6291 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:31.034135  9104 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.181591  8990 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:31.181859  8937 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:31.026469  9034 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.055990  9008 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.021229  9007 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.183143  9008 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.079609  8867 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:31.065673  8958 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.128s
I20260709 12:14:31.037499  8957 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:31.185221  8867 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.185781  8957 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.181936  9104 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.181167  8989 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:31.189013  9104 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.184011  9034 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:31.201116  8957 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.203657  8957 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:31.196009  8986 consensus_meta.cc:287] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.002s
W20260709 12:14:31.229090  9103 consensus_meta.cc:287] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.000s
I20260709 12:14:31.237620  9115 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.020753  5570 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:31.265108  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 244258us
I20260709 12:14:31.266996  5570 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:31.270282  5570 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:31.192579  8888 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:31.209841  9011 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:31.279335  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:31.357972  5596 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:31.359340  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:31.360409  5596 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:31.282056  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:31.363559  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:31.364967  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:31.238714  9112 consensus_meta.cc:287] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 12:14:31.365914  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:31.374750  5603 raft_consensus.cc:2368] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8.
W20260709 12:14:31.384014  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 201483us
I20260709 12:14:31.277736  5567 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:31.386559  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:31.288901  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:31.304802  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 438569us
I20260709 12:14:31.305585  5750 raft_consensus.cc:1240] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:31.355805  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.373126  8833 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:31.302471  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 395299us
I20260709 12:14:31.379103  5600 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:31.350370  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:31.286722  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:31.341003  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:31.395292  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:31.324476  8990 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:31.323822  8989 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:31.319696  8981 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:31.325555  8991 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:14:31.399588  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:31.302776  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:31.409623  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 123299us
I20260709 12:14:31.335909  9010 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:31.400296  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:31.337220  9034 raft_consensus.cc:2764] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:14:31.417562  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 140229us
W20260709 12:14:31.426347  9106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.004s	sys 0.021s
W20260709 12:14:31.426908  9106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.004s	sys 0.022s
I20260709 12:14:31.427910  9104 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:31.428645  5602 consensus_meta.cc:287] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.009s
I20260709 12:14:31.429484  5602 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:31.430503  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:31.431591  5603 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
W20260709 12:14:31.434010  9096 consensus_meta.cc:287] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.848s	user 0.010s	sys 0.009s
I20260709 12:14:31.434614  9096 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.438536  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.439669  6327 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:31.440626  6322 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:31.401928  8989 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.441303  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.413573  9140 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.438572  6323 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:31.402034  8990 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:31.449256  9096 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:31.450255  8784 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:31.451575  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.452929  8803 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.453636  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.454550  5678 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:31.456172  5598 raft_consensus.cc:2410] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:31.450157  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.453677  9134 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.508488  5598 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:31.508991  9134 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.510803  5598 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:31.511436  9134 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:31.458294  9104 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:31.458604  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:31.459616  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 59603.8us
I20260709 12:14:31.513108  5598 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:31.513350  5716 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:31.462507  8960 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:31.467334  9126 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:31.471835  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:31.472332  9097 raft_consensus.cc:3055] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:31.473109  5719 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:31.473536  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:31.475317  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:31.475729  9007 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.476425  8989 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:31.520558  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:31.522119  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.522840  6327 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
W20260709 12:14:31.476951  5718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.007s	sys 0.007s
I20260709 12:14:31.477155  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:31.477324  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:31.450500  6325 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 8 LEARNER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:14:31.470842  5597 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:31.473598  6319 raft_consensus.cc:2376] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 8. Re-sending same reply.
I20260709 12:14:31.512326  6322 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:31.452821  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:31.470947  9099 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:31.454372  8981 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.459852  9122 raft_consensus.cc:3055] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:31.517791  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 73913.1us
I20260709 12:14:31.519801  6328 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:31.500344  8990 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:31.528267  6320 raft_consensus.cc:2368] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8.
I20260709 12:14:31.529064  8803 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.529992  9034 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:31.534226  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 75739.9us
I20260709 12:14:31.534519  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.487004  9140 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:31.526768  5718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.008s	sys 0.007s
I20260709 12:14:31.539291  8981 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:31.542590  6321 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:31.543550  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:31.539481  9122 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:31.545047  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:31.545857  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:31.549121  8916 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:31.550704  5672 raft_consensus.cc:2410] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:14:31.539405  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.551067  5670 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:31.552572  5603 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:14:31.552807  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.558491  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:31.515933  9126 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:31.568248  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.518080  9097 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:31.571110  6319 raft_consensus.cc:2393] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:31.574569  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:31.575023  5597 raft_consensus.cc:3055] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:14:31.575873  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 102901us
I20260709 12:14:31.600823  5597 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:14:31.576375  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 664090us
I20260709 12:14:31.576880  8960 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.578197  6325 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:31.578001  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:31.602466  6323 raft_consensus.cc:2410] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:31.571409  9140 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:31.607751  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 62905.2us
I20260709 12:14:31.599617  9126 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:31.610649  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:31.612493  6319 raft_consensus.cc:1240] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:31.612901  5674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.006s	sys 0.009s
I20260709 12:14:31.613358  5718 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:31.615564  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:31.616145  8888 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:14:31.616567  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:31.617079  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 103881us
I20260709 12:14:31.621928  8475 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:31.623456  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:31.624411  9134 raft_consensus.cc:670] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } [suppressed 6 similar messages]
I20260709 12:14:31.626904  5567 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:31.627497  5600 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:31.628418  9104 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.640034  6327 raft_consensus.cc:2368] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9.
W20260709 12:14:31.644199  5674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.006s	sys 0.010s
I20260709 12:14:31.649860  9106 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.651459  5675 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:31.651682  9104 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.654121  6320 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:31.640803  9122 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.655582  9122 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.655926  9097 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.657279  9097 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.658703  5716 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:31.659962  5716 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:31.660919  9141 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:31.661533  9141 raft_consensus.cc:697] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:31.662207  5570 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:31.662648  9141 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:31.667003  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 60153.8us
I20260709 12:14:31.668742  5567 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:31.669719  9034 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:31.670113  9034 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:31.670466  9034 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.670989  8803 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:31.672062  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 58850.4us
I20260709 12:14:31.672943  5718 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:31.674103  9129 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:31.674770  9129 raft_consensus.cc:697] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:31.674942  5679 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:31.622105  9145 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:31.681326  6328 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:31.673993  8916 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:31.683331  9129 consensus_queue.cc:237] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:31.685905  9010 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.686806  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:31.687103  5501 catalog_manager.cc:5697] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:31.688234  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:31.689947  8958 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:31.690533  8958 raft_consensus.cc:697] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:31.697734  8916 raft_consensus.cc:697] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:31.698328  8958 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.698783  8916 consensus_queue.cc:237] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:31.704953  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.708048  9007 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:31.686874  9127 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:31.710062  9127 raft_consensus.cc:697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:31.690797  5597 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.711071  9127 consensus_queue.cc:237] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:31.712177  5597 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.689949  5501 catalog_manager.cc:5697] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:31.733554  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 51551us
I20260709 12:14:31.691030  9145 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.734872  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:31.735152  6320 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:31.687096  8475 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:31.741971  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 73296.8us
I20260709 12:14:31.746389  5716 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:31.736793  9010 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.740615  9145 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:31.752223  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:31.757916  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 127474us
I20260709 12:14:31.744159  9104 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:31.767135  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:31.774144  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:31.773330  5718 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:31.744737  9106 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:14:31.776544  5679 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
W20260709 12:14:31.780421  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 165022us
I20260709 12:14:31.779482  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:31.785879  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.786681  9106 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:31.787261  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 106815us
I20260709 12:14:31.787375  9106 raft_consensus.cc:697] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:31.788640  9106 consensus_queue.cc:237] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:31.790277  9115 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:31.773149  9141 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:31.794028  9141 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.794401  9141 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:31.794519  9149 log.cc:927] Time spent T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:14:31.799376  8960 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.799808  8960 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.803781  6328 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:31.805102  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.807782  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:31.809419  6293 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:31.810190  8715 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.810778  8715 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:31.812080  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.812719  8475 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:31.785009  6325 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:31.814110  9104 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:31.814482  9104 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.814548  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:31.814797  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 64826.9us
I20260709 12:14:31.816028  5567 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:31.805677  6328 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:31.819259  6325 raft_consensus.cc:2410] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:31.819983  9119 consensus_queue.cc:1059] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:31.820808  9119 consensus_queue.cc:1243] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer c02ed29558db481589fd3db23e43a07f log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:31.821301  9119 raft_consensus.cc:2764] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:31.822048  9119 raft_consensus.cc:3055] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:31.822392  9119 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:14:31.825465  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.822337  6327 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:31.823459  9119 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.819183  6319 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:31.837132  6293 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:31.834244  6326 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:31.821249  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:31.840555  6324 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:31.759274  9010 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.814906  9104 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.847358  9110 consensus_queue.cc:1059] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:14:31.863140  8839 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.864187  9085 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.864799  9085 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:31.861055  9134 consensus_queue.cc:1059] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 12:14:31.867563  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.889746  5597 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:31.874076  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:31.894065  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 145934us
W20260709 12:14:31.894574  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:31.894243  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 57211.3us
I20260709 12:14:31.891705  9085 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:31.896966  8715 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:31.901079  9141 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:31.903676  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:31.914319  6291 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:31.915154  5753 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:31.932657  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 58919.4us
I20260709 12:14:31.933089  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:31.933818  5597 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:31.935575  5746 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:31.936189  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:31.936795  9129 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:31.937709  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:31.902673  9096 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:32.014977  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2024) took 1343 ms. Trace:
I20260709 12:14:32.015538  5604 rpcz_store.cc:276] 0709 12:14:30.671059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.675392 (+  4333us) service_pool.cc:224] Handling call
0709 12:14:30.695432 (+ 20040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:30.975173 (+279741us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:31.340741 (+365568us) log.cc:844] Serialized 14 byte log entry
0709 12:14:31.520055 (+179314us) log.cc:844] Serialized 14 byte log entry
0709 12:14:31.526284 (+  6229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:31.539385 (+ 13101us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:31.545857 (+  6472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.555176 (+  9319us) spinlock_profiling.cc:243] Waited 9.45 ms on lock 0x7b18003da260. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:31.654088 (+ 98912us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4800003fd8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4502974aa1 00007f450296bb37 00007f450296b9ca 00007f4502a6326f 00007f4502a62f37 00007f4502a7755c 00007f4502a77508 00007f4502a77488 00007f4502a77443 00007f4502a766ec 00007f45019a0a96
0709 12:14:31.805542 (+151454us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b18003da260. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:32.014595 (+209053us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b540031b5d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:32.014637 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.014784 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3688,"prepare.queue_time_us":4852,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":20606,"raft.queue_time_us":18061,"raft.run_cpu_time_us":2974,"raft.run_wall_time_us":143719,"spinlock_wait_cycles":675267328,"thread_start_us":93427,"threads_started":1,"wal-append.queue_time_us":185054}
I20260709 12:14:32.019301  8803 raft_consensus.cc:3055] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:32.019750  8803 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:32.020678  8803 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.026145  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:31.934298  9119 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.002374  5642 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:32.031162  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:32.033080  5598 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:31.982656  9096 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.034823  5567 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:32.028848  9099 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.946141  8989 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:32.066565  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.062654  5596 raft_consensus.cc:2393] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:32.064352  5750 raft_consensus.cc:1240] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:31.983287  9034 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.053895  9096 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:32.074216  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:32.075038  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 172542us
I20260709 12:14:32.094336  5595 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:32.076574  8803 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.124796  8840 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:32.126467  9156 log.cc:927] Time spent T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:14:32.130069  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:32.096163  9141 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:32.133406  9160 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
W20260709 12:14:32.134239  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 97555.5us
I20260709 12:14:32.070801  8990 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.117722  5604 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:32.160571  6291 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:32.177062  5595 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:32.136606  8958 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.179407  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.096697  9140 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:32.187047  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 207442us
I20260709 12:14:32.182050  9134 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.174886  9110 consensus_queue.cc:1059] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:14:32.222116  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:32.222528  9162 log.cc:927] Time spent T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:14:32.222680  9111 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.227360  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 311438us
I20260709 12:14:32.156070  9125 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.302s
W20260709 12:14:32.228363  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 67862.8us
W20260709 12:14:32.234123  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.256577  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 144542us
I20260709 12:14:32.262377  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:32.263082  5604 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:32.256945  9010 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:32.228993  9134 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.262367  9111 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:32.278769  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.186977  8958 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:32.271420  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.319780  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.317070  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.323542  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 130943us
W20260709 12:14:32.325889  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 55556.3us
I20260709 12:14:32.329512  5670 raft_consensus.cc:1240] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:32.243899  8839 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:32.333137  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:14:32.334949  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 112969us
I20260709 12:14:32.315752  9099 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:32.325439  9034 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:32.332607  8989 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:32.336877  8888 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:32.338128  9175 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:32.337565  9154 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 12:14:32.231429  8840 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 12:14:32.359473  9007 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.360078  9007 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.366503  5595 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:32.357874  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:32.357796  5750 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:32.262872  9127 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.337488  8990 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:32.357899  8937 raft_consensus.cc:3055] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:14:32.358301  9161 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:14:32.333285  8839 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.338191  8958 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:32.385735  5679 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
W20260709 12:14:32.391029  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 45117.1us
I20260709 12:14:32.388170  9127 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:32.409145  9155 log.cc:927] Time spent T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 12:14:32.379148  8937 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:32.410328  9167 log.cc:927] Time spent T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:14:32.410840  8937 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:32.404531  9126 consensus_meta.cc:287] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
I20260709 12:14:32.403573  8839 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:32.431216  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 92431.3us
I20260709 12:14:32.410540  9127 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:32.422588  9106 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.447888  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 68441.2us
W20260709 12:14:32.446070  9122 consensus_meta.cc:287] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.790s	user 0.009s	sys 0.004s
W20260709 12:14:32.448076  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.427722  8958 consensus_queue.cc:1059] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 12:14:32.465438  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 123418us
I20260709 12:14:32.454548  9140 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:32.439049  9126 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:32.459306  8937 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.478626  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:32.488559  6322 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 5.
I20260709 12:14:32.491250  5604 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:32.491835  5567 leader_election.cc:400] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8.
I20260709 12:14:32.493796  5567 leader_election.cc:403] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:14:32.499562  9166 log.cc:927] Time spent T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:14:32.501890  9188 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:32.453890  9106 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.504187  5602 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:32.504938  5753 consensus_meta.cc:287] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.002s
I20260709 12:14:32.499437  5567 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:32.493806  9165 log.cc:927] Time spent T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:14:32.507244  5567 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:32.508342  9088 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:32.508463  5567 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:32.508886  9088 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.509423  9125 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.510149  9125 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.510775  9125 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:32.511133  9125 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:32.511497  9125 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:32.512627  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 182055us
I20260709 12:14:32.513410  5645 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:32.516863  5645 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:32.518280  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 252864us
I20260709 12:14:32.519111  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:32.520018  8888 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:32.521445  8888 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.522075  8888 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.522884  8888 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:32.523379  8888 raft_consensus.cc:697] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:32.524040  9111 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:32.505416  9122 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8.
I20260709 12:14:32.525234  9110 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:32.529506  9183 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:32.529855  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:32.502519  9188 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:32.530525  5599 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:32.531127  8715 consensus_queue.cc:1059] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:32.531312  8840 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:32.532209  9188 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:32.533625  9088 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:32.534679  5679 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:32.535633  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:32.565862  9111 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:32.532140  8840 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:14:32.532198  8715 raft_consensus.cc:3055] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:32.566783  8715 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:32.538548  9010 consensus_queue.cc:1059] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:32.566995  9188 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:32.538936  5753 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:32.567747  8840 raft_consensus.cc:3055] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:32.567555  9188 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:32.497294  9121 log.cc:927] Time spent T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:14:32.568410  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:32.568631  9183 raft_consensus.cc:697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:32.543241  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2181) took 1774 ms. Trace:
I20260709 12:14:32.543462  9106 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:32.547312  9125 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:32.548480  9119 consensus_meta.cc:287] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
I20260709 12:14:32.569603  9188 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:32.552712  5598 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:32.554225  9099 raft_consensus.cc:3055] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:32.593993  9125 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:32.594203  9099 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:32.591038  5595 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:14:32.594926  5595 pending_rounds.cc:85] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 7
W20260709 12:14:32.554768  9145 consensus_meta.cc:287] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.776s	user 0.001s	sys 0.009s
W20260709 12:14:32.529654  9104 consensus_meta.cc:287] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.002s
I20260709 12:14:32.595136  9099 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.595736  9104 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:32.595964  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 79237.1us
I20260709 12:14:32.596398  9099 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.597641  5645 leader_election.cc:400] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8.
I20260709 12:14:32.479374  9115 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:32.556731  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:32.595088  9096 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.598884  5600 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:32.598779  9115 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:32.599220  5645 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:32.600030  9140 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:32.597877  9104 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:32.600153  9096 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:32.557178  9097 consensus_meta.cc:287] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.899s	user 0.008s	sys 0.005s
I20260709 12:14:32.559818  9134 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:32.558265  5599 raft_consensus.cc:1240] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:32.562579  9170 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.201s	user 0.003s	sys 0.000s
I20260709 12:14:32.561445  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:32.602701  5596 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:32.563305  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:32.603477  5597 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:32.564585  5570 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:32.569504  8715 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:32.605187  8715 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:32.564473  5718 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:32.595578  8960 consensus_meta.cc:287] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.795s	user 0.012s	sys 0.003s
I20260709 12:14:32.606577  8960 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.607961  8957 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:32.608337  8957 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.608517  9119 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:32.608946  9119 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.609274  9119 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:32.549685  9007 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:32.608668  8957 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:32.610108  9179 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:32.610775  9188 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:32.611166  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:32.612989  5675 raft_consensus.cc:3055] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:32.613361  5675 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:32.614284  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:32.614157  5675 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:32.615125  5675 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.616354  5600 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:32.590951  5569 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:32.591296  5501 catalog_manager.cc:5697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 3 to 4, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 4 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:14:32.620558  6323 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:32.622114  5569 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:32.623101  9179 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.623771  9179 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:32.624135  9179 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:32.624502  9179 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.592119  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:32.569634  9183 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.626442  5569 leader_election.cc:400] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8.
I20260709 12:14:32.568109  8840 raft_consensus.cc:740] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:32.524235  8888 consensus_queue.cc:237] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:32.555094  9126 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:32.595618  9145 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.600843  9115 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:32.556780  8839 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:32.571393  9169 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.407s	user 0.004s	sys 0.001s
I20260709 12:14:32.570210  5602 rpcz_store.cc:276] 0709 12:14:30.768683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.431270 (+662587us) service_pool.cc:224] Handling call
0709 12:14:31.431945 (+   675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.504590 (+1072645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.543026 (+ 38436us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400207954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:32.543184 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465469824}
W20260709 12:14:32.663832  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 64681.6us
I20260709 12:14:32.675381  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:32.683741  5604 raft_consensus.cc:2410] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:14:32.681139  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.595160  5595 pending_rounds.cc:107] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 7.8
W20260709 12:14:32.684465  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 217089us
I20260709 12:14:32.684953  5595 raft_consensus.cc:2889] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:32.686009  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 59706.8us
W20260709 12:14:32.694576  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 215770us
I20260709 12:14:32.698372  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:32.700138  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:32.704298  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:32.705027  5600 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.706466  5569 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:32.708451  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:32.709666  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:32.710268  5750 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
W20260709 12:14:32.712534  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 193518us
I20260709 12:14:32.713280  6328 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:14:32.715061  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.680472  8957 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:32.719794  6320 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:32.727193  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:32.729440  5597 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:32.706175  9129 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:32.746636  5746 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:32.748996  5675 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:14:32.735472  5679 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:32.718662  8715 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.755184  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:32.749716  5675 pending_rounds.cc:85] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 6
I20260709 12:14:32.757256  5675 pending_rounds.cc:107] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:14:32.757524  5675 raft_consensus.cc:2889] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:32.722903  8960 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:32.708119  9141 consensus_queue.cc:1059] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:14:32.762102  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:32.763180  9085 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:32.763012  9197 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:32.770498  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:32.771200  6326 raft_consensus.cc:2393] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:32.763465  9096 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.763630  5747 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:32.712371  9106 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:14:32.765640  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:32.773814  6325 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
W20260709 12:14:32.762928  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.771894  5569 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:32.771900  5597 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:14:32.776376  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:32.776983  5676 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
W20260709 12:14:32.777015  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 69562.5us
I20260709 12:14:32.784132  6324 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:32.784380  5748 raft_consensus.cc:1240] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:32.784719  5645 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:32.783912  5600 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:32.771128  9122 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.787153  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:32.793794  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.788130  5569 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:32.790660  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:32.815119  6327 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:32.772774  9085 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:32.815768  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:32.836432  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.762681  9140 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:14:32.752647  9129 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.823017  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:32.818709  6291 leader_election.cc:336] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 2.099s (SENT)
I20260709 12:14:32.744385  8840 consensus_queue.cc:260] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:32.792104  8990 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:32.827093  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 56655.7us
W20260709 12:14:32.827785  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 93600.2us
I20260709 12:14:32.839622  6291 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:32.815291  8839 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:32.773043  9177 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 12:14:32.841068  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 53029.2us
I20260709 12:14:32.879290  6293 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:32.877082  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 99090.5us
I20260709 12:14:32.782836  9096 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.880256  5716 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:32.881425  5676 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:32.886257  9134 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:14:32.887555  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 104948us
I20260709 12:14:32.892198  9134 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:32.839002  9085 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:32.897591  6291 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:32.901459  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:32.902042  5679 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:32.821007  9122 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.893519  8997 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:32.878810  9126 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:32.876355  8990 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.911755  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:32.914440  5569 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:32.914618  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.908316  9104 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:14:32.916002  8916 raft_consensus.cc:3055] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:32.916430  8916 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:32.917543  5642 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:32.900745  9192 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.897274  9097 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:32.894383  8957 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:32.897846  9145 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:32.928150  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.917358  8916 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:32.923138  9088 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:32.931659  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:32.932173  8916 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:32.918932  9126 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.922230  8990 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:32.922397  8840 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:32.931308  9201 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:14:32.932410  5673 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:32.953491  6320 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:32.924065  9183 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:32.923877  9104 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:32.926498  9097 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.952844  6291 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:32.965368  5645 leader_election.cc:400] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9.
I20260709 12:14:32.965528  6291 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:32.965770  5645 leader_election.cc:403] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:14:32.950235  9126 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.973585  9204 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:32.974296  9176 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:32.974840  9176 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:32.975720  9176 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:32.976650  9085 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:32.978499  9096 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:32.962805  9097 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:32.979784  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:32.955859  9183 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:32.960853  9141 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:14:32.991379  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:32.971024  9007 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:32.998152  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 83791.2us
I20260709 12:14:32.930361  9194 consensus_queue.cc:1059] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:14:32.928596  9192 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.004388  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:32.982016  8715 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:33.007799  5569 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:33.007315  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:32.966621  9104 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.010677  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:32.997265  9183 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:33.022429  5645 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:33.018246  9205 consensus_queue.cc:1059] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:14:33.023463  6327 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:33.001745  9096 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:32.999589  9140 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:33.025717  6291 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:33.000571  9204 raft_consensus.cc:697] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:33.001391  8839 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.007608  9010 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:33.030666  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:33.030548  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 93765.7us
I20260709 12:14:33.076594  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:33.077402  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:33.078003  5600 raft_consensus.cc:2376] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 8. Re-sending same reply.
W20260709 12:14:33.080339  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 54716.8us
I20260709 12:14:33.081701  6291 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:33.024395  8715 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.011003  9007 raft_consensus.cc:697] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:33.087884  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:33.088663  5598 raft_consensus.cc:2393] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:33.088245  9007 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.089480  9215 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:33.090047  9215 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:33.090515  9099 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:33.091024  9099 raft_consensus.cc:697] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:33.091670  9202 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:14:33.091948  9099 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:33.093182  9206 log.cc:927] Time spent T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:14:33.093972  5604 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:33.083249  5602 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:33.087138  5597 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:33.007172  9145 consensus_queue.cc:1059] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:14:33.033555  9140 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:33.088294  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:33.108089  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 145506us
I20260709 12:14:33.111373  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:33.128756  6327 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
W20260709 12:14:33.086836  9201 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:33.112094  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:33.115772  5596 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:33.076068  9129 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:33.136699  5601 raft_consensus.cc:2393] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:33.152845  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 144900us
W20260709 12:14:33.106319  9200 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:14:33.085032  9096 raft_consensus.cc:697] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:33.090535  9215 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:33.172431  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 90800.8us
I20260709 12:14:33.130796  9140 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:33.209906  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:33.130872  9134 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:33.163491  9194 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:33.222113  5596 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:33.100296  8715 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.173435  9129 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.228499  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:33.227116  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.171152  8958 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:33.173192  9192 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:33.229333  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 131630us
I20260709 12:14:33.168447  9122 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:33.227097  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.231616  5600 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.215459  9106 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.239565  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.218576  9085 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:33.277505  5570 leader_election.cc:336] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.980s (SENT)
I20260709 12:14:33.279372  5570 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:33.279454  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 56746.6us
I20260709 12:14:33.228446  9194 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:14:33.281198  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 71090.5us
I20260709 12:14:33.230517  9190 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.291901  5645 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:33.292299  5753 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:14:33.292629  5753 pending_rounds.cc:85] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 7
I20260709 12:14:33.292874  5753 pending_rounds.cc:107] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:14:33.293090  5753 raft_consensus.cc:2889] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:33.293305  9145 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:33.294029  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:33.294587  5599 raft_consensus.cc:2376] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9. Re-sending same reply.
I20260709 12:14:33.295259  9218 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:33.295372  5570 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:33.312650  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:33.313838  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:33.291175  9194 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:33.316103  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:33.323104  5597 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:33.313341  6325 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
W20260709 12:14:33.323479  6328 consensus_meta.cc:287] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.001s
I20260709 12:14:33.320274  9214 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:33.320725  9221 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:14:33.304359  9179 consensus_meta.cc:287] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.000s
I20260709 12:14:33.323787  6328 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:33.328878  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:33.331998  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.335901  9195 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.163s
I20260709 12:14:33.336223  9219 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.336546  5645 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:33.338063  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:33.244949  9129 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.336747  9219 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.348695  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.242215  8958 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.281723  9106 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.349040  5679 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:14:33.304390  9085 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:14:33.227285  9204 consensus_queue.cc:237] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.366545  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.377920  5600 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:33.318213  9096 consensus_queue.cc:237] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.380530  8990 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.382475  8990 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:33.383718  5753 raft_consensus.cc:1240] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:14:33.384400  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:33.345582  9214 raft_consensus.cc:697] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:33.299959  9190 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.362068  9104 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:33.366736  9119 consensus_meta.cc:287] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.000s
I20260709 12:14:33.387888  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.335692  9205 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:14:33.392795  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:33.421263  5747 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:33.395970  5567 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:33.396502  5603 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:14:33.397076  8997 raft_consensus.cc:3055] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:33.410602  5716 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:33.413067  9209 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:33.415525  9198 log.cc:927] Time spent T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.484s	user 0.000s	sys 0.013s
I20260709 12:14:33.423252  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.430394  5748 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:33.358558  9145 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:33.424496  5716 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:33.344640  9179 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.431167  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.423763  5642 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:33.421953  5603 pending_rounds.cc:85] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 8
I20260709 12:14:33.438778  5600 raft_consensus.cc:1275] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 12:14:33.442225  9211 log.cc:927] Time spent T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
W20260709 12:14:33.442649  9213 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:14:33.444245  9129 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:33.445892  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:33.446806  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 50912.6us
W20260709 12:14:33.485057  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.447304  9218 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.487478  9218 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.489924  8840 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:33.447774  8990 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:33.448551  5753 raft_consensus.cc:1275] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:14:33.451462  9216 log.cc:927] Time spent T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 12:14:33.452209  9212 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 12:14:33.442216  8715 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:33.457850  9214 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.338800  9221 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.497718  9221 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:33.459486  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:33.498689  5752 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:33.463840  5747 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
W20260709 12:14:33.474289  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 49964.1us
I20260709 12:14:33.477041  5603 pending_rounds.cc:107] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:14:33.502225  5603 raft_consensus.cc:2889] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:33.502753  5716 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:33.503270  9218 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:33.477166  5600 pending_rounds.cc:85] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 3
W20260709 12:14:33.459383  8916 consensus_meta.cc:287] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.003s
I20260709 12:14:33.504191  5600 pending_rounds.cc:107] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:14:33.504374  9221 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:33.504581  5600 raft_consensus.cc:2889] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:33.504803  9221 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.503849  5716 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:33.503625  9235 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:33.506088  5716 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:33.506335  9235 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:33.506703  9235 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:33.507019  9235 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:33.503607  5603 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:33.505182  9221 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.524755  9239 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:14:33.515002  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 178510us
I20260709 12:14:33.526316  5596 raft_consensus.cc:1240] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:33.429471  9224 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:33.428946  8997 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:33.471927  9140 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.431746  9230 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:33.525285  9239 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.524776  9217 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:33.529598  9207 raft_consensus.cc:3055] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:33.475106  9209 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.471390  9190 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:33.530426  6323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 601) took 1765 ms (client timeout 1980 ms). Trace:
I20260709 12:14:33.513792  5752 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:33.537489  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.513777  9195 raft_consensus.cc:2764] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:14:33.558552  5679 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
W20260709 12:14:33.558007  6323 rpcz_store.cc:269] 0709 12:14:31.765180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.766838 (+  1658us) service_pool.cc:224] Handling call
0709 12:14:33.530201 (+1763363us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54006be4d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:33.530336 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910411520}
I20260709 12:14:33.433032  9119 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.562773  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:33.562994  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 171792us
I20260709 12:14:33.559233  9207 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:33.583557  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:33.583720  9207 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.584408  9085 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:33.595080  9140 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:33.595805  9129 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:33.599054  9209 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:33.599931  9235 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.536087  9230 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.602195  9230 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:33.603721  9235 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:33.556524  8997 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.606593  8997 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.607506  9190 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.608059  9190 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.595863  9145 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.615262  9179 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:33.604519  9097 consensus_meta.cc:287] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.003s
I20260709 12:14:33.618220  5670 raft_consensus.cc:2393] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:33.615370  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 475) took 1053 ms. Trace:
W20260709 12:14:33.621730  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 317362us
W20260709 12:14:33.600134  9126 consensus_meta.cc:287] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.608s	user 0.007s	sys 0.000s
I20260709 12:14:33.635357  5595 rpcz_store.cc:276] 0709 12:14:32.563028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.563322 (+   294us) service_pool.cc:224] Handling call
0709 12:14:32.563605 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.694359 (+130754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.615159 (+920800us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b54003e1554. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:33.615315 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16001280}
I20260709 12:14:33.584844  9085 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:33.648923  9179 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.663863  9221 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.664956  9179 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.656569  9085 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:33.686187  8839 consensus_meta.cc:287] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.000s
I20260709 12:14:33.686632  8839 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9.
I20260709 12:14:33.674470  8868 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:14:33.690044  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.691244  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.692056  5674 raft_consensus.cc:2393] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:33.693969  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.687595  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.684363  5673 raft_consensus.cc:1240] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:33.538735  9239 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:33.697865  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.700624  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:33.703331  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 193183us
I20260709 12:14:33.706451  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.707301  5677 raft_consensus.cc:2410] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:14:33.711632  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.563198  9231 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.713747  5716 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:33.698637  9181 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.698928  9106 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:33.649770  9126 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.673712  9119 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:33.641884  9097 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.721822  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:33.709218  9207 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:33.725091  6324 consensus_meta.cc:287] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.000s
I20260709 12:14:33.728801  6324 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:33.535777  9224 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.731022  5597 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:33.731937  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.732779  5752 raft_consensus.cc:2410] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:33.735037  5677 raft_consensus.cc:2376] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8. Re-sending same reply.
I20260709 12:14:33.726517  9127 raft_consensus.cc:3055] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:33.725131  9179 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:33.730103  9208 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.784349  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.779106  9209 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:33.792346  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.793371  5676 raft_consensus.cc:2410] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:33.767412  9204 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:33.850977  5570 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:33.851795  5604 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:33.853842  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.855499  9217 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:33.721179  9231 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:33.857867  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 79971us
I20260709 12:14:33.859907  9134 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:33.860644  9097 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:33.849489  9190 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:33.862111  9179 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:33.734202  9106 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:14:33.889570  6323 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 12:14:33.770713  9127 raft_consensus.cc:740] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:33.796332  9208 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:33.868831  9215 consensus_meta.cc:287] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.652s	user 0.006s	sys 0.002s
I20260709 12:14:33.869557  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:33.869551  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:33.871809  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:33.727774  9181 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.897105  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:33.897389  5674 raft_consensus.cc:2368] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:14:33.897038  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:33.898286  6320 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:33.885787  5570 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:33.890054  9179 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.900190  9179 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:33.900575  9126 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:33.900892  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:33.901046  5642 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:33.900199  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:33.902489  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.902959  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:33.904852  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.905828  5672 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:33.907238  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:33.907888  6328 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 5.
I20260709 12:14:33.859808  8839 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:14:33.915797  9195 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:33.916224  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:33.916635  8960 raft_consensus.cc:3055] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:33.916776  6319 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:33.917212  9195 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:33.917675  9195 raft_consensus.cc:697] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:33.918291  6323 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:33.918529  9195 consensus_queue.cc:237] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:33.920027  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.911605  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:33.912520  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.922624  5744 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 5.
I20260709 12:14:33.913302  9127 consensus_queue.cc:260] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.914320  5674 raft_consensus.cc:1275] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:33.893669  9134 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.906558  9215 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:33.914983  9242 consensus_queue.cc:1059] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:33.909732  9126 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:33.924434  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:33.924469  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:33.933185  5750 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:33.902456  9204 raft_consensus.cc:697] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:33.902302  9099 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.931443  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:33.939687  5678 raft_consensus.cc:2393] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:33.917044  8960 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:33.936663  5569 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:14:33.933902  9183 consensus_meta.cc:287] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.895s	user 0.008s	sys 0.002s
I20260709 12:14:33.945072  6320 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:14:33.941665  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:33.954154  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:33.956447  5674 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.958662  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:33.934885  9097 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.940330  9126 raft_consensus.cc:697] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:33.974520  9214 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:33.938122  9127 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:33.973804  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 120949us
I20260709 12:14:33.928614  9140 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:14:33.935467  9119 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:33.981185  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:33.929071  9230 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.932528  9085 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.982043  5569 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:33.949393  9099 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:34.038508  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 58608.2us
W20260709 12:14:34.042117  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 60142.3us
I20260709 12:14:34.043344  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:33.973950  9183 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:33.972339  9179 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.061858  9099 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:34.061596  9224 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:34.063359  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.074455  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.063727  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 82585.2us
I20260709 12:14:33.981736  9097 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:33.986967  9119 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.039592  9193 consensus_queue.cc:1059] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:14:33.980451  9214 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:34.064807  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:34.079903  9256 log.cc:927] Time spent T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:14:34.080760  9245 log.cc:927] Time spent T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:14:34.081089  9194 consensus_meta.cc:287] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.738s	user 0.004s	sys 0.004s
I20260709 12:14:34.081436  8888 raft_consensus.cc:3055] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:34.064231  9175 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:34.124156  9194 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.134990  9097 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:34.136298  9126 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.107334  9214 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:34.128753  6328 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:34.117519  9099 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:33.989384  8960 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:34.172370  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 271344us
W20260709 12:14:34.173142  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 319760us
I20260709 12:14:34.119654  8888 raft_consensus.cc:740] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:14:34.175758  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 112721us
W20260709 12:14:34.176232  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 111490us
I20260709 12:14:34.179140  5569 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:34.183064  5670 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:34.175033  9256 log.cc:927] Time spent T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:34.079985  9204 consensus_queue.cc:237] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:34.219241  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:34.221171  5719 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:34.223944  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 44881.6us
I20260709 12:14:34.200376  8960 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:34.235069  5674 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:34.205899  9231 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:34.212486  9208 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:34.262115  5719 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:34.265658  5569 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:34.218425  9215 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:34.261593  5642 connection.cc:256] RPC call timeout handler was delayed by -2.5791448140000739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 12:14:34.237022  9181 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:34.287307  9181 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.288123  9259 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.276820  9258 log.cc:927] Time spent T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:14:34.282300  9183 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:34.236534  9097 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:14:34.286528  8916 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:34.287884  9181 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:34.242031  9134 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:34.234392  9261 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:34.243085  9221 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:34.290798  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:34.263375  9207 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:34.292819  5642 connection.cc:256] RPC call timeout handler was delayed by -1.9111407919999692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 12:14:34.317126  5642 connection.cc:256] RPC call timeout handler was delayed by -1.7500407919999361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
W20260709 12:14:34.317499  5642 connection.cc:256] RPC call timeout handler was delayed by -1.7349448140000732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2614s for a response
W20260709 12:14:34.317806  5642 connection.cc:256] RPC call timeout handler was delayed by -1.7131407919998765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 12:14:34.318089  5642 connection.cc:256] RPC call timeout handler was delayed by -1.628540791999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260709 12:14:34.289093  9230 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:34.289508  9215 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:34.291707  9099 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:34.242419  8888 consensus_queue.cc:260] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:34.343612  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 107477us
I20260709 12:14:34.302409  9190 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.300724  9263 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.274345  9176 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:14:34.303133  9231 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:34.288643  9259 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:34.319064  9183 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:34.372335  9190 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.373899  9263 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:34.373207  9262 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:14:34.378145  8888 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:34.379925  5645 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:34.386206  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.388352  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:34.326643  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 67329.6us
W20260709 12:14:34.389845  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 127819us
I20260709 12:14:34.388470  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:34.380488  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 89718.1us
I20260709 12:14:34.430531  5750 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:34.393522  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:34.393954  5752 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:34.436146  9181 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:34.366916  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 291505us
W20260709 12:14:34.399011  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 72162.7us
I20260709 12:14:34.359125  9210 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:34.390779  9274 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.441112  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:34.354075  8916 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:34.443817  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 50413.8us
I20260709 12:14:34.447608  5604 raft_consensus.cc:2410] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:14:34.445534  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 65705.4us
I20260709 12:14:34.449268  5569 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:34.451637  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:34.448104  6291 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:34.454908  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:34.455547  5603 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:34.456270  5719 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:34.454686  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:34.455682  6291 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:34.460179  5595 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:34.464459  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:34.463284  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:34.465916  5600 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:34.443114  9210 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.481022  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:34.481740  5595 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.466965  9262 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:34.487100  9262 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:34.452713  9230 raft_consensus.cc:3055] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:14:34.489791  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.427547  9183 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.400530  9231 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:34.491400  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:34.492491  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:34.493039  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:34.493136  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:34.459426  9119 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:34.495779  9217 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.499253  5719 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:34.500105  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:34.530651  5752 raft_consensus.cc:2410] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:14:34.500923  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:34.503222  8868 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:34.516496  9097 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:34.511520  9179 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:34.467551  9252 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:14:34.515527  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2064) took 1281 ms. Trace:
I20260709 12:14:34.457121  9140 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:34.454659  9134 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:34.462940  9181 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:34.548875  5596 rpcz_store.cc:276] 0709 12:14:33.233953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.234456 (+   503us) service_pool.cc:224] Handling call
0709 12:14:33.282407 (+ 47951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.526724 (+244317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.515272 (+988548us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54002aadd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:34.515463 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560492928}
I20260709 12:14:34.524163  5603 raft_consensus.cc:1240] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:14:34.470849  9194 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:34.472545  9210 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:34.531821  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:34.526708  9280 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:34.581945  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:34.543541  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 44372.4us
I20260709 12:14:34.507992  9129 raft_consensus.cc:3055] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:34.545099  5750 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:34.546188  5600 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:34.516326  9230 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:34.460179  9275 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 12:14:34.551049  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 90431.3us
I20260709 12:14:34.453544  9274 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:34.576679  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:34.533376  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:34.553411  9085 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:34.593532  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 60239.1us
I20260709 12:14:34.583174  5719 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:34.594784  5719 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:34.586512  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:34.588338  5675 raft_consensus.cc:1275] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:34.549263  9097 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:34.554613  9251 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:34.596309  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 130276us
I20260709 12:14:34.597790  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:34.600502  9097 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:34.605975  9284 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:34.603861  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:34.609066  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.609714  5716 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:34.580578  9140 raft_consensus.cc:697] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:34.587517  9280 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:34.614786  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.615880  5603 raft_consensus.cc:2410] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 12 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 12:14:34.612473  6291 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:34.619277  5747 raft_consensus.cc:1240] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:34.619635  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:34.611590  5716 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:34.613327  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 154199us
I20260709 12:14:34.621212  5569 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:34.622368  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:34.622982  5569 leader_election.cc:400] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:14:34.624449  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:34.624936  5569 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:34.625458  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:34.625986  9286 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:34.585615  9190 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:34.626786  9286 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:34.623144  5750 raft_consensus.cc:2393] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
W20260709 12:14:34.627249  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.627638  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:34.628458  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.627173  9190 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:34.629038  9190 raft_consensus.cc:697] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:34.584754  9129 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:34.631398  5676 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:34.632401  5569 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:34.635198  5679 raft_consensus.cc:1240] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:34.544129  9217 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:34.605600  9283 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:14:34.591646  9194 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:34.641695  9242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.004s	sys 0.009s
W20260709 12:14:34.642163  9242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.004s	sys 0.009s
I20260709 12:14:34.649425  5569 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:34.650084  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:34.650674  6321 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:34.650156  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:34.653980  6325 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:14:34.654579  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 57742.7us
W20260709 12:14:34.724522  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 75157.2us
I20260709 12:14:34.654667  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:34.605633  9197 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:34.690232  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:34.726034  6328 raft_consensus.cc:2376] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8. Re-sending same reply.
I20260709 12:14:34.654039  5570 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:34.729157  5747 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
W20260709 12:14:34.726625  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.729673  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 75716.7us
I20260709 12:14:34.731952  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:34.595578  9134 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:14:34.727880  5569 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:34.630632  9251 raft_consensus.cc:697] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:34.739766  6291 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:34.631007  9280 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.746434  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:34.738088  6320 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:34.646564  9085 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:34.651460  9286 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:34.725553  9284 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:34.755930  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:34.631470  9204 consensus_queue.cc:1059] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 12:14:34.749532  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:34.749225  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:34.763736  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:34.752934  5601 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:14:34.748530  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:34.759166  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:34.638096  9224 consensus_queue.cc:1059] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:14:34.728223  9197 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.769517  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:34.766642  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:34.774755  5676 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.732863  8958 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:34.722745  9119 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:14:34.771590  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:34.744680  9215 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:34.789824  6328 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:34.755436  9261 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:34.751890  9085 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:14:34.782302  9127 consensus_meta.cc:287] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.799s	user 0.008s	sys 0.003s
I20260709 12:14:34.815387  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:34.818765  5672 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:34.769821  9259 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:34.780160  9197 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.780136  9263 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:34.808738  9099 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.808148  9261 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.812341  9085 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:34.781641  9179 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:14:34.838482  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:34.745085  9230 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.830123  9252 raft_consensus.cc:3055] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:34.823865  9183 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:34.832664  8785 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:34.826821  8916 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.832127  8997 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:34.772006  9190 consensus_queue.cc:237] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.829473  9215 raft_consensus.cc:697] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:34.837828  9261 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:34.790402  9140 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.790656  9129 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:34.837458  9231 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:34.871538  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:34.849694  9203 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:34.850498  9252 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:34.855706  8785 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:34.837270  9099 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.882546  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:34.835490  9194 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:34.869011  9291 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.892261  5673 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:34.866330  9289 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:34.894529  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:34.895774  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:34.897425  5672 raft_consensus.cc:2393] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:14:34.896966  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 285424us
I20260709 12:14:34.903421  5679 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:34.905360  5595 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:34.872506  9272 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:34.877476  8997 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:34.880337  9203 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.919782  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:34.867635  8916 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:34.920670  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:34.889271  9129 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:34.926259  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:34.890208  8785 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:34.935606  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:34.938046  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.944475  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:34.945564  5678 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:14:34.946717  5678 pending_rounds.cc:85] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 7
I20260709 12:14:34.946954  5678 pending_rounds.cc:107] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:14:34.898412  9274 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:34.947248  5678 raft_consensus.cc:2889] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:34.917510  9288 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.951669  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:34.840204  9251 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.930863  9284 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:34.953431  5595 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
W20260709 12:14:34.955184  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.928769  9203 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.959393  9298 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.963033  9298 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:34.964254  9239 consensus_meta.cc:287] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.254s	user 0.005s	sys 0.005s
I20260709 12:14:34.967856  9239 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:34.945608  9270 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:34.970667  9270 raft_consensus.cc:697] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:34.971596  9270 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.968297  9252 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:34.965834  9285 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.204s	user 0.001s	sys 0.001s
I20260709 12:14:34.952311  9179 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.975190  5752 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:34.975069  9179 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:34.977097  9179 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:34.937711  9217 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:34.897970  9291 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:34.968883  9097 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.933810  8997 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.922434  9289 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:35.201344  5596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.005s	sys 0.010s
W20260709 12:14:35.709532  5596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.055s	user 0.010s	sys 0.028s
W20260709 12:14:35.709952  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 960714us
W20260709 12:14:34.949833  9290 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 12:14:35.017182  5567 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.711s (SENT) [suppressed 24 similar messages]
W20260709 12:14:35.656342  5719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.006s	sys 0.008s
W20260709 12:14:35.639518  5744 consensus_meta.cc:287] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.816s	user 0.010s	sys 0.002s
W20260709 12:14:35.740396  5716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.010s	sys 0.005s
W20260709 12:14:35.970991  5676 consensus_meta.cc:287] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.189s	user 0.009s	sys 0.009s
W20260709 12:14:35.407508  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.737250  5599 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:14:35.996996  5719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.008s	sys 0.015s
W20260709 12:14:35.024224  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.100805  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:35.053038  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.006976  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.711066  5671 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:35.830099  9301 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:14:35.972358  5744 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:36.011127  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 821) took 2082 ms. Trace:
I20260709 12:14:35.996169  5676 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
W20260709 12:14:35.997324  5716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.015s	sys 0.008s
W20260709 12:14:35.990267  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.142251  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 1.19326e+06us
W20260709 12:14:36.030292  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.049113  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2136) took 1263 ms. Trace:
W20260709 12:14:35.016033  9207 consensus_meta.cc:287] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.675s	user 0.003s	sys 0.005s
W20260709 12:14:35.017694  8888 consensus_meta.cc:287] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.000s
W20260709 12:14:36.181136  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 1.43155e+06us
W20260709 12:14:36.181352  5676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1498) took 1397 ms (client timeout 1738 ms). Trace:
I20260709 12:14:36.140750  6324 rpcz_store.cc:276] 0709 12:14:33.888697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.888851 (+   154us) service_pool.cc:224] Handling call
0709 12:14:33.889221 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.236392 (+347171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.236427 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.264456 (+ 28029us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.444388 (+179932us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:34.444420 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.444482 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.970354 (+1525872us) raft_consensus.cc:1685] finished
0709 12:14:35.970372 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.970533 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38365,"raft.queue_time_us":44217,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":5105,"thread_start_us":475571,"threads_started":2,"wal-append.queue_time_us":363144,"wal-append.run_cpu_time_us":2764,"wal-append.run_wall_time_us":1344294}
W20260709 12:14:36.160095  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.150104  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2145) took 1192 ms. Trace:
I20260709 12:14:36.147328  5679 rpcz_store.cc:276] 0709 12:14:34.736071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.736189 (+   118us) service_pool.cc:224] Handling call
0709 12:14:34.736453 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.919595 (+183142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.999043 (+1079448us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400064d54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:35.999213 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383564544}
W20260709 12:14:36.183350  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.710258  9280 consensus_meta.cc:287] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.928s	user 0.009s	sys 0.000s
W20260709 12:14:35.712086  9286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.007s	sys 0.005s
W20260709 12:14:36.182080  5676 rpcz_store.cc:269] 0709 12:14:34.744852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.745778 (+   926us) service_pool.cc:224] Handling call
0709 12:14:36.142041 (+1396263us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:35.852150  9145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.000s	sys 0.012s
I20260709 12:14:36.183100  5671 rpcz_store.cc:276] 0709 12:14:34.957257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.957454 (+   197us) service_pool.cc:224] Handling call
0709 12:14:35.710891 (+753437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.149848 (+438957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.150050 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408}
W20260709 12:14:35.752460  8960 consensus_meta.cc:287] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.491s	user 0.012s	sys 0.000s
I20260709 12:14:36.201861  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:35.968135  9085 consensus_meta.cc:287] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.120s	user 0.007s	sys 0.003s
I20260709 12:14:35.994460  9298 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:35.969892  9313 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.027371  9261 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:34.974336  8957 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:35.397207  8916 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:35.396751  9099 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:34.979852  9239 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:36.049484  9203 consensus_meta.cc:287] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.018s	user 0.005s	sys 0.004s
I20260709 12:14:36.149603  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:35.014704  9215 consensus_queue.cc:237] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.185403  5675 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:35.277504  9197 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.197700  5677 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:35.207141  8785 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.202370  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:35.978535  9195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.530s	user 0.000s	sys 0.014s
I20260709 12:14:36.204613  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:36.244547  9297 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.246286  9195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.866s	user 0.012s	sys 0.016s
I20260709 12:14:36.246518  5679 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:14:36.247782  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:36.248867  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:34.962342  9294 log.cc:927] Time spent T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:14:35.974107  9270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.018s	sys 0.036s
I20260709 12:14:36.006078  9252 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:36.234650  8957 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.250280  9097 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.248797  8997 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.249490  5679 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:36.251760  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:36.249910  9270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.030s	sys 0.036s
I20260709 12:14:36.252552  9197 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.253175  5679 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:36.253559  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 233945us
I20260709 12:14:36.253786  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2147) took 1095 ms. Trace:
I20260709 12:14:36.254174  5679 rpcz_store.cc:276] 0709 12:14:35.158054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.252678 (+1094624us) service_pool.cc:224] Handling call
0709 12:14:36.253013 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.253562 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.253721 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.208652  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2196) took 1003 ms. Trace:
I20260709 12:14:36.149194  9303 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.188448  9280 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:36.198325  9286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.007s	sys 0.014s
I20260709 12:14:36.255865  5599 rpcz_store.cc:276] 0709 12:14:35.206816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.201539 (+994723us) service_pool.cc:224] Handling call
0709 12:14:36.208585 (+  7046us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:35.918713  9210 consensus_meta.cc:287] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.330s	user 0.007s	sys 0.003s
I20260709 12:14:36.256893  9210 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:36.210012  9140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.011s	sys 0.035s
I20260709 12:14:36.149487  9242 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:36.261073  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:36.254969  5642 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:35.762152  9273 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:36.226778  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:35.894994  9214 consensus_meta.cc:287] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 1.717s	user 0.011s	sys 0.001s
I20260709 12:14:36.186450  9207 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:36.249903  9291 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.276288  9197 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:34.960618  9288 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.214118  8888 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:36.214821  9145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.002s	sys 0.021s
I20260709 12:14:36.249003  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 675) took 1632 ms. Trace:
W20260709 12:14:36.205134  5600 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.596s	user 0.021s	sys 0.045s
I20260709 12:14:36.251855  8957 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:36.255257  9297 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:36.185029  9129 consensus_meta.cc:287] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.244s	user 0.005s	sys 0.004s
I20260709 12:14:36.259492  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:36.306979  5599 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:36.263654  5676 raft_consensus.cc:2410] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 12 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 12:14:36.264475  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 2148) took 1049 ms. Trace:
I20260709 12:14:36.257493  9280 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.226889  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:36.260042  9140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.011s	sys 0.035s
I20260709 12:14:34.961723  9284 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.244939  9203 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:36.342610  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 87699.6us
I20260709 12:14:36.313026  5751 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:14:36.283600  9263 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:36.230216  9085 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.263119  9311 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:36.233043  9313 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.260298  9239 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.264211  9305 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.282028  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2082) took 1759 ms. Trace:
I20260709 12:14:36.261977  9183 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:36.303337  6327 rpcz_store.cc:276] 0709 12:14:34.616323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.616537 (+   214us) service_pool.cc:224] Handling call
0709 12:14:34.723770 (+107233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.734130 (+ 10360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.734160 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.734587 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.935136 (+200549us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:34.946145 (+ 11009us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.946371 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.946441 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.248801 (+1302360us) raft_consensus.cc:1685] finished
0709 12:14:36.248821 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.248945 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49942,"prepare.queue_time_us":12930,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":14844,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9574,"spinlock_wait_cycles":16072064,"thread_start_us":160534,"threads_started":1,"wal-append.queue_time_us":453881}
W20260709 12:14:36.305004  5600 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.696s	user 0.022s	sys 0.045s
I20260709 12:14:36.307667  5671 rpcz_store.cc:276] 0709 12:14:35.215243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.209409 (+994166us) service_pool.cc:224] Handling call
0709 12:14:36.264390 (+ 54981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.262136  9303 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.349223  6325 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:36.300669  9291 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.309365  9316 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.362071  5676 raft_consensus.cc:3055] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:36.283703  9197 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.273231  9242 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.363520  5598 rpcz_store.cc:276] 0709 12:14:34.522417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.522556 (+   139us) service_pool.cc:224] Handling call
0709 12:14:34.527531 (+  4975us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.532599 (+  5068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.532629 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.533134 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.733315 (+200181us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:34.733359 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.733422 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.281753 (+1548331us) raft_consensus.cc:1685] finished
0709 12:14:36.281799 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.281960 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":762,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":10762,"thread_start_us":143564,"threads_started":1,"wal-append.queue_time_us":256894}
I20260709 12:14:36.399447  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:36.399603  9306 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:36.400132  5598 raft_consensus.cc:2393] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:36.400524  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2197) took 1107 ms. Trace:
I20260709 12:14:36.400794  5598 rpcz_store.cc:276] 0709 12:14:35.293575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.399168 (+1105593us) service_pool.cc:224] Handling call
0709 12:14:36.400473 (+  1305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.368364  9303 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.368543  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2075) took 1926 ms. Trace:
I20260709 12:14:36.369191  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1538) took 1875 ms. Trace:
I20260709 12:14:36.402407  5745 rpcz_store.cc:276] 0709 12:14:34.493472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.549860 (+ 56388us) service_pool.cc:224] Handling call
0709 12:14:36.369005 (+1819145us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400053cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:36.369122 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252560640}
I20260709 12:14:36.370030  5671 raft_consensus.cc:1240] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:36.402279  5602 rpcz_store.cc:276] 0709 12:14:34.441908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.442015 (+   107us) service_pool.cc:224] Handling call
0709 12:14:34.456476 (+ 14461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:34.468086 (+ 11610us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:34.826614 (+358528us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.952511 (+125897us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:34.954818 (+  2307us) log.cc:844] Serialized 52 byte log entry
0709 12:14:34.954956 (+   138us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:34.955189 (+   233us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.708857 (+753668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.708950 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.368348 (+659398us) raft_consensus.cc:1685] finished
0709 12:14:36.368366 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.368485 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7220,"prepare.queue_time_us":258318,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":3528,"raft.queue_time_us":29857,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":84674,"spinlock_wait_cycles":6272256,"thread_start_us":410998,"threads_started":2,"wal-append.queue_time_us":1457807}
I20260709 12:14:36.405650  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:36.406328  5602 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:36.406787  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2195) took 1219 ms. Trace:
I20260709 12:14:36.369745  9291 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.407406  9097 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:36.407614  9303 consensus_queue.cc:1059] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:36.407968  9097 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.407085  5602 rpcz_store.cc:276] 0709 12:14:35.187829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.405402 (+1217573us) service_pool.cc:224] Handling call
0709 12:14:36.406732 (+  1330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.408757  8997 raft_consensus.cc:3055] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:36.401628  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:36.409555  8997 raft_consensus.cc:740] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:36.410195  5598 raft_consensus.cc:2393] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:36.410553  8997 consensus_queue.cc:260] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.411123  9097 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.410230  9280 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:36.319347  9261 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.371042  9313 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.278017  9214 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.408763  9291 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.358114  9263 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:36.412946  5595 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 11: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:36.318384  8785 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.312810  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2083) took 1768 ms. Trace:
I20260709 12:14:36.411885  8997 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:36.412921  9263 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:36.398140  5599 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:36.412207  9261 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.401831  9306 consensus_queue.cc:1059] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:36.413776  5596 rpcz_store.cc:276] 0709 12:14:34.544785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.556099 (+ 11314us) service_pool.cc:224] Handling call
0709 12:14:34.586120 (+ 30021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.593735 (+  7615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.593787 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.594260 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.710083 (+1115823us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:35.710124 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.710204 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.312550 (+602346us) raft_consensus.cc:1685] finished
0709 12:14:36.312577 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.312745 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7226,"raft.queue_time_us":7316,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":41099,"thread_start_us":1055612,"threads_started":1,"wal-append.queue_time_us":1651418}
I20260709 12:14:36.416473  5596 raft_consensus.cc:1240] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:14:36.415431  9261 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.418323  9261 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:14:36.418480  9214 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.418269  5676 raft_consensus.cc:740] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:36.419147  9280 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.419691  5676 consensus_queue.cc:260] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.420838  5676 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:36.422387  9313 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.422927  9313 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.314790  9219 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:36.428453  9313 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.409480  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:36.415349  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2194) took 1276 ms. Trace:
I20260709 12:14:36.430536  5599 rpcz_store.cc:276] 0709 12:14:35.138716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.256739 (+1118023us) service_pool.cc:224] Handling call
0709 12:14:36.415276 (+158537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.432029  5599 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:14:36.430619  5602 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:14:36.442655  5676 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:14:36.411432  5598 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:14:36.475401  5676 pending_rounds.cc:85] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 5
I20260709 12:14:36.475658  5676 pending_rounds.cc:107] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:14:36.475765  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2198) took 1089 ms. Trace:
I20260709 12:14:36.475903  5676 raft_consensus.cc:2889] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:36.476166  5598 rpcz_store.cc:276] 0709 12:14:35.385957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.410897 (+1024940us) service_pool.cc:224] Handling call
0709 12:14:36.411197 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.475509 (+ 64312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.475712 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:36.231509  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 1.21424e+06us
I20260709 12:14:36.446171  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1481) took 2543 ms. Trace:
I20260709 12:14:36.364833  9183 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.421546  9280 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.417704  5596 raft_consensus.cc:1240] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:14:36.465749  9224 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.456827  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.359902  8888 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.378402  9308 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:36.470746  9310 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:14:36.468461  9219 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:36.361886  9239 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.490298  5596 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:36.376834  9305 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.450642  9263 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.477648  5670 rpcz_store.cc:276] 0709 12:14:33.848972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.850317 (+  1345us) service_pool.cc:224] Handling call
0709 12:14:33.853861 (+  3544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.187861 (+334000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.392258 (+2204397us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540037a0d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:36.392445 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754652416}
I20260709 12:14:36.481889  5567 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:36.468148  9270 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.361117  9311 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:36.490734  5569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.026s	sys 0.033s
I20260709 12:14:36.380851  9316 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.471532  9214 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:36.499132  5569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.026s	sys 0.034s
I20260709 12:14:36.496184  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:36.492659  5598 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:36.479715  9286 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.501029  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:36.507499  5602 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:36.479686  9334 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.479403  9291 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.480014  9183 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:36.484962  9298 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:36.493554  9306 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:14:36.484527  9303 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:36.509070  5676 raft_consensus.cc:1240] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:36.516815  9321 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:14:36.491977  9335 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:36.517558  5671 raft_consensus.cc:3055] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:36.526397  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:36.526688  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:36.526415  5671 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:36.521137  5567 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:36.521064  5716 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:36.520855  5718 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:36.536139  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:36.540719  5745 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:14:36.536404  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:36.490213  9224 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.508773  9329 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.513581  9210 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.539880  5747 raft_consensus.cc:2410] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:36.535387  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:36.547817  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:36.536708  5671 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.549878  5671 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:36.505988  9214 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.551889  5716 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:36.511030  9252 consensus_queue.cc:1059] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:36.553653  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:36.503430  9270 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.494240  9308 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.566959  5602 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:36.553001  5718 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:36.557859  5747 raft_consensus.cc:1240] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:36.542380  9322 log.cc:927] Time spent T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 12:14:36.561901  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.513052  9334 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.558038  9219 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:36.538296  9280 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.537652  9330 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:36.571053  5747 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:36.544893  9316 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:36.510499  9286 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.650089  5748 raft_consensus.cc:2393] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:36.652163  5747 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:36.651252  6293 connection.cc:256] RPC call timeout handler was delayed by -2.0268953740001052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
W20260709 12:14:36.594322  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.654241  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.548775  9129 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.523484  9303 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.519111  9298 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.519248  9291 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.550081  9126 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:36.558296  8475 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:36.642700  9252 raft_consensus.cc:3055] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:14:36.643177  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 82018.8us
I20260709 12:14:36.554551  9329 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.536919  9335 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.566910  9203 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:36.649113  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 96195.7us
I20260709 12:14:36.665897  9217 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:36.692178  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:36.566697  8957 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:36.693126  8957 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.693522  8957 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:36.569706  9085 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:36.697837  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.676087  5671 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:14:36.675380  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2192) took 1574 ms. Trace:
I20260709 12:14:36.699412  5671 pending_rounds.cc:85] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 7
I20260709 12:14:36.680299  5596 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:36.699853  5671 pending_rounds.cc:107] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:14:36.680521  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2090) took 2073 ms. Trace:
I20260709 12:14:36.700162  5671 raft_consensus.cc:2889] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:36.683661  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:36.675302  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:36.700906  5670 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:36.682466  8888 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.690218  5718 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:36.653309  6293 connection.cc:256] RPC call timeout handler was delayed by -1.9872953740000412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
I20260709 12:14:36.658892  9097 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:36.686486  5716 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:36.691749  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2085) took 2085 ms. Trace:
W20260709 12:14:36.705368  6293 connection.cc:256] RPC call timeout handler was delayed by -1.3673340150000968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 12:14:36.711457  6293 connection.cc:256] RPC call timeout handler was delayed by -1.1126340149999123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:14:36.711789  6293 connection.cc:256] RPC call timeout handler was delayed by -1.0051541940001698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:14:36.679272  9252 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:36.699534  5601 rpcz_store.cc:276] 0709 12:14:35.100694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.100815 (+   121us) service_pool.cc:224] Handling call
0709 12:14:35.101134 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:35.116313 (+ 15179us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:35.116345 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:35.996651 (+880306us) log.cc:844] Serialized 26 byte log entry
0709 12:14:36.475905 (+479254us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:36.475943 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.476007 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.675178 (+199171us) raft_consensus.cc:1685] finished
0709 12:14:36.675198 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.675325 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1982,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":7727,"thread_start_us":259834,"threads_started":1,"wal-append.queue_time_us":315342}
I20260709 12:14:36.719663  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:36.634317  9326 consensus_queue.cc:1059] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 12:14:36.702867  8475 raft_consensus.cc:697] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:36.722352  5747 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:36.706069  5600 rpcz_store.cc:276] 0709 12:14:34.606068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.607978 (+  1910us) service_pool.cc:224] Handling call
0709 12:14:34.608271 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.608460 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:36.362982 (+1754522us) log.cc:844] Serialized 14 byte log entry
0709 12:14:36.691435 (+328453us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:36.691486 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:36.691527 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.691589 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.691699 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30831,"prepare.queue_time_us":208992,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":2044387,"threads_started":3,"wal-append.queue_time_us":273032}
I20260709 12:14:36.665449  9129 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.701026  5603 rpcz_store.cc:276] 0709 12:14:34.607510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.827621 (+220111us) service_pool.cc:224] Handling call
0709 12:14:34.837790 (+ 10169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.843314 (+  5524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.843347 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.851584 (+  8237us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.116980 (+265396us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:35.157503 (+ 40523us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.157750 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.157851 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.680282 (+1522431us) raft_consensus.cc:1685] finished
0709 12:14:36.680317 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.680454 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5143,"prepare.queue_time_us":40257,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":58,"raft.queue_time_us":35387,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":48309,"thread_start_us":240111,"threads_started":1,"wal-append.queue_time_us":1069525}
I20260709 12:14:36.650452  9280 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.716538  9316 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:36.691004  9205 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:14:36.733039  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:36.690718  9197 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:36.698460  8916 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:36.650758  9330 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.737790  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:36.718912  8785 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:36.743856  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:36.747084  5601 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:36.748778  8475 consensus_queue.cc:237] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.752103  8957 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.734243  9263 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.786283  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:36.798503  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:36.798683  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 80767us
I20260709 12:14:36.733349  9325 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.786967  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:36.738289  9242 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.703223  9344 consensus_queue.cc:1059] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:14:36.802783  5598 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:36.816635  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:36.817564  5716 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:36.728372  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:36.720060  9097 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.834491  9097 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.836050  9097 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:36.814644  5750 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:36.837201  5671 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:36.768033  9239 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.838385  9239 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:36.838815  9239 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.839224  9239 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:36.842072  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 54584.7us
W20260709 12:14:36.845083  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 323978us
I20260709 12:14:36.847656  9308 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.848210  9308 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:36.848670  9308 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.850704  9308 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.735304  9331 consensus_queue.cc:1059] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:14:36.754005  9334 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.743213  9347 raft_consensus.cc:2764] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:14:36.861842  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:36.862509  5602 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:36.863365  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:36.863941  5602 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:36.858642  5749 raft_consensus.cc:2955] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:36.867113  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:36.867702  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 125370us
I20260709 12:14:36.793242  9316 raft_consensus.cc:697] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:36.873132  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:36.874158  5718 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:36.878041  5671 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:14:36.812932  9305 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:36.787851  9197 consensus_queue.cc:1059] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:14:36.883692  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:36.785283  8916 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.881906  9214 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:36.882507  9270 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.801987  9261 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:14:36.856889  9311 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:36.880363  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 78759.6us
I20260709 12:14:36.917865  6293 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:36.919101  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:36.920418  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:36.921223  5671 raft_consensus.cc:2410] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 10 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:14:36.922506  5569 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:36.924978  9291 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.889931  8785 consensus_queue.cc:1059] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:14:36.884181  9203 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:36.926859  9214 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.927352  9214 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.757645  9252 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.901638  9331 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:36.931392  9197 raft_consensus.cc:3055] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:36.931802  9197 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:36.932214  9343 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:36.932627  9197 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.933341  9273 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:36.933516  9345 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:36.933830  9273 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:36.934760  9342 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:14:36.936161  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2149) took 1572 ms. Trace:
I20260709 12:14:36.936556  5679 rpcz_store.cc:276] 0709 12:14:35.363561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.254946 (+891385us) service_pool.cc:224] Handling call
0709 12:14:36.255244 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.445661 (+190417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:36.445696 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:36.456658 (+ 10962us) log.cc:844] Serialized 26 byte log entry
0709 12:14:36.523129 (+ 66471us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:36.551779 (+ 28650us) log.cc:844] Serialized 14 byte log entry
0709 12:14:36.567891 (+ 16112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.567964 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.935957 (+367993us) raft_consensus.cc:1685] finished
0709 12:14:36.935975 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.936105 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":916,"prepare.queue_time_us":10694,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":35710,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":52735,"thread_start_us":182875,"threads_started":2,"wal-append.queue_time_us":231245}
I20260709 12:14:36.955597  5598 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:36.957739  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:36.961045  8839 raft_consensus.cc:3055] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:36.961616  8839 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:36.962568  8839 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.963796  8839 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:36.816359  9325 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:36.846925  9239 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:36.971539  5746 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:14:37.545387  5716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.014s	sys 0.042s
W20260709 12:14:37.547564  5716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.014s	sys 0.042s
W20260709 12:14:37.547868  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 730302us
I20260709 12:14:37.549939  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:37.054563  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 50022.6us
I20260709 12:14:36.924171  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:37.552466  5671 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:37.544590  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 610013us
I20260709 12:14:37.053669  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:37.432754  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:36.974119  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2144) took 2042 ms. Trace:
W20260709 12:14:36.933257  9338 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:14:37.431574  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:37.016439  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.636534  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.069101  5501 catalog_manager.cc:5697] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 3 to 5, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 5 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:37.054476  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.546398  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 676) took 1363 ms. Trace:
W20260709 12:14:36.984930  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 91209.8us
W20260709 12:14:37.638767  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.639176  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.639612  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.639560  5569 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:37.545136  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 627424us
W20260709 12:14:37.090700  5498 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45214 (request call id 297) took 26838 ms (client timeout 15000 ms). Trace:
W20260709 12:14:37.603287  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 54095.5us
I20260709 12:14:37.549117  5716 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:37.640705  6293 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:37.638616  6328 rpcz_store.cc:276] 0709 12:14:36.182935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.183083 (+   148us) service_pool.cc:224] Handling call
0709 12:14:36.183400 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.469516 (+286116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:36.469544 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:36.470662 (+  1118us) log.cc:844] Serialized 26 byte log entry
0709 12:14:36.687617 (+216955us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:36.687666 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.687950 (+   284us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.933076 (+245126us) raft_consensus.cc:1685] finished
0709 12:14:36.933098 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.546327 (+613229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91056,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":7270,"thread_start_us":480339,"threads_started":2,"wal-append.queue_time_us":306780}
I20260709 12:14:37.642154  5569 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:36.937191  9348 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:14:37.675233  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2066) took 4172 ms. Trace:
W20260709 12:14:37.675854  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 795633us
I20260709 12:14:37.555974  5673 rpcz_store.cc:276] 0709 12:14:34.931310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.934325 (+  3015us) service_pool.cc:224] Handling call
0709 12:14:34.951635 (+ 17310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.356850 (+1405215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:36.356882 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:36.357329 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:14:36.472730 (+115401us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:36.472770 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.973625 (+500855us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400447fd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:36.973678 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.973730 (+    52us) raft_consensus.cc:1685] finished
0709 12:14:36.973744 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.974046 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":709,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4437,"spinlock_wait_cycles":3226080128,"thread_start_us":81308,"threads_started":1,"wal-append.queue_time_us":184077}
W20260709 12:14:37.104290  9260 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 2.878s	user 0.000s	sys 0.023s
W20260709 12:14:37.146190  9183 consensus_meta.cc:287] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.618s	user 0.006s	sys 0.003s
I20260709 12:14:36.978289  9327 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:37.711910  5597 rpcz_store.cc:276] 0709 12:14:33.394563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.394678 (+   115us) service_pool.cc:224] Handling call
0709 12:14:33.394970 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.731595 (+336625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.567099 (+3835504us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54002aba54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:37.567339 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772442496}
W20260709 12:14:37.377511  9326 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.002s	sys 0.016s
I20260709 12:14:36.976390  9344 raft_consensus.cc:3055] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:37.710950  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:36.936374  9324 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.787s
I20260709 12:14:37.718573  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:37.742436  5604 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:36.970081  9298 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:37.544632  9252 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:37.210435  9330 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.975672  9345 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:37.699894  5567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.009s	sys 0.019s
I20260709 12:14:37.673591  5671 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
W20260709 12:14:37.764218  5567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.010s	sys 0.020s
I20260709 12:14:37.764447  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1510) took 1068 ms. Trace:
I20260709 12:14:37.735535  5673 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:37.765300  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 669) took 1109 ms. Trace:
I20260709 12:14:37.727463  5501 catalog_manager.cc:5697] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 4 to 6, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 6 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:37.146894  9335 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:36.977128  9329 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:37.740149  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:37.766139  5598 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:37.661110  8839 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.147403  9280 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:37.744059  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:37.767206  5673 rpcz_store.cc:276] 0709 12:14:36.655996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.734857 (+1078861us) service_pool.cc:224] Handling call
0709 12:14:37.735187 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.765050 (+ 29863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.765251 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.767621  5597 raft_consensus.cc:2410] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:37.549486  9303 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:37.726554  9197 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:37.762791  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:37.764595  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 918273us
I20260709 12:14:37.676146  9352 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:37.764859  5671 rpcz_store.cc:276] 0709 12:14:36.695775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.923927 (+228152us) service_pool.cc:224] Handling call
0709 12:14:37.764385 (+840458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.768653  5673 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:37.770040  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:37.731439  9344 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:37.234738  9273 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:37.722079  9327 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:14:37.730885  9326 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.002s	sys 0.018s
I20260709 12:14:37.779233  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 671) took 1122 ms. Trace:
I20260709 12:14:37.776180  5604 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:37.783083  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1508) took 1105 ms. Trace:
I20260709 12:14:37.823968  5673 rpcz_store.cc:276] 0709 12:14:36.677402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.768096 (+1090694us) service_pool.cc:224] Handling call
0709 12:14:37.768498 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.782829 (+ 14331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.783023 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.782696  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:37.792661  5747 raft_consensus.cc:1240] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:14:37.727983  9183 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:37.825124  5597 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:37.826015  5679 rpcz_store.cc:276] 0709 12:14:36.656427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.731910 (+1075483us) service_pool.cc:224] Handling call
0709 12:14:37.779174 (+ 47264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.775257  9345 raft_consensus.cc:697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:37.831938  9345 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:37.831734  5501 catalog_manager.cc:5697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 2 to 6, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 6 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:37.106449  9316 consensus_queue.cc:237] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:37.833314  5501 catalog_manager.cc:5697] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 2 to 3, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:37.780162  9280 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:37.792604  9311 raft_consensus.cc:1064] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:14:37.790653  9264 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:37.840423  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:37.640846  5498 rpcz_store.cc:269] 0709 12:14:10.252480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.252859 (+   379us) service_pool.cc:224] Handling call
0709 12:14:37.090433 (+26837574us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:22.750876 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:22.751577 (+   701us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:22.751634 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:14:22.751681 (+    47us) tablet.cc:662] Decoding operations
0709 12:14:22.825055 (+ 73374us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:22.825128 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:22.825156 (+    28us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:14:23.193800 (+368644us) tablet.cc:701] Row locks acquired
0709 12:14:23.193865 (+    65us) write_op.cc:260] PREPARE: finished
0709 12:14:23.194056 (+   191us) write_op.cc:270] Start()
0709 12:14:23.211102 (+ 17046us) write_op.cc:276] Timestamp: P: 1783599263193991 usec, L: 0
0709 12:14:23.212968 (+  1866us) op_driver.cc:348] REPLICATION: starting
0709 12:14:23.350145 (+137177us) log.cc:844] Serialized 8876 byte log entry
0709 12:14:24.854592 (+1504447us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:25.878477 (+1023885us) op_driver.cc:464] REPLICATION: finished
0709 12:14:25.993462 (+114985us) write_op.cc:301] APPLY: starting
0709 12:14:25.993556 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:25.994001 (+   445us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:25.994037 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:26.002675 (+  8638us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:26.003092 (+   417us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 12:14:26.003138 (+    46us) write_op.cc:312] APPLY: finished
0709 12:14:26.003615 (+   477us) log.cc:844] Serialized 158 byte log entry
0709 12:14:26.008435 (+  4820us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:26.008618 (+   183us) write_op.cc:454] Released schema lock
0709 12:14:26.008703 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:26.009135 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:26.009161 (+    26us) write_op.cc:454] Released schema lock
0709 12:14:27.819587 (+1810426us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b54003b9cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4832a 00007f44fd9cdf14 00007f44fd9cdec3 00007f44fd9cde38 00007f44fd9cddf3 00007f44fd9cd0dc 00007f44fd9f6e16 00007f44fd9decbb 00007f44fd9c939d 00007f44fd9ccd75
Metrics: {"mutex_wait_us":113385,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":108755,"apply.run_cpu_time_us":7875,"apply.run_wall_time_us":15662,"num_ops":23,"prepare.queue_time_us":234340,"prepare.run_cpu_time_us":152163,"prepare.run_wall_time_us":850300,"raft.queue_time_us":590611,"raft.run_cpu_time_us":29829,"raft.run_wall_time_us":2023184,"replication_time_us":2636415,"spinlock_wait_cycles":339650816,"thread_start_us":472270,"threads_started":4,"wal-append.queue_time_us":787676,"wal-append.run_cpu_time_us":37247,"wal-append.run_wall_time_us":2872417}]]}
I20260709 12:14:37.841305  5501 catalog_manager.cc:5697] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:37.779883  9352 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.794704  9327 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:37.773422  9298 consensus_queue.cc:1059] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:14:37.846619  5670 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:37.848685  5598 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 6.
I20260709 12:14:37.851863  5604 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:37.852332  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:37.852670  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:37.791982  8957 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:37.778239  8839 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:37.838171  9214 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:37.790419  9335 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:14:37.856566  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:37.846875  9264 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.857663  5604 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:37.858253  5598 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:37.849416  9280 raft_consensus.cc:697] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:37.864491  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2105) took 1130 ms. Trace:
I20260709 12:14:37.864895  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2100) took 1157 ms. Trace:
I20260709 12:14:37.865291  5598 rpcz_store.cc:276] 0709 12:14:36.707851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.853063 (+1145212us) service_pool.cc:224] Handling call
0709 12:14:37.858109 (+  5046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.864140 (+  6031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.864853 (+   713us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1538304}
I20260709 12:14:37.850370  9352 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:37.867071  5597 raft_consensus.cc:1240] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:37.865175  5604 rpcz_store.cc:276] 0709 12:14:36.733827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.853386 (+1119559us) service_pool.cc:224] Handling call
0709 12:14:37.857506 (+  4120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.864007 (+  6501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.864251 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.871443  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2106) took 1129 ms. Trace:
I20260709 12:14:37.872129  5597 rpcz_store.cc:276] 0709 12:14:36.742259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.857810 (+1115551us) service_pool.cc:224] Handling call
0709 12:14:37.866901 (+  9091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.871171 (+  4270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.871388 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.865401  9264 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:37.864794  9303 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.888716  5597 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:37.895916  8839 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:37.914183  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 365075us
W20260709 12:14:37.930333  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 289660us
I20260709 12:14:37.919391  5716 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:37.876837  9298 raft_consensus.cc:3055] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:37.951344  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 240881us
I20260709 12:14:37.953435  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2147) took 1070 ms. Trace:
I20260709 12:14:37.855825  9344 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:37.956199  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 178956us
W20260709 12:14:38.001644  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 289395us
I20260709 12:14:38.007405  9270 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.008085  9270 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:37.954038  5746 rpcz_store.cc:276] 0709 12:14:36.883355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.661970 (+778615us) service_pool.cc:224] Handling call
0709 12:14:37.662315 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.662528 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:37.736410 (+ 73882us) log.cc:844] Serialized 14 byte log entry
0709 12:14:37.953024 (+216614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:37.953095 (+    71us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:37.953151 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.953220 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.953362 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9607,"prepare.queue_time_us":139338,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":206547,"threads_started":1,"wal-append.queue_time_us":206836}
I20260709 12:14:37.901522  9239 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:38.019058  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 72352.3us
I20260709 12:14:38.028831  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:38.030289  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:38.030977  5671 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:38.031833  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:38.032867  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:38.033670  5671 raft_consensus.cc:2410] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:38.038026  8868 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:38.038410  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:38.038980  5746 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.025205  8839 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:38.040414  8839 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:37.951810  9279 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:37.951995  9298 raft_consensus.cc:740] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:37.899791  9303 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:38.054478  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.056109  5679 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:38.044936  9351 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 12:14:38.079882  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 57211.5us
I20260709 12:14:38.043262  9330 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.076665  9376 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:38.078975  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:38.107825  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 142653us
W20260709 12:14:38.128901  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 72603.5us
I20260709 12:14:38.176555  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:38.079339  5597 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:37.987028  9325 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:38.079591  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:38.051200  9279 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:38.392509  5746 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:38.415490  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:38.201853  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.195170  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.443980  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 363360us
I20260709 12:14:38.052809  9239 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.440042  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2107) took 1684 ms. Trace:
I20260709 12:14:38.231727  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1503) took 2049 ms. Trace:
W20260709 12:14:38.376490  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.463438  5671 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:38.458880  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2112) took 1654 ms. Trace:
W20260709 12:14:38.465979  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.461401  5673 raft_consensus.cc:2393] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:38.474247  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:38.465837  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.480140  5597 rpcz_store.cc:276] 0709 12:14:36.804797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.872749 (+1067952us) service_pool.cc:224] Handling call
0709 12:14:37.888587 (+ 15838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:38.458284 (+569697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.458755 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:38.230602  9364 log.cc:927] Time spent T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.360s	user 0.000s	sys 0.000s
W20260709 12:14:38.460964  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.481673  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:38.485814  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:38.486445  5671 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:38.487156  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:38.487914  5673 raft_consensus.cc:2393] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 6: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:38.486896  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:38.488565  5746 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:38.222442  9366 log.cc:927] Time spent T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.323s	user 0.000s	sys 0.000s
I20260709 12:14:38.053195  9280 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.463688  5567 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:38.476432  5676 rpcz_store.cc:276] 0709 12:14:36.182352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.492764 (+310412us) service_pool.cc:224] Handling call
0709 12:14:36.500680 (+  7916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.519920 (+ 19240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.231445 (+1711525us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b540024f9d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:38.231658 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18885504}
I20260709 12:14:38.494007  5597 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:38.499125  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2207) took 1610 ms. Trace:
I20260709 12:14:38.440161  9183 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:38.499527  5597 rpcz_store.cc:276] 0709 12:14:36.888212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.493001 (+1604789us) service_pool.cc:224] Handling call
0709 12:14:38.493690 (+   689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:38.498853 (+  5163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.499069 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:38.507853  5597 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:38.454048  9273 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:38.513702  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2213) took 1621 ms. Trace:
I20260709 12:14:38.514123  5597 rpcz_store.cc:276] 0709 12:14:36.891993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.507339 (+1615346us) service_pool.cc:224] Handling call
0709 12:14:38.507685 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:38.508436 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.513647 (+  5211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:38.226052  9270 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:38.532265  5746 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:38.387195  8839 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:38.544071  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:38.544407  9390 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.457808  9381 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:38.458070  9279 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.466037  9375 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.555635  5676 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
W20260709 12:14:38.557717  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 94090.7us
I20260709 12:14:38.564607  5567 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:38.560494  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:38.450312  9345 consensus_queue.cc:1059] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
W20260709 12:14:38.587160  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 417824us
I20260709 12:14:38.566068  9395 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:14:38.571341  9311 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.454161  9298 consensus_queue.cc:260] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.566802  5671 raft_consensus.cc:2393] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:38.586495  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:38.611963  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 47446.1us
I20260709 12:14:38.613353  5567 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:38.588647  9252 consensus_meta.cc:287] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.825s	user 0.008s	sys 0.001s
I20260709 12:14:38.188905  9330 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.480093  9239 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:38.608117  9214 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:38.626395  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:38.588322  9197 consensus_meta.cc:287] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.807s	user 0.005s	sys 0.005s
I20260709 12:14:38.618430  5745 raft_consensus.cc:2410] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:38.628535  5679 raft_consensus.cc:2393] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:38.590695  9378 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.608292  9273 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.595976  5746 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:38.586047  9372 consensus_queue.cc:1059] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:14:38.625682  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:38.638079  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:38.639202  6328 raft_consensus.cc:2393] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:38.612092  5676 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:38.639518  6323 raft_consensus.cc:2393] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:38.616256  9383 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.615685  9395 consensus_queue.cc:1243] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:14:38.588579  8839 consensus_queue.cc:1059] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:14:38.620944  9345 consensus_queue.cc:1243] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:14:38.625921  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 449401us
I20260709 12:14:38.636741  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:38.642391  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:38.621658  9325 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:38.626394  9368 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.623208  9392 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.632407  8868 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.642333  9376 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:38.638103  9298 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:38.633520  9225 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.658176  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:38.658510  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:38.659268  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:38.583516  9381 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.671089  6323 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
W20260709 12:14:38.650918  5670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1511) took 1954 ms (client timeout 1508 ms). Trace:
W20260709 12:14:38.678898  5670 rpcz_store.cc:269] 0709 12:14:36.696156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.731912 (+ 35756us) service_pool.cc:224] Handling call
0709 12:14:38.650670 (+1918758us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540029b8d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:38.650812 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2508480256}
I20260709 12:14:38.653501  5671 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:38.653285  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2131) took 2126 ms. Trace:
I20260709 12:14:38.752146  9255 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:38.654809  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:38.654124  6319 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.652056  9396 raft_consensus.cc:3055] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:38.640103  9378 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:38.656448  9365 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.672957  5679 raft_consensus.cc:2410] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:14:38.645476  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.649822  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:38.760862  5570 leader_election.cc:336] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.698s (SENT)
I20260709 12:14:38.666944  5642 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:38.671456  9368 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.658406  9325 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.646027  9214 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:38.567291  9390 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.662178  8868 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:38.695793  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:38.683629  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:38.745183  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:38.696485  9224 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:38.643748  9393 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.680673  9225 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:38.645056  9383 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.640699  9273 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.750655  5678 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:38.590060  9375 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.751682  5748 rpcz_store.cc:276] 0709 12:14:36.525210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.525385 (+   175us) service_pool.cc:224] Handling call
0709 12:14:38.651284 (+2125899us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54000541d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:38.651413 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242175744}
I20260709 12:14:38.754882  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:38.757172  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:38.640337  9370 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:38.761595  5570 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:38.671289  9392 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:38.752743  9255 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:38.761025  6320 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:14:39.399118  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.399595  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.755434  9386 log.cc:927] Time spent T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.125s	user 0.003s	sys 0.001s
I20260709 12:14:39.393970  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2143) took 2654 ms. Trace:
W20260709 12:14:39.395511  5745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2145) took 2581 ms (client timeout 2011 ms). Trace:
I20260709 12:14:38.756239  9400 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:38.958273  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 207319us
I20260709 12:14:39.403486  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:38.783699  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:38.910698  6319 raft_consensus.cc:2410] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:38.831789  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.405185  5599 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:39.404122  5670 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.405494  5672 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:14:39.406327  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.919951  9327 consensus_meta.cc:287] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 1.064s	user 0.005s	sys 0.006s
I20260709 12:14:38.755915  9396 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:39.400672  5673 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:38.875737  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.464700  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 2169) took 1007 ms. Trace:
W20260709 12:14:39.405098  5595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2191) took 4304 ms (client timeout 2136 ms). Trace:
I20260709 12:14:38.473564  5598 rpcz_store.cc:276] 0709 12:14:36.755288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.866566 (+1111278us) service_pool.cc:224] Handling call
0709 12:14:37.868489 (+  1923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.868691 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:37.950908 (+ 82217us) log.cc:844] Serialized 14 byte log entry
0709 12:14:38.439647 (+488739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:38.439710 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:38.439758 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.439835 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.439971 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142093,"prepare.queue_time_us":24948,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":499449,"thread_start_us":421231,"threads_started":3}
I20260709 12:14:39.104298  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.448736  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2146) took 4327 ms. Trace:
I20260709 12:14:38.810624  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2108) took 2050 ms. Trace:
W20260709 12:14:39.027899  9352 consensus_meta.cc:287] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 1.158s	user 0.006s	sys 0.005s
I20260709 12:14:39.407357  5753 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:38.920782  9296 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 4.051s	user 0.006s	sys 0.050s
I20260709 12:14:38.922487  5601 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
W20260709 12:14:39.445065  5745 rpcz_store.cc:269] 0709 12:14:36.814133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.814250 (+   117us) service_pool.cc:224] Handling call
0709 12:14:39.395263 (+2581013us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54000537d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:39.395432 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4025507200}
I20260709 12:14:38.829547  5569 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:39.448850  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 781904us
W20260709 12:14:39.016434  9264 consensus_meta.cc:287] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.114s	user 0.009s	sys 0.001s
I20260709 12:14:39.450333  6321 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.466233  5678 rpcz_store.cc:276] 0709 12:14:35.081273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.081444 (+   171us) service_pool.cc:224] Handling call
0709 12:14:38.698254 (+3616810us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:38.750482 (+ 52228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.408787 (+658305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.409014 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4872448}
I20260709 12:14:39.456126  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.028702  8958 raft_consensus.cc:3055] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:39.407840  9190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.414s	user 0.011s	sys 0.034s
I20260709 12:14:39.452384  5752 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
W20260709 12:14:39.017866  9403 log.cc:927] Time spent T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:14:39.024075  9391 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
I20260709 12:14:39.479871  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:39.446497  5747 rpcz_store.cc:276] 0709 12:14:36.739505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.739621 (+   116us) service_pool.cc:224] Handling call
0709 12:14:36.739914 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:37.828883 (+1088969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.393590 (+1564707us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000546d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:39.393862 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2415040768}
I20260709 12:14:39.403537  9372 raft_consensus.cc:3055] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:39.461552  5671 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:39.463699  6320 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:39.406204  9308 raft_consensus.cc:3055] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:39.465076  5673 rpcz_store.cc:276] 0709 12:14:38.457099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.683375 (+226276us) service_pool.cc:224] Handling call
0709 12:14:39.464633 (+781258us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:39.451625  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.008812  9303 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:39.449460  9399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.003s	sys 0.006s
W20260709 12:14:39.465229  6291 connection.cc:256] RPC call timeout handler was delayed by -3.6994333350000943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:14:39.422840  9344 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.392436  9286 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:39.020865  9376 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:39.468302  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.453177  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.577843  6291 connection.cc:256] RPC call timeout handler was delayed by -3.3685289560000911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:14:39.579401  6291 connection.cc:256] RPC call timeout handler was delayed by -3.3685289560000911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:14:39.579607  6291 connection.cc:256] RPC call timeout handler was delayed by -3.3316289560000314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 12:14:39.579793  6291 connection.cc:256] RPC call timeout handler was delayed by -3.2524289559999033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 12:14:39.090243  9289 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:39.465487  5595 rpcz_store.cc:269] 0709 12:14:35.100357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.100513 (+   156us) service_pool.cc:224] Handling call
0709 12:14:39.025263 (+3924750us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b540031b5d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:39.405031 (+379768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951302528}
I20260709 12:14:39.456410  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 664) took 4502 ms. Trace:
I20260709 12:14:39.461434  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:39.407545  9239 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:38.924109  9330 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:39.447543  9230 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.475004  5604 rpcz_store.cc:276] 0709 12:14:36.759809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.869723 (+1109914us) service_pool.cc:224] Handling call
0709 12:14:37.869968 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.870098 (+   130us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:37.977296 (+107198us) log.cc:844] Serialized 14 byte log entry
0709 12:14:38.810207 (+832911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:38.810276 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:38.810327 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.810397 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.810546 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16841,"prepare.queue_time_us":23830,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":355951,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":48752,"thread_start_us":619867,"threads_started":3,"wal-append.queue_time_us":674071}
I20260709 12:14:39.406939  9288 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:39.466486  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 705584us
W20260709 12:14:39.580580  9399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.005s	sys 0.006s
I20260709 12:14:39.573578  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2168) took 1116 ms. Trace:
I20260709 12:14:39.484390  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:39.573451  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1516) took 1460 ms. Trace:
I20260709 12:14:39.574504  5679 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:39.457988  9306 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:39.464259  9371 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:39.581665  9376 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.476186  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:39.575371  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:39.533106  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 703588us
I20260709 12:14:39.484604  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:39.574784  5673 raft_consensus.cc:1240] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:39.579983  6291 connection.cc:256] RPC call timeout handler was delayed by -3.216133334999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
I20260709 12:14:39.578527  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:39.477484  9264 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.582129  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.581956  5748 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:39.582891  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.620404  5595 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:39.603505  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.621881  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:39.622828  9298 consensus_meta.cc:287] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.961s	user 0.009s	sys 0.000s
I20260709 12:14:39.623127  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.623781  5595 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:39.624342  5600 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:39.623281  9288 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:39.624989  9288 raft_consensus.cc:697] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:39.625579  9378 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:39.625840  9288 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.626607  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:39.627027  9300 log.cc:927] Time spent T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 4.748s	user 0.031s	sys 0.041s
I20260709 12:14:39.624603  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:39.483337  9190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.490s	user 0.011s	sys 0.036s
I20260709 12:14:39.598191  9381 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:38.758625  9295 raft_consensus.cc:2955] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:39.628525  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2144) took 2881 ms. Trace:
I20260709 12:14:39.593297  9255 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:39.627184  5603 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:39.629493  5746 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 7. Ops: []
I20260709 12:14:39.581679  5672 rpcz_store.cc:276] 0709 12:14:34.954338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.956502 (+  2164us) service_pool.cc:224] Handling call
0709 12:14:39.405054 (+4448552us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:39.405200 (+   146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.451847 (+ 46647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.456350 (+  4503us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6695040}
I20260709 12:14:39.629549  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:39.477249  9352 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.630323  5603 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.630604  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2153) took 1630 ms. Trace:
I20260709 12:14:39.630932  5746 rpcz_store.cc:276] 0709 12:14:38.000591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.640865 (+640274us) service_pool.cc:224] Handling call
0709 12:14:38.641149 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.629915 (+988766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.630397 (+   482us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b540009f1d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:39.630554 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272578944}
I20260709 12:14:39.622996  9262 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:39.632058  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:39.632644  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:39.632946  9225 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:39.475685  9327 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:39.633122  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:39.633937  9190 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:39.634289  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:39.584371  9141 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:39.638691  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.639312  6325 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:38.779646  9365 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.476832  8958 raft_consensus.cc:740] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:39.482447  5567 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:39.428577  9393 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:39.593819  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.594873  5747 raft_consensus.cc:2368] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:14:39.483613  9372 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:39.595397  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.643751  6326 raft_consensus.cc:2410] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:39.643906  5604 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:39.595641  5671 rpcz_store.cc:276] 0709 12:14:38.112968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.422633 (+1309665us) service_pool.cc:224] Handling call
0709 12:14:39.461381 (+ 38748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.546051 (+ 84670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.573377 (+ 27326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.595011  5678 rpcz_store.cc:276] 0709 12:14:38.456880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.474515 (+1017635us) service_pool.cc:224] Handling call
0709 12:14:39.573130 (+ 98615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.573284 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.573300 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:39.573328 (+    28us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:39.573350 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.573415 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.573527 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.596217  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2173) took 1120 ms. Trace:
I20260709 12:14:39.634908  5749 rpcz_store.cc:276] 0709 12:14:36.747111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.747216 (+   105us) service_pool.cc:224] Handling call
0709 12:14:36.787994 (+ 40778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.803326 (+ 15332us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:36.928379 (+125053us) log.cc:844] Serialized 14 byte log entry
0709 12:14:38.464623 (+1536244us) log.cc:844] Serialized 14 byte log entry
0709 12:14:38.464850 (+   227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:38.464902 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:38.464958 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.628322 (+1163364us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b54002c79d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:39.628366 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.628473 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":443924,"prepare.queue_time_us":110517,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":439734,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":8977,"spinlock_wait_cycles":34744064,"thread_start_us":605499,"threads_started":2,"wal-append.queue_time_us":917504,"wal-append.run_cpu_time_us":16063,"wal-append.run_wall_time_us":1736297}
I20260709 12:14:39.644795  5679 rpcz_store.cc:276] 0709 12:14:38.476123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.474630 (+998507us) service_pool.cc:224] Handling call
0709 12:14:39.574349 (+ 99719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.595990 (+ 21641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.596170 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.574807  9308 raft_consensus.cc:740] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:39.457454  9400 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:39.619697  6291 connection.cc:256] RPC call timeout handler was delayed by -3.1009333350000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 12:14:39.651976  6291 connection.cc:256] RPC call timeout handler was delayed by -2.9680289559998982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:14:39.652225  6291 connection.cc:256] RPC call timeout handler was delayed by -2.9680289559998982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:14:39.652427  6291 connection.cc:256] RPC call timeout handler was delayed by -2.8537289559999408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 12:14:39.652621  6291 connection.cc:256] RPC call timeout handler was delayed by -2.8537289559999408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 12:14:39.652812  6291 connection.cc:256] RPC call timeout handler was delayed by -2.7673289560000285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
I20260709 12:14:39.012403  9279 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:39.453006  9099 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:14:39.587076  9253 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:39.628008  5595 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:39.473291  9181 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:39.635027  5746 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:39.628185  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 674) took 5012 ms. Trace:
I20260709 12:14:39.666421  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1542) took 1017 ms. Trace:
I20260709 12:14:39.666913  5746 rpcz_store.cc:276] 0709 12:14:38.648663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.634061 (+985398us) service_pool.cc:224] Handling call
0709 12:14:39.666358 (+ 32297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.635162  5600 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.586665  9316 consensus_queue.cc:1059] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:39.595036  9239 consensus_queue.cc:1059] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:14:39.636006  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2174) took 1159 ms. Trace:
I20260709 12:14:39.646283  9313 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:39.673676  5673 rpcz_store.cc:276] 0709 12:14:38.476373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.574368 (+1097995us) service_pool.cc:224] Handling call
0709 12:14:39.574629 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.635766 (+ 61137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.635947 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.621482  5569 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:39.674777  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 53380.2us
W20260709 12:14:39.621037  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 144945us
I20260709 12:14:39.621364  5753 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 6.
I20260709 12:14:39.601503  5719 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:39.621637  6319 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:39.675822  5642 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:39.675786  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1547) took 1018 ms. Trace:
W20260709 12:14:39.677278  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 75863.7us
W20260709 12:14:39.677820  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.634234  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1530) took 5142 ms. Trace:
I20260709 12:14:39.676630  5753 rpcz_store.cc:276] 0709 12:14:38.657388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.482550 (+825162us) service_pool.cc:224] Handling call
0709 12:14:39.675729 (+193179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.678629  5642 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:39.641695  5603 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
W20260709 12:14:39.642211  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 159814us
I20260709 12:14:39.646497  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 491) took 1015 ms. Trace:
I20260709 12:14:39.666357  6322 rpcz_store.cc:276] 0709 12:14:34.616053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.616464 (+   411us) service_pool.cc:224] Handling call
0709 12:14:34.650305 (+ 33841us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.724079 (+ 73774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.724108 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.724548 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.867012 (+142464us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:34.867056 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.867241 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:38.919498 (+4052257us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:39.627907 (+708409us) raft_consensus.cc:1685] finished
0709 12:14:39.627926 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.628113 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87113,"raft.queue_time_us":74648,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":13511,"spinlock_wait_cycles":4338432,"thread_start_us":96676,"threads_started":1,"wal-append.queue_time_us":136751}
I20260709 12:14:39.648411  5752 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:14:39.680387  5604 rpcz_store.cc:276] 0709 12:14:38.631302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.587628 (+956326us) service_pool.cc:224] Handling call
0709 12:14:39.646438 (+ 58810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.680987  5752 pending_rounds.cc:85] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 4
I20260709 12:14:39.635380  9371 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:39.717518  5746 raft_consensus.cc:1240] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:14:39.686138  9289 consensus_queue.cc:1059] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 12:14:39.653056  6291 connection.cc:256] RPC call timeout handler was delayed by -2.7673289560000285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
I20260709 12:14:39.657588  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:39.658664  5749 raft_consensus.cc:1240] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:39.598500  9306 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:39.631166  9368 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:39.634711  9327 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:39.635211  9297 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:39.663661  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2176) took 1178 ms. Trace:
I20260709 12:14:39.642939  9141 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:39.664553  9407 log.cc:927] Time spent T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:14:39.665398  9410 log.cc:927] Time spent T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:14:39.576416  9405 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:39.669601  5679 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:39.670663  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.647464  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.749936  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2178) took 1264 ms. Trace:
I20260709 12:14:39.750077  5598 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:39.678617  5751 rpcz_store.cc:276] 0709 12:14:34.491328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.491438 (+   110us) service_pool.cc:224] Handling call
0709 12:14:34.523933 (+ 32495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.349861 (+1825928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.634002 (+3284141us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54000a7b54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:39.634162 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4032790400}
I20260709 12:14:39.750312  5679 rpcz_store.cc:276] 0709 12:14:38.487270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.645605 (+1158335us) service_pool.cc:224] Handling call
0709 12:14:39.669422 (+ 23817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.749650 (+ 80228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.749870 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.750593  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 490) took 1120 ms. Trace:
I20260709 12:14:39.681941  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 488) took 1052 ms. Trace:
I20260709 12:14:39.751170  5598 rpcz_store.cc:276] 0709 12:14:38.630148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.621729 (+991581us) service_pool.cc:224] Handling call
0709 12:14:39.750539 (+128810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.751314  5604 rpcz_store.cc:276] 0709 12:14:38.629573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.681193 (+1051620us) service_pool.cc:224] Handling call
0709 12:14:39.681470 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.681623 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.681647 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:39.681686 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:39.681720 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.681790 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.681893 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.665683  9400 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:39.730420  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 50270.6us
I20260709 12:14:39.753223  5719 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:39.732270  6291 connection.cc:256] RPC call timeout handler was delayed by -2.7385289559999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260709 12:14:39.756035  6291 connection.cc:256] RPC call timeout handler was delayed by -2.7385289559999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260709 12:14:39.756361  6291 connection.cc:256] RPC call timeout handler was delayed by -2.7160289559999455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 12:14:39.756644  6291 connection.cc:256] RPC call timeout handler was delayed by -2.6962289559999135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
W20260709 12:14:39.756925  6291 connection.cc:256] RPC call timeout handler was delayed by -1.8394289559998924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3199s for a response
W20260709 12:14:39.757194  6291 connection.cc:256] RPC call timeout handler was delayed by -1.8394289559998924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3199s for a response
I20260709 12:14:39.758729  6319 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:39.647382  5745 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:39.681286  5752 pending_rounds.cc:107] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:14:39.760461  5752 raft_consensus.cc:2889] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.760608  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.761154  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1550) took 1019 ms. Trace:
I20260709 12:14:39.737962  9306 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.762799  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.763526  9279 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:39.763919  9394 raft_consensus.cc:3055] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:39.764186  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:39.765321  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:39.765067  9372 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.765938  9297 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:39.621258  9396 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:39.766366  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.766929  9396 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.766383  9297 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:39.767228  9127 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:39.763818  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.767691  9127 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.768112  6325 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:39.768538  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:39.768951  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:39.769192  6328 raft_consensus.cc:2393] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 6: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:39.763562  5598 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:39.723554  9308 consensus_queue.cc:260] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:39.770023  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:39.770813  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.770807  6328 raft_consensus.cc:2410] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:39.683151  9325 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:39.771471  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1553) took 1009 ms. Trace:
I20260709 12:14:39.761499  5752 rpcz_store.cc:276] 0709 12:14:38.742123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.637142 (+895019us) service_pool.cc:224] Handling call
0709 12:14:39.648165 (+ 11023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.760934 (+112769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.761107 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.771608  5598 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:39.678843  9204 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:39.740680  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1549) took 1068 ms. Trace:
I20260709 12:14:39.772979  5748 rpcz_store.cc:276] 0709 12:14:38.672058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.640000 (+967942us) service_pool.cc:224] Handling call
0709 12:14:39.740617 (+100617us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.681444  9262 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:39.743046  5671 rpcz_store.cc:276] 0709 12:14:38.484908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.644517 (+1159609us) service_pool.cc:224] Handling call
0709 12:14:39.663318 (+ 18801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.663444 (+   126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.663458 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:39.663498 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:39.663517 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.663550 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.663620 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.680148  9225 raft_consensus.cc:3055] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:39.776396  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:39.681598  9326 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:39.681495  9303 consensus_queue.cc:1059] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:14:39.759941  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.769670  6325 raft_consensus.cc:2393] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:39.682116  9370 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:39.771867  5745 rpcz_store.cc:276] 0709 12:14:38.762328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.642586 (+880258us) service_pool.cc:224] Handling call
0709 12:14:39.647213 (+  4627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.771224 (+124011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.771420 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.786762  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.736863  5600 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:39.777908  5719 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:39.787688  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.731956  9383 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:39.766311  9372 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.788865  5603 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 11. Ops: []
I20260709 12:14:39.772404  9405 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:39.768075  9127 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.794057  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.767549  9297 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.791442  5604 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:39.796056  6321 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:39.792905  9370 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.685949  9255 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:14:39.796414  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:39.792376  9390 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:39.797439  6323 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:39.765228  9141 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:39.807467  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.775660  9308 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.810631  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.813066  6328 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:39.813416  5604 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:39.774797  9394 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:39.776767  9204 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.672451  9253 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:39.783634  9326 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.816300  5719 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:39.781869  9225 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:39.822769  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.794763  9378 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.826184  9210 raft_consensus.cc:3055] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:39.786504  9181 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:39.843636  6328 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:39.825579  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 238854us
I20260709 12:14:39.838263  6323 raft_consensus.cc:1240] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:39.839078  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.839740  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2175) took 1355 ms. Trace:
I20260709 12:14:39.796545  9298 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:39.803767  9316 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:39.841413  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:39.843061  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.795411  9405 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.847412  5604 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:39.849828  9298 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.849867  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.826747  9204 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.844779  5672 rpcz_store.cc:276] 0709 12:14:38.484608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.630287 (+1145679us) service_pool.cc:224] Handling call
0709 12:14:39.630575 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.630907 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.630936 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.631378 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:14:39.784788 (+153410us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:39.784832 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.784906 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:39.839488 (+ 54582us) raft_consensus.cc:1685] finished
0709 12:14:39.839511 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.839669 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":955,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":153123,"threads_started":1,"wal-append.queue_time_us":153405}
I20260709 12:14:39.837884  9326 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.855962  9253 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:39.856087  9225 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:39.862707  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:39.840114  9375 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:39.871402  5597 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:39.866065  5677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 656) took 4982 ms (client timeout 2580 ms). Trace:
I20260709 12:14:39.840294  9210 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:39.845548  9371 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:39.864009  9141 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:39.854115  9392 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:39.870657  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.872852  9225 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.914276  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:39.915402  9311 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:39.915771  9311 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:39.916117  9311 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:39.875118  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.878470  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.879338  6319 raft_consensus.cc:1240] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:39.879091  6328 raft_consensus.cc:2955] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:39.849948  9413 raft_consensus.cc:3055] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:39.922237  9413 raft_consensus.cc:740] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:39.922613  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.923408  6325 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
W20260709 12:14:39.871975  5677 rpcz_store.cc:269] 0709 12:14:34.874408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.877100 (+  2692us) service_pool.cc:224] Handling call
0709 12:14:39.853830 (+4976730us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54001b7454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:39.856896 (+  3066us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2989998976}
I20260709 12:14:39.867565  5670 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:39.842123  9289 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:39.925509  9289 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:39.926347  9289 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.927486  9289 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.892318  9279 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:39.893807  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:39.950626  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 56938us
I20260709 12:14:39.951066  9141 raft_consensus.cc:697] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:39.870814  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2096) took 3381 ms. Trace:
I20260709 12:14:39.844619  9378 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.951695  5596 rpcz_store.cc:276] 0709 12:14:36.489125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.506787 (+ 17662us) service_pool.cc:224] Handling call
0709 12:14:36.507112 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.699931 (+192819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.870553 (+3170622us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400470ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:39.870752 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397461248}
I20260709 12:14:39.953137  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:39.953784  9378 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:39.913491  9365 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:39.914248  6323 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:39.847970  9181 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.924547  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 2172) took 1448 ms. Trace:
I20260709 12:14:39.923162  9413 consensus_queue.cc:260] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.884996  9352 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:39.862845  9264 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:39.941582  9204 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:39.944583  9326 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:39.929188  9376 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:39.954312  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:40.020677  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.957863  9127 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.024892  9376 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:40.026060  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 74729.8us
I20260709 12:14:39.950840  9279 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.026901  5718 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.023729  9326 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:39.960922  9306 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.027714  9279 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:40.025209  9370 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:40.028657  5671 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.029999  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:39.941581  9405 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:40.030633  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.048825  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.049243  8916 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:39.958084  9210 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.049612  9405 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:40.050118  9210 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:40.051396  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.053300  9127 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:40.047794  9181 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:40.054469  9273 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:40.054345  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:40.055853  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:40.056485  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:40.056916  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:40.057512  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:40.058068  6326 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:40.061890  5750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2140) took 3389 ms (client timeout 1829 ms). Trace:
W20260709 12:14:40.062353  5750 rpcz_store.cc:269] 0709 12:14:36.672101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.672219 (+   118us) service_pool.cc:224] Handling call
0709 12:14:40.061664 (+3389445us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002c92d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:40.061810 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261734656}
W20260709 12:14:40.064533  5601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 2109) took 3270 ms (client timeout 1735 ms). Trace:
W20260709 12:14:40.064978  5601 rpcz_store.cc:269] 0709 12:14:36.794262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.798219 (+  3957us) service_pool.cc:224] Handling call
0709 12:14:40.064349 (+3266130us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b540048ec54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:40.064455 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4882879360}
I20260709 12:14:40.066004  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.066596  5601 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:39.961958  5674 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:14:40.072119  5674 pending_rounds.cc:85] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 9
I20260709 12:14:40.033628  9188 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.072438  5674 pending_rounds.cc:107] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:14:40.072692  5674 raft_consensus.cc:2889] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:40.054847  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.073487  5598 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:40.072718  9188 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.074620  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.075445  5598 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:40.076220  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.034789  5596 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:40.073473  9302 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.952039  9141 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.023061  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:40.037734  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:40.071789  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.037420  9204 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:40.038771  5602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2212) took 3149 ms (client timeout 1601 ms). Trace:
I20260709 12:14:40.076726  9188 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:40.082564  5602 rpcz_store.cc:269] 0709 12:14:36.891534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.555598 (+664064us) service_pool.cc:224] Handling call
0709 12:14:40.038591 (+2482993us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400206f54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:40.038711 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044941184}
I20260709 12:14:40.084098  6327 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:40.077314  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2095) took 3588 ms. Trace:
I20260709 12:14:40.024504  9413 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:40.040509  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:40.085151  5599 rpcz_store.cc:276] 0709 12:14:36.488755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.488862 (+   107us) service_pool.cc:224] Handling call
0709 12:14:39.405017 (+2916155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.451573 (+ 46556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.077120 (+625547us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b540031b5d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:40.077252 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6679360384}
I20260709 12:14:40.086938  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 495) took 1441 ms. Trace:
I20260709 12:14:40.087265  5599 rpcz_store.cc:276] 0709 12:14:38.645247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.086184 (+1440937us) service_pool.cc:224] Handling call
0709 12:14:40.086486 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.086650 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.086676 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:40.086718 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:40.086752 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.086803 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.086887 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:40.042116  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:40.088565  6323 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.088742  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2215) took 3196 ms. Trace:
W20260709 12:14:40.077404  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.043239  5675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1500) took 5297 ms (client timeout 1882 ms). Trace:
W20260709 12:14:40.091111  5675 rpcz_store.cc:269] 0709 12:14:34.745436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.746202 (+   766us) service_pool.cc:224] Handling call
0709 12:14:40.043043 (+5296841us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54001e4454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:40.043161 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3307846016}
I20260709 12:14:40.077905  9302 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.022832  5670 rpcz_store.cc:276] 0709 12:14:38.475874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.695484 (+219610us) service_pool.cc:224] Handling call
0709 12:14:39.924477 (+1228993us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:40.078922  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 55935.9us
I20260709 12:14:40.082705  9204 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.081648  9335 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:40.099668  9335 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:40.038570  5718 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:40.100045  9335 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:40.100672  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 62179.3us
I20260709 12:14:40.101621  5718 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:40.099247  8868 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:40.049559  9298 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:40.081295  9394 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.103683  9394 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:40.105124  9204 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:40.089146  5603 rpcz_store.cc:276] 0709 12:14:36.892566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.686155 (+2793589us) service_pool.cc:224] Handling call
0709 12:14:39.788698 (+102543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.789222 (+   524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.088570 (+299348us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b5400207950. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:40.088686 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164135808}
I20260709 12:14:40.085238  6327 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.106429  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.082839  5604 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:39.959187  9311 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.070573  5569 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:40.107515  6320 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 8 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:40.107722  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 493) took 1467 ms. Trace:
I20260709 12:14:40.108055  9298 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:40.080174  5600 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:40.108240  5569 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:40.108076  5604 rpcz_store.cc:276] 0709 12:14:38.639888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.082331 (+1442443us) service_pool.cc:224] Handling call
0709 12:14:40.082659 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.107466 (+ 24807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.107664 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:40.108523  9298 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.109807  9360 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.110229  9360 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:40.110090  9313 consensus_queue.cc:1059] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:40.110610  9360 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.111171  9313 raft_consensus.cc:3055] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:40.111526  9313 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:40.112370  9313 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.110738  9298 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.114481  9217 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:40.068938  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:40.083137  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2214) took 3190 ms. Trace:
I20260709 12:14:40.102932  9209 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:40.105600  9204 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.118657  5597 rpcz_store.cc:276] 0709 12:14:36.892330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.544974 (+1652644us) service_pool.cc:224] Handling call
0709 12:14:39.871194 (+1326220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.871862 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.082940 (+211078us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400470ed0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:40.083082 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3042601856}
I20260709 12:14:40.119896  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.120460  5597 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:40.122722  5597 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.070417  9181 consensus_queue.cc:1059] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:40.123519  8958 consensus_queue.cc:260] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.124503  9273 raft_consensus.cc:3055] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:40.125006  9273 raft_consensus.cc:740] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:40.113509  9313 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.125777  9273 consensus_queue.cc:260] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.126794  9273 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.124543  8958 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:40.127856  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 489) took 1498 ms. Trace:
I20260709 12:14:40.128180  5600 rpcz_store.cc:276] 0709 12:14:38.629897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.079671 (+1449774us) service_pool.cc:224] Handling call
0709 12:14:40.080003 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.127595 (+ 47592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.127802 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:40.129179  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.123958  5597 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:14:40.129462  5744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2126) took 5506 ms (client timeout 1926 ms). Trace:
W20260709 12:14:40.129921  5744 rpcz_store.cc:269] 0709 12:14:34.623548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.625234 (+  1686us) service_pool.cc:224] Handling call
0709 12:14:40.129267 (+5504033us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54003642d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:40.129374 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453019904}
I20260709 12:14:40.107057  5603 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:40.132033  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.135362  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.136170  5670 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:40.077296  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.137470  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.138571  5598 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:40.138763  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.139420  5675 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:40.137056  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:40.140527  5670 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.140692  9393 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:40.141723  9389 consensus_queue.cc:1059] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:40.143030  9353 raft_consensus.cc:3055] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:40.143379  9353 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:40.143452  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:40.144250  9353 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.145215  9353 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:40.145458  9420 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
W20260709 12:14:40.131256  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.147109  9415 log.cc:927] Time spent T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.322s	user 0.005s	sys 0.000s
I20260709 12:14:39.985493  5595 raft_consensus.cc:2410] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:40.149454  9129 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:40.188170  6324 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.004s	sys 0.006s
I20260709 12:14:40.103055  5718 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:40.107095  6327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:52390
W20260709 12:14:40.204221  6324 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.004s	sys 0.006s
I20260709 12:14:40.204717  6327 raft_consensus.cc:606] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:14:40.205132  6327 raft_consensus.cc:614] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:40.149504  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.154759  9302 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:40.156697  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.158514  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 60760.2us
W20260709 12:14:40.229075  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 126085us
I20260709 12:14:40.160796  5744 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:14:40.229707  5744 pending_rounds.cc:85] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 6
I20260709 12:14:40.162447  6293 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:40.229908  5718 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:40.230624  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 68253.5us
I20260709 12:14:40.162943  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.231729  5600 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:40.163156  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:40.163657  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.165336  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.130812  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.234095  5671 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:40.234562  5597 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:40.235265  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.236548  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.167750  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.238025  5603 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:40.238986  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.239809  9389 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.240248  9389 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:40.240584  9389 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.168506  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:40.168646  9298 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.169171  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1499) took 5424 ms. Trace:
I20260709 12:14:40.242853  5674 rpcz_store.cc:276] 0709 12:14:34.745143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.745578 (+   435us) service_pool.cc:224] Handling call
0709 12:14:34.759824 (+ 14246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.073356 (+5313532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.168825 (+ 95469us) spinlock_profiling.cc:243] Waited 5.2 s on lock 0x7b54001b7954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:40.169114 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11964200832}
I20260709 12:14:40.244277  9298 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:40.169818  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.066623  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:40.170892  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.246495  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.167812  9311 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:40.230221  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.175016  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:40.247802  5752 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:40.249950  9298 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:40.250355  9298 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:40.250743  9298 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:40.175153  6326 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:40.176185  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.255034  5751 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:40.246932  5603 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:40.179668  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.181622  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.182940  5716 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:40.256986  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 74148.3us
I20260709 12:14:40.032413  9306 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:40.177685  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.258736  6293 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:40.267375  5598 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
W20260709 12:14:39.937441  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 258856us
I20260709 12:14:40.259611  5718 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.261209  5719 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:40.184827  6323 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:40.264554  5596 raft_consensus.cc:1240] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:40.024858  6291 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.500s (SENT) [suppressed 28 similar messages]
I20260709 12:14:40.197224  5670 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
W20260709 12:14:40.224188  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.271377  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 246523us
I20260709 12:14:40.265493  5675 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:40.205854  5604 raft_consensus.cc:2376] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9. Re-sending same reply.
I20260709 12:14:40.229969  5744 pending_rounds.cc:107] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 12:14:40.274124  5744 raft_consensus.cc:2917] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 12:14:40.263123  5600 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:40.274595  5744 raft_consensus.cc:2889] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:40.228196  5673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.016s	sys 0.007s
I20260709 12:14:40.246415  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.249536  5567 leader_election.cc:400] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:14:40.261795  5752 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:14:40.237507  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.257628  5716 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:40.266898  5678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.006s	sys 0.017s
W20260709 12:14:40.269625  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 65524.8us
I20260709 12:14:40.177778  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.258548  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 494) took 1616 ms. Trace:
I20260709 12:14:40.276417  5671 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
W20260709 12:14:40.276170  5678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.006s	sys 0.017s
I20260709 12:14:40.275653  5567 leader_election.cc:403] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:14:40.276675  5602 rpcz_store.cc:276] 0709 12:14:38.641793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.083833 (+1442040us) service_pool.cc:224] Handling call
0709 12:14:40.084137 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.084459 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.084485 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.084919 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.258249 (+173330us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:40.258289 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.258351 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.258389 (+    38us) raft_consensus.cc:1685] finished
0709 12:14:40.258399 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.258502 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1017,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":172979,"threads_started":1,"wal-append.queue_time_us":168935}
I20260709 12:14:40.278724  5567 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
W20260709 12:14:40.279567  5673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.016s	sys 0.007s
I20260709 12:14:40.282482  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:40.278445  5570 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.287340  5716 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:40.288573  5570 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.286767  5719 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:40.282235  5567 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:40.292513  5718 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.199115  9262 raft_consensus.cc:697] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:14:40.264618  9409 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.020s	sys 0.068s
I20260709 12:14:40.298504  5642 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:40.299713  5570 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:40.266616  9106 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:40.266490  9129 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:40.307788  5601 raft_consensus.cc:2410] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:14:40.301589  6291 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:40.259759  9127 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.312783  5718 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:40.313687  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 223125us
I20260709 12:14:40.183460  9335 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.183460  9297 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:40.316494  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.314770  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.318275  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.285907  9313 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:14:40.314986  5716 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.292757  9181 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:40.295258  9209 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:40.306202  9409 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.020s	sys 0.068s
I20260709 12:14:40.323128  5597 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.258055  9179 consensus_queue.cc:1059] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:14:40.328055  5671 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:40.329315  5675 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:14:40.295445  9371 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.332144  5570 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.335071  6293 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:40.343016  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:40.296074  9311 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.343115  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.344280  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.344769  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.344930  5671 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:40.345468  5675 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:40.336941  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.345849  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.346787  5671 raft_consensus.cc:2410] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:14:40.345966  5752 raft_consensus.cc:2376] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 8. Re-sending same reply.
W20260709 12:14:40.354717  5645 leader_election.cc:336] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.946s (SENT)
I20260709 12:14:40.346903  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.306943  9324 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:40.356925  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 496) took 1710 ms. Trace:
I20260709 12:14:40.357052  5570 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.358670  5595 raft_consensus.cc:2393] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:40.320644  9141 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:40.310029  9405 raft_consensus.cc:2764] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:40.319602  9279 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.319664  9264 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:40.374172  6293 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:40.361909  5672 raft_consensus.cc:1240] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.374948  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.376573  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.365093  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.359833  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.390743  5595 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 11: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:40.372156  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2162) took 2342 ms. Trace:
I20260709 12:14:40.359083  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.365967  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.374066  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.391273  5676 rpcz_store.cc:276] 0709 12:14:38.029398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.879140 (+849742us) service_pool.cc:224] Handling call
0709 12:14:40.043713 (+1164573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.044149 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.044178 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.044663 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.276616 (+231953us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:40.276656 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.276723 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.276772 (+    49us) raft_consensus.cc:1685] finished
0709 12:14:40.276785 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.333902 (+ 57117us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001e4450. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:40.372075 (+ 38173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10548,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":2518598912,"thread_start_us":231578,"threads_started":1,"wal-append.queue_time_us":219596}
I20260709 12:14:40.361462  9390 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:40.393229  5596 raft_consensus.cc:2410] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:14:40.391585  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 52661.2us
I20260709 12:14:40.393626  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.394356  5596 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:14:40.394697  5596 pending_rounds.cc:85] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 8
I20260709 12:14:40.378733  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:40.395253  5674 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:40.320004  9225 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:40.313580  9306 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.372545  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.395601  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.390682  5600 raft_consensus.cc:2376] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 8. Re-sending same reply.
I20260709 12:14:40.391999  5675 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:40.397980  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.394937  5596 pending_rounds.cc:107] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:14:40.398785  5596 raft_consensus.cc:2889] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:40.398926  5642 connection.cc:256] RPC call timeout handler was delayed by -2.4800148419999459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 12:14:40.399417  5642 connection.cc:256] RPC call timeout handler was delayed by -2.4737148419999357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
W20260709 12:14:40.399718  5642 connection.cc:256] RPC call timeout handler was delayed by -2.4593148419999125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 12:14:40.399987  5642 connection.cc:256] RPC call timeout handler was delayed by -2.2748148420000689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 12:14:40.400271  5642 connection.cc:256] RPC call timeout handler was delayed by -2.2523148420000325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 12:14:40.400540  5642 connection.cc:256] RPC call timeout handler was delayed by -2.0505037560001256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:14:40.400810  5642 connection.cc:256] RPC call timeout handler was delayed by -2.0433037560001139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 12:14:40.401088  5642 connection.cc:256] RPC call timeout handler was delayed by -2.0408384570000635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 12:14:40.401371  5642 connection.cc:256] RPC call timeout handler was delayed by -2.0048148420000871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 12:14:40.390183  5671 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:40.304988  9239 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:14:40.384022  5670 raft_consensus.cc:1240] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.385222  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.412087  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:40.382234  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 67315.2us
W20260709 12:14:40.388370  5645 leader_election.cc:336] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.208s (SENT)
I20260709 12:14:40.413151  5676 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
W20260709 12:14:40.402900  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 45937.5us
I20260709 12:14:40.404279  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.360284  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.331138  9181 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.391620  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.413267  5645 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.306937  9344 consensus_queue.cc:1059] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:14:40.402788  5569 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:40.413861  5601 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 12: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:40.386301  9141 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:40.389525  9326 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 12:14:40.498673  5671 raft_consensus.cc:2410] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:40.498545  9141 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.357371  9311 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.476146  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.499185  9311 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.499634  5604 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:40.475385  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.390080  9383 consensus_queue.cc:1059] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
W20260709 12:14:40.501328  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 98628.1us
I20260709 12:14:40.381870  9313 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:40.501549  9405 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:40.476621  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.423207  9414 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.340705  9418 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:40.475813  5596 raft_consensus.cc:2955] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:40.477213  9225 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:40.509209  9225 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.513163  5569 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:40.514005  9405 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.514424  9405 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:40.514765  9405 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:40.515002  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.516307  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.518056  9311 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.518255  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:40.520213  9418 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:40.517642  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.521303  5602 raft_consensus.cc:2393] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:40.331230  8916 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:14:40.420871  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.338948  9302 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:14:40.379014  9360 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.526928  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:40.330950  9253 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:14:40.523579  5597 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 12:14:40.401638  5642 connection.cc:256] RPC call timeout handler was delayed by -1.898403756000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 12:14:40.536092  5642 connection.cc:256] RPC call timeout handler was delayed by -1.6682148419999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2503s for a response
W20260709 12:14:40.536458  5642 connection.cc:256] RPC call timeout handler was delayed by -1.6455037560001529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 12:14:40.536731  5642 connection.cc:256] RPC call timeout handler was delayed by -1.39461484200001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2807s for a response
W20260709 12:14:40.537012  5642 connection.cc:256] RPC call timeout handler was delayed by -1.2767148420000467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2938s for a response
W20260709 12:14:40.538435  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 160437us
W20260709 12:14:40.539000  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.356264  9393 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:40.375759  9330 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:40.525666  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.597425  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:40.522786  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:40.598299  5602 raft_consensus.cc:2393] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:40.527599  5671 raft_consensus.cc:2393] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:40.355783  9394 consensus_queue.cc:1059] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:14:40.532480  5673 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:14:40.532958  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.391731  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2177) took 1906 ms. Trace:
I20260709 12:14:40.409464  9422 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.540429  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.537591  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:40.543850  5674 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:14:40.544080  5569 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:40.461737  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.462461  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:40.613032  5753 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:40.419461  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:40.381230  9129 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:40.382212  9176 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:40.619029  9176 raft_consensus.cc:697] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:40.574362  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.619321  9129 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.355654  9175 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:40.520780  9311 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:40.599510  5598 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:40.515558  9141 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:40.613996  9446 log.cc:927] Time spent T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:14:40.622721  9141 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:40.622985  9448 log.cc:927] Time spent T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 12:14:40.623390  9344 raft_consensus.cc:3055] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:40.623729  9176 consensus_queue.cc:237] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.625062  9380 consensus_queue.cc:1059] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:40.625509  9360 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:40.596458  9417 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:40.569121  5595 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:40.604777  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:40.409296  9378 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:40.627275  9394 raft_consensus.cc:3055] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:40.627640  9394 raft_consensus.cc:740] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:40.628512  9394 consensus_queue.cc:260] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.597229  9330 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.630081  9330 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:40.634595  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 90603.2us
I20260709 12:14:40.635826  5569 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:40.637135  5569 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:40.639472  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 673) took 1060 ms. Trace:
W20260709 12:14:40.475414  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 108815us
I20260709 12:14:40.639858  5679 rpcz_store.cc:276] 0709 12:14:39.579519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.777280 (+197761us) service_pool.cc:224] Handling call
0709 12:14:39.802816 (+ 25536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.055432 (+252616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.055462 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.055948 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.326445 (+270497us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:40.326482 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.326544 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.639260 (+312716us) raft_consensus.cc:1685] finished
0709 12:14:40.639283 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.639413 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2771,"raft.queue_time_us":60339,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":17056,"thread_start_us":519495,"threads_started":2,"wal-append.queue_time_us":405874}
I20260709 12:14:40.408300  9306 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:40.641996  9306 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:40.423725  9276 raft_consensus.cc:2764] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:14:40.622737  5597 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:40.649003  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:40.521574  8868 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.566020  9181 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.626614  9417 raft_consensus.cc:2764] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:14:40.657374  9326 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.539088  9308 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:14:40.657809  9326 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.658178  9326 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.658476  9378 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:40.658897  9378 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:40.659241  9378 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.607702  5678 rpcz_store.cc:276] 0709 12:14:38.485152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.644590 (+1159438us) service_pool.cc:224] Handling call
0709 12:14:39.668274 (+ 23684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.668421 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:40.278949 (+610528us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.391337 (+112388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:40.391407 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:40.391456 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.391519 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.391621 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1886,"prepare.queue_time_us":372169,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":129,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":12516,"thread_start_us":664782,"threads_started":2}
I20260709 12:14:40.403163  9264 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.663105  9264 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:40.382422  9353 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.230s
I20260709 12:14:40.659559  9313 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.666086  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1555) took 1218 ms. Trace:
I20260709 12:14:40.666527  5747 rpcz_store.cc:276] 0709 12:14:39.447940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.660681 (+212741us) service_pool.cc:224] Handling call
0709 12:14:39.660967 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.668664 (+  7697us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:40.126767 (+458103us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b1800357c40. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95b455 00007f45014433c7 00007f44fda559a7 00007f44fda650bf 00007f44fda65038
0709 12:14:40.265713 (+138946us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.381583 (+115870us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.396358 (+ 14775us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.396543 (+   185us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:40.411553 (+ 15010us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.479967 (+ 68414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.480046 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.665862 (+185816us) raft_consensus.cc:1685] finished
0709 12:14:40.665886 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.666027 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":265829,"prepare.queue_time_us":579018,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":228869,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":45875,"spinlock_wait_cycles":43620480,"thread_start_us":205857,"threads_started":2,"wal-append.queue_time_us":84288}
I20260709 12:14:40.668586  9352 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:40.669019  9352 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.669350  9352 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:40.674122  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.674834  5673 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:40.675746  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.677080  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.650133  9344 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:40.677661  5671 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
W20260709 12:14:40.687165  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.687978  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.689850  5678 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:14:40.690196  5678 pending_rounds.cc:85] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 4
I20260709 12:14:40.690637  5678 pending_rounds.cc:107] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:14:40.690924  5678 raft_consensus.cc:2889] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:40.691824  5673 raft_consensus.cc:1275] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:14:40.692210  5673 pending_rounds.cc:85] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 6
I20260709 12:14:40.692397  5747 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.689009  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.692497  5673 pending_rounds.cc:107] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:14:40.693522  5673 raft_consensus.cc:2889] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:40.520867  9418 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.694661  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.695685  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:40.650389  9413 consensus_meta.cc:287] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.548s	user 0.004s	sys 0.004s
I20260709 12:14:40.704361  5569 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:40.707279  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.708033  5679 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:40.708925  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:40.709571  5679 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.714108  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.629678  9394 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.714622  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.720973  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:40.721580  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 310552us
I20260709 12:14:40.651331  9393 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.722373  5670 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:40.723690  5673 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:14:40.702008  8958 consensus_meta.cc:287] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.004s
I20260709 12:14:40.726939  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:40.728091  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:40.534725  9204 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.745883  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:40.746464  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.750583  5752 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:40.747342  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:40.751890  5751 raft_consensus.cc:2393] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:40.704041  9209 raft_consensus.cc:697] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:40.753191  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:40.724618  9313 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:40.756983  5747 raft_consensus.cc:2393] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:40.751205  5673 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
W20260709 12:14:40.759858  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 365234us
I20260709 12:14:40.760103  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:40.760375  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:40.760690  5678 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.761318  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:40.655565  9298 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.758855  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.650733  9422 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.538565  9262 consensus_queue.cc:237] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.724154  9393 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.764027  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.768268  5673 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.764097  5671 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:40.761585  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:40.774220  5745 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:40.776494  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.721446  9360 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:14:40.783206  5749 raft_consensus.cc:1240] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:40.774535  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.784808  5670 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:40.784724  5751 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:40.781627  9313 raft_consensus.cc:697] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:40.786100  8958 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:40.786672  9313 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.787421  9326 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.787772  9176 consensus_queue.cc:1059] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:40.790122  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.791038  9306 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:40.791594  5747 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:40.793017  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.793746  5745 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:40.795179  5718 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:40.796319  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:40.780974  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 367574us
I20260709 12:14:40.765733  9335 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:40.799204  5716 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.801120  5718 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:40.832121  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:40.832319  5679 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:40.839464  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:40.844471  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 43484.6us
I20260709 12:14:40.846835  5718 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:40.789665  9326 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:40.849601  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.804518  9224 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:40.875710  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 76579.3us
I20260709 12:14:40.880312  5718 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:40.761996  9344 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:40.881304  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 343783us
I20260709 12:14:40.844376  9297 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:40.851464  9335 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.858577  9239 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.888324  5642 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:40.927635  5716 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:40.886512  9253 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.914646  9217 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:40.858058  9210 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:14:40.917351  9335 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.880297  8958 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:14:40.919255  9422 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:40.921152  9239 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.857270  9209 consensus_queue.cc:237] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:40.968007  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 79762.3us
I20260709 12:14:40.973829  9360 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.974993  9335 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:40.975598  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 213979us
I20260709 12:14:40.981307  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:40.933928  9253 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:40.982750  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 55211.3us
I20260709 12:14:40.990495  5716 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:40.992152  6291 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:40.967113  9230 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.968611  9453 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:40.986690  9127 consensus_meta.cc:287] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.001s
I20260709 12:14:41.001410  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:40.983791  9239 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:41.011766  9460 consensus_queue.cc:1059] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:14:41.012668  9316 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:41.012842  9449 log.cc:927] Time spent T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:14:41.056377  5748 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 11. Ops: []
I20260709 12:14:40.965826  9378 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:40.995673  9253 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:41.020562  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 283004us
I20260709 12:14:40.999189  9217 raft_consensus.cc:697] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:41.006004  9453 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:41.002748  9461 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:41.018847  9204 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:40.989044  9360 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.018743  9127 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:41.092110  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 100044us
I20260709 12:14:41.072255  9298 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:41.072702  9297 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:41.058764  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 57501us
I20260709 12:14:40.999869  9181 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.218945  9181 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:41.109161  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:41.220005  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:41.111606  5678 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
W20260709 12:14:41.106913  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 116462us
I20260709 12:14:41.223402  5716 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:41.226150  9106 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:41.226765  9106 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:41.227646  9106 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:41.156484  9459 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:14:41.162123  5595 raft_consensus.cc:1240] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:41.229533  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:41.230129  5595 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:41.230399  5567 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:41.231030  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:41.227645  5600 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:14:41.232098  5567 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:41.232112  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:41.232885  9383 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.233500  5595 raft_consensus.cc:2393] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 7: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:41.177160  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:41.083438  9306 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:41.105213  9359 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:41.234179  5601 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:41.234427  9359 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.156797  9413 consensus_queue.cc:1059] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:41.147776  9467 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:41.236392  9413 raft_consensus.cc:3055] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:41.236858  9413 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:41.237866  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:41.238734  5601 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:41.173514  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:41.176648  5675 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:41.105332  9461 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:41.187244  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.175434  9449 log.cc:927] Time spent T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:14:41.182014  9352 consensus_meta.cc:287] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.003s
W20260709 12:14:41.158182  9462 log.cc:927] Time spent T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:14:41.242296  9461 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:41.169816  9466 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:41.178791  9365 raft_consensus.cc:3055] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:41.088508  9453 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.243561  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 677) took 1640 ms. Trace:
I20260709 12:14:41.160899  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:41.242035  9352 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.241532  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:41.243506  9365 raft_consensus.cc:740] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:41.245178  5603 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:41.245477  9365 consensus_queue.cc:260] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.246266  9352 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:41.154407  9230 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:41.244611  5597 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:41.159832  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:41.249511  5597 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:14:41.249630  5596 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:41.250156  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:41.250782  5596 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:41.251869  5601 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:41.153525  9460 consensus_queue.cc:1059] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:14:41.170981  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:41.212960  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.168381  9418 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.255540  9418 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:41.214005  9239 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.240448  5567 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:41.083205  9470 raft_consensus.cc:3055] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:41.098245  9389 consensus_meta.cc:287] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.857s	user 0.005s	sys 0.007s
I20260709 12:14:41.174551  9217 consensus_queue.cc:237] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.258219  9470 raft_consensus.cc:740] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:41.261425  9389 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.247659  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:41.263392  5675 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:41.019374  9330 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.244710  5677 rpcz_store.cc:276] 0709 12:14:39.602776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.969999 (+367223us) service_pool.cc:224] Handling call
0709 12:14:40.034118 (+ 64119us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.034463 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:40.283367 (+248904us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.597503 (+314136us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.877442 (+279939us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b2c00025bc8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fc344a11 00007f44fc354372 00007f44fda86a01 00007f44fda4b43a 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2
0709 12:14:40.877860 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.877996 (+   136us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:40.878030 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.878103 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.243255 (+365152us) raft_consensus.cc:1685] finished
0709 12:14:41.243369 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.243507 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58736,"prepare.queue_time_us":8296,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":66639,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":10297,"spinlock_wait_cycles":8015104,"thread_start_us":460806,"threads_started":2,"wal-append.queue_time_us":439621}
I20260709 12:14:41.246623  5603 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:14:41.246639  9365 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:41.256072  5604 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:41.231488  9181 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:41.181041  9393 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.262137  9352 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.271770  5642 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:41.274138  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:41.275198  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:41.276079  5675 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:14:41.279013  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:41.314064  5746 raft_consensus.cc:1240] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:41.180950  9390 consensus_meta.cc:287] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.000s
I20260709 12:14:41.260334  9470 consensus_queue.cc:260] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.106931  9264 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.302574  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:41.238389  9413 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.315315  5745 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:41.313673  5642 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:41.331260  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:41.267220  9371 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:41.280440  9422 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.316895  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:41.303444  9454 log.cc:927] Time spent T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:14:41.338258  6291 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:41.316073  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:41.108036  9455 consensus_queue.cc:1059] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.189s
I20260709 12:14:41.336030  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2225) took 1009 ms. Trace:
I20260709 12:14:41.341313  5598 rpcz_store.cc:276] 0709 12:14:40.326145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.326302 (+   157us) service_pool.cc:224] Handling call
0709 12:14:40.373246 (+ 46944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.620923 (+247677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.335774 (+714851us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540048e254. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:41.335965 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519571328}
W20260709 12:14:41.384611  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.342911  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:41.391924  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:41.424019  5603 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:41.424221  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 81481.5us
I20260709 12:14:41.425040  5642 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:41.402006  9239 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:41.391810  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 45863.2us
I20260709 12:14:41.330319  9390 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:41.286661  9383 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:14:41.393265  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:41.432910  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:41.406469  9359 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:41.433871  9418 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.346369  9353 consensus_queue.cc:1059] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 12:14:41.335814  9253 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.401325  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:41.390964  9106 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:41.440021  9482 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.405941  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:41.433048  9262 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:41.406458  9316 consensus_queue.cc:1059] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:41.302559  9467 consensus_queue.cc:1059] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:14:41.335129  9371 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:41.344069  9460 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:41.325155  9297 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:41.347707  9376 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:41.340397  9481 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:41.420297  5752 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:14:41.399672  9413 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:41.343916  9230 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:14:41.547385  9383 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:41.393272  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 55100.1us
I20260709 12:14:41.346171  9473 consensus_queue.cc:1059] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:14:41.548060  9383 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.548810  9473 raft_consensus.cc:3055] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:41.549199  9473 raft_consensus.cc:740] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:41.550073  9473 consensus_queue.cc:260] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.550486  9383 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:41.551283  9473 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:41.552726  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:41.451534  6323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:14:41.554121  6323 raft_consensus.cc:606] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
W20260709 12:14:41.452059  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.398960  9176 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:41.559935  9465 log.cc:927] Time spent T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:14:41.562014  9474 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
W20260709 12:14:41.346814  9306 consensus_queue.cc:1175] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "831d76c5ee1045f0af923ce24fa4c301" responder_term: 9 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:41.566898  6323 raft_consensus.cc:614] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:41.456663  5603 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:41.442374  5672 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:14:41.411259  9141 consensus_queue.cc:1059] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:14:41.449465  5744 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:14:41.409832  9204 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:14:41.460690  5745 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:41.589910  9383 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:41.402032  5597 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:41.590790  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:41.450189  9276 consensus_queue.cc:1059] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:14:41.427770  9485 consensus_queue.cc:1059] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 12:14:41.515386  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 82516.9us
W20260709 12:14:41.499071  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.461262  9418 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.470482  9460 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:41.459901  9360 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:41.462023  9378 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:41.510993  9389 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:41.516129  9405 consensus_meta.cc:287] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 1.001s	user 0.010s	sys 0.000s
I20260709 12:14:41.471752  9262 raft_consensus.cc:697] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:41.464601  9482 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.553484  5677 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:41.572098  5716 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:41.586732  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.591825  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:41.592482  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:41.594288  6322 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 8 LEARNER]: Advancing to term 9
I20260709 12:14:41.595288  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:41.596062  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.605196  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.606021  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.606189  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.573832  9330 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:41.606539  5745 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:41.628409  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.616734  5751 raft_consensus.cc:2393] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:41.607064  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.596158  9264 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:41.630504  6326 raft_consensus.cc:2410] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:14:41.600210  9106 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:41.602145  9273 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:41.627221  6321 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:41.621178  9456 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.630924  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.631055  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.631405  6319 raft_consensus.cc:2393] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:41.631793  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.633016  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.636421  6324 raft_consensus.cc:2410] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:14:41.612303  9460 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:41.627715  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:41.634861  9106 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:41.602612  9324 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:14:41.599694  9383 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.639909  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:41.640951  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:41.626057  9405 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.590906  9453 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.647439  6327 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:41.627588  9376 raft_consensus.cc:697] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:41.639071  9273 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:41.650794  9376 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.651027  9273 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.653242  9106 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.654547  9106 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:41.656720  9302 raft_consensus.cc:3055] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:41.657138  9302 raft_consensus.cc:740] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:41.657961  9302 consensus_queue.cc:260] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.659077  9302 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:41.663916  9482 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:41.664686  9262 consensus_queue.cc:237] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.669174  9471 raft_consensus.cc:3055] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:14:41.669490  9394 consensus_meta.cc:287] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.945s	user 0.009s	sys 0.000s
W20260709 12:14:41.670442  9335 consensus_meta.cc:287] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.000s
I20260709 12:14:41.670892  9335 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.673024  9335 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:41.675668  9461 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.643339  9456 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:41.679908  9393 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:41.680419  9456 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:41.684209  9371 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.677712  9461 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:41.688266  9405 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:41.689258  9486 raft_consensus.cc:3055] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:41.689505  9383 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:41.690455  9359 raft_consensus.cc:3055] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:41.690824  9359 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:41.691817  9453 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:41.686462  9471 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:41.692052  9359 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.693413  9359 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.693022  9471 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.695115  9471 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:41.696084  9486 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:41.699890  9486 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.701041  9486 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:41.715413  9491 log.cc:927] Time spent T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.204s	user 0.002s	sys 0.000s
W20260709 12:14:41.592871  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.743619  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.744320  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.377646  5599 rpcz_store.cc:276] 0709 12:14:38.646618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.088098 (+1441480us) service_pool.cc:224] Handling call
0709 12:14:40.088541 (+   443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:40.088919 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.088947 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:40.089537 (+   590us) log.cc:844] Serialized 52 byte log entry
0709 12:14:40.248195 (+158658us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:40.347834 (+ 99639us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.356646 (+  8812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.356714 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.356749 (+    35us) raft_consensus.cc:1685] finished
0709 12:14:40.356760 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.356877 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8488,"prepare.queue_time_us":99649,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":36247,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":257556,"threads_started":2,"wal-append.queue_time_us":158597}
W20260709 12:14:41.750516  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 178383us
I20260709 12:14:41.758093  5747 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:41.760946  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:41.543545  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:41.753043  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 497) took 1025 ms. Trace:
I20260709 12:14:41.765587  5604 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:41.751399  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.758352  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 152418us
I20260709 12:14:41.765956  5744 rpcz_store.cc:276] 0709 12:14:40.727690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.727818 (+   128us) service_pool.cc:224] Handling call
0709 12:14:41.752581 (+1024763us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400181ad4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:41.752790 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585449344}
I20260709 12:14:41.767650  5642 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:41.752144  5601 raft_consensus.cc:1240] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:41.779959  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.781169  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:41.783113  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:41.764322  5569 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:41.783432  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:41.784089  5599 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:41.785511  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:41.792130  9452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.007s	sys 0.004s
W20260709 12:14:41.792840  9452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.008s	sys 0.005s
I20260709 12:14:41.793061  9344 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:41.824973  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.826289  9295 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:41.843715  9295 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:41.844290  9295 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.826558  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:41.827594  6327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:14:41.829528  6324 raft_consensus.cc:1240] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:41.841064  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.843039  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.851979  6327 raft_consensus.cc:606] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:41.862084  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:41.864509  5645 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:41.866153  9496 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:41.868321  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:41.868726  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:41.869396  5603 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:41.869623  5595 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:41.872514  6327 raft_consensus.cc:614] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:41.882800  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:41.883060  9414 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:41.869504  9209 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.884244  9209 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.887615  9209 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:41.881495  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 117628us
I20260709 12:14:41.899534  9414 raft_consensus.cc:697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:41.901000  9414 consensus_queue.cc:237] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.903167  5599 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
W20260709 12:14:41.881610  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 98730.3us
I20260709 12:14:41.908552  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:41.909835  9383 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:41.910153  9176 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.910277  9383 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.910682  9383 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.911062  9405 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.912992  5604 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:41.917661  5570 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:41.917971  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:41.919581  9473 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.922060  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:41.926689  9295 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:41.930164  9295 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:41.931942  9335 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:41.930179  6323 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:41.935142  9262 raft_consensus.cc:2764] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 12:14:41.936489  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.940783  6328 raft_consensus.cc:2410] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:41.911703  9405 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:41.942095  5677 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:41.944022  9405 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:41.947091  5677 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:14:41.934556  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 70195.3us
I20260709 12:14:41.955487  9175 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:41.956192  5570 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:41.958055  9405 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:41.975852  9371 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:41.981057  9469 log.cc:927] Time spent T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.982s	user 0.003s	sys 0.000s
W20260709 12:14:41.979132  9464 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.967s	user 0.005s	sys 0.000s
I20260709 12:14:41.980139  9097 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:41.963827  5645 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:41.999701  9097 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:14:42.015974  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 66418.3us
I20260709 12:14:42.026645  5749 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:42.027653  6322 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 9 LEARNER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:42.000197  9097 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:42.031327  9456 raft_consensus.cc:3055] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:42.030999  9097 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.031814  9456 raft_consensus.cc:740] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:42.032866  9456 consensus_queue.cc:260] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:42.034001  9456 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:42.034417  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.040026  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:42.040936  9413 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:42.041988  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 506) took 1277 ms. Trace:
I20260709 12:14:42.042361  5745 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:14:42.043915  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:42.041008  5744 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:42.046742  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:42.047542  9204 raft_consensus.cc:3055] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:42.048012  9204 raft_consensus.cc:740] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:42.042387  5747 rpcz_store.cc:276] 0709 12:14:40.764550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.792360 (+ 27810us) service_pool.cc:224] Handling call
0709 12:14:41.756934 (+964574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.758669 (+  1735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.041686 (+283017us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b5400181ad0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:42.041885 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217231104}
I20260709 12:14:42.049929  5601 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:42.050899  9473 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:42.051604  5595 raft_consensus.cc:1240] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:14:42.051826  9097 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:42.052855  9253 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:42.053597  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:42.047542  5752 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:42.055388  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:41.921564  9460 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:42.079288  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 161729us
I20260709 12:14:42.084048  5603 raft_consensus.cc:2468] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:42.087308  5604 raft_consensus.cc:2410] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:42.087069  9473 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:42.087517  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:42.089689  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 133703us
I20260709 12:14:42.094069  5676 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:14:42.095122  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 131517us
I20260709 12:14:42.090742  5570 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:42.097821  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:42.099398  5744 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:42.098459  5645 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:42.087731  9509 log.cc:927] Time spent T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:14:42.083076  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:42.040784  9209 consensus_queue.cc:1059] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:14:42.115092  5676 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:42.117749  9308 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:42.119766  5570 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:42.121608  9308 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:42.049293  9204 consensus_queue.cc:260] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:42.123240  5670 raft_consensus.cc:1240] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:42.124204  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2154) took 1798 ms. Trace:
I20260709 12:14:42.124599  5748 rpcz_store.cc:276] 0709 12:14:40.325844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.325989 (+   145us) service_pool.cc:224] Handling call
0709 12:14:40.361182 (+ 35193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.079218 (+718036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.123724 (+1044506us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b54003647d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:42.124048 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539612416}
I20260709 12:14:42.128211  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:42.129120  5603 raft_consensus.cc:2393] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 11: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:42.130278  9383 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:42.130935  5601 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:42.131840  6322 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:42.132205  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:42.132553  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2237) took 1758 ms. Trace:
I20260709 12:14:42.133025  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:42.133152  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:42.133702  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:42.133962  5752 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: [6.4-9.6]
I20260709 12:14:42.130194  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:42.132380  6328 raft_consensus.cc:1240] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:42.130533  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:42.134975  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:42.135453  5595 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:42.135507  5744 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:14:42.134387  5604 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:42.134122  6327 raft_consensus.cc:2410] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:42.132957  5600 rpcz_store.cc:276] 0709 12:14:40.373712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.396779 (+ 23067us) service_pool.cc:224] Handling call
0709 12:14:40.397011 (+   232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.231879 (+834868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.132079 (+900200us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54003e08d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:42.132366 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909711616}
I20260709 12:14:42.140305  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:42.141381  5744 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:42.142529  9473 consensus_queue.cc:1059] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:42.145977  5570 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:42.141309  5752 raft_consensus.cc:2393] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:42.136272  6324 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:14:42.158901  9298 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:42.159965  9494 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:42.165343  5604 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:42.180543  6320 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
W20260709 12:14:42.197299  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 101290us
W20260709 12:14:42.198424  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.198776  5744 raft_consensus.cc:1240] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:42.199710  6291 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:42.200341  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:42.200942  5570 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:42.192541  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:42.172580  9298 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.202768  9298 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:42.203552  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:42.204486  5747 raft_consensus.cc:2393] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 6: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:42.205221  9298 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:42.205485  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:42.205998  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:42.206614  9308 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:42.206835  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:42.207234  9308 raft_consensus.cc:697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:42.207566  9461 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.208482  9389 raft_consensus.cc:670] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } [suppressed 3 similar messages]
I20260709 12:14:42.208295  9461 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.163021  9460 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:42.170002  9383 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:42.206909  5745 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:42.210271  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:42.222111  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.207546  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:42.223547  5744 raft_consensus.cc:2368] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11.
W20260709 12:14:42.223776  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.224223  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.224603  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:42.226305  9308 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.227923  9461 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:42.228257  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:42.205375  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:42.187883  9510 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:14:42.223778  5595 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:42.235710  5748 raft_consensus.cc:2376] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10. Re-sending same reply.
I20260709 12:14:42.231021  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:42.249217  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:42.259436  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:42.260077  5672 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:42.262145  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:42.267132  6324 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:42.270696  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:42.279556  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:42.276849  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:42.258009  9298 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.279107  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1572) took 1003 ms. Trace:
I20260709 12:14:42.286725  5676 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:42.287791  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.289446  5744 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:42.292543  5748 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:42.292465  5670 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:42.296372  9471 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:42.296912  9471 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:42.297376  9471 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:42.299612  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:42.286423  5751 rpcz_store.cc:276] 0709 12:14:41.275814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.336946 (+ 61132us) service_pool.cc:224] Handling call
0709 12:14:42.276936 (+939990us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54000c9c54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:42.278920 (+  1984us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407239936}
W20260709 12:14:42.310544  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 110944us
W20260709 12:14:42.288751  9224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.005s	sys 0.018s
I20260709 12:14:42.304917  9306 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.320003  9470 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:42.314834  9224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.006s	sys 0.018s
I20260709 12:14:42.321161  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:42.322129  5597 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:42.322347  9224 raft_consensus.cc:3055] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:42.322937  9224 raft_consensus.cc:740] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:42.324139  9224 consensus_queue.cc:260] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:42.326436  5719 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:42.327176  5600 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:42.328702  9451 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:42.331115  9306 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:42.333587  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:42.335779  6324 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:42.336194  5747 raft_consensus.cc:2393] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:42.336505  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:42.337230  5603 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:42.337496  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:42.337785  9453 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:42.338160  9453 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:42.338873  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:42.338531  9453 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:42.366807  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:42.367790  9520 log.cc:927] Time spent T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:14:42.369781  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:42.370759  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:42.366871  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:42.371573  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:42.367340  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 103018us
I20260709 12:14:42.383354  5597 raft_consensus.cc:2393] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:42.372006  6321 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:42.384500  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:42.366999  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:42.384409  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:42.386658  5599 raft_consensus.cc:2368] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11.
W20260709 12:14:42.398994  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.284793  9298 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.308791  9461 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.410761  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.410138  5600 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:14:42.411302  5718 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:42.396831  9224 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:42.430538  5674 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:42.424098  5604 raft_consensus.cc:1240] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:42.422837  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:42.439502  5603 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:42.409643  9405 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.414570  9371 raft_consensus.cc:3055] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:42.442004  9302 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.126212  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:42.512188  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:42.442641  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:42.499193  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:42.503822  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:42.522609  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.532040  5604 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:42.419703  9461 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.538738  5716 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:42.504614  9371 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:42.441845  8916 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 12:14:42.523936  9302 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:42.558935  5749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 507) took 1781 ms (client timeout 2067 ms). Trace:
I20260709 12:14:42.569950  5600 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:42.567778  5749 rpcz_store.cc:269] 0709 12:14:40.764817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.798690 (+ 33873us) service_pool.cc:224] Handling call
0709 12:14:42.515953 (+1717263us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400363dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:42.546620 (+ 30667us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2720548096}
W20260709 12:14:42.563437  5750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2161) took 2148 ms (client timeout 2093 ms). Trace:
W20260709 12:14:42.576361  5750 rpcz_store.cc:269] 0709 12:14:40.410216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.410406 (+   190us) service_pool.cc:224] Handling call
0709 12:14:42.540919 (+2130513us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54001815d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:42.559008 (+ 18089us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3093241728}
I20260709 12:14:42.498081  9380 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.162s
I20260709 12:14:42.539655  9451 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.588935  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 65133.3us
I20260709 12:14:42.617107  5597 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:14:42.604045  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 43901.3us
I20260709 12:14:42.622763  9217 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:42.625190  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 209315us
I20260709 12:14:42.627525  9371 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.630153  9451 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:42.632867  9451 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:42.603940  9306 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:42.635239  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 322831us
I20260709 12:14:42.635946  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:42.636794  5745 raft_consensus.cc:2393] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:42.638595  9518 log.cc:927] Time spent T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 12:14:42.642765  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 144251us
I20260709 12:14:42.575714  9494 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:14:42.659044  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 44926.8us
I20260709 12:14:42.601503  9414 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:42.569715  9405 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:42.666059  5716 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:42.667987  5567 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:42.694438  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.699599  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:42.654142  9335 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:42.660045  9217 raft_consensus.cc:697] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:42.704936  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 44561.6us
I20260709 12:14:42.667377  9414 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:42.708761  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 266477us
I20260709 12:14:42.713717  6324 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
W20260709 12:14:42.700599  9097 consensus_meta.cc:287] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.639s	user 0.016s	sys 0.004s
I20260709 12:14:42.721676  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:42.739069  5716 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:42.715903  9380 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:42.722415  9414 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:42.748855  9335 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:42.811460  9335 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:42.752905  9370 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:42.814647  9453 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.817242  9453 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:42.818096  6320 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:42.820149  9370 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.820662  9370 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.754298  9405 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:42.756524  9302 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:42.759191  9461 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:42.766760  9217 consensus_queue.cc:237] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:42.769273  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 181093us
W20260709 12:14:42.770174  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 47490.6us
I20260709 12:14:42.770718  9482 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:42.769991  9209 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:42.821720  9371 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:42.774045  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2202) took 1918 ms. Trace:
W20260709 12:14:42.793437  5677 consensus_meta.cc:287] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.627s	user 0.003s	sys 0.003s
I20260709 12:14:42.861300  5677 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:42.793782  9298 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:42.802119  9311 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:42.825176  5670 consensus_meta.cc:287] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.009s
I20260709 12:14:42.865343  5670 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
W20260709 12:14:42.830866  5676 consensus_meta.cc:287] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.002s
I20260709 12:14:42.866076  5676 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:42.834105  5674 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:42.840372  5604 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
W20260709 12:14:42.845881  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.864971  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.826726  9308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.004s	sys 0.018s
I20260709 12:14:42.878700  9209 raft_consensus.cc:697] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:42.879704  9209 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.832222  9380 raft_consensus.cc:697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:42.867683  9482 raft_consensus.cc:697] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:42.876735  9308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.004s	sys 0.019s
W20260709 12:14:42.885535  9517 log.cc:927] Time spent T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.533s	user 0.000s	sys 0.006s
I20260709 12:14:42.750459  9306 consensus_queue.cc:1059] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 12:14:42.871640  9302 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:42.898274  9302 raft_consensus.cc:3055] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:42.898694  9302 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:42.867367  9295 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:42.899600  5678 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:14:42.872201  9335 consensus_queue.cc:1059] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:14:42.877101  5716 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:42.907004  5567 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:42.904232  9471 consensus_meta.cc:287] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.009s
I20260709 12:14:42.861104  5679 rpcz_store.cc:276] 0709 12:14:40.855129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.855255 (+   126us) service_pool.cc:224] Handling call
0709 12:14:40.855592 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.860707 (+  5115us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:42.054221 (+1193514us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b18002ddc00. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95b455 00007f45014433c7 00007f44fda559a7 00007f44fda650bf 00007f44fda65038
0709 12:14:42.167285 (+113064us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.438325 (+271040us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:42.571161 (+132836us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.571315 (+   154us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:42.571349 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.571418 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.773550 (+202132us) raft_consensus.cc:1685] finished
0709 12:14:42.773648 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.773847 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18842,"prepare.queue_time_us":597457,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1437,"raft.queue_time_us":5197,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":89872,"spinlock_wait_cycles":40964480,"thread_start_us":221796,"threads_started":2,"wal-append.queue_time_us":558667}
W20260709 12:14:42.965337  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 102524us
I20260709 12:14:42.968056  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:42.970018  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 389928us
I20260709 12:14:42.975884  6293 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:42.977003  9335 raft_consensus.cc:2804] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:42.969327  9308 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:42.922837  9471 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.984469  6326 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:42.974498  9344 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.988531  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 98228.3us
I20260709 12:14:42.981951  9311 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:42.899619  9302 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.007787  5567 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:42.983515  9456 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 12:14:43.058746  9515 log.cc:927] Time spent T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.666s	user 0.000s	sys 0.002s
I20260709 12:14:43.064786  9529 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:43.065455  9529 raft_consensus.cc:697] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:43.066129  9461 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.066475  9529 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.988816  9473 consensus_queue.cc:1059] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:14:43.069866  9414 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.071996  9414 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:43.072567  9414 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:43.072844  9224 consensus_meta.cc:287] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.635s	user 0.005s	sys 0.002s
I20260709 12:14:43.067096  9471 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:42.995486  9370 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:43.073057  9414 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:42.980975  9380 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.080214  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:42.996876  9344 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.085234  5570 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:43.088680  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:43.092741  9486 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:43.093319  9486 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.093957  9460 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.094496  9460 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.095371  9486 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:42.992617  9482 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:43.101305  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 401814us
W20260709 12:14:43.102192  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 94514.7us
I20260709 12:14:43.100253  9460 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:43.078452  9370 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:43.107983  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:43.085335  9471 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:14:43.103158  9352 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:43.078384  9461 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.113018  5570 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.113902  5570 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.103720  9414 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:43.115831  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:43.128960  5570 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.108009  9486 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:43.137187  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 445394us
I20260709 12:14:43.143193  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:43.150372  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.132117  9298 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:43.200587  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 84828.9us
W20260709 12:14:43.201658  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 93258.9us
I20260709 12:14:43.142845  9370 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:43.155448  9460 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:43.140175  9486 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:43.214421  9532 log.cc:927] Time spent T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:14:43.168463  9405 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:43.210772  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 489130us
I20260709 12:14:43.166265  9298 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:43.220889  6320 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:43.208597  9453 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.244678  6324 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:43.246881  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:43.247695  5678 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 7: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:43.224393  9405 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.230567  9335 raft_consensus.cc:697] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:43.248881  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.228319  9370 raft_consensus.cc:697] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:14:43.236682  6291 leader_election.cc:336] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.500s (SENT)
I20260709 12:14:43.251592  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:43.230221  9298 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:43.262136  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 282325us
W20260709 12:14:43.267210  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 66233.3us
I20260709 12:14:43.268266  5567 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:43.268863  6327 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:43.253376  9344 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:43.270874  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:43.267598  5716 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:43.271934  6322 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:43.254439  9405 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:43.270229  9470 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:43.296211  9335 consensus_queue.cc:237] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.297441  9370 consensus_queue.cc:237] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:43.296249  6291 leader_election.cc:336] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.541s (SENT)
I20260709 12:14:43.258725  9453 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.304960  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:43.305559  9414 consensus_queue.cc:1059] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:43.306740  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:43.305651  6327 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
W20260709 12:14:43.308049  6291 leader_election.cc:336] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.629s (SENT)
I20260709 12:14:43.308497  6291 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:43.309548  6291 leader_election.cc:336] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.945s (SENT)
I20260709 12:14:43.309675  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:43.313313  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 78685.7us
I20260709 12:14:43.310436  5719 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.311614  9308 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:43.316045  9540 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:43.316224  9308 raft_consensus.cc:697] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:43.317466  9308 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.318164  9209 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:43.318888  9209 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.319278  9209 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:43.318557  5645 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.321838  9344 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:43.322203  6326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 856) took 1720 ms (client timeout 2183 ms). Trace:
W20260709 12:14:43.322631  6326 rpcz_store.cc:269] 0709 12:14:41.602128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.631089 (+ 28961us) service_pool.cc:224] Handling call
0709 12:14:43.321992 (+1690903us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540024f4d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:43.322130 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2648828160}
W20260709 12:14:43.323531  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:43.324450  9527 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.637s	user 0.008s	sys 0.015s
W20260709 12:14:43.326305  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 587073us
I20260709 12:14:43.327062  5718 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:43.327888  9352 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.328287  5718 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:43.328428  9352 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.330618  9352 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:43.332069  8916 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:43.332664  8916 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.325536  5569 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:43.341889  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.306761  9414 raft_consensus.cc:3055] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:43.342554  5674 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
W20260709 12:14:43.342900  6291 leader_election.cc:336] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.072s (SENT)
I20260709 12:14:43.345436  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:43.343851  6323 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:43.304018  9253 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:43.339916  6327 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:43.348539  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.342597  9352 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:43.350571  9534 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:43.351157  9534 raft_consensus.cc:697] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:43.352028  9534 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.352686  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.353447  5678 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:43.354300  9453 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:43.338604  9494 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.356586  9494 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.358636  9494 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:43.360270  9209 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.360723  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:43.361644  9536 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:43.362526  9209 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:43.363147  9536 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:43.361891  9344 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:43.364177  9344 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:43.364445  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 98695.9us
I20260709 12:14:43.365100  9405 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.312031  9461 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:43.369871  9405 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:43.378311  9486 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:43.363740  5718 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:14:43.381026  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.334082  9471 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.459069  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:43.459626  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 95977.2us
I20260709 12:14:43.383210  9352 raft_consensus.cc:697] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:43.462917  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.464865  5674 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:14:43.466114  5719 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.466908  9394 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.467501  9394 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.363178  9209 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:43.469842  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:43.470544  6320 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:43.470849  9209 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.471381  9209 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.479007  6320 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:43.481736  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:43.379765  9253 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.473500  9209 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:43.485394  5719 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.344743  9414 raft_consensus.cc:740] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:43.483680  6327 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:43.469566  9394 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:43.461019  9461 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:43.484369  9217 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:43.462694  9486 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:43.524884  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 182006us
W20260709 12:14:43.531340  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 149941us
W20260709 12:14:43.537401  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.551419  5678 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:43.551335  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.554095  5719 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.516165  9494 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:43.576928  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 116747us
I20260709 12:14:43.578322  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:43.580158  5642 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:43.581858  9536 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:43.582082  9494 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:43.582304  9461 raft_consensus.cc:697] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:43.583315  9461 consensus_queue.cc:237] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.585005  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.585331  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.585744  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.586560  5671 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:43.586882  9298 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.576547  9414 consensus_queue.cc:260] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.588246  9414 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:43.589011  9298 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:43.555261  9394 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:14:43.480895  9405 consensus_queue.cc:1059] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:14:43.481194  9471 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.591279  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:43.592324  9542 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:43.592880  9542 raft_consensus.cc:697] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:43.522610  9253 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:43.593793  9542 consensus_queue.cc:237] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.595230  9209 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.595870  9209 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.595285  9485 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:43.576450  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:43.586496  5675 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 6.
I20260709 12:14:43.597292  9352 consensus_queue.cc:237] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.611167  6325 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:43.610721  5645 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.593468  9471 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:43.552223  9217 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.640196  9097 raft_consensus.cc:3055] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:43.640625  9097 raft_consensus.cc:740] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:43.631646  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:43.635708  6291 leader_election.cc:336] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.168s (SENT)
I20260709 12:14:43.635802  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:43.636457  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.589576  9298 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:43.643018  5674 raft_consensus.cc:2393] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:43.637043  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.643989  5678 raft_consensus.cc:2410] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:43.644502  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:43.645009  5671 raft_consensus.cc:2393] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:43.648589  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.620724  9485 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.642638  9536 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:43.656719  5675 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:43.662125  5671 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:43.660037  6325 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:43.645218  9217 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:43.646947  9209 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:43.670970  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:43.641475  9097 consensus_queue.cc:260] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.672438  5604 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:43.655747  9538 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.651441  9485 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:43.673511  5678 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
W20260709 12:14:43.680624  6291 leader_election.cc:336] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 2.200s (SENT)
I20260709 12:14:43.681105  6291 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:43.686968  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:43.687551  5674 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:43.686424  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:43.665019  8916 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:43.697652  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:43.652222  9298 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:43.698410  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.715377  6293 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.686818  9471 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.690919  9097 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:43.722949  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:43.725144  6328 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:43.723620  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:43.725629  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:43.727126  6324 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
W20260709 12:14:43.728835  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 369489us
I20260709 12:14:43.730039  5600 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:14:43.734663  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 369389us
I20260709 12:14:43.736455  5570 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.736517  5645 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.737471  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:43.738250  5645 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.714322  9540 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:43.742937  9253 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.745327  9253 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:43.686110  9538 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.714771  8916 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:43.751976  6325 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:43.725085  9453 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:43.719625  9308 raft_consensus.cc:3055] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:43.755159  5603 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:43.724601  9471 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.764303  5567 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:43.775879  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:43.823807  6291 leader_election.cc:400] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11.
I20260709 12:14:43.824365  6291 leader_election.cc:403] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:14:43.823024  9380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.003s	sys 0.009s
I20260709 12:14:43.755203  9413 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:43.836527  5679 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:43.842063  5674 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:43.761725  9453 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:43.830945  9380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.004s	sys 0.009s
W20260709 12:14:43.860760  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 123265us
I20260709 12:14:43.764099  9308 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:43.877388  5600 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:43.878036  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:43.878923  9547 log.cc:927] Time spent T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
W20260709 12:14:43.879861  9548 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:14:43.882189  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:43.883015  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 302908us
I20260709 12:14:43.903143  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:43.883723  9559 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:43.884660  9561 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:43.886262  9471 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:43.886711  9217 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:43.837671  9306 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:43.894925  5598 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:43.765717  8916 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:43.902278  5603 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:43.866643  9453 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:43.882865  9298 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:43.911649  6291 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:43.921093  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.904089  9536 raft_consensus.cc:697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:43.937983  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:43.938630  6327 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:43.914414  9306 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.914290  9559 raft_consensus.cc:697] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:43.982043  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:43.965605  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 227438us
I20260709 12:14:43.984028  5645 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:43.984978  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.990505  9380 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:43.994426  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.939523  9538 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:43.937604  9471 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:43.997524  6323 raft_consensus.cc:1240] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:43.980571  9306 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:43.991914  9414 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.991750  9460 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:44.006124  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 99449.9us
I20260709 12:14:44.010317  5570 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:43.997208  9370 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:44.016903  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:44.017827  5604 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.020217  9553 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11.
I20260709 12:14:44.020442  9370 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.021040  9380 consensus_queue.cc:1059] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:44.022008  9564 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.022193  9536 consensus_queue.cc:237] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.022528  9564 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.024121  6319 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:44.033694  6327 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:44.003473  9561 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:44.024188  5642 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:44.003576  9573 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:44.046322  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 327135us
I20260709 12:14:44.021931  9380 raft_consensus.cc:3055] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:44.057830  9380 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:44.057928  9302 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.014299  9534 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:44.043653  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:44.058197  6319 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:44.058674  5602 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:44.058761  9380 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.060004  9380 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.061020  5597 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:14:44.062434  9551 log.cc:927] Time spent T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:14:44.063082  9534 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:44.066761  5596 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:44.074287  9552 log.cc:927] Time spent T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:14:44.077404  9344 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.078003  9344 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.080823  9344 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.083123  9311 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.083657  9311 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:44.084736  9556 log.cc:927] Time spent T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:14:44.085697  9311 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:44.056519  5604 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:44.114488  6326 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:44.048024  9573 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.055941  6293 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:44.114279  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:44.017686  9308 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.119729  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:44.124656  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:44.028824  9414 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.119727  9582 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:44.153590  9298 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:44.154160  9298 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:44.155002  9298 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.152884  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:44.158329  8916 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.158428  5747 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
W20260709 12:14:44.151684  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 415059us
I20260709 12:14:44.126580  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:44.150704  5751 raft_consensus.cc:1240] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:14:44.130457  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 106337us
I20260709 12:14:44.161688  5745 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:44.159376  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 103522us
I20260709 12:14:44.160866  5744 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
W20260709 12:14:44.170079  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.120085  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:44.182133  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.048862  9561 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.121579  9573 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.188325  5672 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:44.198400  5718 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:44.151363  9564 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.151360  9217 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.196826  5679 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:14:44.173619  9371 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:44.152052  9370 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.211119  5567 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:44.173947  9306 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.215016  5642 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:44.201926  9308 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.204648  9371 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.203775  9587 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.219867  9106 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.174178  9582 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.230474  9534 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:44.253342  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 243500us
I20260709 12:14:44.230778  9414 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.205269  9451 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:14:44.203977  9302 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:14:44.120647  9559 consensus_queue.cc:237] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.240234  9308 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:14:44.251689  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 240463us
I20260709 12:14:44.234469  5718 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:44.234642  9371 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:44.269088  6325 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:44.270867  9298 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:44.266549  6291 leader_election.cc:336] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 2.200s (SENT)
I20260709 12:14:44.271971  9298 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:44.273427  6291 leader_election.cc:336] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 2.224s (SENT)
I20260709 12:14:44.274569  6291 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:44.275331  9529 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:44.276656  6291 leader_election.cc:336] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 2.247s (SENT)
I20260709 12:14:44.277130  6291 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:44.277352  9298 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.277927  9529 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:44.278801  9298 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:44.279687  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:44.280555  9529 raft_consensus.cc:2764] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:14:44.280095  9298 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.282498  9529 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:44.282836  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:44.284341  6319 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:14:44.285512  9550 log.cc:927] Time spent T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 12:14:44.286710  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:44.287374  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.288393  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:44.288954  6320 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:44.289152  9581 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:44.289708  9581 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:44.290565  9298 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.292008  9581 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.291805  9298 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:44.293812  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:44.303619  6321 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.305681  5719 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:44.306607  9279 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:44.306907  9541 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:44.310274  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:44.311990  6328 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:14:44.305524  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:44.259845  9097 consensus_meta.cc:287] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.535s	user 0.003s	sys 0.007s
W20260709 12:14:44.313581  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 98648.6us
I20260709 12:14:44.254644  9460 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:44.316135  9311 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:14:44.252401  9587 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.309563  9414 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:44.316166  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:44.326359  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:44.327575  5599 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:44.327415  6291 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:44.380539  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.349538  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:44.343829  5716 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:44.579316  5501 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44240 (request call id 205) took 33258 ms (client timeout 15000 ms). Trace:
W20260709 12:14:44.662287  5753 consensus_meta.cc:287] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.002s
I20260709 12:14:44.334353  9414 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.666265  5753 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:44.443106  5602 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:44.544376  9597 raft_consensus.cc:1064] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:14:44.316638  9217 consensus_queue.cc:1059] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.355s
I20260709 12:14:44.669824  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 730) took 1394 ms. Trace:
I20260709 12:14:44.669692  9572 consensus_queue.cc:1059] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:44.353569  5719 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:44.335824  9587 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.671248  9209 raft_consensus.cc:3055] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:44.340371  9582 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.306597  9335 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:44.671949  9209 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:44.670462  6322 rpcz_store.cc:276] 0709 12:14:43.275748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.290186 (+ 14438us) service_pool.cc:224] Handling call
0709 12:14:43.295850 (+  5664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:43.306100 (+ 10250us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:43.908065 (+601965us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b18002ebe80. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa92c2a6 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9
0709 12:14:44.182136 (+274071us) log.cc:844] Serialized 14 byte log entry
0709 12:14:44.425833 (+243697us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.467921 (+ 42088us) log.cc:844] Serialized 26 byte log entry
0709 12:14:44.468084 (+   163us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:44.468116 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.468191 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:44.669515 (+201324us) raft_consensus.cc:1685] finished
0709 12:14:44.669598 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.669726 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41919,"prepare.queue_time_us":575140,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":60748,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":22223,"spinlock_wait_cycles":11800832,"thread_start_us":453827,"threads_started":2,"wal-append.queue_time_us":462184}
I20260709 12:14:44.672547  9335 raft_consensus.cc:697] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:44.562225  9485 consensus_meta.cc:287] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.846s	user 0.010s	sys 0.000s
I20260709 12:14:44.466648  9106 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:44.672868  9209 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.388352  9529 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.286s
I20260709 12:14:44.674170  9209 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.318156  9461 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.359s
I20260709 12:14:44.484472  9470 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:44.389063  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 61805.5us
I20260709 12:14:44.335902  6321 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
W20260709 12:14:44.546137  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:44.491963  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.667095  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.327018  9306 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.678159  5673 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
W20260709 12:14:44.666499  9413 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.019s	sys 0.016s
I20260709 12:14:44.347771  9600 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:44.679354  9413 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.020s	sys 0.016s
I20260709 12:14:44.328238  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:44.680008  9413 raft_consensus.cc:697] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:44.577885  9352 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:14:44.465619  9594 log.cc:927] Time spent T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:14:44.342943  5569 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:44.381990  5603 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:44.425710  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.494020  9460 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.187s
W20260709 12:14:44.460500  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 69950.2us
W20260709 12:14:44.484659  9602 log.cc:927] Time spent T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
I20260709 12:14:44.465162  9471 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.691720  9471 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.681169  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:44.682374  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 328860us
I20260709 12:14:44.666636  9414 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:44.664183  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 275947us
I20260709 12:14:44.318809  9204 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.680295  5595 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
W20260709 12:14:44.676108  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 332321us
I20260709 12:14:44.679764  9600 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.711298  9600 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.712798  9471 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:44.678915  6291 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:44.716682  9371 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.673322  9485 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.719089  9587 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:44.719708  9485 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.341912  9370 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.721573  9370 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.722150  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:44.717567  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.688354  5672 raft_consensus.cc:2410] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:14:44.689682  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.362242  9581 consensus_queue.cc:1059] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.328s
W20260709 12:14:44.666025  5501 rpcz_store.cc:269] 0709 12:14:11.321239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.321471 (+   232us) service_pool.cc:224] Handling call
0709 12:14:44.579040 (+33257569us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:38.630566 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:38.688878 (+ 58312us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:38.688948 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:14:38.688967 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:38.756509 (+ 67542us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:38.774527 (+ 18018us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:38.796152 (+ 21625us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:14:38.894777 (+ 98625us) tablet.cc:701] Row locks acquired
0709 12:14:38.894822 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:14:38.895024 (+   202us) write_op.cc:270] Start()
0709 12:14:38.895174 (+   150us) write_op.cc:276] Timestamp: P: 1783599278894956 usec, L: 0
0709 12:14:38.895191 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:14:38.918322 (+ 23131us) log.cc:844] Serialized 3231 byte log entry
0709 12:14:40.260098 (+1341776us) op_driver.cc:464] REPLICATION: finished
0709 12:14:40.674324 (+414226us) write_op.cc:301] APPLY: starting
0709 12:14:40.715025 (+ 40701us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:40.777108 (+ 62083us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:40.804834 (+ 27726us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:41.182660 (+377826us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:41.183067 (+   407us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:14:41.183127 (+    60us) write_op.cc:312] APPLY: finished
0709 12:14:41.183537 (+   410us) log.cc:844] Serialized 65 byte log entry
0709 12:14:41.183751 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:41.183888 (+   137us) write_op.cc:454] Released schema lock
0709 12:14:41.183947 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:41.268956 (+ 85009us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:41.282162 (+ 13206us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5244780,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":350321,"apply.run_cpu_time_us":5639,"apply.run_wall_time_us":524417,"num_ops":8,"prepare.queue_time_us":574135,"prepare.run_cpu_time_us":18339,"prepare.run_wall_time_us":1010569,"raft.queue_time_us":511549,"raft.run_cpu_time_us":24813,"raft.run_wall_time_us":119250,"replication_time_us":1364763,"thread_start_us":1820253,"threads_started":4,"wal-append.queue_time_us":721915,"wal-append.run_cpu_time_us":91345,"wal-append.run_wall_time_us":2723285}]]}
I20260709 12:14:44.726775  9581 raft_consensus.cc:3055] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:14:44.727092  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.727955  9610 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.348377  6293 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:44.693176  9453 consensus_meta.cc:287] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.753s	user 0.009s	sys 0.000s
I20260709 12:14:44.595500  9298 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.694434  5671 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:44.730365  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:44.699045  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 356148us
I20260709 12:14:44.443027  9590 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:44.468744  9561 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.739614  9371 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:44.686323  9562 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.739996  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:44.740536  6324 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.740394  9562 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.738845  9298 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.742617  9562 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.743964  9298 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:44.706045  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.737627  9097 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:14:44.746317  9572 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.746873  9572 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.747709  9204 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:44.747988  9546 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.748401  9204 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.748523  9546 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.750582  9204 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:44.747803  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.705947  5716 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:44.696498  9311 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:44.719933  9573 consensus_meta.cc:287] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.516s	user 0.001s	sys 0.006s
I20260709 12:14:44.721011  9582 raft_consensus.cc:3055] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:44.725136  6325 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.725636  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:44.726063  9540 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:44.692149  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:44.729171  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:44.729205  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:44.728492  9610 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:44.758008  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 52114.6us
W20260709 12:14:44.729784  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 381459us
I20260709 12:14:44.731381  9471 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:44.738030  9529 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.771799  9471 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.772223  9471 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:44.732628  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.773857  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.774927  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.776365  6324 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:44.777164  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:44.727170  9581 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:44.732935  9534 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:14:44.697314  9541 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:44.738896  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.781085  9581 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.780937  5500 catalog_manager.cc:5697] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 5 to 6, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 6 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.782240  5671 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:44.737712  9590 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.328277  9564 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:44.769441  5604 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
W20260709 12:14:44.798071  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 107311us
I20260709 12:14:44.795064  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.800218  5753 raft_consensus.cc:1240] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:44.800837  5672 raft_consensus.cc:3055] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:44.801980  5749 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:44.802466  5676 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:44.687132  9352 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.734858  5569 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:44.769642  5595 raft_consensus.cc:2376] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8. Re-sending same reply.
I20260709 12:14:44.779944  6325 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
W20260709 12:14:44.806599  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 71823.9us
I20260709 12:14:44.806830  5716 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:44.807940  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:44.771574  9370 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.811426  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:44.813356  5569 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:44.811628  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:44.820242  5745 raft_consensus.cc:2393] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:44.820489  9600 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.821861  5569 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:44.823530  9335 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.836117  9600 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.836782  9600 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.837296  5747 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:44.801241  5672 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:44.769443  6323 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:44.805002  5500 catalog_manager.cc:5697] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:44.839047  9600 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.839882  5719 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:44.753027  9460 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.811400  6320 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:44.840843  9460 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.841234  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.811297  9561 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:44.783306  5718 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:44.842303  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.843053  9460 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.843528  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:44.843402  5672 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.844120  5670 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:44.782660  9204 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.812003  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:44.845118  9470 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:44.845605  9470 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.770361  9209 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:44.812930  9394 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:44.812904  9562 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:44.811928  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:44.807922  9485 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:14:44.847522  9470 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.804325  9590 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:44.798332  9541 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.815387  9344 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:44.807998  9564 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.817396  5671 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:44.813386  5751 raft_consensus.cc:1275] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:44.822932  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:44.824075  5744 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:14:44.824654  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:44.730614  9413 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.826711  9306 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:44.828609  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.749217  9572 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.899183  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:44.900070  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:44.900431  9610 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.873230  9561 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.900877  9414 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:44.863485  5642 connection.cc:256] RPC call timeout handler was delayed by -2.5900511999998344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
I20260709 12:14:44.782351  9581 raft_consensus.cc:3060] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:44.830721  9370 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:44.833257  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.839179  5500 catalog_manager.cc:5697] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 5 to 6, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 6 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.794183  9534 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:44.852174  9460 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:44.849066  5675 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:44.844394  5672 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.846906  5677 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:44.851545  5600 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:44.777719  6324 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:44.860121  5595 raft_consensus.cc:1275] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:44.861214  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:44.861984  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 78765.8us
I20260709 12:14:44.941001  9209 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:44.862617  9485 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:44.864010  5753 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:44.942037  9482 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:44.866194  5719 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:44.943018  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 77048.1us
I20260709 12:14:44.943552  9482 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:44.944123  9482 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:44.754962  9582 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:44.872257  5670 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:14:44.929289  9370 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.882361  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.902503  9564 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.903105  9561 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:44.846917  9562 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.904206  9597 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.962568  9562 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.905357  9546 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:44.905786  9306 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.910290  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.951562  9534 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:44.966686  5671 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:44.752688  9453 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.967257  9534 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.968746  9453 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:44.828843  9471 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:44.914592  5642 connection.cc:256] RPC call timeout handler was delayed by -2.44065119999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2259s for a response
I20260709 12:14:44.970067  6327 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:14:44.919725  5750 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:44.920461  5602 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:44.954912  5500 catalog_manager.cc:5697] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 7, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 7 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:14:44.862603  9279 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:44.814597  9311 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:14:44.914117  9414 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:44.859683  9541 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.957290  9370 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.941588  9204 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:14:44.941597  5718 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:14:45.033013  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 91483.3us
I20260709 12:14:44.754637  9573 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:44.952903  5672 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:14:45.038578  5672 pending_rounds.cc:85] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 3
I20260709 12:14:44.953138  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:44.953833  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:44.953830  5719 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:44.954015  6293 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:45.039783  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 85853us
I20260709 12:14:44.955694  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:44.955798  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:45.041891  5595 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:44.931032  9572 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:44.958572  5604 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:44.959057  9295 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.973987  9564 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:44.962071  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:44.973018  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:44.970836  5642 connection.cc:256] RPC call timeout handler was delayed by -1.0964621120001539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 12:14:44.957801  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:45.076244  5674 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:44.978919  5500 catalog_manager.cc:5697] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:44.947155  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 140398us
W20260709 12:14:44.948443  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 209827us
I20260709 12:14:45.079466  5677 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:45.082198  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:45.082922  5600 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:44.974381  9352 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:44.961042  9482 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.083959  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:45.084738  5645 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:45.085392  5716 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:45.038873  5672 pending_rounds.cc:107] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:14:45.086979  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:45.026212  9279 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:45.030128  9559 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.089864  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:44.957659  9460 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.118141  5570 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:45.117218  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:45.136401  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.189322  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:45.208092  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 90028.1us
I20260709 12:14:45.208683  6320 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:45.204154  5642 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:45.204990  5601 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:45.117878  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:45.169530  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:45.038909  9606 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:14:45.191606  5672 raft_consensus.cc:2889] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:45.186525  5500 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:14:45.043794  9451 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:45.220134  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:45.220474  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:45.221081  6328 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:45.224099  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:45.204058  5595 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:45.045531  9414 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 12:14:45.209313  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.211159  5602 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:45.211179  5604 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:45.212267  5670 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:45.188773  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:45.214819  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 741) took 1171 ms. Trace:
I20260709 12:14:45.217736  5603 raft_consensus.cc:2368] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11.
I20260709 12:14:45.141323  5673 raft_consensus.cc:2393] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:45.076845  9453 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:14:45.116681  9617 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:14:45.170894  9217 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.215356  9529 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.236153  6327 rpcz_store.cc:276] 0709 12:14:44.043926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.047811 (+  3885us) service_pool.cc:224] Handling call
0709 12:14:44.050943 (+  3132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.970537 (+919594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.214578 (+244041us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400092ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:45.214760 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113202944}
I20260709 12:14:45.240558  5677 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:14:45.209995  9561 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:45.238760  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:45.169973  9609 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:45.044315  9572 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:45.251003  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 67985.2us
I20260709 12:14:45.251791  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:45.288388  5672 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:45.220069  9610 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:45.220130  9451 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.299048  9451 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:45.299165  9609 raft_consensus.cc:697] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:45.300154  9609 consensus_queue.cc:237] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.086404  9564 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.302810  9564 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:45.228252  9587 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:45.303807  9587 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.304185  9587 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:45.190824  9582 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.308032  9582 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.308573  5602 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:14:45.228446  9600 consensus_queue.cc:1059] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:14:45.238381  9413 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:45.115707  9295 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.321396  5670 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:45.297070  5604 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:45.260035  9217 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:45.282927  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 329192us
I20260709 12:14:45.224839  9461 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:45.320114  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:45.250712  9344 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:45.294206  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.323454  5677 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:14:45.324309  6293 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:45.334199  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:45.338428  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.254884  9453 raft_consensus.cc:697] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:45.218784  9559 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.374110  5718 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:45.292912  9584 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:45.313707  9471 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:45.309576  9562 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.286859  9529 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.361554  9344 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.315097  9572 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:45.552351  6291 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:45.449980  5670 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:45.566151  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:14:45.468043  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 148026us
W20260709 12:14:45.381425  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.375145  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:45.456504  5500 catalog_manager.cc:5697] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:45.570431  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:45.453630  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:45.571151  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 485775us
W20260709 12:14:45.570618  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 196613us
W20260709 12:14:45.363905  9614 log.cc:927] Time spent T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 12:14:45.559346  9621 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:14:45.572005  9470 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:45.587256  5596 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:45.361467  9461 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.588536  5718 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:45.584439  6322 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:45.596195  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:45.489269  9590 consensus_meta.cc:287] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.641s	user 0.008s	sys 0.001s
I20260709 12:14:45.511411  9473 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:45.616335  9473 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.460788  9279 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.598053  9471 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:45.623395  9615 log.cc:927] Time spent T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.402s	user 0.002s	sys 0.000s
I20260709 12:14:45.623378  9471 raft_consensus.cc:697] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:45.466799  9536 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:45.592005  5500 catalog_manager.cc:5697] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 4 to 6, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 6 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:45.597733  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:45.565412  9460 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:45.598824  5670 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:14:45.564185  9344 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:45.600041  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:45.567991  9306 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:45.642076  5753 raft_consensus.cc:2376] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9. Re-sending same reply.
I20260709 12:14:45.600299  9295 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:45.600574  9529 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:45.593482  9470 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.601549  9620 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:45.602280  9624 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:14:45.602653  9546 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:45.344648  9413 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:45.629633  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 63535.2us
I20260709 12:14:45.585642  5716 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:45.610733  9590 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.575198  9414 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:45.656451  5642 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:45.450454  9311 consensus_queue.cc:1059] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.201s
I20260709 12:14:45.672458  5500 catalog_manager.cc:5697] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 4, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 4 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:14:45.625396  9573 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:45.638963  9536 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:45.657775  9470 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.646414  9562 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:45.672492  6291 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:45.667555  9106 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:14:45.725464  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 139908us
I20260709 12:14:45.710027  5500 catalog_manager.cc:5697] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 6, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 6 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:45.594135  9209 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:14:45.565158  9453 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.596577  9584 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.672698  9620 raft_consensus.cc:697] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:45.674408  9414 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.675873  8916 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.677235  9473 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:45.742265  5672 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:14:45.717969  9536 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:45.746047  5500 catalog_manager.cc:5697] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 4 to 5, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 5 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:14:45.719239  5490 maintenance_manager.cc:419] P ce423f944eb64a23961a8a3bbc019610: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033415
I20260709 12:14:45.742779  9534 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:45.760123  9622 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:14:45.760838  9628 raft_consensus.cc:3055] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:45.741091  9624 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:14:45.761724  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 105383us
I20260709 12:14:45.637904  9461 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:45.761844  5672 pending_rounds.cc:85] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 5
I20260709 12:14:45.794302  5672 pending_rounds.cc:107] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:14:45.794622  5672 raft_consensus.cc:2889] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:45.762166  9631 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:45.654109  9471 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.758423  9562 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.745576  9414 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:45.760897  9632 log.cc:927] Time spent T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:14:45.779220  5500 catalog_manager.cc:5697] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 4, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 4 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:45.795558  9529 raft_consensus.cc:2764] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 12:14:45.790557  5717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.010s	sys 0.010s
W20260709 12:14:45.792928  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 53016.6us
W20260709 12:14:45.772408  5718 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.66:33011 timed out after 1.595s (SENT) [suppressed 30 similar messages]
I20260709 12:14:45.774348  9106 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:45.803686  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:45.764835  9335 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:14:45.788837  9306 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.812647  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:45.841279  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:45.871505  5670 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 6.
I20260709 12:14:45.764262  8916 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.791751  9628 raft_consensus.cc:740] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:45.818342  5717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.010s	sys 0.011s
I20260709 12:14:45.833153  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:45.833515  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:45.881608  5744 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:14:45.801647  9631 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.896708  9631 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:45.900046  9413 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:45.804777  9600 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.901149  9600 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.902987  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:45.903312  9600 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:45.811745  9534 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 12:14:45.864790  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:45.904765  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:45.879113  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:45.812537  9295 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:14:45.815939  9582 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 12:14:45.909981  5600 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:45.809711  9573 consensus_queue.cc:1059] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:14:45.911255  9573 raft_consensus.cc:3055] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:45.911582  9573 raft_consensus.cc:740] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:45.912478  9573 consensus_queue.cc:260] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:45.916716  9587 consensus_meta.cc:287] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.612s	user 0.005s	sys 0.002s
I20260709 12:14:45.894073  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:45.901170  9635 log.cc:927] Time spent T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:14:45.920895  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2251) took 1179 ms. Trace:
W20260709 12:14:45.926437  9640 log.cc:927] Time spent T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:14:45.930285  9628 consensus_queue.cc:260] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.931777  9628 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:45.938395  9620 consensus_queue.cc:237] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.860299  9559 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:45.937417  9344 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.879295  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:45.881904  5745 raft_consensus.cc:2393] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 7: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:45.871585  5749 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:45.880370  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:45.884213  5601 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:45.878682  9306 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.886785  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:45.889149  9584 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:45.815999  9562 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.894945  9106 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:45.872643  9610 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:45.953457  5750 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:45.877358  5500 catalog_manager.cc:5697] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 4, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 4 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:45.950155  9633 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 12:14:45.958276  5569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.014s	sys 0.047s
I20260709 12:14:45.959282  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:45.976876  5569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.014s	sys 0.048s
I20260709 12:14:45.976634  5596 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 12:14:45.979368  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 692275us
I20260709 12:14:45.979628  5596 pending_rounds.cc:85] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 4
I20260709 12:14:45.979876  5596 pending_rounds.cc:107] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:14:45.980129  5596 raft_consensus.cc:2889] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:45.977533  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:45.981338  6324 raft_consensus.cc:2410] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:45.864342  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:45.903225  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:45.982242  5597 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:45.921380  5675 rpcz_store.cc:276] 0709 12:14:44.741147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.933156 (+192009us) service_pool.cc:224] Handling call
0709 12:14:44.933511 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.933887 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:44.934441 (+   554us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.083586 (+149145us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.175163 (+ 91577us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.175321 (+   158us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:45.175354 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.175428 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.920647 (+745219us) raft_consensus.cc:1685] finished
0709 12:14:45.920669 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.920825 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":132,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":1124,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":52352,"thread_start_us":148579,"threads_started":1,"wal-append.queue_time_us":285195}
W20260709 12:14:45.973515  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.982192  5603 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
W20260709 12:14:45.925647  9451 consensus_meta.cc:287] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.003s
I20260709 12:14:45.986603  5569 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:45.917287  9587 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:45.995229  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:45.995941  5602 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:45.996263  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:45.997043  5751 raft_consensus.cc:2393] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:45.978124  9370 consensus_meta.cc:287] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.946s	user 0.001s	sys 0.009s
I20260709 12:14:45.978397  9631 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:46.004151  9559 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:46.004138  9638 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:46.007980  6324 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:14:46.016580  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.018296  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.976428  9344 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:45.970980  9610 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:46.014554  5500 catalog_manager.cc:5697] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:14:46.024268  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:46.025144  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 352730us
I20260709 12:14:46.020200  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:46.027470  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:46.028844  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:46.029712  5670 raft_consensus.cc:2410] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:46.035046  5603 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:14:46.035883  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:46.037649  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:46.060031  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.070413  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:46.022063  9638 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.084705  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:46.092279  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:46.032325  9610 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:46.096238  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:46.082204  5500 catalog_manager.cc:5697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.098985  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1585) took 1216 ms. Trace:
I20260709 12:14:46.000571  9451 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:46.102128  5601 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:14:46.099390  5676 rpcz_store.cc:276] 0709 12:14:44.882776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.170945 (+288169us) service_pool.cc:224] Handling call
0709 12:14:45.171344 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.171585 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.171613 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.189379 (+ 17766us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.570654 (+381275us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:45.816416 (+245762us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.819272 (+  2856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.819356 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:46.098659 (+279303us) raft_consensus.cc:1685] finished
0709 12:14:46.098680 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:46.098919 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":435553,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":11983,"raft.queue_time_us":2731,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":42586,"thread_start_us":547924,"threads_started":2,"wal-append.queue_time_us":448512}
I20260709 12:14:46.105818  5500 catalog_manager.cc:5697] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:14:46.110579  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 52432.8us
I20260709 12:14:46.105995  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:46.067449  9394 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:46.014997  9370 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:46.129473  5500 catalog_manager.cc:5697] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:14:46.096195  9643 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:46.111533  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:46.134982  6291 leader_election.cc:400] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11.
I20260709 12:14:46.137236  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:46.131508  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:46.133843  6293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.020s
W20260709 12:14:46.137996  6293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.011s	sys 0.020s
I20260709 12:14:46.138180  5601 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 11: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:46.138355  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 510091us
I20260709 12:14:46.139127  5570 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:46.140658  9534 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:46.140863  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:46.141481  5675 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:46.097035  9638 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:46.141566  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:46.144021  9643 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:46.140450  5500 catalog_manager.cc:5697] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 3 to 4, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 4 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:46.146585  9460 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:46.147599  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:14:46.160394  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 173313us
I20260709 12:14:46.161299  5570 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:46.162338  5570 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:46.164485  5598 raft_consensus.cc:2393] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:46.163177  5570 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:46.167749  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:46.169202  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:46.169812  5751 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:46.171396  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 399012us
I20260709 12:14:46.196815  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:46.199484  9370 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:46.200217  9370 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.200695  9370 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:46.202028  9647 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:46.202194  9295 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:46.202742  9295 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:46.203120  9295 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:46.206532  9644 consensus_queue.cc:1059] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.171s
I20260709 12:14:46.207641  9644 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:46.208038  9644 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:46.150954  9413 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 12:14:46.179216  9541 consensus_meta.cc:287] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.136s	user 0.012s	sys 0.000s
I20260709 12:14:46.173988  9546 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:14:46.212312  9643 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:46.136193  9394 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:46.168819  9600 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:46.169471  9584 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:46.227337  5751 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:46.232620  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:46.179504  9453 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:46.209374  9541 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:46.222512  9639 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:46.239945  9581 consensus_meta.cc:287] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.310s	user 0.005s	sys 0.007s
I20260709 12:14:46.228731  9471 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:46.386545  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:46.333277  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 184961us
I20260709 12:14:46.401659  5645 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:46.339340  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 212299us
I20260709 12:14:46.274403  9658 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:46.232522  9629 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:46.351068  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.239491  9453 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:46.255125  9572 consensus_meta.cc:287] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.000s
I20260709 12:14:46.233909  9643 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:46.419142  9651 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:46.419615  9623 log.cc:927] Time spent T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.853s	user 0.000s	sys 0.004s
W20260709 12:14:46.420553  9649 log.cc:927] Time spent T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 12:14:46.421334  9541 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:46.266731  9306 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:46.266664  8916 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:46.208880  9644 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:46.239156  9562 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:46.523903  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.416796  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 268646us
W20260709 12:14:47.028234  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 860460us
I20260709 12:14:46.759192  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1586) took 1542 ms. Trace:
I20260709 12:14:47.059772  6293 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:46.542475  5747 raft_consensus.cc:1240] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:46.601368  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:47.028258  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:46.824152  5598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2253) took 1953 ms (client timeout 2203 ms). Trace:
I20260709 12:14:46.452986  5675 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:14:46.792040  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:46.959319  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2265) took 1355 ms. Trace:
I20260709 12:14:46.963100  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2199) took 1135 ms. Trace:
I20260709 12:14:46.886423  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2202) took 1023 ms. Trace:
I20260709 12:14:47.028262  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:46.385280  9451 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:46.386318  9587 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:46.559053  9657 log.cc:927] Time spent T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260709 12:14:46.594270  9652 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.059599  5672 rpcz_store.cc:276] 0709 12:14:45.216710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.289797 (+ 73087us) service_pool.cc:224] Handling call
0709 12:14:45.290163 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.810491 (+520328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.758870 (+948379us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54001e3f54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:46.759110 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038938880}
I20260709 12:14:47.141423  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:46.716120  9217 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:47.141989  5672 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.060309  9658 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:47.055907  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 892712us
I20260709 12:14:47.054837  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:47.056545  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 654902us
I20260709 12:14:47.063501  5749 raft_consensus.cc:2393] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:47.149706  5749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1585) took 1178 ms. Trace:
I20260709 12:14:47.150081  5749 rpcz_store.cc:276] 0709 12:14:45.971051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.984519 (+ 13468us) service_pool.cc:224] Handling call
0709 12:14:46.791873 (+807354us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:14:47.149648 (+357775us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14605568}
I20260709 12:14:47.063283  5677 rpcz_store.cc:276] 0709 12:14:45.603824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.619076 (+ 15252us) service_pool.cc:224] Handling call
0709 12:14:45.619334 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.727501 (+108167us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:46.026197 (+298696us) log.cc:844] Serialized 14 byte log entry
0709 12:14:46.387400 (+361203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:46.387468 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:46.387532 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.959050 (+571518us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540029b8d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:46.959099 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:46.959251 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":368961,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":148042,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":26323,"spinlock_wait_cycles":255923712,"thread_start_us":645530,"threads_started":3,"wal-append.queue_time_us":722584}
I20260709 12:14:46.384537  9413 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:46.406160  9582 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.062275  5598 rpcz_store.cc:269] 0709 12:14:44.870546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.872777 (+  2231us) service_pool.cc:224] Handling call
0709 12:14:46.823869 (+1951092us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003e1a54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:46.824048 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2892628736}
W20260709 12:14:46.558918  9646 log.cc:927] Time spent T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.409s	user 0.001s	sys 0.000s
W20260709 12:14:46.594481  9654 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
W20260709 12:14:47.010673  9610 consensus_meta.cc:287] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.903s	user 0.008s	sys 0.002s
I20260709 12:14:47.063843  5596 rpcz_store.cc:276] 0709 12:14:45.827849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.828313 (+   464us) service_pool.cc:224] Handling call
0709 12:14:45.879998 (+ 51685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.991262 (+111264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.962827 (+971565us) spinlock_profiling.cc:243] Waited 90.3 ms on lock 0x7b54002aba54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:46.963034 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207789824}
I20260709 12:14:47.070798  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:46.559253  9645 log.cc:927] Time spent T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.362s	user 0.002s	sys 0.001s
W20260709 12:14:46.657032  9628 consensus_meta.cc:287] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.716s	user 0.014s	sys 0.000s
I20260709 12:14:46.353720  9335 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:14:46.432299  9461 consensus_meta.cc:287] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.000s
W20260709 12:14:46.588529  9470 consensus_meta.cc:287] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.849s	user 0.006s	sys 0.005s
I20260709 12:14:47.126681  9460 consensus_queue.cc:1059] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 12:14:46.558789  9656 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.224s	user 0.000s	sys 0.003s
I20260709 12:14:47.092175  5746 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:14:47.040429  9295 consensus_meta.cc:287] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.837s	user 0.016s	sys 0.005s
I20260709 12:14:47.123589  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:46.829509  9414 consensus_meta.cc:287] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 1.004s	user 0.009s	sys 0.000s
W20260709 12:14:46.586387  9641 log.cc:927] Time spent T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.314s	user 0.002s	sys 0.000s
I20260709 12:14:46.750047  9630 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.125820  5601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.012s	sys 0.034s
I20260709 12:14:46.820583  9298 raft_consensus.cc:3055] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:14:46.762683  9638 consensus_meta.cc:287] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.005s
W20260709 12:14:46.483065  9536 consensus_meta.cc:287] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.703s	user 0.006s	sys 0.003s
I20260709 12:14:47.056151  9651 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.991595  9344 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.064220  5602 rpcz_store.cc:276] 0709 12:14:45.862902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.874987 (+ 12085us) service_pool.cc:224] Handling call
0709 12:14:45.904004 (+ 29017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.996328 (+ 92324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.886117 (+889789us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b5400194954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:46.886345 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210688768}
I20260709 12:14:46.434856  9370 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:46.427289  9394 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:47.073655  9453 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:46.787535  9636 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.875329  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:47.059346  9631 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:46.826793  9590 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:47.147056  5748 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:47.082711  9688 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:46.408015  9471 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.147753  5645 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:47.122255  9306 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:14:47.148458  9106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.010s	sys 0.019s
I20260709 12:14:47.135205  9573 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:47.151816  9609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.410s	user 0.004s	sys 0.013s
I20260709 12:14:47.071157  9572 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:47.071287  9643 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:46.404527  9639 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.087719  9629 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:47.421943  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2262) took 2199 ms. Trace:
I20260709 12:14:47.602591  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:47.190829  5672 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
W20260709 12:14:47.604529  9609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.865s	user 0.010s	sys 0.019s
I20260709 12:14:47.605331  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2261) took 2387 ms. Trace:
W20260709 12:14:47.177146  5718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.022s
W20260709 12:14:47.605206  6291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.056s	user 0.003s	sys 0.012s
W20260709 12:14:47.606885  6291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.003s	sys 0.012s
I20260709 12:14:47.605916  5679 rpcz_store.cc:276] 0709 12:14:45.218326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.411261 (+192935us) service_pool.cc:224] Handling call
0709 12:14:45.411616 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.457446 (+ 45830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.457474 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.469781 (+ 12307us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.797170 (+327389us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:45.797207 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.797270 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:47.605088 (+1807818us) raft_consensus.cc:1685] finished
0709 12:14:47.605107 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.605248 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45405,"raft.queue_time_us":46085,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":13880,"thread_start_us":318625,"threads_started":1,"wal-append.queue_time_us":589805}
I20260709 12:14:47.607501  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 2271) took 1370 ms. Trace:
I20260709 12:14:47.607818  5675 rpcz_store.cc:276] 0709 12:14:46.236643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.092711 (+856068us) service_pool.cc:224] Handling call
0709 12:14:47.607448 (+514737us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.607909  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:47.399333  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 339605us
I20260709 12:14:47.608567  5679 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:14:47.193849  6322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.003s	sys 0.006s
W20260709 12:14:47.609272  6322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.006s	sys 0.007s
I20260709 12:14:47.610358  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 533) took 1110 ms. Trace:
W20260709 12:14:47.660177  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 52568.9us
I20260709 12:14:47.279325  5747 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:47.610976  5748 rpcz_store.cc:276] 0709 12:14:46.499662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.499814 (+   152us) service_pool.cc:224] Handling call
0709 12:14:47.610215 (+1110401us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:47.606379  5718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.005s	sys 0.046s
I20260709 12:14:47.634070  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 757) took 1724 ms. Trace:
I20260709 12:14:47.620908  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:47.603816  5601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.020s	sys 0.038s
W20260709 12:14:47.662209  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 514493us
I20260709 12:14:47.662484  6291 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:47.666262  6323 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.282454  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:47.663448  6322 rpcz_store.cc:276] 0709 12:14:45.957362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.971187 (+ 13825us) service_pool.cc:224] Handling call
0709 12:14:45.998839 (+ 27652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.999072 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:14:46.223382 (+224310us) log.cc:844] Serialized 14 byte log entry
0709 12:14:46.439182 (+215800us) log.cc:844] Serialized 14 byte log entry
0709 12:14:47.609519 (+1170337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:47.609570 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:47.609609 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.609663 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.609784 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":415273,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":7457,"raft.queue_time_us":461684,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":12772,"spinlock_wait_cycles":161332480,"thread_start_us":1533969,"threads_started":3,"wal-append.queue_time_us":681289}
W20260709 12:14:47.300690  5670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.018s	sys 0.033s
I20260709 12:14:47.283854  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:47.668562  5670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.024s	sys 0.038s
I20260709 12:14:47.173745  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:47.282137  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:47.669505  5677 raft_consensus.cc:2393] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:47.182029  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2264) took 1578 ms. Trace:
I20260709 12:14:47.604183  5674 rpcz_store.cc:276] 0709 12:14:45.222619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.613349 (+390730us) service_pool.cc:224] Handling call
0709 12:14:45.630146 (+ 16797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.641809 (+ 11663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.641843 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.680820 (+ 38977us) log.cc:844] Serialized 26 byte log entry
0709 12:14:46.036876 (+356056us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:46.036916 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.036985 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:47.421700 (+1384715us) raft_consensus.cc:1685] finished
0709 12:14:47.421722 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.421872 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1783,"raft.queue_time_us":8029,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4925,"thread_start_us":292685,"threads_started":1,"wal-append.queue_time_us":443341}
W20260709 12:14:47.671109  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 50281.5us
I20260709 12:14:47.681667  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:47.682372  5745 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:47.684759  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:47.603116  9529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.012s	sys 0.011s
I20260709 12:14:47.150509  9658 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:47.671449  9106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.017s	sys 0.026s
I20260709 12:14:47.268337  9683 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:47.451680  9279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.007s	sys 0.038s
W20260709 12:14:47.269559  9597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.586s	user 0.029s	sys 0.007s
I20260709 12:14:47.692329  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2272) took 1455 ms. Trace:
I20260709 12:14:47.725366  5672 rpcz_store.cc:276] 0709 12:14:46.236932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.661707 (+1424775us) service_pool.cc:224] Handling call
0709 12:14:47.691686 (+ 29979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:47.691854 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:47.691877 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:47.692143 (+   266us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:47.692172 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.692210 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.692290 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.696825  5674 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:14:47.726646  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:47.698009  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:47.728382  5745 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.701465  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:47.702385  5753 raft_consensus.cc:2393] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 11: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:47.266367  9204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.017s	sys 0.015s
I20260709 12:14:47.266057  9702 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.672644  5673 rpcz_store.cc:276] 0709 12:14:45.603545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.616836 (+ 13291us) service_pool.cc:224] Handling call
0709 12:14:45.617129 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.626775 (+  9646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.626806 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.627270 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.951047 (+323777us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:45.951086 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.951156 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:47.181793 (+1230637us) raft_consensus.cc:1685] finished
0709 12:14:47.181817 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.181968 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9099,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":323370,"threads_started":1,"wal-append.queue_time_us":527004}
I20260709 12:14:47.601959  9703 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:47.179126  9561 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.229796  9623 log.cc:927] Time spent T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:14:47.599107  9620 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.228544  9587 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:47.238569  9637 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.598850  9676 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:47.268365  9660 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.704648  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:47.705325  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:47.700754  6292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.019s	sys 0.018s
W20260709 12:14:47.780767  6292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.019s	sys 0.018s
I20260709 12:14:47.662078  9298 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:47.650974  9685 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:47.423677  9677 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:47.671221  9672 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.694613  9529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.013s	sys 0.011s
I20260709 12:14:47.723126  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:47.672114  9651 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:47.690757  9630 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.791985  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 880) took 2331 ms. Trace:
I20260709 12:14:47.748102  9680 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:47.731559  5718 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:47.733601  5750 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:47.699542  9534 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.694351  9482 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.742537  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2266) took 2138 ms. Trace:
W20260709 12:14:47.746649  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.740504  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:47.727679  9279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.291s	user 0.008s	sys 0.043s
I20260709 12:14:47.182121  9582 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:47.650504  9295 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:47.840548  9705 log.cc:927] Time spent T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:14:47.841661  9630 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:47.834229  5671 rpcz_store.cc:276] 0709 12:14:45.604075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.647128 (+ 43053us) service_pool.cc:224] Handling call
0709 12:14:45.672866 (+ 25738us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.673463 (+   597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.673516 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.736003 (+ 62487us) log.cc:844] Serialized 26 byte log entry
0709 12:14:46.056370 (+320367us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:46.056419 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.056486 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:47.742316 (+1685830us) raft_consensus.cc:1685] finished
0709 12:14:47.742338 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.742479 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11593,"raft.queue_time_us":1572,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":32712,"thread_start_us":278613,"threads_started":1,"wal-append.queue_time_us":410492}
I20260709 12:14:47.843262  9691 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:47.843713  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:47.843873  9691 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.844954  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:47.845923  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:47.846567  9482 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:47.846990  9370 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:47.847769  9643 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:47.847590  9370 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.848592  9482 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:47.176388  9652 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:47.181039  9413 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:47.657713  9306 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.671003  9470 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.846532  5596 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
W20260709 12:14:47.740656  9204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.018s	sys 0.026s
I20260709 12:14:47.231155  9610 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:47.680755  9414 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:47.703123  9693 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:47.762873  9703 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.686362  9335 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:47.770974  5716 connection.cc:256] RPC call timeout handler was delayed by -1.8771023540000442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:14:47.680759  9461 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.771706  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:48.058040  5744 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:47.686025  9536 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.690801  9344 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.674651  9688 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.072173  5676 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:48.012890  9562 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:47.792851  6327 rpcz_store.cc:276] 0709 12:14:45.455285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.455657 (+   372us) service_pool.cc:224] Handling call
0709 12:14:45.479186 (+ 23529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.488042 (+  8856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.488073 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.493114 (+  5041us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.985377 (+492263us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:45.985424 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.985485 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:47.786240 (+1800755us) raft_consensus.cc:1685] finished
0709 12:14:47.786266 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.786423 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11929,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":12810,"thread_start_us":420694,"threads_started":1,"wal-append.queue_time_us":632823}
I20260709 12:14:47.748266  9683 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:47.687631  9609 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:47.757856  9702 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.831447  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:47.822646  5673 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:14:47.830140  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 98611us
I20260709 12:14:47.792233  9685 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:47.844319  5598 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:47.685830  9638 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:47.850387  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:47.852905  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 56927.3us
I20260709 12:14:47.858208  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2254) took 2941 ms. Trace:
I20260709 12:14:47.793659  9689 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:47.859176  5567 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:47.863642  9460 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:14:47.864349  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 132066us
I20260709 12:14:48.079968  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:48.114842  5599 rpcz_store.cc:276] 0709 12:14:44.897465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.897607 (+   142us) service_pool.cc:224] Handling call
0709 12:14:44.897981 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.898814 (+   833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.898842 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.899335 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.039784 (+140449us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:45.141968 (+102184us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.142204 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.142284 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:46.082963 (+940679us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:47.806621 (+1723658us) raft_consensus.cc:1685] finished
0709 12:14:47.838769 (+ 32148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.838937 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11652,"prepare.queue_time_us":130540,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":29403,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":20484,"spinlock_wait_cycles":11778304,"thread_start_us":140086,"threads_started":1,"wal-append.queue_time_us":360245}
I20260709 12:14:47.870200  9644 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:47.879428  5753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1587) took 1907 ms (client timeout 1854 ms). Trace:
W20260709 12:14:47.883929  9674 log.cc:927] Time spent T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 12:14:47.885325  9678 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
W20260709 12:14:47.886655  9684 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:14:47.888648  9564 raft_consensus.cc:3055] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:47.894804  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:47.898061  9667 log.cc:927] Time spent T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 1.139s	user 0.001s	sys 0.016s
W20260709 12:14:47.899590  9671 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.150s	user 0.006s	sys 0.005s
I20260709 12:14:48.141654  9682 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:48.142259  9682 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.144980  9682 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:47.905118  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:47.905118  9664 log.cc:927] Time spent T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 1.186s	user 0.003s	sys 0.010s
I20260709 12:14:48.146615  9295 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:48.147171  9295 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:47.907246  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1589) took 1874 ms. Trace:
I20260709 12:14:47.781302  9700 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:47.766000  9561 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.148072  9709 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:48.148650  9709 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.149387  9561 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:48.132649  9559 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:48.041949  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:48.150830  9703 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:47.680688  9636 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.132123  9564 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:48.152093  9564 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.152701  9636 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:48.153287  9564 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.850427  9695 raft_consensus.cc:2804] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:14:48.141664  9694 log.cc:927] Time spent T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 12:14:48.153920  5751 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:47.805692  9672 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.789140  9660 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.154927  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2269) took 1919 ms. Trace:
I20260709 12:14:48.155589  9470 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:48.156248  9660 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:47.848785  9639 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:47.857594  9708 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.788295  9587 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.068192  5678 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:47.790861  9637 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.012117  9584 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:48.014108  9643 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:47.785390  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:48.041332  9693 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.043919  9710 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.725301  9597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.049s	user 0.034s	sys 0.014s
I20260709 12:14:48.098251  5746 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:48.115396  5747 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:48.118727  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 456268us
I20260709 12:14:48.118750  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2270) took 1882 ms. Trace:
I20260709 12:14:48.068426  9370 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:48.215308  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:48.216180  6320 raft_consensus.cc:2410] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:14:48.123627  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 264524us
W20260709 12:14:48.118129  5753 rpcz_store.cc:269] 0709 12:14:45.971632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.972089 (+   457us) service_pool.cc:224] Handling call
0709 12:14:47.879141 (+1907052us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400011654. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:47.879327 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3923894656}
I20260709 12:14:47.788903  9676 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:47.826195  9677 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.072836  9691 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:48.101277  9699 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 12:14:47.835587  9680 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.255344  6321 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:48.138135  5749 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:48.138705  5596 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:48.140199  9686 log.cc:927] Time spent T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:14:48.140568  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 763) took 1929 ms. Trace:
I20260709 12:14:48.140512  9655 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.098s
W20260709 12:14:47.902421  9666 log.cc:927] Time spent T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 1.153s	user 0.008s	sys 0.005s
I20260709 12:14:48.147663  9638 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:47.770484  9620 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.149931  5602 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:48.286550  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1609) took 1007 ms. Trace:
W20260709 12:14:47.846221  9690 log.cc:927] Time spent T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:14:48.154105  9695 raft_consensus.cc:697] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:48.155280  5670 rpcz_store.cc:276] 0709 12:14:46.235886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.236029 (+   143us) service_pool.cc:224] Handling call
0709 12:14:46.236424 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:46.240584 (+  4160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:46.240621 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:46.386188 (+145567us) log.cc:844] Serialized 26 byte log entry
0709 12:14:47.669054 (+1282866us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:47.669099 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.669493 (+   394us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:48.154702 (+485209us) raft_consensus.cc:1685] finished
0709 12:14:48.154720 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:48.154862 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3752,"raft.queue_time_us":148851,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":1233484,"threads_started":1,"wal-append.queue_time_us":1276086}
I20260709 12:14:48.160981  6323 raft_consensus.cc:2410] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:14:48.161198  5679 consensus_meta.cc:287] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.017s
I20260709 12:14:48.097555  9609 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:48.147883  5750 rpcz_store.cc:276] 0709 12:14:46.033283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.033401 (+   118us) service_pool.cc:224] Handling call
0709 12:14:46.070773 (+ 37372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:47.829944 (+1759171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.906953 (+ 77009us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400052dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:47.907178 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3823705856}
I20260709 12:14:48.203281  5748 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:48.098204  9562 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.149498  9413 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:48.285445  9573 consensus_meta.cc:287] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.000s
I20260709 12:14:48.046656  9298 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.132988  9689 raft_consensus.cc:697] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:48.158071  9572 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:48.150861  9709 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:48.199769  9724 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:14:48.147614  9295 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.132522  8916 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 12:14:48.218530  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 100685us
I20260709 12:14:48.251395  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:48.250978  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:48.350075  6328 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:48.306463  9609 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.271518  9597 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:14:48.132311  9460 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.102384  9683 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.259064  6324 rpcz_store.cc:276] 0709 12:14:46.211624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.211784 (+   160us) service_pool.cc:224] Handling call
0709 12:14:46.212148 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:46.212476 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:46.212504 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:46.213008 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:14:46.507197 (+294189us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:46.507242 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.507312 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:47.886034 (+1378722us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:48.140275 (+254241us) raft_consensus.cc:1685] finished
0709 12:14:48.140296 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:48.140511 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":536,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":166331264,"thread_start_us":293780,"threads_started":1,"wal-append.queue_time_us":1385062}
I20260709 12:14:48.211963  9279 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.265898  5746 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:48.365556  5746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1613) took 1085 ms. Trace:
I20260709 12:14:48.267642  9677 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:48.261875  9370 consensus_queue.cc:1059] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:14:48.271931  5749 raft_consensus.cc:1240] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:48.209484  9693 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.276121  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1593) took 2253 ms. Trace:
I20260709 12:14:48.277637  6325 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:48.286936  5751 rpcz_store.cc:276] 0709 12:14:47.279576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.685533 (+405957us) service_pool.cc:224] Handling call
0709 12:14:48.286402 (+600869us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400258354. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:48.286498 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858650368}
I20260709 12:14:48.254043  9715 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:48.214350  9471 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:48.347548  9610 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:48.301256  5679 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:14:48.299786  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:48.211249  9584 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:48.306133  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1614) took 1025 ms. Trace:
I20260709 12:14:48.306902  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 765) took 1434 ms. Trace:
I20260709 12:14:48.307459  6327 raft_consensus.cc:1240] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:48.207973  9643 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:48.162138  9546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.576s	user 0.012s	sys 0.017s
W20260709 12:14:48.314826  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 194104us
I20260709 12:14:48.260172  9691 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:48.331938  5570 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:48.332947  6321 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:48.506954  5745 consensus_meta.cc:287] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.777s	user 0.019s	sys 0.000s
I20260709 12:14:48.514779  5745 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:14:48.337153  5602 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:48.196448  9708 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.337391  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 731) took 2198 ms. Trace:
I20260709 12:14:48.407851  5751 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:14:48.271107  9582 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:48.338403  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.515161  6323 rpcz_store.cc:276] 0709 12:14:46.872196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.872773 (+   577us) service_pool.cc:224] Handling call
0709 12:14:48.306814 (+1434041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.306221  9644 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:48.309115  9629 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:48.523324  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:48.359099  6320 raft_consensus.cc:1240] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:48.214123  5675 rpcz_store.cc:276] 0709 12:14:46.236324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.608655 (+1372331us) service_pool.cc:224] Handling call
0709 12:14:47.608924 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.056484 (+447560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.056517 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:48.056560 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:48.056591 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.118519 (+ 61928us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5400490f54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:48.118566 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:48.118692 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028712192}
I20260709 12:14:48.334928  9720 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.332954  9413 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.336483  9414 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:48.214775  9710 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.365972  5746 rpcz_store.cc:276] 0709 12:14:47.280572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.221838 (+941266us) service_pool.cc:224] Handling call
0709 12:14:48.265543 (+ 43705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.365249 (+ 99706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.365490 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.372081  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2274) took 1240 ms. Trace:
I20260709 12:14:48.343657  9573 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.376614  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:48.343178  9536 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:48.351755  9298 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:48.381433  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 217276us
I20260709 12:14:48.381225  5678 rpcz_store.cc:276] 0709 12:14:46.022776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.023866 (+  1090us) service_pool.cc:224] Handling call
0709 12:14:46.071273 (+ 47407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.193483 (+2122210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.275875 (+ 82392us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b5400064854. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:48.276059 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4592044288}
I20260709 12:14:48.148164  9700 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.351352  9306 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:48.407812  9344 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:48.408113  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:48.515421  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1619) took 1083 ms. Trace:
W20260709 12:14:48.515444  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 183617us
I20260709 12:14:48.426204  5598 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:14:48.514292  5748 rpcz_store.cc:276] 0709 12:14:47.280826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.785103 (+504277us) service_pool.cc:224] Handling call
0709 12:14:48.306073 (+520970us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.343058  5750 raft_consensus.cc:1240] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:14:48.493075  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1610) took 1213 ms. Trace:
I20260709 12:14:48.518806  5676 rpcz_store.cc:276] 0709 12:14:46.139353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.139503 (+   150us) service_pool.cc:224] Handling call
0709 12:14:46.139796 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.072657 (+1932861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.333982 (+261325us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400064d54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:48.337329 (+  3347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4443623808}
I20260709 12:14:48.515497  5670 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:48.515951  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 2275) took 1375 ms. Trace:
I20260709 12:14:48.357002  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:48.523686  9652 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:49.531695  9709 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:49.533118  6320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 886) took 1272 ms. Trace:
I20260709 12:14:48.556254  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:48.932080  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.545980  6328 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
W20260709 12:14:49.537376  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 1.18036e+06us
I20260709 12:14:49.532488  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 2220) took 1011 ms. Trace:
W20260709 12:14:49.006281  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.531523  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:49.533824  5716 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:48.519098  9546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.934s	user 0.017s	sys 0.017s
W20260709 12:14:48.506600  9726 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:14:49.577999  5603 rpcz_store.cc:276] 0709 12:14:48.521522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.523081 (+  1559us) service_pool.cc:224] Handling call
0709 12:14:49.532432 (+1009351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.524497  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:48.381793  9559 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 1.198s
I20260709 12:14:49.534480  5677 rpcz_store.cc:276] 0709 12:14:47.131857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.689158 (+557301us) service_pool.cc:224] Handling call
0709 12:14:47.689446 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:47.689623 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:47.983304 (+293681us) log.cc:844] Serialized 14 byte log entry
0709 12:14:48.371705 (+388401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:48.371764 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:48.371817 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.371890 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:48.372014 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":448293,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":156743,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":21852,"spinlock_wait_cycles":1011840,"thread_start_us":680862,"threads_started":3,"wal-append.queue_time_us":281334}
I20260709 12:14:48.502769  9713 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:49.533548  6320 rpcz_store.cc:276] 0709 12:14:48.260862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.358601 (+ 97739us) service_pool.cc:224] Handling call
0709 12:14:48.358930 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:49.532881 (+1173951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.533068 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.533494  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:49.535967  5745 rpcz_store.cc:276] 0709 12:14:47.432586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.697716 (+265130us) service_pool.cc:224] Handling call
0709 12:14:48.515353 (+817637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.536758  5744 rpcz_store.cc:276] 0709 12:14:47.279845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.133507 (+853662us) service_pool.cc:224] Handling call
0709 12:14:48.199333 (+ 65826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.199551 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:48.363334 (+163783us) log.cc:844] Serialized 14 byte log entry
0709 12:14:48.490147 (+126813us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:48.490208 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:48.490259 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.490332 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:48.492992 (+  2660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29676,"prepare.queue_time_us":739130,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":297959,"raft.run_wall_time_us":88981,"spinlock_wait_cycles":39539584,"thread_start_us":279195,"threads_started":2,"wal-append.queue_time_us":855917}
I20260709 12:14:49.532013  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2217) took 1011 ms. Trace:
I20260709 12:14:49.578399  6321 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:48.505961  9698 log.cc:927] Time spent T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:14:49.534019  5679 rpcz_store.cc:276] 0709 12:14:47.140111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.607675 (+467564us) service_pool.cc:224] Handling call
0709 12:14:48.515895 (+908220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.523379  9370 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:49.568264  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 544) took 1726 ms. Trace:
W20260709 12:14:49.033929  9704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.008s	sys 0.028s
W20260709 12:14:49.568092  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.588603  9414 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:49.556042  5747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1611) took 2275 ms (client timeout 1883 ms). Trace:
I20260709 12:14:49.552805  6323 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:49.607803  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 773) took 1163 ms. Trace:
W20260709 12:14:49.599586  9534 consensus_meta.cc:287] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.764s	user 0.009s	sys 0.002s
I20260709 12:14:48.391628  9677 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.595834  9713 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:48.444141  9658 consensus_meta.cc:287] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.728s	user 0.009s	sys 0.009s
W20260709 12:14:49.583258  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.583660  9573 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:48.505919  9638 raft_consensus.cc:3055] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:48.656241  9689 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:49.584200  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 1.05971e+06us
W20260709 12:14:49.584975  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 51247.8us
I20260709 12:14:49.584170  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 771) took 1224 ms. Trace:
I20260709 12:14:49.580361  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:48.507236  9695 consensus_queue.cc:237] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:48.703248  9453 consensus_meta.cc:287] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 1.012s	user 0.008s	sys 0.001s
I20260709 12:14:49.586613  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:48.658259  5597 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:48.408501  9295 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:48.699220  9690 log.cc:927] Time spent T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 12:14:48.444712  9715 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:48.660698  9666 log.cc:927] Time spent T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 12:14:49.590335  5675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 736) took 1463 ms (client timeout 1907 ms). Trace:
I20260709 12:14:49.588925  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:49.590924  5596 rpcz_store.cc:276] 0709 12:14:48.520640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.520855 (+   215us) service_pool.cc:224] Handling call
0709 12:14:49.531502 (+1010647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:49.531691 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:49.531716 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:49.531757 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:49.531792 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.531843 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.531955 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:49.278048  9651 consensus_meta.cc:287] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 1.451s	user 0.005s	sys 0.005s
W20260709 12:14:48.960039  9725 log.cc:927] Time spent T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.513s	user 0.000s	sys 0.000s
W20260709 12:14:49.056653  9564 consensus_meta.cc:287] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.903s	user 0.011s	sys 0.000s
W20260709 12:14:49.577994  5670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 2284) took 1336 ms (client timeout 1623 ms). Trace:
I20260709 12:14:49.594123  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:48.699442  9587 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:48.609074  9582 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:49.367993  9735 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:49.546931  9721 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.211s	user 0.019s	sys 0.031s
I20260709 12:14:49.596256  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:49.535625  9712 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.594281  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:49.535084  9461 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:48.659854  9688 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:48.701270  9702 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:49.449088  9460 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:49.222761  9676 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:49.221621  9584 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:49.276770  9620 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:49.240067  9660 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:48.886857  9717 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.566659  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 770) took 1209 ms. Trace:
W20260709 12:14:49.600862  5718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.000s	sys 0.016s
I20260709 12:14:48.877287  9685 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:48.959371  9731 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.414292  9683 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:49.601226  5598 rpcz_store.cc:276] 0709 12:14:47.842187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.843440 (+  1253us) service_pool.cc:224] Handling call
0709 12:14:49.535638 (+1692198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.377363  9279 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.048708  9643 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:14:49.576788  9710 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:49.579612  6328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58722 (request call id 691) took 1363 ms (client timeout 1808 ms). Trace:
I20260709 12:14:49.291757  9680 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:49.606462  5719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.008s	sys 0.023s
I20260709 12:14:49.588747  9536 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:49.608129  6323 rpcz_store.cc:276] 0709 12:14:48.444355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.520378 (+ 76023us) service_pool.cc:224] Handling call
0709 12:14:49.607742 (+1087364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.553315  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2191) took 1877 ms. Trace:
W20260709 12:14:49.608678  5747 rpcz_store.cc:269] 0709 12:14:47.280102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.684473 (+404371us) service_pool.cc:224] Handling call
0709 12:14:49.555804 (+1871331us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54002c79d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:49.555969 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988451072}
I20260709 12:14:48.607239  9644 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.576996  9720 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.616699  6321 raft_consensus.cc:2410] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 12:14:49.610735  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 47964.3us
I20260709 12:14:49.623361  5676 raft_consensus.cc:2410] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:14:49.623898  5677 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:49.624320  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2219) took 1103 ms. Trace:
W20260709 12:14:49.626413  5675 rpcz_store.cc:269] 0709 12:14:48.127323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.533258 (+1405935us) service_pool.cc:224] Handling call
0709 12:14:49.590278 (+ 57020us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.611730  9691 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:49.628556  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2271) took 1722 ms. Trace:
I20260709 12:14:49.631404  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 734) took 2020 ms. Trace:
I20260709 12:14:49.631595  6320 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 11: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
W20260709 12:14:49.645485  5718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.000s	sys 0.016s
I20260709 12:14:49.553633  9413 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.627445  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:49.629594  5679 raft_consensus.cc:2410] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:14:49.645360  6324 rpcz_store.cc:276] 0709 12:14:48.356814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.376332 (+ 19518us) service_pool.cc:224] Handling call
0709 12:14:49.566530 (+1190198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.579619  9709 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.616392  9573 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:49.635650  5678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 739) took 1244 ms (client timeout 1636 ms). Trace:
I20260709 12:14:49.656939  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:49.626634  5603 raft_consensus.cc:3060] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:49.622869  6325 rpcz_store.cc:276] 0709 12:14:48.359637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.383327 (+ 23690us) service_pool.cc:224] Handling call
0709 12:14:49.584111 (+1200784us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:49.807186  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 1.2878e+06us
I20260709 12:14:49.807782  6321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 772) took 1416 ms. Trace:
W20260709 12:14:49.810635  5679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1599) took 1443 ms (client timeout 1847 ms). Trace:
W20260709 12:14:49.809515  5678 rpcz_store.cc:269] 0709 12:14:48.393889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.557508 (+1163619us) service_pool.cc:224] Handling call
0709 12:14:49.635573 (+ 78065us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.810846  5598 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:49.808597  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:49.657119  5750 rpcz_store.cc:276] 0709 12:14:47.676064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.310638 (+634574us) service_pool.cc:224] Handling call
0709 12:14:48.342839 (+ 32201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:49.534630 (+1191791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.553251 (+ 18621us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:49.631132  9721 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.019s	sys 0.032s
I20260709 12:14:49.622129  9562 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:49.629107  5670 rpcz_store.cc:269] 0709 12:14:48.198024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.299512 (+101488us) service_pool.cc:224] Handling call
0709 12:14:49.534400 (+1234888us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.642490  9534 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:49.635244  9696 log.cc:927] Time spent T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.440s	user 0.008s	sys 0.024s
W20260709 12:14:49.656810  5719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.008s	sys 0.023s
W20260709 12:14:49.809197  5677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 740) took 1288 ms (client timeout 1647 ms). Trace:
W20260709 12:14:49.732107  5567 leader_election.cc:336] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.526s (SENT)
I20260709 12:14:49.620369  9672 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:49.825490  5603 raft_consensus.cc:2468] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:49.826073  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 2225) took 1303 ms. Trace:
W20260709 12:14:49.810779  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.826735  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:49.824071  5677 rpcz_store.cc:269] 0709 12:14:48.520649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.586364 (+1065715us) service_pool.cc:224] Handling call
0709 12:14:49.809136 (+222772us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.812301  5675 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
W20260709 12:14:49.811357  5679 rpcz_store.cc:269] 0709 12:14:48.367095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.593898 (+1226803us) service_pool.cc:224] Handling call
0709 12:14:49.810579 (+216681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.807961  5672 rpcz_store.cc:276] 0709 12:14:47.610670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.726467 (+115797us) service_pool.cc:224] Handling call
0709 12:14:47.734481 (+  8014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.268147 (+533666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.268182 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:48.268221 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:48.268250 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.631165 (+1362915us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b54003ce1d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:49.631216 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.631344 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1226837760}
I20260709 12:14:49.633642  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:49.627876  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:49.827859  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 95796.1us
I20260709 12:14:49.651578  9717 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:49.814958  9279 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:49.816718  9709 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:49.629601  9582 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.832646  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:49.635263  9660 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.627600  9106 consensus_queue.cc:1059] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.190s
W20260709 12:14:49.815518  5676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1598) took 1451 ms (client timeout 1689 ms). Trace:
I20260709 12:14:49.787406  5597 rpcz_store.cc:276] 0709 12:14:48.521219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.521354 (+   135us) service_pool.cc:224] Handling call
0709 12:14:48.658006 (+136652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:49.624075 (+966069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.624268 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.817843  9561 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.811177  6321 rpcz_store.cc:276] 0709 12:14:48.391441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.524024 (+132583us) service_pool.cc:224] Handling call
0709 12:14:49.807714 (+1283690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.611693  9677 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:49.651198  9637 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:49.819870  9740 log.cc:927] Time spent T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:14:49.820449  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:49.684558  9536 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:14:49.837241  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 209901us
I20260709 12:14:49.655308  9747 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:49.627286  9715 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:49.656616  6328 rpcz_store.cc:269] 0709 12:14:48.216040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.217417 (+  1377us) service_pool.cc:224] Handling call
0709 12:14:49.579552 (+1362135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.824908  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:49.650626  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2216) took 3499 ms. Trace:
I20260709 12:14:49.826453  5603 rpcz_store.cc:276] 0709 12:14:48.522864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.588671 (+1065807us) service_pool.cc:224] Handling call
0709 12:14:49.826019 (+237348us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:49.635226  9609 consensus_meta.cc:287] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 1.264s	user 0.008s	sys 0.000s
W20260709 12:14:49.828327  5675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1602) took 1435 ms (client timeout 1907 ms). Trace:
I20260709 12:14:49.829198  5596 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:49.829409  5567 leader_election.cc:336] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.707s (SENT)
I20260709 12:14:49.626019  9414 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.184s
I20260709 12:14:49.830843  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:49.830901  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:49.831301  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 197759us
I20260709 12:14:49.807782  5600 rpcz_store.cc:276] 0709 12:14:47.905919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.906042 (+   123us) service_pool.cc:224] Handling call
0709 12:14:47.906375 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:48.048250 (+141875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.048282 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:48.062614 (+ 14332us) log.cc:844] Serialized 26 byte log entry
0709 12:14:48.418042 (+355428us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:48.418087 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.418169 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:49.628358 (+1210189us) raft_consensus.cc:1685] finished
0709 12:14:49.628377 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.628500 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141456,"raft.queue_time_us":148384,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3032,"thread_start_us":301140,"threads_started":1,"wal-append.queue_time_us":1430095}
I20260709 12:14:49.614059  9658 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:49.788563  9683 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.718721  9708 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:49.833691  5674 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:49.833503  5676 rpcz_store.cc:269] 0709 12:14:48.366740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.580107 (+1213367us) service_pool.cc:224] Handling call
0709 12:14:49.815245 (+235138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.832791  9688 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:49.834393  9564 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:14:49.833201  6320 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:49.612022  9652 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.218s
I20260709 12:14:49.819140  9644 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:49.628216  9651 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.615370  9638 raft_consensus.cc:740] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:49.611869  9597 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:49.851845  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:49.856799  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 888) took 1571 ms. Trace:
I20260709 12:14:49.632022  9712 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.883881  5567 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:49.623618  9453 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.884264  5670 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:49.629962  9735 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.864037  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:49.656186  9731 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:50.028905  6326 raft_consensus.cc:1240] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:49.853175  9685 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.327s
I20260709 12:14:50.097116  9688 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:50.181252  5596 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
W20260709 12:14:50.178354  9743 log.cc:927] Time spent T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 12:14:50.181800  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.182466  5600 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:14:50.182997  6320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 889) took 1874 ms. Trace:
I20260709 12:14:50.183708  9460 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:49.853345  9630 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.331s
I20260709 12:14:50.184244  9460 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:49.833428  9573 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.352s
I20260709 12:14:50.185392  9460 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:49.859663  5716 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:49.934409  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.186828  9460 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:50.187222  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 327620us
I20260709 12:14:50.188089  9628 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:50.188827  5670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 735) took 2065 ms (client timeout 2229 ms). Trace:
W20260709 12:14:50.189181  5670 rpcz_store.cc:269] 0709 12:14:48.123312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.824598 (+1701286us) service_pool.cc:224] Handling call
0709 12:14:50.188771 (+364173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.189638  9628 consensus_queue.cc:1059] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:50.183640  5598 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
W20260709 12:14:49.884375  5675 rpcz_store.cc:269] 0709 12:14:48.393203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.808331 (+1415128us) service_pool.cc:224] Handling call
0709 12:14:49.828261 (+ 19930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.021257  5673 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:49.842446  9536 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:49.946399  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:50.179723  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:14:50.162883  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.198325  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 368916us
W20260709 12:14:49.931262  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 45421.2us
I20260709 12:14:50.190603  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:49.909655  6321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 887) took 1645 ms. Trace:
I20260709 12:14:49.964296  6323 rpcz_store.cc:276] 0709 12:14:48.285734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.838211 (+1552477us) service_pool.cc:224] Handling call
0709 12:14:49.856291 (+ 18080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:49.856476 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:49.856500 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:49.856538 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:49.856573 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.856623 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.856740 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.183313  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:50.201972  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 214326us
I20260709 12:14:50.203540  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:49.883167  5601 rpcz_store.cc:276] 0709 12:14:46.151209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.151343 (+   134us) service_pool.cc:224] Handling call
0709 12:14:46.151667 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:46.172923 (+ 21256us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:46.229040 (+ 56117us) log.cc:844] Serialized 14 byte log entry
0709 12:14:48.074329 (+1845289us) log.cc:844] Serialized 14 byte log entry
0709 12:14:48.078926 (+  4597us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:48.125408 (+ 46482us) log.cc:844] Serialized 52 byte log entry
0709 12:14:48.125652 (+   244us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:48.129280 (+  3628us) log.cc:844] Serialized 14 byte log entry
0709 12:14:48.129851 (+   571us) log.cc:844] Serialized 14 byte log entry
0709 12:14:49.637121 (+1507270us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b1800014500. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95b455 00007f44fda43060 00007f44fda55716 00007f44fda66287 00007f44fda66208
0709 12:14:49.650301 (+ 13180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.650384 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:49.650425 (+    41us) raft_consensus.cc:1685] finished
0709 12:14:49.650437 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.650569 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13200,"prepare.queue_time_us":273012,"prepare.run_cpu_time_us":167,"prepare.run_wall_time_us":9206,"raft.queue_time_us":45076,"raft.run_cpu_time_us":476,"raft.run_wall_time_us":45558,"spinlock_wait_cycles":64361728,"thread_start_us":1698981,"threads_started":3,"wal-append.queue_time_us":1177117}
I20260709 12:14:50.218466  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.218617  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.219094  5601 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:50.219400  5603 raft_consensus.cc:2393] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:50.220029  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:50.220219  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.187158  9683 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:50.203200  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.190532  9631 raft_consensus.cc:3055] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:49.858537  9744 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.353s
I20260709 12:14:49.892177  9534 consensus_queue.cc:1059] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.320s
I20260709 12:14:50.212159  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.199651  9582 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:50.048033  9693 consensus_meta.cc:287] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 1.603s	user 0.010s	sys 0.000s
W20260709 12:14:50.085392  9742 log.cc:927] Time spent T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 12:14:50.205442  5718 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:49.908773  9715 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:50.198686  5596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 2223) took 1676 ms (client timeout 2205 ms). Trace:
I20260709 12:14:50.216603  5670 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:50.238175  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1603) took 1812 ms. Trace:
I20260709 12:14:50.238435  5670 rpcz_store.cc:276] 0709 12:14:48.425799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.190368 (+1764569us) service_pool.cc:224] Handling call
0709 12:14:50.238130 (+ 47762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.202715  6320 rpcz_store.cc:276] 0709 12:14:48.309091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.182141 (+1873050us) service_pool.cc:224] Handling call
0709 12:14:50.182435 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.182614 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:50.182641 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:50.182684 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:50.182720 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.182771 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.182939 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:50.204568  6291 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.003s	sys 0.007s
I20260709 12:14:50.222218  5679 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:50.144702  9691 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:50.198134  5678 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.217334  6321 rpcz_store.cc:276] 0709 12:14:48.264699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.842087 (+1577388us) service_pool.cc:224] Handling call
0709 12:14:49.842412 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:49.909243 (+ 66831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:49.909279 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:49.909330 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:49.909368 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.909445 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.909591 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66661,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":24656}
I20260709 12:14:50.223803  5642 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:50.267616  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:50.222223  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.269214  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:50.226859  9453 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:50.269948  5601 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:50.114616  9638 consensus_queue.cc:260] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:50.214344  9695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.007s	sys 0.006s
I20260709 12:14:50.221112  9295 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.856627  9713 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:49.843263  9279 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:50.276296  9695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.007s	sys 0.006s
I20260709 12:14:50.276670  9727 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:50.235543  9660 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:50.237854  9683 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:49.883750  9747 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:50.119979  9717 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:50.186213  9651 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:50.203668  9644 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:49.835974  9561 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:50.230243  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.295644  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:50.296380  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.297109  5597 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:50.297971  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.298120  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:50.298632  5597 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:50.298807  6325 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:50.299386  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.300416  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.215900  9564 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:50.224310  9728 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.300891  6325 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:50.277631  9691 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:50.270202  9413 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:50.301518  9728 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:50.303256  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2272) took 2184 ms. Trace:
I20260709 12:14:50.181377  9688 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:50.237622  5570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.011s	sys 0.015s
W20260709 12:14:50.304869  5570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.012s	sys 0.015s
I20260709 12:14:50.303877  5599 rpcz_store.cc:276] 0709 12:14:48.119356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.119473 (+   117us) service_pool.cc:224] Handling call
0709 12:14:48.139845 (+ 20372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:48.342340 (+202495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.342373 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:48.349516 (+  7143us) log.cc:844] Serialized 26 byte log entry
0709 12:14:49.532356 (+1182840us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:49.532387 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.532446 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:50.303051 (+770605us) raft_consensus.cc:1685] finished
0709 12:14:50.303073 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.303195 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5497,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47,"thread_start_us":442877,"threads_started":2,"wal-append.queue_time_us":1196118}
W20260709 12:14:50.305193  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 699758us
I20260709 12:14:50.305534  5675 raft_consensus.cc:2410] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:14:50.306231  9747 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.224759  9631 raft_consensus.cc:740] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:50.237510  5596 rpcz_store.cc:269] 0709 12:14:48.522395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.627626 (+1105231us) service_pool.cc:224] Handling call
0709 12:14:50.198633 (+571007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.201990  9597 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:50.272743  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:50.239327  9677 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:50.270853  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:50.288429  5752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1618) took 2998 ms (client timeout 3579 ms). Trace:
I20260709 12:14:50.280441  9295 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:50.284169  9727 raft_consensus.cc:697] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:50.322521  5752 rpcz_store.cc:269] 0709 12:14:47.290262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.041654 (+751392us) service_pool.cc:224] Handling call
0709 12:14:50.288210 (+2246556us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b54003633d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:50.288354 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4911402880}
I20260709 12:14:50.282819  9672 raft_consensus.cc:3055] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:50.293149  9720 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:50.378101  5603 raft_consensus.cc:2410] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:50.280350  9638 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.428509  5600 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:50.301862  9564 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:50.306085  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:50.445971  9564 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:50.447539  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2222) took 1925 ms. Trace:
I20260709 12:14:50.447948  5599 rpcz_store.cc:276] 0709 12:14:48.522107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.446672 (+1924565us) service_pool.cc:224] Handling call
0709 12:14:50.447029 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.447218 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:50.447242 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:50.447284 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:50.447319 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.447369 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.447481 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.449362  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2282) took 2718 ms. Trace:
I20260709 12:14:50.449612  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2224) took 1927 ms. Trace:
I20260709 12:14:50.450057  5599 rpcz_store.cc:276] 0709 12:14:48.522623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.448832 (+1926209us) service_pool.cc:224] Handling call
0709 12:14:50.449149 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.449316 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:50.449340 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:50.449379 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:50.449419 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.449467 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.449562 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.451859  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2227) took 1928 ms. Trace:
I20260709 12:14:50.452186  5599 rpcz_store.cc:276] 0709 12:14:48.523352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.450949 (+1927597us) service_pool.cc:224] Handling call
0709 12:14:50.451247 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.451556 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:50.451585 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:50.451625 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:50.451653 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.451706 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.451811 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:50.239391  6291 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.003s	sys 0.007s
W20260709 12:14:50.454115  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 851952us
I20260709 12:14:50.309126  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:50.455765  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2228) took 1897 ms. Trace:
I20260709 12:14:50.300913  5597 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:49.908090  9609 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:50.316982  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1600) took 1949 ms. Trace:
I20260709 12:14:50.236871  9693 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:50.354588  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 87023.5us
I20260709 12:14:50.469498  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:50.472617  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:50.312665  9754 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:14:50.359236  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.353211  9295 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.475320  6293 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:50.431993  9688 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:50.306124  9691 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:50.442864  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.482372  5676 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:50.358668  9672 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:50.456180  5599 rpcz_store.cc:276] 0709 12:14:48.556636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.453010 (+1896374us) service_pool.cc:224] Handling call
0709 12:14:50.453288 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.453466 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:50.453490 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:50.453528 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:50.453564 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.453618 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.453706 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.450148  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 685) took 2235 ms. Trace:
I20260709 12:14:50.457983  5671 rpcz_store.cc:276] 0709 12:14:47.731343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.842755 (+111412us) service_pool.cc:224] Handling call
0709 12:14:47.843063 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.443630 (+600567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.443657 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:48.443699 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:48.443732 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.449124 (+2005392us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b540029bdd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:50.449173 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.449296 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380632960}
I20260709 12:14:50.266285  9715 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:50.456699  5670 rpcz_store.cc:276] 0709 12:14:48.367348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.272570 (+1905222us) service_pool.cc:224] Handling call
0709 12:14:50.316902 (+ 44332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.453619  5678 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:50.377753  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.476254  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:50.476449  6293 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:50.474720  5596 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
I20260709 12:14:50.480331  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:50.474120  9720 consensus_queue.cc:1059] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.007s
W20260709 12:14:50.481242  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.482872  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1608) took 1526 ms. Trace:
I20260709 12:14:50.444550  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.470934  9660 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.512495  9758 consensus_queue.cc:1059] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:14:50.516534  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.512641  9534 consensus_queue.cc:1059] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:14:50.518216  9688 raft_consensus.cc:3055] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:50.518378  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 768) took 2819 ms. Trace:
I20260709 12:14:50.518608  9688 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:50.518985  9628 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.519712  9695 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:50.519462  9688 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:50.520507  9715 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:50.520234  9695 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:50.520673  9688 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:50.518818  6326 rpcz_store.cc:276] 0709 12:14:47.699397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.701004 (+  1607us) service_pool.cc:224] Handling call
0709 12:14:47.701320 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.179975 (+2478655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.518174 (+338199us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b54006be4d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:50.518325 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5352455424}
I20260709 12:14:50.521885  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1610) took 1284 ms. Trace:
I20260709 12:14:50.522091  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:50.522619  9695 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:50.517771  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.524274  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.523917  5670 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:50.525473  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.525923  9660 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:50.526831  9700 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:50.527185  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.527981  9660 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:50.525462  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.529235  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.529130  6327 rpcz_store.cc:276] 0709 12:14:48.214336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.217323 (+  2987us) service_pool.cc:224] Handling call
0709 12:14:48.307279 (+ 89956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.514950 (+207671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.449986 (+1935036us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b5400538ed0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:50.450097 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111344000}
I20260709 12:14:50.485221  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:50.530180  5747 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:50.530359  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.531883  5678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1609) took 1441 ms (client timeout 1725 ms). Trace:
I20260709 12:14:50.532975  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.516253  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:50.533716  5745 raft_consensus.cc:2393] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 11: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:50.531554  5676 rpcz_store.cc:276] 0709 12:14:48.956979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.442563 (+1485584us) service_pool.cc:224] Handling call
0709 12:14:50.482785 (+ 40222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:50.529024  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 52646us
I20260709 12:14:50.535043  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.516228  5677 raft_consensus.cc:2410] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:50.535772  5675 rpcz_store.cc:276] 0709 12:14:49.237549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.211873 (+974324us) service_pool.cc:224] Handling call
0709 12:14:50.521659 (+309786us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b5400367754. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:50.521811 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176523520}
I20260709 12:14:50.536494  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.537119  5675 raft_consensus.cc:1240] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:50.537737  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2286) took 2339 ms. Trace:
I20260709 12:14:50.538151  5675 rpcz_store.cc:276] 0709 12:14:48.198425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.536642 (+2338217us) service_pool.cc:224] Handling call
0709 12:14:50.536945 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.537515 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.537686 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:50.486155  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 270449us
I20260709 12:14:50.541275  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:50.542269  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 2285) took 2344 ms. Trace:
I20260709 12:14:50.545428  5677 rpcz_store.cc:276] 0709 12:14:48.198219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.444252 (+2246033us) service_pool.cc:224] Handling call
0709 12:14:50.542203 (+ 97951us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:50.532262  5678 rpcz_store.cc:269] 0709 12:14:49.090492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.835365 (+744873us) service_pool.cc:224] Handling call
0709 12:14:50.531778 (+696413us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.531582  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:50.548826  5747 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:50.543277  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.528667  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:50.550350  5750 raft_consensus.cc:2376] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9. Re-sending same reply.
I20260709 12:14:50.478874  9295 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:50.486748  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 281227us
I20260709 12:14:50.474709  9703 consensus_queue.cc:1059] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 12:14:50.543782  9631 consensus_queue.cc:260] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:50.735785  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:50.736063  9609 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:50.736277  9631 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.735145  9731 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:50.738895  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:50.740562  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.738938  5718 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:50.743290  9204 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:50.734715  9536 consensus_meta.cc:287] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 12:14:50.743755  9204 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.744521  9204 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.744300  9536 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:50.569473  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.746595  9536 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:50.551002  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.747290  9672 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:50.749332  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.749946  5677 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:14:50.750789  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.752765  5678 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:50.751317  5677 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
W20260709 12:14:50.702193  5602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 542) took 2758 ms (client timeout 1673 ms). Trace:
W20260709 12:14:50.754680  5602 rpcz_store.cc:269] 0709 12:14:47.841478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.844668 (+  3190us) service_pool.cc:224] Handling call
0709 12:14:50.599521 (+2754853us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540009ecd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:50.599618 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699979520}
W20260709 12:14:50.716653  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 53551.9us
W20260709 12:14:50.681627  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.763260  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.763656  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.764451  5642 connection.cc:256] RPC call timeout handler was delayed by -1.2672032130001298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 12:14:50.487526  9691 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:50.481721  9692 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:50.766484  5602 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:50.768492  9760 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:50.771450  6324 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:14:50.769547  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.589949  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1601) took 2216 ms. Trace:
I20260709 12:14:50.758437  9672 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.762773  6293 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:50.586706  5598 raft_consensus.cc:2410] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:50.583848  5599 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:50.598284  5679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 738) took 2230 ms (client timeout 2107 ms). Trace:
W20260709 12:14:50.785113  5642 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.698s (SENT) [suppressed 34 similar messages]
I20260709 12:14:50.599086  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2283) took 2864 ms. Trace:
I20260709 12:14:50.785997  6293 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:50.786290  5673 rpcz_store.cc:276] 0709 12:14:47.734274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.101312 (+367038us) service_pool.cc:224] Handling call
0709 12:14:48.101604 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.199571 (+2097967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.598850 (+399279us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400447fd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:50.599029 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4414297856}
W20260709 12:14:50.788666  5679 rpcz_store.cc:269] 0709 12:14:48.367992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.830615 (+1462623us) service_pool.cc:224] Handling call
0709 12:14:50.598067 (+767452us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b54001e3a54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:50.598198 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55410048}
I20260709 12:14:50.790596  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:50.720759  9335 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:50.772718  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:50.771092  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.776800  5677 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:50.525543  9735 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:50.782619  5676 rpcz_store.cc:276] 0709 12:14:48.373273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.544328 (+2171055us) service_pool.cc:224] Handling call
0709 12:14:50.589370 (+ 45042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.589561 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:50.589588 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:50.589632 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:50.589662 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.589710 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.589874 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.791356  5679 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:50.772507  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 737) took 2640 ms. Trace:
I20260709 12:14:50.789604  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 556) took 1162 ms. Trace:
I20260709 12:14:50.557456  9660 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:50.799953  6320 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:50.799724  5599 rpcz_store.cc:276] 0709 12:14:49.621519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.583421 (+961902us) service_pool.cc:224] Handling call
0709 12:14:50.583679 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.783962 (+200283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.784152 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.800753  6293 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:50.772094  9534 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.800074  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.797435  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.802022  5673 raft_consensus.cc:2393] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:50.798056  5746 raft_consensus.cc:2393] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:50.802392  5677 raft_consensus.cc:2393] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:50.799017  5716 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:50.796211  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.777212  9692 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:50.801182  5672 rpcz_store.cc:276] 0709 12:14:48.131900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.454622 (+2322722us) service_pool.cc:224] Handling call
0709 12:14:50.454878 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.455074 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:50.455373 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 12:14:50.772202 (+316829us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:50.772252 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:50.772296 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.772353 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.772456 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9195,"prepare.queue_time_us":565,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":19279,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":9724,"thread_start_us":307262,"threads_started":1}
I20260709 12:14:50.792719  9700 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:50.789137  9703 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:50.519474  9628 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:50.808925  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.810570  5718 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:50.808925  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.814267  5716 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:50.815191  5716 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:50.801719  9660 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:50.806013  9692 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:50.790657  9747 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:50.825095  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.787262  9760 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:50.812247  9700 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:50.827860  9335 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:50.822455  9414 consensus_queue.cc:1059] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:14:50.882776  9414 raft_consensus.cc:3055] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:50.883196  9414 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:50.884155  9414 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:50.885434  9414 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:50.892010  9639 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:50.892526  9639 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:50.892882  9639 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:50.895380  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.896071  5677 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:50.897001  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:50.901093  5569 connection.cc:256] RPC call timeout handler was delayed by -2.5934414199998628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 12:14:50.856015  9564 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:50.856994  9693 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:50.857486  9762 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:50.828593  9695 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:50.807260  9534 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:50.860389  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2277) took 3188 ms. Trace:
I20260709 12:14:50.805199  9764 consensus_queue.cc:1059] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:14:50.822569  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.947614  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.948768  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.546746  9727 consensus_queue.cc:237] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:50.868963  5679 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:50.950577  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.951748  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.952729  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:50.811831  9703 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:50.953521  9703 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:50.873122  9335 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.901873  5752 raft_consensus.cc:2410] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:50.854295  9713 raft_consensus.cc:3055] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:50.906339  9597 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:50.907724  9204 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:50.897531  5677 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 7.
W20260709 12:14:50.914812  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 558) took 1269 ms (client timeout 1681 ms). Trace:
W20260709 12:14:50.960412  5600 rpcz_store.cc:269] 0709 12:14:49.645200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.183105 (+537905us) service_pool.cc:224] Handling call
0709 12:14:50.914654 (+731549us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54002ff154. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:50.914756 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468902272}
I20260709 12:14:50.824550  9733 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:50.962960  9733 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.963348  9733 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:50.967869  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.969157  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.909942  9760 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:50.918615  5569 connection.cc:256] RPC call timeout handler was delayed by -2.4512414199998602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 12:14:50.970451  5569 connection.cc:256] RPC call timeout handler was delayed by -2.3972414199997729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 12:14:50.970777  5569 connection.cc:256] RPC call timeout handler was delayed by -1.9346414199997071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24209999999999998s for a response
W20260709 12:14:50.971127  5569 connection.cc:256] RPC call timeout handler was delayed by -1.3325414199998704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.309s for a response
I20260709 12:14:50.919866  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2209) took 5027 ms. Trace:
I20260709 12:14:50.971553  5595 rpcz_store.cc:276] 0709 12:14:45.886712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.905596 (+ 18884us) service_pool.cc:224] Handling call
0709 12:14:45.905924 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:45.906296 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:45.906558 (+   262us) log.cc:844] Serialized 14 byte log entry
0709 12:14:47.059643 (+1153085us) log.cc:844] Serialized 14 byte log entry
0709 12:14:47.074084 (+ 14441us) log.cc:844] Serialized 14 byte log entry
0709 12:14:47.074244 (+   160us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:47.074803 (+   559us) log.cc:844] Serialized 52 byte log entry
0709 12:14:47.074946 (+   143us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:47.083232 (+  8286us) log.cc:844] Serialized 14 byte log entry
0709 12:14:47.084339 (+  1107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.084411 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:47.832822 (+748411us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b1800393400. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e522 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:47.860349 (+ 27527us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b1800393400. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e522 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:47.896378 (+ 36029us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b1800393400. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e522 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:47.900679 (+  4301us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b1800393400. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa92c2a6 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1
0709 12:14:47.901157 (+   478us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b1800393400. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:48.290001 (+388844us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b1800393400. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa92c2a6 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1
0709 12:14:50.902681 (+2612680us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b1800393400. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:50.913857 (+ 11176us) raft_consensus.cc:1685] finished
0709 12:14:50.913879 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.914021 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274860,"prepare.queue_time_us":1706884,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":8471,"raft.queue_time_us":50866,"raft.run_cpu_time_us":526,"raft.run_wall_time_us":88703,"spinlock_wait_cycles":273869696,"thread_start_us":488524,"threads_started":3,"wal-append.queue_time_us":497658}
I20260709 12:14:50.826251  9660 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.859136  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.974355  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.974545  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.975000  5748 raft_consensus.cc:2376] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11. Re-sending same reply.
I20260709 12:14:50.975673  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.975927  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.976598  5748 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:50.979494  9573 raft_consensus.cc:3055] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:50.942106  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.943950  5674 rpcz_store.cc:276] 0709 12:14:47.672287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.727298 (+ 55011us) service_pool.cc:224] Handling call
0709 12:14:47.727565 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.198292 (+2470727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.860117 (+661825us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b540037a5d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:50.860319 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4843214592}
I20260709 12:14:50.875666  9482 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:14:50.876168  9700 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:50.971386  5569 connection.cc:256] RPC call timeout handler was delayed by -1.1865633439999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
I20260709 12:14:50.983727  9712 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:50.985371  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.986370  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.986495  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.986702  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.987129  5674 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:50.987943  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.988462  5674 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:14:50.988897  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:50.990455  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.991498  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.992447  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.992836  9204 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:50.994345  9766 raft_consensus.cc:3055] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:50.994887  9766 raft_consensus.cc:740] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:50.995836  9766 consensus_queue.cc:260] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:50.956420  5679 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.993672  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:50.957136  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:50.971328  5598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 2226) took 2448 ms (client timeout 2918 ms). Trace:
I20260709 12:14:50.960899  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:51.000614  5598 rpcz_store.cc:269] 0709 12:14:48.523106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.204222 (+1681116us) service_pool.cc:224] Handling call
0709 12:14:50.971136 (+766914us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54001acf54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:50.971265 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841027328}
I20260709 12:14:50.997951  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.002521  6321 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:14:51.003535  5676 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:51.004774  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:51.005396  5676 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:51.006403  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:51.006667  5673 raft_consensus.cc:2410] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:14:50.980158  5596 raft_consensus.cc:1240] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:51.000090  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:50.999801  5672 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 12: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:50.977442  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.008355  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:50.979934  9573 raft_consensus.cc:740] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:50.989194  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:51.010720  6323 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:51.013029  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.011348  5677 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:14:50.998409  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:50.993463  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.022729  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.027575  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.028992  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:51.030082  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:51.030236  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.030903  5750 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:51.031349  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.031733  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:51.031983  5748 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:51.032625  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:51.032879  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.033510  5748 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:51.033607  6326 raft_consensus.cc:1240] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:14:51.034366  9767 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:14:51.034724  6327 raft_consensus.cc:2368] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8.
I20260709 12:14:51.035125  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:51.036375  9534 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.037114  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.037936  5748 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:50.959946  9713 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:51.038978  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:51.039722  5748 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:51.039542  9713 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:51.040618  9713 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:51.036281  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.041750  5598 raft_consensus.cc:2393] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:51.042740  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.943435  9747 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.044327  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:50.997463  9766 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.962074  9335 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.046295  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.048617  9728 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:51.049036  9295 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:51.035789  9692 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:51.030850  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.043105  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1616) took 3761 ms. Trace:
I20260709 12:14:51.147526  5753 rpcz_store.cc:276] 0709 12:14:47.281297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.253617 (+972320us) service_pool.cc:224] Handling call
0709 12:14:48.490467 (+236850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.490639 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.490662 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:48.490697 (+    35us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:48.490724 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.490769 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.042932 (+2552163us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54003638d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:51.043025 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523742080}
I20260709 12:14:51.098449  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.044588  9564 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.121833  5598 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:51.099346  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 298635us
I20260709 12:14:51.152998  6293 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:51.125626  5748 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:14:51.127050  5595 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:51.126832  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.156581  6323 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:51.158062  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:51.130378  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.130970  5672 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:51.131175  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 545) took 1512 ms. Trace:
I20260709 12:14:51.130965  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:14:51.131731  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 346613us
I20260709 12:14:51.043114  9628 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:51.145138  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.030467  5673 raft_consensus.cc:1240] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:51.162496  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1606) took 2395 ms. Trace:
I20260709 12:14:51.151116  5745 raft_consensus.cc:2393] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:14:51.129860  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 319362us
I20260709 12:14:51.149950  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1607) took 2364 ms. Trace:
I20260709 12:14:51.158782  5595 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:14:51.165956  5673 rpcz_store.cc:276] 0709 12:14:48.766677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.029962 (+2263285us) service_pool.cc:224] Handling call
0709 12:14:51.030299 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.162253 (+131954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.162440 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.166484  5676 rpcz_store.cc:276] 0709 12:14:48.785175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.077975 (+2292800us) service_pool.cc:224] Handling call
0709 12:14:51.149465 (+ 71490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.149654 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.149676 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:51.149714 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:51.149742 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.149806 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.149895 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.184111  5748 raft_consensus.cc:1240] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:51.184540  5679 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:51.185674  5747 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:14:51.196307  5747 pending_rounds.cc:85] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 7
I20260709 12:14:51.196588  5747 pending_rounds.cc:107] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:14:51.196820  5747 raft_consensus.cc:2889] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:51.192965  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:51.206984  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 381934us
I20260709 12:14:51.162894  5597 rpcz_store.cc:276] 0709 12:14:49.618766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.471527 (+852761us) service_pool.cc:224] Handling call
0709 12:14:50.471810 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.472013 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:50.808737 (+336724us) log.cc:844] Serialized 14 byte log entry
0709 12:14:51.130828 (+322091us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:51.130877 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:51.130923 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.131007 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.131122 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":480334,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":91,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":18903,"thread_start_us":658154,"threads_started":2}
I20260709 12:14:51.210742  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.209491  5676 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:14:51.212610  5676 pending_rounds.cc:85] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 8
I20260709 12:14:51.212740  5670 raft_consensus.cc:1240] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:14:51.213063  5676 pending_rounds.cc:107] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:14:51.213410  5676 raft_consensus.cc:2889] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:51.197044  6293 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:51.213274  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2221) took 2691 ms. Trace:
I20260709 12:14:51.218389  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.222393  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:51.230778  5673 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:14:51.231264  5673 pending_rounds.cc:85] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 6
I20260709 12:14:51.231490  5673 pending_rounds.cc:107] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:14:51.231732  5673 raft_consensus.cc:2889] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:51.233585  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.234899  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.235961  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.237280  5753 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:51.237999  9691 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:51.240190  9691 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.243323  9703 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:51.253357  9692 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:51.254675  9692 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:51.262421  9747 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:51.264205  9295 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.186579  9693 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:51.268689  9758 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:51.269356  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 47078us
I20260709 12:14:51.298309  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:51.271551  5675 raft_consensus.cc:1240] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:51.272286  9573 consensus_queue.cc:260] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:51.276597  9639 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:51.280797  5718 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:51.282524  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:51.293604  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.295797  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.306478  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:51.245595  9703 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.310166  5597 raft_consensus.cc:2376] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12. Re-sending same reply.
I20260709 12:14:51.315718  5718 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:51.305054  5747 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:51.309827  5595 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
W20260709 12:14:51.324880  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.320994  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:51.342969  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.344724  5595 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
W20260709 12:14:51.315074  9672 consensus_meta.cc:287] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.001s
I20260709 12:14:51.295424  9693 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:51.314558  9106 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:51.289355  9733 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:51.300125  9747 raft_consensus.cc:697] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:51.353844  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2238) took 1074 ms. Trace:
I20260709 12:14:51.383224  5599 rpcz_store.cc:276] 0709 12:14:50.279640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.801048 (+521408us) service_pool.cc:224] Handling call
0709 12:14:50.809663 (+  8615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.809869 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:51.129180 (+319311us) log.cc:844] Serialized 14 byte log entry
0709 12:14:51.353417 (+224237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:51.353489 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:51.353538 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.353609 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.353752 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142720,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":222,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3886,"thread_start_us":528849,"threads_started":2}
I20260709 12:14:51.337865  9721 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:51.325400  9631 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:51.352998  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 156058us
I20260709 12:14:51.387562  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.326217  9636 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:51.374897  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.360801  5744 raft_consensus.cc:2410] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:14:51.388202  5599 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 7.
I20260709 12:14:51.346714  9720 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:51.360000  9693 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:51.404383  9639 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.313597  9758 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:51.412693  6291 connection.cc:256] RPC call timeout handler was delayed by -1.3644964260001871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 12:14:51.413184  6291 connection.cc:256] RPC call timeout handler was delayed by -1.3644964260001871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 12:14:51.413477  6291 connection.cc:256] RPC call timeout handler was delayed by -1.2510964260000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 12:14:51.416261  6291 connection.cc:256] RPC call timeout handler was delayed by -1.2411964260002151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 12:14:51.418190  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:51.418731  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.419083  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.423192  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.421475  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:51.427448  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.387351  9721 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.431053  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.431915  5599 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 12: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:51.433193  5597 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:14:51.441445  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.445242  5598 pending_rounds.cc:85] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 8
I20260709 12:14:51.445657  5598 pending_rounds.cc:107] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:14:51.445969  5598 raft_consensus.cc:2889] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:51.447003  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:51.448179  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.448061  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:51.450366  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:51.450906  5745 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:51.440642  9721 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:51.454696  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:51.457422  5750 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.408174  9720 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:51.470427  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:51.446380  9700 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:51.478564  5745 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:51.482195  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.441516  9660 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:51.483052  5595 raft_consensus.cc:2410] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:14:51.457042  9335 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:51.480612  5750 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:51.486856  5749 raft_consensus.cc:2368] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9.
W20260709 12:14:51.493340  9780 log.cc:927] Time spent T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:14:51.493697  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:51.494901  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:51.495625  5595 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:51.496099  9414 consensus_meta.cc:287] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.000s
I20260709 12:14:51.496315  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:51.499594  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1604) took 2954 ms. Trace:
I20260709 12:14:51.499982  5678 rpcz_store.cc:276] 0709 12:14:48.545707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.569799 (+2024092us) service_pool.cc:224] Handling call
0709 12:14:50.706560 (+136761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.753170 (+ 46610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.499396 (+746226us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b54001b7e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:51.499544 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105818496}
I20260709 12:14:51.501008  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:51.501502  5678 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:51.501988  9758 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.456128  9747 consensus_queue.cc:237] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:51.214494  5603 rpcz_store.cc:276] 0709 12:14:48.521823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.433905 (+1912082us) service_pool.cc:224] Handling call
0709 12:14:50.434217 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.434407 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:50.765656 (+331249us) log.cc:844] Serialized 14 byte log entry
0709 12:14:51.050074 (+284418us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b1800011fe0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:51.212892 (+162818us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:51.212988 (+    96us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:51.213040 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.213103 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.213220 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":329517,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":29638,"spinlock_wait_cycles":11294464,"thread_start_us":710942,"threads_started":2}
I20260709 12:14:51.513244  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:51.515115  9582 raft_consensus.cc:3055] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:51.515599  9582 raft_consensus.cc:740] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:51.516426  9582 consensus_queue.cc:260] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:51.517508  9582 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:51.518299  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:51.556883  5677 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:51.522599  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2273) took 3402 ms. Trace:
W20260709 12:14:51.524200  9773 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:14:51.525149  9775 log.cc:927] Time spent T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:14:51.531339  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:51.538045  5718 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:51.560153  5604 rpcz_store.cc:276] 0709 12:14:48.119764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.119869 (+   105us) service_pool.cc:224] Handling call
0709 12:14:48.141267 (+ 21398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:48.348964 (+207697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.348998 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:48.358881 (+  9883us) log.cc:844] Serialized 26 byte log entry
0709 12:14:49.532071 (+1173190us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:49.532104 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.522137 (+1990033us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540009e2d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:51.522194 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:51.522248 (+    54us) raft_consensus.cc:1685] finished
0709 12:14:51.522262 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.522527 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477008256,"thread_start_us":289543,"threads_started":1,"wal-append.queue_time_us":1199455,"wal-append.run_cpu_time_us":2876,"wal-append.run_wall_time_us":1572551}
I20260709 12:14:51.529505  9561 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:51.542917  9658 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.546561  5670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1597) took 3188 ms. Trace:
W20260709 12:14:51.550118  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:51.553572  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.516317  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1605) took 2910 ms. Trace:
I20260709 12:14:51.474989  9204 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:14:51.539716  9700 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.569334  5670 rpcz_store.cc:276] 0709 12:14:48.358166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.539433 (+2181267us) service_pool.cc:224] Handling call
0709 12:14:50.539714 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.213264 (+673550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.546259 (+332995us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400355cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:51.546477 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547249920}
I20260709 12:14:51.600739  5718 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:51.611820  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:51.612448  5670 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:14:51.574471  5675 rpcz_store.cc:276] 0709 12:14:48.605809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.550165 (+1944356us) service_pool.cc:224] Handling call
0709 12:14:50.550509 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.299036 (+748527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.516056 (+217020us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400447ad4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:51.516251 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657727360}
I20260709 12:14:51.613803  5677 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:14:51.568439  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:51.614867  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:51.615489  5674 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 12: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:51.614643  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:51.604046  5645 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:51.616228  6293 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:51.638738  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 766) took 3957 ms. Trace:
I20260709 12:14:51.615688  5677 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 13: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:51.639168  6322 rpcz_store.cc:276] 0709 12:14:47.681932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.682277 (+   345us) service_pool.cc:224] Handling call
0709 12:14:47.705632 (+ 23355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.343470 (+637838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.343506 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:48.343567 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:48.343600 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.915327 (+2571727us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b18003c9460. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa92c2a6 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419
0709 12:14:51.638499 (+723172us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54001c8ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:51.638548 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.638682 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4278,"raft.queue_time_us":3441,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4417,"spinlock_wait_cycles":1451341952}
W20260709 12:14:51.568737  9782 log.cc:927] Time spent T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:14:51.654716  5718 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:51.567423  9713 consensus_meta.cc:287] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.002s
I20260709 12:14:51.616153  9295 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.656533  6319 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:14:51.602298  9727 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:51.656901  9295 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:51.659198  9295 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.661518  5674 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:51.638414  9758 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:51.616473  9414 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:51.633184  5678 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:51.571079  9306 raft_consensus.cc:3055] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:51.606117  9204 consensus_queue.cc:1243] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:51.666270  5670 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:51.570531  9720 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:51.616674  9564 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.655601  9561 consensus_queue.cc:1059] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:14:51.684687  9660 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:51.675277  5678 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:51.650844  9700 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:14:51.671993  9775 log.cc:927] Time spent T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:51.673542  6293 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:51.666213  9758 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:51.640192  9461 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:14:51.638054  9672 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:14:51.822211  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:51.742465  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:51.783438  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.671851  9295 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:14:51.841423  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.738814  9631 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.681607  9414 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:51.696352  9564 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:51.843395  9700 raft_consensus.cc:697] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:14:51.863413  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.855720  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2296) took 1086 ms. Trace:
I20260709 12:14:51.865891  5672 rpcz_store.cc:276] 0709 12:14:50.768996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.188570 (+419574us) service_pool.cc:224] Handling call
0709 12:14:51.210130 (+ 21560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.210342 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:51.484754 (+274412us) log.cc:844] Serialized 14 byte log entry
0709 12:14:51.855347 (+370593us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:51.855404 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:51.855457 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.855525 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.855660 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77426,"prepare.queue_time_us":315452,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":88,"thread_start_us":557303,"threads_started":2}
W20260709 12:14:51.859081  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 185606us
I20260709 12:14:51.681586  9306 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:51.852696  9660 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:51.856592  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2300) took 1078 ms. Trace:
I20260709 12:14:51.880482  5673 rpcz_store.cc:276] 0709 12:14:50.778381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.232672 (+454291us) service_pool.cc:224] Handling call
0709 12:14:51.232972 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.233164 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:51.438514 (+205350us) log.cc:844] Serialized 14 byte log entry
0709 12:14:51.856246 (+417732us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:51.856297 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:51.856351 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.856421 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.856535 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67687,"prepare.queue_time_us":292850,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":1154,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":10063,"thread_start_us":522208,"threads_started":2}
W20260709 12:14:51.878343  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 461551us
W20260709 12:14:51.885363  6291 connection.cc:256] RPC call timeout handler was delayed by -1.0071964260000641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
I20260709 12:14:51.892297  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2299) took 1114 ms. Trace:
I20260709 12:14:51.892820  5679 rpcz_store.cc:276] 0709 12:14:50.778127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.198436 (+420309us) service_pool.cc:224] Handling call
0709 12:14:51.198766 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.198994 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:14:51.464307 (+265313us) log.cc:844] Serialized 14 byte log entry
0709 12:14:51.891870 (+427563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:51.891932 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:51.891989 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.892067 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.892231 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83,"prepare.queue_time_us":326540,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":590026,"threads_started":2}
W20260709 12:14:51.895259  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 402476us
I20260709 12:14:51.896369  5569 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:51.898445  5569 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:51.903625  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:51.916744  6322 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:51.923383  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:51.916798  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.924609  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.921274  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.925696  6326 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 11: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:51.925925  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.926219  6320 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:51.926811  6328 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
W20260709 12:14:51.928043  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 324036us
W20260709 12:14:51.928856  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.928936  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.930843  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.929992  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.942039  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.929065  5645 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:51.934602  6326 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:51.943809  6328 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:14:51.930074  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:51.931900  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:51.946273  6327 raft_consensus.cc:2376] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11. Re-sending same reply.
I20260709 12:14:51.927423  6322 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:14:51.945322  6320 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:51.945194  6325 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
W20260709 12:14:51.948936  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 308956us
W20260709 12:14:51.949051  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 294447us
I20260709 12:14:51.914376  9660 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:51.955945  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 741) took 3415 ms. Trace:
I20260709 12:14:51.956302  5672 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:14:51.954906  5679 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:14:51.956660  5719 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:51.956342  5671 rpcz_store.cc:276] 0709 12:14:48.540251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.569021 (+2028770us) service_pool.cc:224] Handling call
0709 12:14:50.581184 (+ 12163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:50.764657 (+183473us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:14:50.789036 (+ 24379us) log.cc:844] Serialized 14 byte log entry
0709 12:14:51.132593 (+343557us) log.cc:844] Serialized 14 byte log entry
0709 12:14:51.161196 (+ 28603us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:51.161674 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 12:14:51.164615 (+  2941us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:51.164649 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.164716 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:51.526783 (+362067us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b18004007e0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:14:51.955691 (+428908us) raft_consensus.cc:1685] finished
0709 12:14:51.955721 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.955875 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":279549,"prepare.queue_time_us":422681,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":245763,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":60223,"spinlock_wait_cycles":3635968,"thread_start_us":316281,"threads_started":1,"wal-append.queue_time_us":553069}
I20260709 12:14:51.929644  9771 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:51.949084  9582 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:51.971421  9766 consensus_queue.cc:1059] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:51.973268  9630 raft_consensus.cc:3055] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:51.973681  9630 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:51.976157  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.978511  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.980351  6326 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:51.982791  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:51.983492  6327 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:51.976166  9771 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:51.995229  9771 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:52.001087  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:52.001834  5603 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:52.006601  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:51.955590  9747 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:52.007220  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 75254.9us
I20260709 12:14:52.007298  5601 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:14:51.970444  9693 consensus_meta.cc:287] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 12:14:52.036439  6291 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:52.025600  5718 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:52.010315  5600 pending_rounds.cc:85] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 6
I20260709 12:14:52.044392  5600 pending_rounds.cc:107] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:14:52.044445  6291 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:52.044924  5600 raft_consensus.cc:2889] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:52.045841  6291 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:52.047669  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.016233  5603 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:51.962296  9414 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:52.050792  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 152454us
I20260709 12:14:52.058260  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:52.059912  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:52.065958  6328 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 12: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:51.974828  9658 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.975713  9582 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:52.034168  9802 raft_consensus.cc:3055] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:51.962157  9695 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 12:14:52.044046  9747 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:51.949260  9306 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.079282  9414 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.056574  9771 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:52.078310  9639 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:52.095624  9582 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:51.962836  9700 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:52.119814  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 74080.2us
I20260709 12:14:52.119429  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.094101  9802 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:52.122503  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:52.063227  9693 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.107587  9461 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:52.103104  9747 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:52.108768  9414 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:52.103910  9672 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.092720  9658 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.109018  9771 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:52.108335  9639 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:52.111435  9689 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:52.119117  9813 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:14:52.137502  9795 log.cc:927] Time spent T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:14:52.107306  9691 consensus_queue.cc:1059] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 12:14:52.141331  9796 log.cc:927] Time spent T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:14:52.104683  9660 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.133154  9672 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.143918  9672 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:52.142118  9797 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:14:52.144454  9658 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:52.132613  9771 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:52.151293  9573 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:52.152849  9747 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.153997  6320 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:52.155143  9564 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:52.155411  9733 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:52.124915  9758 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:52.158551  9306 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:52.163072  9799 log.cc:927] Time spent T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:14:52.135515  9798 log.cc:927] Time spent T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:14:52.131313  9787 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:52.169245  9787 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.169586  9787 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:52.165459  9335 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:52.082952  9630 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.134054  9639 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:52.186962  9721 consensus_meta.cc:287] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.000s
W20260709 12:14:52.191254  9815 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:14:52.187983  9721 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.200317  9721 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:52.174109  9771 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.195609  9787 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.203125  9747 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:52.204187  9787 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:52.204402  9771 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:52.063493  5569 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:52.260470  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:52.260592  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 197048us
I20260709 12:14:52.265861  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2240) took 1971 ms. Trace:
I20260709 12:14:52.266377  5602 rpcz_store.cc:276] 0709 12:14:50.294171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.814933 (+520762us) service_pool.cc:224] Handling call
0709 12:14:50.815237 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:50.815569 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:51.337089 (+521520us) log.cc:844] Serialized 14 byte log entry
0709 12:14:51.986322 (+649233us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.090481 (+104159us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:52.092317 (+  1836us) log.cc:844] Serialized 26 byte log entry
0709 12:14:52.092741 (+   424us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:52.264576 (+171835us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.265171 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.265326 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.265411 (+    85us) raft_consensus.cc:1685] finished
0709 12:14:52.265425 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.265654 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8326,"prepare.queue_time_us":199039,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":118,"raft.queue_time_us":264348,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":24280,"thread_start_us":1100768,"threads_started":4,"wal-append.queue_time_us":176311}
W20260709 12:14:52.268637  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.262420  5569 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:52.272145  5569 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:52.273581  5569 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:52.288039  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 1.53217e+06us
I20260709 12:14:52.286829  5498 catalog_manager.cc:5697] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 5 to 8, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 8 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:52.174007  6319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 690) took 3958 ms. Trace:
I20260709 12:14:52.194842  9693 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:52.157152  9414 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.315174  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.127027  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.316105  9817 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:52.334790  9414 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:52.335860  9820 raft_consensus.cc:2764] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:14:52.317946  6319 rpcz_store.cc:276] 0709 12:14:48.215746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.215965 (+   219us) service_pool.cc:224] Handling call
0709 12:14:51.653999 (+3438034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.656947 (+  2948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.173834 (+516887us) spinlock_profiling.cc:243] Waited 3.38 s on lock 0x7b54001c8ed0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:52.173952 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7777167616}
I20260709 12:14:52.319805  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.320513  9801 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:52.327212  9825 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:52.332582  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.338991  9801 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:52.341581  9801 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:52.341506  9825 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.344666  9825 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:52.345693  5745 raft_consensus.cc:2368] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10.
I20260709 12:14:52.346761  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.347642  5745 raft_consensus.cc:2393] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:52.348770  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.340624  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.350973  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.351553  5675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1617) took 1444 ms. Trace:
I20260709 12:14:52.351992  5675 rpcz_store.cc:276] 0709 12:14:50.907251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.639695 (+732444us) service_pool.cc:224] Handling call
0709 12:14:51.640048 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.640743 (+   695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.640786 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:51.641256 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:14:51.983653 (+342397us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:51.983695 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.983767 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.339019 (+355252us) raft_consensus.cc:1685] finished
0709 12:14:52.351119 (+ 12100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.351372 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":16644,"thread_start_us":149258,"threads_started":1,"wal-append.queue_time_us":431038}
W20260709 12:14:52.357060  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.359120  5748 raft_consensus.cc:1240] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:52.366214  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 240757us
I20260709 12:14:52.386438  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.389832  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.391443  5753 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:52.390771  9801 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.392962  9461 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:52.396770  9630 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:52.398396  5601 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:52.396765  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:52.400279  5744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1631) took 1867 ms (client timeout 1852 ms). Trace:
W20260709 12:14:52.403723  5744 rpcz_store.cc:269] 0709 12:14:50.532242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.532358 (+   116us) service_pool.cc:224] Handling call
0709 12:14:52.399773 (+1867415us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54000a7654. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:52.400037 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407946112}
I20260709 12:14:52.405316  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:52.401798  5749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 543) took 1613 ms (client timeout 1628 ms). Trace:
W20260709 12:14:52.405970  5749 rpcz_store.cc:269] 0709 12:14:50.788144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.975448 (+187304us) service_pool.cc:224] Handling call
0709 12:14:52.401311 (+1425863us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54002c79d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:52.401572 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168463104}
I20260709 12:14:52.407238  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.408113  5749 raft_consensus.cc:2368] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9.
I20260709 12:14:52.409163  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.411199  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.412317  5744 raft_consensus.cc:2368] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8.
I20260709 12:14:52.414024  5749 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:14:52.414752  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2306) took 1634 ms. Trace:
I20260709 12:14:52.415282  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.409260  9802 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.423403  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.424391  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.425146  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.425598  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.432186  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.432464  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.433341  5750 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:52.438939  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.440189  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.440929  5752 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:52.441665  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.443810  5752 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:14:52.423475  9802 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:52.444617  9306 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.445385  9306 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.447607  9306 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:52.429316  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.449167  5675 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:14:52.449347  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:52.449093  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:52.450155  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.450615  9639 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.451964  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:52.352058  5746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:14:52.454577  5746 raft_consensus.cc:606] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:14:52.454680  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:52.454959  5746 raft_consensus.cc:614] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:52.429809  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.433287  5748 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:52.459316  9639 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:52.459376  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:52.415197  5676 rpcz_store.cc:276] 0709 12:14:50.780176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.298195 (+518019us) service_pool.cc:224] Handling call
0709 12:14:51.518779 (+220584us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:51.519228 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.519260 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:51.519906 (+   646us) log.cc:844] Serialized 52 byte log entry
0709 12:14:51.890034 (+370128us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:51.890077 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.890154 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.371089 (+480935us) raft_consensus.cc:1685] finished
0709 12:14:52.371131 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.414274 (+ 43143us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400063950. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:52.414527 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6486,"raft.queue_time_us":32013,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8937,"spinlock_wait_cycles":506568576,"thread_start_us":369699,"threads_started":1,"wal-append.queue_time_us":604038}
I20260709 12:14:52.461516  5751 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:52.467588  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:14:52.474800  5674 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:52.473177  5498 catalog_manager.cc:5697] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 3 to 7, term changed from 8 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:52.473909  5752 raft_consensus.cc:606] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:14:52.482715  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:52.487146  9831 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:52.487596  9813 raft_consensus.cc:2764] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:14:52.488359  9813 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:52.489265  9801 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:52.489009  9813 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.490953  5749 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:14:52.487778  9831 raft_consensus.cc:697] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:14:52.504508  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 211210us
W20260709 12:14:52.505481  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 111025us
I20260709 12:14:52.511552  5750 raft_consensus.cc:2410] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:52.521924  9582 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.524302  9582 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:52.554149  9831 consensus_queue.cc:237] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.556960  9771 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:14:52.558892  9813 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:52.561093  5569 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:52.568315  5498 catalog_manager.cc:5697] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 8, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 8 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:52.570845  5671 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:52.572369  5498 catalog_manager.cc:5697] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:52.581925  5567 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:52.583729  5567 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:52.584753  9817 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:52.585602  9817 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:52.599344  6293 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:52.601003  5567 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:52.604681  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 43752.7us
I20260709 12:14:52.605500  6328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:14:52.606437  6328 raft_consensus.cc:606] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:52.606722  9838 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:52.605680  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:52.607100  5570 leader_election.cc:336] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.808s (SENT)
I20260709 12:14:52.608794  9829 consensus_queue.cc:1059] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:52.610085  9820 raft_consensus.cc:3055] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:14:52.610227  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.610558  9820 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:52.612119  9838 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:52.611781  9820 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.612578  9838 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:52.613377  9820 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:52.613420  5567 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:14:52.616333  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.623339  5567 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:52.616703  6328 raft_consensus.cc:614] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:52.618434  9771 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:52.616760  9829 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:52.608018  9813 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:52.625778  5745 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:52.608708  5570 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:52.628147  6291 connection.cc:256] RPC call timeout handler was delayed by -1.4519365690000541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 12:14:52.633096  6291 connection.cc:256] RPC call timeout handler was delayed by -1.4042365690002043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
I20260709 12:14:52.646117  9837 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:52.647670  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:52.629812  9813 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:52.650075  9813 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:52.653941  5716 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:52.654959  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 121175us
W20260709 12:14:52.659354  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 50770.3us
I20260709 12:14:52.629643  9771 raft_consensus.cc:697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:52.633450  9801 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:52.655709  9832 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:52.616892  9817 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:14:52.667762  9771 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.668037  5498 catalog_manager.cc:5697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:52.669616  5498 catalog_manager.cc:5697] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:52.671306  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.671967  5750 raft_consensus.cc:1240] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:52.671463  5498 catalog_manager.cc:5697] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:52.672986  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.673053  5570 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:52.671972  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.675803  5746 raft_consensus.cc:2393] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:52.678049  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.682108  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.682636  5567 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:52.683451  9817 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:52.685679  9832 raft_consensus.cc:697] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:52.686869  9832 consensus_queue.cc:237] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.687856  9461 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:52.688453  9461 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.690564  9461 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:52.692655  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:52.693351  5600 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:52.695649  5595 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:52.695830  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1656) took 1240 ms. Trace:
I20260709 12:14:52.698071  5749 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:52.682013  6328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75421a11c1284039a8a17196290f3c16"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:14:52.683480  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.673285  5498 catalog_manager.cc:5697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:52.702881  5744 raft_consensus.cc:2368] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8.
I20260709 12:14:52.699925  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.703735  5745 raft_consensus.cc:2368] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10.
I20260709 12:14:52.696226  5747 rpcz_store.cc:276] 0709 12:14:51.455793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.455900 (+   107us) service_pool.cc:224] Handling call
0709 12:14:51.456225 (+   325us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:51.456608 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:52.374930 (+918322us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b180044f3e0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95b455 00007f45014433c7 00007f44fda559a7 00007f44fda650bf 00007f44fda65038
0709 12:14:52.484143 (+109213us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.571643 (+ 87500us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:52.660063 (+ 88420us) log.cc:844] Serialized 78 byte log entry
0709 12:14:52.660240 (+   177us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:52.694781 (+ 34541us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.695117 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.695274 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.695458 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.695525 (+    67us) raft_consensus.cc:1685] finished
0709 12:14:52.695537 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.695663 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9051,"prepare.queue_time_us":64401,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":13991,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":12108,"spinlock_wait_cycles":5013248,"thread_start_us":118557,"threads_started":2,"wal-append.queue_time_us":69067}
I20260709 12:14:52.707078  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.678078  9691 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.699324  9837 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:52.707701  5752 raft_consensus.cc:2376] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 9. Re-sending same reply.
I20260709 12:14:52.706566  6328 raft_consensus.cc:606] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:14:52.711066  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.702502  9802 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:52.711376  5570 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:52.714001  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.713709  5750 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
W20260709 12:14:52.724550  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 684012us
I20260709 12:14:52.725469  5567 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:52.705485  9801 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:14:52.726734  5744 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:52.725942  5718 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:52.740540  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:52.674935  9831 consensus_queue.cc:1059] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:14:52.713049  9837 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:52.747418  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 85100.4us
I20260709 12:14:52.710631  9691 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.718003  9817 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:52.753270  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:52.758595  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 51632.3us
I20260709 12:14:52.752730  5498 catalog_manager.cc:5697] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:52.763545  5570 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:52.764781  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:52.766151  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:52.767086  5598 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:52.768646  5567 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:52.774487  9561 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:52.790248  9827 consensus_queue.cc:1059] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:14:52.753376  9802 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:52.792657  9106 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:52.793341  9106 raft_consensus.cc:697] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:52.794349  9106 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.795351  9534 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:52.796104  9534 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.797816  9806 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.798385  9806 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.799284  9597 raft_consensus.cc:3055] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:52.799726  9597 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:52.800426  9806 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:52.800661  9597 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:52.801517  9825 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:52.754480  9837 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:52.805326  9414 consensus_queue.cc:1059] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:52.790457  5716 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:52.801143  9295 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:52.813690  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:14:52.817116  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.835101  9631 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:14:52.839632  9820 consensus_queue.cc:1059] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:52.840545  9820 consensus_queue.cc:1059] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:52.843191  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:52.843959  6291 connection.cc:256] RPC call timeout handler was delayed by -1.0091365690002476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
I20260709 12:14:52.850164  9721 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:52.850705  9721 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.851075  9721 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:52.852371  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.852988  5752 raft_consensus.cc:2376] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 10. Re-sending same reply.
I20260709 12:14:52.869349  5674 raft_consensus.cc:1240] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:52.876046  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:52.830711  9825 raft_consensus.cc:3055] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:52.881932  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:52.903795  5744 raft_consensus.cc:2376] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 10. Re-sending same reply.
I20260709 12:14:52.874976  9597 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:52.913637  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:52.895743  9829 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:52.918814  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:52.908367  9825 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:53.001255  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:53.002632  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:53.004453  9695 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:53.005199  9695 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.007418  9695 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:53.007669  5498 catalog_manager.cc:5697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 4 to 8, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 8 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:14:52.877398  9806 consensus_queue.cc:1059] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:14:52.831045  9295 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:52.901298  9813 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:53.018028  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 227703us
I20260709 12:14:53.019426  5676 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:14:53.023347  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:53.031528  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 265072us
I20260709 12:14:53.038452  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:53.049250  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 243160us
I20260709 12:14:53.021893  9829 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:53.054823  5601 raft_consensus.cc:1240] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:53.057331  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 293857us
W20260709 12:14:53.063907  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 295375us
I20260709 12:14:53.065577  5716 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:53.037118  9802 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:53.072186  9824 consensus_queue.cc:1059] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.161s
I20260709 12:14:53.073079  9813 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:53.073207  9824 raft_consensus.cc:3055] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:53.073879  5719 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:53.074599  9713 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:14:53.076376  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:53.077097  6326 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:14:53.078222  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:53.082530  6319 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:14:53.078531  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:53.073599  9824 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:53.093981  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:53.093392  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:53.098941  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 73931us
I20260709 12:14:53.099923  5719 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:53.071148  9534 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:53.102779  9630 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.103963  9802 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:53.104425  9802 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:53.107204  5719 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:53.108750  9832 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:53.110117  9862 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:53.110579  9862 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:53.110801  6321 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:53.110598  9801 raft_consensus.cc:3055] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:53.112042  9801 raft_consensus.cc:740] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:53.112949  9801 consensus_queue.cc:260] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:53.113926  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.114202  9801 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.115901  9817 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.116686  6327 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 12: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:53.117340  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:53.109400  9832 consensus_queue.cc:1059] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:14:53.118124  6325 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:14:53.118986  9832 raft_consensus.cc:3055] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:53.119378  9832 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:53.119865  9842 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 12:14:53.124188  6323 raft_consensus.cc:1240] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:14:53.126046  9862 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.120401  9832 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.084600  9414 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:53.138291  5567 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:53.139312  6319 raft_consensus.cc:2393] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:53.125804  6322 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
W20260709 12:14:53.149381  9859 log.cc:927] Time spent T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:14:53.155599  9813 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:53.156157  9813 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:14:53.156581  9813 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:53.160104  6328 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
W20260709 12:14:53.161432  9838 consensus_meta.cc:287] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.548s	user 0.005s	sys 0.002s
I20260709 12:14:53.167424  9295 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:53.168593  9685 raft_consensus.cc:3055] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:53.169023  9685 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:53.169946  9685 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.170985  9685 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.088738  9825 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.174868  9825 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:53.176802  5498 catalog_manager.cc:5697] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 4 to 11, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:53.182528  9854 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:53.179190  9817 raft_consensus.cc:3055] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:53.183283  9582 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:53.183678  9817 raft_consensus.cc:740] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:53.183921  9582 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.184914  9817 consensus_queue.cc:260] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.180583  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:53.186055  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 236532us
I20260709 12:14:53.186131  9306 consensus_queue.cc:1059] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:53.178211  5645 leader_election.cc:336] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.523s (SENT)
I20260709 12:14:53.186965  9306 raft_consensus.cc:3055] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:53.187312  9306 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:14:53.187461  5645 leader_election.cc:336] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.533s (SENT)
W20260709 12:14:53.188066  5645 leader_election.cc:336] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.544s (SENT)
I20260709 12:14:53.185308  9573 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.188241  9306 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.188721  9573 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.189553  9306 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.146111  9414 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:53.190316  9828 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:14:53.189972  5642 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:53.198952  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.185410  5498 catalog_manager.cc:5697] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 3 to 6, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 6 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:14:53.144640  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 50867.7us
W20260709 12:14:53.209019  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 110679us
I20260709 12:14:53.221818  5498 catalog_manager.cc:5697] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 4 to 7, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 7 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:53.215385  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:53.190953  5645 leader_election.cc:336] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.546s (SENT)
W20260709 12:14:53.226329  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.228256  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:53.233247  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:53.241274  5595 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:14:53.191382  9414 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.253527  6323 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.193580  9864 raft_consensus.cc:3055] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:53.268805  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 79238.9us
I20260709 12:14:53.101622  9691 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:53.254082  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 107620us
I20260709 12:14:53.266984  5498 catalog_manager.cc:5697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:53.267398  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.228292  9817 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.223470  9295 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.290117  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:53.268378  9864 raft_consensus.cc:740] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:14:53.296186  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.296069  9864 consensus_queue.cc:260] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:53.297863  9561 consensus_meta.cc:287] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.002s
W20260709 12:14:53.296836  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.297515  9864 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.298029  5676 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:14:53.297657  5642 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:53.306013  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:53.165663  9837 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.298352  9561 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.314568  9582 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:53.308192  9573 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:53.319207  9461 consensus_queue.cc:1059] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:53.322343  5567 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:53.221774  9838 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.311152  9691 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.344365  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:53.345033  5745 raft_consensus.cc:2376] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 13. Re-sending same reply.
I20260709 12:14:53.330698  6323 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:53.334000  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:53.334658  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:53.336959  9771 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:53.336979  9727 consensus_queue.cc:1059] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:14:53.352550  5604 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:53.353348  9727 raft_consensus.cc:3055] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:53.353796  9727 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:53.354768  9727 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.356002  9727 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.331051  9461 consensus_queue.cc:1059] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:14:53.358229  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:53.358644  9733 raft_consensus.cc:3055] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:53.359095  9733 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:53.327291  9631 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:14:53.359993  9733 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.361173  9733 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.341138  9862 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.363787  9862 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:53.343312  9204 raft_consensus.cc:3055] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:53.364552  9204 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:53.365586  9204 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.350782  5750 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:14:53.374294  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:53.377854  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 67080.9us
I20260709 12:14:53.373736  9306 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.345177  9813 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.330366  9832 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:53.406215  5567 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:53.406621  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:53.407397  9854 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.407444  5671 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:53.408994  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:53.409878  9573 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:53.411818  9813 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:53.414088  9204 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:53.419013  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 44810.9us
I20260709 12:14:53.310499  9824 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:53.437795  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 184216us
I20260709 12:14:53.438800  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:53.449095  5671 raft_consensus.cc:1275] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:53.427124  9873 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.390434  9306 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.465006  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:53.465819  5671 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.467715  9713 raft_consensus.cc:993] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:14:53.470625  9106 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.471238  9106 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.473426  9106 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:53.474144  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.462096  5498 catalog_manager.cc:5697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:53.475760  9631 consensus_queue.cc:1059] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:53.487182  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 67428.4us
I20260709 12:14:53.490922  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:53.492483  5671 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:53.494726  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:53.495353  5676 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.497613  5719 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:53.500339  5642 leader_election.cc:400] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10.
I20260709 12:14:53.500836  5642 leader_election.cc:403] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:53.505554  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:53.493438  9573 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:53.506686  6323 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:53.509797  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.563277  5676 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
W20260709 12:14:53.548926  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.499166  9824 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.513229  6325 raft_consensus.cc:2393] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:53.511890  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:53.512903  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:14:53.572856  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 85021.8us
W20260709 12:14:53.582378  9875 log.cc:927] Time spent T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:14:53.594916  5675 raft_consensus.cc:2410] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:14:53.528641  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 119744us
I20260709 12:14:53.550765  9862 raft_consensus.cc:3055] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:53.505091  9861 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:53.535843  9582 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10.
I20260709 12:14:53.500373  9802 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.607349  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:53.608361  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:53.611891  5749 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:14:53.558641  9837 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:53.508430  9573 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.612262  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:53.604175  9862 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:53.612907  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 124870us
I20260709 12:14:53.621061  5642 leader_election.cc:400] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8.
I20260709 12:14:53.621390  5642 leader_election.cc:403] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:14:53.594628  9631 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:53.604679  9838 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:53.624569  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:53.625880  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:53.626545  5676 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:53.620199  9713 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:53.629897  9860 consensus_queue.cc:1059] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 12:14:53.630806  9851 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:14:53.638183  6323 raft_consensus.cc:2410] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:53.620667  9573 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:53.632512  9721 consensus_meta.cc:287] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.000s
I20260709 12:14:53.645218  5671 raft_consensus.cc:2393] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:53.645895  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:53.634720  9106 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.612109  9414 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.648849  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:53.651443  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:53.640260  9582 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 7. Current term is 8.
I20260709 12:14:53.653712  5719 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:53.663352  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 58394.9us
I20260709 12:14:53.687577  5670 raft_consensus.cc:1217] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 12:14:53.689090  5670 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:14:53.657399  5677 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:53.654804  5675 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:53.657837  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:53.661916  9534 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:53.691344  9534 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:53.691677  9833 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.692190  9833 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.694749  9833 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:53.649115  9631 raft_consensus.cc:697] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:53.696085  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.687373  9873 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.699183  5498 catalog_manager.cc:5697] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:53.700057  5674 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:14:53.701123  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 47498.8us
I20260709 12:14:53.655980  9204 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.658005  9880 raft_consensus.cc:1081] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:14:53.661181  9865 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:53.658787  9802 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:53.667845  9106 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.647116  9721 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.713493  9106 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:53.663115  9414 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:53.677701  9306 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:53.711095  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 250406us
I20260709 12:14:53.692235  9534 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:53.722983  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.724586  9721 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:53.728468  6320 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:14:53.728921  6320 pending_rounds.cc:85] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 9
I20260709 12:14:53.729158  6320 pending_rounds.cc:107] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:14:53.729423  6320 raft_consensus.cc:2889] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:53.730808  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:53.731287  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:53.735692  9801 consensus_meta.cc:287] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.621s	user 0.003s	sys 0.008s
I20260709 12:14:53.708726  9865 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.709851  9860 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:53.737082  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 85715.3us
I20260709 12:14:53.741266  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:53.665982  9862 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.723601  9695 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.733688  9204 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.752496  9204 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:53.760687  6291 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:53.739522  9825 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.736263  9824 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:14:53.762163  9825 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.763293  9824 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:53.764729  9824 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:53.765161  9824 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.765506  9824 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.766283  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:53.768042  5747 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:53.768975  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:53.776803  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.769665  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:53.769971  9862 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.770316  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:53.770628  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:53.771049  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:53.774343  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:53.779152  5752 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:14:53.772295  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:53.771479  9685 consensus_queue.cc:1175] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c02ed29558db481589fd3db23e43a07f" responder_term: 10 status { last_received { term: 10 index: 9 } last_committed_idx: 7 last_received_current_leader { term: 10 index: 9 } }
W20260709 12:14:53.771744  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 51590.3us
W20260709 12:14:53.780220  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.738894  9865 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:53.772397  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:53.770098  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:53.765522  9631 consensus_queue.cc:237] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.781457  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:53.790781  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.749518  9691 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.764614  9825 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:53.795302  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:53.800092  5598 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.781543  9801 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.798951  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.807350  5745 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:53.791771  6324 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:53.799000  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:53.808884  5670 raft_consensus.cc:2410] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:14:53.808863  5719 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:53.800827  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.799175  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:53.810727  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.813656  5602 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:53.817143  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:53.819078  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.819625  5602 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:53.811790  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:53.822450  5749 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:14:53.823623  5567 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:53.825887  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:53.826357  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.826272  9561 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.827122  5596 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:53.829834  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.830701  5597 raft_consensus.cc:2393] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:53.831821  5677 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:53.833127  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:53.837904  5567 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:53.838953  9885 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:53.843114  9885 raft_consensus.cc:697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:53.844182  9885 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:14:53.838951  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.788005  9695 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.840071  9306 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:53.847812  6324 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:53.839519  9829 raft_consensus.cc:3055] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:53.811551  9721 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:53.813719  9825 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:53.857467  5671 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:53.833920  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:53.859678  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.860654  5597 raft_consensus.cc:2410] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:14:53.865147  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:53.865726  5601 raft_consensus.cc:3060] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.864713  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.866389  5596 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:14:53.869997  9561 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:53.880820  9561 raft_consensus.cc:697] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:53.881179  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:53.862437  9829 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:53.870957  9306 raft_consensus.cc:697] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:53.882138  9867 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.882484  9829 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.880823  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.883352  5718 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:53.884006  9829 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:53.884145  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.884352  9867 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.884843  5596 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:53.885408  5718 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:53.862267  9825 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.886137  9867 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:53.870682  9630 consensus_queue.cc:1048] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:14:53.886583  9867 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.887001  9867 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.888613  9573 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.890959  9573 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:53.891654  5678 raft_consensus.cc:2393] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:53.894050  5671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75421a11c1284039a8a17196290f3c16"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:50284
I20260709 12:14:53.833451  9801 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.894732  5671 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:53.895128  5671 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:53.895368  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.896275  9801 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:53.886368  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 125780us
W20260709 12:14:53.898502  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 64649.4us
I20260709 12:14:53.899662  5642 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:53.900628  5679 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:53.900871  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:53.901365  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.901803  9534 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:53.902310  9534 raft_consensus.cc:697] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:53.902626  5604 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:53.903414  9825 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.893978  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.904338  5595 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:14:53.903576  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.904966  9695 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:53.905591  5604 raft_consensus.cc:2393] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:53.903213  9860 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:14:53.907354  5675 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:53.916975  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.916918  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.901825  9691 raft_consensus.cc:2764] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:14:53.918241  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.918677  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:53.872217  9727 consensus_queue.cc:1059] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:14:53.919480  5595 raft_consensus.cc:2410] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:14:53.920279  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.881775  9561 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.920954  5595 raft_consensus.cc:2368] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9.
I20260709 12:14:53.903654  9886 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:53.917197  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:53.908442  5498 catalog_manager.cc:5697] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 7, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 7 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:53.885663  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:53.924530  5642 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:53.924957  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.919298  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:53.913509  5716 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:53.921720  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.927030  5595 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:14:53.893488  5598 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:53.933415  5718 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:53.921636  9872 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.476s	user 0.000s	sys 0.001s
I20260709 12:14:53.941397  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:53.939733  5671 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.943753  5601 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:53.944422  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:53.945679  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.942585  5718 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:53.947193  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:53.921880  9886 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.942354  9860 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:53.912418  9721 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.963366  9721 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:53.964246  5595 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:53.965265  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.965883  5595 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:14:53.966440  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.967375  5599 raft_consensus.cc:2410] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:53.968596  5599 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:53.960863  9860 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.970376  9860 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.972785  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:53.973519  5674 raft_consensus.cc:2393] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:53.961360  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:53.975797  6320 raft_consensus.cc:2410] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:14:53.976743  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 52336.6us
I20260709 12:14:53.978891  9853 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.963276  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:53.954725  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.959426  5569 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:53.961256  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 63479.7us
I20260709 12:14:53.941327  9573 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:53.981470  5498 catalog_manager.cc:5697] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 5 to 8, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 8 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:53.985742  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.951586  5671 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:53.945194  9630 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.991291  5596 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:53.987444  5678 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:53.992141  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:53.993280  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:53.993911  5600 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:53.990931  5716 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:53.959474  9631 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:53.998471  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.002835  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:54.004985  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 45646us
I20260709 12:14:54.003124  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.006057  5745 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:54.004851  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:53.959375  9886 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:53.903208  9534 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:54.004539  5752 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:54.007202  5751 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:53.986857  9806 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:14:54.022261  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.022332  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:54.029707  5747 raft_consensus.cc:2393] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:53.882616  9306 consensus_queue.cc:237] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:53.964177  9824 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:53.954841  9889 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:14:54.036099  5716 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:54.004730  9631 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:54.019935  9801 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:53.979399  9853 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:54.027778  9733 consensus_meta.cc:287] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.006s
W20260709 12:14:54.048188  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 60626.2us
I20260709 12:14:54.047616  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:54.049698  5595 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:54.049969  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:54.051313  5718 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:54.051630  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:54.052088  9878 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.052196  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:54.030405  9833 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:54.054911  5753 raft_consensus.cc:2410] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:14:54.052996  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:54.056655  5642 connection.cc:256] RPC call timeout handler was delayed by -1.0115803509997932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
I20260709 12:14:54.056740  5677 raft_consensus.cc:1240] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:54.057132  5642 connection.cc:256] RPC call timeout handler was delayed by -1.0101308600001175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 12:14:54.057731  6291 leader_election.cc:400] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9.
W20260709 12:14:54.058506  5645 leader_election.cc:336] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.566s (SENT)
I20260709 12:14:54.057235  5718 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:54.059144  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.059293  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:54.044665  9631 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.060774  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.045701  9801 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.061317  5599 raft_consensus.cc:2393] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:54.063532  5600 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:14:54.062021  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.061962  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:54.067354  5645 leader_election.cc:336] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.728s (SENT)
I20260709 12:14:54.076005  5645 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:54.077994  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:54.064291  9733 raft_consensus.cc:2804] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:54.066053  9801 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:54.081543  9106 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:14:54.078836  5595 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:54.082386  5716 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:54.063170  9833 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:54.094254  5673 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:54.094379  5604 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:54.058291  9865 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:54.099129  9898 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:14:54.099853  9890 log.cc:927] Time spent T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:14:54.104787  5642 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:54.108078  9693 consensus_queue.cc:1059] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:14:54.109627  9874 log.cc:927] Time spent T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.621s	user 0.003s	sys 0.000s
W20260709 12:14:54.111433  9891 log.cc:927] Time spent T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.137s	user 0.003s	sys 0.000s
W20260709 12:14:54.122979  9897 log.cc:927] Time spent T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:54.131628  9824 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:54.088953  9894 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:54.080459  9204 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:54.134883  5598 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:14:54.177937  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:54.180794  5673 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:54.191664  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.209403  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 104699us
I20260709 12:14:54.215433  9853 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:54.217208  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:54.218803  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 80035.5us
I20260709 12:14:54.220321  5718 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:54.137964  9898 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.223512  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:54.223423  5673 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:14:54.224162  5678 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 14.
I20260709 12:14:54.098124  9867 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:54.180588  9573 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:54.225965  5677 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 13. Current term is 14. Ops: []
I20260709 12:14:54.227625  6293 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:54.211652  9695 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.230901  9582 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:54.231362  9685 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.231787  9693 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:54.232306  9693 raft_consensus.cc:697] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:54.223295  9862 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:14:54.230651  9695 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:54.218762  9414 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:54.237560  5569 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:54.242519  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 197155us
I20260709 12:14:54.244871  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:54.245110  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:54.245605  6323 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:54.246011  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:54.246627  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:54.245751  6326 raft_consensus.cc:2393] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:54.247169  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:54.233150  9871 log.cc:927] Time spent T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.805s	user 0.002s	sys 0.002s
I20260709 12:14:54.247713  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:14:54.274233  5570 leader_election.cc:336] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.970s (SENT)
I20260709 12:14:54.274778  5570 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:54.227002  9898 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.276614  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:54.288514  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:54.236948  9573 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:54.233194  9693 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:54.293529  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 211200us
I20260709 12:14:54.291481  6327 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:54.291687  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:54.243381  9414 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:54.255957  9853 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:14:54.299125  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:54.301667  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:54.300498  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.304817  5744 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:54.240622  9860 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:54.307070  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.307657  5747 raft_consensus.cc:2376] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9. Re-sending same reply.
I20260709 12:14:54.309115  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.309415  9733 raft_consensus.cc:697] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:54.310376  9733 consensus_queue.cc:237] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:54.310384  9829 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:54.311882  9829 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:54.313186  6322 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:54.313724  5745 raft_consensus.cc:2393] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:54.293102  9573 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:54.318334  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.295679  9561 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.319865  9534 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.321890  9700 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.322378  9700 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:54.324476  9700 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:54.325306  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.326056  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.326606  5595 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:54.327020  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.330168  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.330860  5601 raft_consensus.cc:2393] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:54.333007  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.333608  5752 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:54.334914  5747 raft_consensus.cc:2393] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:54.336843  5595 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:14:54.338164  5604 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:54.338922  5602 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:54.301121  9414 raft_consensus.cc:3060] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.353835  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.354575  5597 raft_consensus.cc:2376] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11. Re-sending same reply.
I20260709 12:14:54.356662  5603 raft_consensus.cc:2393] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:54.356793  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.356904  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.357540  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.357007  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.390698  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:14:54.391275  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 59630.3us
I20260709 12:14:54.313472  9825 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:54.395507  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:54.396201  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 96390.3us
I20260709 12:14:54.255646  9833 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:54.399183  9860 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:54.399335  9695 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:54.400098  9865 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:54.402148  9886 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:54.403895  5498 catalog_manager.cc:5697] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 3 to 5, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 5 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:14:54.393962  9894 consensus_queue.cc:1059] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:54.406337  5597 raft_consensus.cc:1240] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:54.406868  5603 raft_consensus.cc:1240] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:54.408203  6291 connection.cc:256] RPC call timeout handler was delayed by -1.7768287199999122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 12:14:54.513216  6291 connection.cc:256] RPC call timeout handler was delayed by -1.7579287199998817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 12:14:54.513595  6291 connection.cc:256] RPC call timeout handler was delayed by -1.7075287199998002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
I20260709 12:14:54.410378  9534 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:54.410691  5500 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45220 (request call id 293) took 38552 ms (client timeout 15000 ms). Trace:
W20260709 12:14:54.395334  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 103752us
I20260709 12:14:54.401623  9867 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:54.413252  5599 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:14:54.413354  9630 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:54.409636  9631 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:54.415269  5604 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:54.424337  9414 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:54.326507  9832 raft_consensus.cc:3055] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:54.358461  5600 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:14:54.427891  5595 raft_consensus.cc:2368] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9.
I20260709 12:14:54.428571  9573 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:54.428856  5676 raft_consensus.cc:2410] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:54.451125  5602 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.453567  6324 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:54.455509  5598 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.530972  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:54.530515  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.460582  6322 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:54.461436  5675 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:54.512579  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:54.516968  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.533344  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.512984  9204 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.534529  5597 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.532632  5751 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:54.536388  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:54.545507  5595 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:54.546168  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.546819  5599 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.551049  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.552143  5745 raft_consensus.cc:2376] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11. Re-sending same reply.
I20260709 12:14:54.556885  5598 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:54.575753  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.463764  9801 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:54.525110  9832 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:54.529227  9873 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.576403  5744 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:14:54.584647  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:54.585402  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:54.584322  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.587770  5745 raft_consensus.cc:2410] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:14:54.588321  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.582231  9534 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:54.590731  5596 raft_consensus.cc:2368] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13.
I20260709 12:14:54.592111  9801 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:54.592478  5599 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
W20260709 12:14:54.514135  5500 rpcz_store.cc:269] 0709 12:14:15.862746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.875598 (+ 12852us) service_pool.cc:224] Handling call
0709 12:14:54.410400 (+38534802us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:47.758764 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:47.759371 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:47.759431 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:14:47.759445 (+    14us) tablet.cc:662] Decoding operations
0709 12:14:47.831316 (+ 71871us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:47.831392 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:47.831434 (+    42us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:14:47.832849 (+  1415us) tablet.cc:701] Row locks acquired
0709 12:14:47.832900 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:14:47.833090 (+   190us) write_op.cc:270] Start()
0709 12:14:47.833250 (+   160us) write_op.cc:276] Timestamp: P: 1783599287833015 usec, L: 0
0709 12:14:47.833274 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:14:48.260676 (+427402us) log.cc:844] Serialized 7062 byte log entry
0709 12:14:50.954812 (+2694136us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b1800139de0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fd5f34bc 00007f44fa94148b 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1
0709 12:14:51.027219 (+ 72407us) op_driver.cc:464] REPLICATION: finished
0709 12:14:51.450012 (+422793us) write_op.cc:301] APPLY: starting
0709 12:14:51.457822 (+  7810us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:51.546840 (+ 89018us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:51.546899 (+    59us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:51.555287 (+  8388us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:51.555659 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=36
0709 12:14:51.555707 (+    48us) write_op.cc:312] APPLY: finished
0709 12:14:51.556195 (+   488us) log.cc:844] Serialized 125 byte log entry
0709 12:14:51.854887 (+298692us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54003b9cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4832a 00007f44fd9cdf14 00007f44fd9cdec3 00007f44fd9cde38 00007f44fd9cddf3 00007f44fd9cd0dc 00007f44fd9f6e16 00007f44fd9decbb 00007f44fd9c939d 00007f44fd9ccd75
0709 12:14:51.982743 (+127856us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:51.982945 (+   202us) write_op.cc:454] Released schema lock
0709 12:14:51.983029 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:51.987358 (+  4329us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:51.987391 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":58726,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":379802,"apply.run_cpu_time_us":59097,"apply.run_wall_time_us":550393,"num_ops":18,"prepare.queue_time_us":732854,"prepare.run_cpu_time_us":67518,"prepare.run_wall_time_us":3196416,"raft.queue_time_us":353919,"raft.run_cpu_time_us":55276,"raft.run_wall_time_us":1650605,"replication_time_us":3165005,"spinlock_wait_cycles":1728506624,"thread_start_us":2607270,"threads_started":5,"wal-append.queue_time_us":1848278,"wal-append.run_cpu_time_us":15687,"wal-append.run_wall_time_us":2619926}]]}
I20260709 12:14:54.597962  9806 consensus_queue.cc:1059] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:14:54.598883  9825 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:54.621812  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.602445  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 71544.5us
I20260709 12:14:54.603781  5597 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:54.605796  5602 raft_consensus.cc:2410] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:54.634287  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:54.635540  5602 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:14:54.635576  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 117139us
W20260709 12:14:54.636740  6291 connection.cc:256] RPC call timeout handler was delayed by -1.587828719999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 12:14:54.558422  9204 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:54.646840  5745 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:14:54.650264  9631 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:54.631423  9414 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:54.654222  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:14:54.656009  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 122348us
I20260709 12:14:54.603071  9873 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:54.659082  9204 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:54.659795  9886 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:54.660552  9914 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.131s	user 0.000s	sys 0.007s
I20260709 12:14:54.663812  5751 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:54.659395  9832 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:54.602114  9561 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:14:54.659010  9898 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:54.672413  5750 raft_consensus.cc:2368] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:14:54.674703  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.675271  5751 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:14:54.674885  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:54.677278  5674 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 13: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:54.678934  9700 consensus_queue.cc:1059] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:14:54.684934  9913 log.cc:927] Time spent T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 12:14:54.710124  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 51766us
I20260709 12:14:54.711191  5642 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:54.719928  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:54.706816  9693 raft_consensus.cc:3055] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:54.720578  5595 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 8.
I20260709 12:14:54.721696  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:14:54.714709  9915 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:14:54.716287  9832 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.724217  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:54.714519  9894 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:54.724277  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:54.727558  5751 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:54.719821  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:54.726788  9910 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.722747  9693 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:54.733435  5716 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:54.741493  9573 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:54.727627  9920 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.738721  5567 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:54.740551  9898 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:54.751653  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:54.727859  9833 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.756568  9910 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:54.758810  9693 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:54.917882  9693 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.920450  9910 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:54.760515  9908 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.453s	user 0.004s	sys 0.003s
I20260709 12:14:54.755900  9802 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.754117  9824 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:54.761384  9920 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.046808  9920 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:54.764248  5567 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:55.047807  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 283600us
I20260709 12:14:55.049134  5567 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:54.762909  5716 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:55.050079  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 287223us
I20260709 12:14:55.050719  5716 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:55.052048  9806 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:55.052311  9461 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:55.052556  9806 raft_consensus.cc:697] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:55.053711  9806 consensus_queue.cc:237] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:55.018003  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 298232us
I20260709 12:14:55.028738  9801 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.763255  9832 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:54.944877  9573 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:55.031985  9630 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.052656  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:55.018795  9833 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:55.058657  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 331517us
I20260709 12:14:55.050211  9898 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:55.077086  5567 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:55.079181  5567 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:55.080297  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:55.065883  9920 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:55.083730  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:55.076385  9630 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.085259  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:55.077900  9733 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:55.081471  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:55.066736  9832 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.072374  9802 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:55.090083  9898 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:55.091748  9833 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:55.093864  5642 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:55.117663  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:55.092329  9561 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:55.121465  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:55.125346  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:55.116623  9832 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.095536  9733 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.131699  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:55.136013  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:14:55.075944  9801 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:55.204454  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 110693us
I20260709 12:14:55.208304  5599 raft_consensus.cc:2468] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:55.208433  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:55.209190  5673 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:14:55.204121  5745 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:55.210158  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:55.211467  5677 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.129210  9582 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:55.122455  9802 raft_consensus.cc:697] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:55.213025  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:55.214001  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:55.218870  5751 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:55.127383  9925 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:55.129712  9920 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:55.214577  5642 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:55.221449  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:55.222146  5678 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.203501  9733 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:55.227067  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:55.268445  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:55.228919  9693 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:55.272518  9931 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:14:55.264518  9582 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.285813  9630 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:55.234578  9925 raft_consensus.cc:697] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:55.265177  9932 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:55.308646  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:55.310599  9802 consensus_queue.cc:237] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.308352  9204 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:14:55.283324  9898 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:55.312939  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:55.326793  9889 raft_consensus.cc:3055] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:55.327572  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:55.327751  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:55.328648  6325 raft_consensus.cc:2410] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:55.329351  6328 raft_consensus.cc:2410] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:14:55.333878  5489 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.302s	user 0.055s	sys 0.048s
I20260709 12:14:55.306443  9693 raft_consensus.cc:697] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:55.309945  9932 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.347302  5676 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:55.327327  9889 raft_consensus.cc:740] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:55.364902  5678 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:55.367120  5601 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:55.373126  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:55.373199  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:55.374845  5599 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:55.345988  9414 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.373939  6328 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
W20260709 12:14:55.376636  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 234339us
I20260709 12:14:55.358775  9932 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:55.381155  6325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:52390
W20260709 12:14:55.381542  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 253037us
I20260709 12:14:55.381780  6325 raft_consensus.cc:606] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:14:55.382289  6325 raft_consensus.cc:614] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:55.380765  9873 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:55.384562  5751 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:14:55.385723  5719 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:55.386147  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 248859us
I20260709 12:14:55.390648  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:55.394479  6291 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:55.398319  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:55.398917  5597 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.389565  9534 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:55.407712  5597 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:55.409595  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:55.410177  5676 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:55.390448  9204 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:55.444836  9881 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:55.445909  9833 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.389241  9561 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:55.379366  9414 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:55.472398  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 78680.1us
I20260709 12:14:55.447734  9204 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.461419  9910 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.448355  9920 raft_consensus.cc:697] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:55.444504  9873 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 12:14:55.488059  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 274948us
I20260709 12:14:55.442101  9534 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.466045  9833 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.474917  9881 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:55.493287  9801 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:55.502702  9881 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.503669  9534 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:55.503850  9561 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:55.496397  9904 log.cc:927] Time spent T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.189s	user 0.006s	sys 0.019s
I20260709 12:14:55.496301  9727 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.506989  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2350) took 1443 ms. Trace:
I20260709 12:14:55.507367  5679 rpcz_store.cc:276] 0709 12:14:54.063528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.063984 (+   456us) service_pool.cc:224] Handling call
0709 12:14:54.078808 (+ 14824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:54.093870 (+ 15062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:54.093900 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:54.099324 (+  5424us) log.cc:844] Serialized 26 byte log entry
0709 12:14:54.285364 (+186040us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:54.285434 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.285498 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:55.495774 (+1210276us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:55.506680 (+ 10906us) raft_consensus.cc:1685] finished
0709 12:14:55.506701 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:55.506900 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12449,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":19768,"spinlock_wait_cycles":77444864,"thread_start_us":156676,"threads_started":1,"wal-append.queue_time_us":207323}
I20260709 12:14:55.509191  9833 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:55.507732  5677 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:55.513896  5597 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:55.496855  9414 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:55.487850  9204 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.492414  9910 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.390059  9925 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.518013  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:55.530985  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:55.531687  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:55.532238  6291 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:55.534652  5718 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:55.535426  9630 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.539144  5745 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:55.542563  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:55.537201  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:55.544131  5747 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:14:55.543231  5670 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:14:55.546854  5677 raft_consensus.cc:3055] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:55.547770  5677 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:55.544389  5603 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:55.446593  9889 consensus_queue.cc:260] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.506114  9727 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:55.465402  9693 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.551761  6328 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:55.553457  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:55.553392  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:55.554387  5749 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.554442  5751 raft_consensus.cc:2368] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13.
I20260709 12:14:55.554986  5679 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:55.490442  9937 consensus_queue.cc:1059] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:14:55.548650  5677 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:55.563006  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 67691.3us
I20260709 12:14:55.564474  5677 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.564654  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:55.568447  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 46156.3us
I20260709 12:14:55.565572  5719 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:55.536741  9630 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:14:55.559634  9824 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.560206  9889 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:55.566556  9853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.235s	user 0.022s	sys 0.016s
I20260709 12:14:55.576344  5642 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:55.577590  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:55.556722  9940 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.571395  9582 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.577982  9534 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:14:55.578691  9853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.022s	sys 0.017s
I20260709 12:14:55.587024  5677 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:14:55.591305  5677 pending_rounds.cc:85] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 7
I20260709 12:14:55.591660  5677 pending_rounds.cc:107] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:14:55.591883  5677 raft_consensus.cc:2889] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:55.579535  9898 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:55.593813  5749 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:14:55.593827  6291 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:55.582381  9886 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:55.583758  9924 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:55.560197  9920 consensus_queue.cc:237] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:55.590827  9534 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:55.624847  5674 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:55.591029  9853 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:55.595233  9898 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.632304  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:55.635694  9898 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.606746  9924 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:55.624265  9824 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:55.628535  9306 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.560884  5489 maintenance_manager.cc:643] P ce423f944eb64a23961a8a3bbc019610: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.673s	user 0.219s	sys 0.164s Metrics: {"bytes_written":30051,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":131989,"dirs.run_cpu_time_us":2710,"dirs.run_wall_time_us":45721,"drs_written":1,"lbm_read_time_us":388,"lbm_reads_lt_1ms":4,"lbm_write_time_us":262332,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"raft.queue_time_us":152335,"reinsert_count":0,"rows_written":63,"thread_start_us":345013,"threads_started":3,"update_count":18,"wal-append.queue_time_us":295420}
W20260709 12:14:55.674185  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 455814us
I20260709 12:14:55.644004  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:55.645839  9865 raft_consensus.cc:3055] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:55.647490  9886 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:14:55.648903  5570 connection.cc:256] RPC call timeout handler was delayed by -1.2828835809998509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
I20260709 12:14:55.663381  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:14:55.664981  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.630193  9534 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:55.640177  9924 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:55.700748  5570 connection.cc:256] RPC call timeout handler was delayed by -1.2162835809999706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
I20260709 12:14:55.702684  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:55.706374  5570 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:55.703578  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 119791us
W20260709 12:14:55.708655  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 64718us
I20260709 12:14:55.709489  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:55.671872  9860 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.717733  5595 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:55.722728  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:55.722990  5570 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:55.724331  5570 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:55.695631  9865 raft_consensus.cc:740] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:55.695897  9886 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.702572  9691 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.748174  5570 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:55.711557  9910 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:55.672401  9306 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.703589  9582 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:55.779130  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:55.781824  5570 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:55.726147  9727 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:55.746690  9886 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:55.746083  9881 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:14:55.793962  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 76831.3us
I20260709 12:14:55.766527  9920 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.725616  9860 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.782174  9801 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.787846  9940 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.753623  9630 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:14:55.786352  9561 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:14:55.808339  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 52037.9us
I20260709 12:14:55.754248  9733 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:55.801282  5570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.530s (SENT) [suppressed 59 similar messages]
I20260709 12:14:55.769256  9691 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.796651  9824 raft_consensus.cc:697] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:55.809656  5716 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:55.813165  5678 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:55.814498  9948 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.796236  9582 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.734088  9853 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:55.814579  9938 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:55.814895  9942 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:55.814679  9957 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.815228  9948 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:55.814504  9950 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:55.819228  5678 raft_consensus.cc:1240] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:55.820180  9582 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.819160  9950 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.820827  5678 raft_consensus.cc:1240] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:55.816885  9938 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:55.832706  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:55.835201  5678 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:55.836449  5569 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:55.837396  5490 maintenance_manager.cc:419] P ce423f944eb64a23961a8a3bbc019610: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8746 bytes on disk
I20260709 12:14:55.854149  5678 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:14:55.837288  9942 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:55.853510  5567 leader_election.cc:336] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.725s (SENT)
I20260709 12:14:55.854777  5752 raft_consensus.cc:2368] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9.
I20260709 12:14:55.792836  9932 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.835995  5716 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:55.853221  5676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
W20260709 12:14:55.858227  9952 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:14:55.857654  5751 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:55.815145  9936 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:55.861434  5674 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:14:55.861992  5489 maintenance_manager.cc:643] P ce423f944eb64a23961a8a3bbc019610: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.006s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":376,"lbm_reads_lt_1ms":4}
I20260709 12:14:55.820895  9950 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:55.799120  9881 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.861024  5676 raft_consensus.cc:606] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:14:55.870692  5676 raft_consensus.cc:614] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:14:55.815269  9929 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:55.867476  5716 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:55.858919  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:55.801476  9920 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:55.869976  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 70929.9us
I20260709 12:14:55.857730  9727 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.803511  9865 consensus_queue.cc:260] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:55.868541  9901 log.cc:927] Time spent T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 1.566s	user 0.011s	sys 0.009s
I20260709 12:14:55.861625  9942 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.874513  6291 leader_election.cc:400] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9.
I20260709 12:14:55.838729  9582 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:55.816453  9956 consensus_queue.cc:1059] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:14:55.905223  5595 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:14:55.905656  6291 leader_election.cc:403] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:14:55.907617  9977 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.868815  9938 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:55.907827  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 207434us
I20260709 12:14:55.915380  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:55.916782  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:55.917488  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:55.922039  5750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1664) took 1346 ms (client timeout 1725 ms). Trace:
W20260709 12:14:55.922564  5750 rpcz_store.cc:269] 0709 12:14:54.575188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.575640 (+   452us) service_pool.cc:224] Handling call
0709 12:14:55.914602 (+1338962us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b54002175d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:55.921967 (+  7365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200137088}
I20260709 12:14:55.909225  9942 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.934396  9899 raft_consensus.cc:2804] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:55.970137  9899 raft_consensus.cc:697] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:55.935225  9974 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:55.935734  9862 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:55.936892  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 569) took 1613 ms. Trace:
W20260709 12:14:55.939878  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 72485.8us
W20260709 12:14:55.950982  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 44960.2us
I20260709 12:14:55.884491  9968 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:14:55.908115  9829 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:55.930079  9865 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:55.964200  9693 consensus_queue.cc:1059] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:55.999346  5596 rpcz_store.cc:276] 0709 12:14:54.323310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.353048 (+ 29738us) service_pool.cc:224] Handling call
0709 12:14:55.936601 (+1583553us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540031b5d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:55.936776 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299371776}
I20260709 12:14:55.886402  9966 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.101s
W20260709 12:14:56.003993  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 129610us
I20260709 12:14:56.013370  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:55.996032  9802 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.913720  9824 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:56.028330  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 318907us
W20260709 12:14:56.032413  9832 consensus_meta.cc:287] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.815s	user 0.008s	sys 0.010s
I20260709 12:14:56.032904  9832 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:56.033623  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:56.033991  9955 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 12:14:56.035375  9959 log.cc:927] Time spent T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 12:14:56.036969  9963 log.cc:927] Time spent T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:14:56.038753  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1667) took 1454 ms. Trace:
I20260709 12:14:56.039177  5744 rpcz_store.cc:276] 0709 12:14:54.584155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.587199 (+  3044us) service_pool.cc:224] Handling call
0709 12:14:54.599353 (+ 12154us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:54.599738 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:54.599769 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:54.633603 (+ 33834us) log.cc:844] Serialized 52 byte log entry
0709 12:14:55.666520 (+1032917us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b1800388540. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:14:55.725349 (+ 58829us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:55.778433 (+ 53084us) log.cc:844] Serialized 14 byte log entry
0709 12:14:55.778675 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:55.778759 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:56.038423 (+259664us) raft_consensus.cc:1685] finished
0709 12:14:56.038527 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:56.038691 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10410,"prepare.queue_time_us":40552,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":3273,"raft.queue_time_us":25285,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":11031,"spinlock_wait_cycles":13962624,"thread_start_us":58582,"threads_started":1,"wal-append.queue_time_us":1220662}
I20260709 12:14:56.041833  9801 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:56.042855  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.003636  9899 consensus_queue.cc:237] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:56.048559  9881 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:56.111434  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:56.035553  9961 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:14:56.022070  9306 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:56.039115  9964 log.cc:927] Time spent T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
W20260709 12:14:56.039132  9965 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:14:56.038638  9932 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:56.121344  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:56.116245  9204 consensus_meta.cc:287] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 12:14:56.128150  9881 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:56.136740  9982 raft_consensus.cc:3055] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:56.138939  9984 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.117779  9691 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.113619  9733 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:56.155773  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 44416.5us
I20260709 12:14:56.148921  9957 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.149592  9920 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:56.039325  9970 consensus_queue.cc:1059] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 12:14:56.024550  9693 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:14:56.023319  9802 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.029829  9878 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 12:14:56.141010  9886 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:56.153127  9898 consensus_meta.cc:287] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.004s
I20260709 12:14:56.244445  9898 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.246678  9898 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:56.176573  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 262287us
I20260709 12:14:56.220103  5642 leader_election.cc:400] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9.
I20260709 12:14:56.255302  5642 leader_election.cc:403] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:56.156205  9982 raft_consensus.cc:740] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:56.162012  9832 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:14:56.234591  5645 leader_election.cc:336] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.762s (SENT)
W20260709 12:14:56.276600  5645 leader_election.cc:336] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.774s (SENT)
I20260709 12:14:56.238437  9582 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.173566  9204 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.286875  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:56.287680  9204 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.288220  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:56.292673  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:56.254854  9733 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.294198  9733 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.295346  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:56.296154  5678 raft_consensus.cc:2410] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:56.296180  9733 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.173485  9950 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.299026  9950 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:56.300199  9924 consensus_meta.cc:287] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.001s
I20260709 12:14:56.300661  9924 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:56.239742  9534 consensus_meta.cc:287] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260709 12:14:56.283849  9982 consensus_queue.cc:260] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.223129  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51914 (request call id 2328) took 1128 ms. Trace:
I20260709 12:14:56.153784  9978 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:56.153635  9976 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9.
W20260709 12:14:56.278280  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 101498us
W20260709 12:14:56.283772  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.284987  9979 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.169s
I20260709 12:14:56.243553  9886 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:56.310333  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 297025us
I20260709 12:14:56.313258  5602 rpcz_store.cc:276] 0709 12:14:55.095055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.095175 (+   120us) service_pool.cc:224] Handling call
0709 12:14:56.222882 (+1127707us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54002ffb54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:56.223055 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953253120}
I20260709 12:14:56.241634  9802 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.341130  9992 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:56.342183  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 327900us
I20260709 12:14:56.343190  5642 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:56.343530  6291 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:56.254565  9939 raft_consensus.cc:3055] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:56.347076  9939 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:14:56.348052  9939 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:56.350597  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:56.350935  9990 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:56.351459  9990 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.349406  9939 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.350481  9832 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.354350  9832 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.356402  9832 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.353564  9990 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.359326  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:56.363104  9832 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:56.364511  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 813) took 1060 ms. Trace:
I20260709 12:14:56.364888  6324 rpcz_store.cc:276] 0709 12:14:55.304291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.308372 (+  4081us) service_pool.cc:224] Handling call
0709 12:14:56.364292 (+1055920us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54006be4d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:56.364419 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1389417216}
I20260709 12:14:56.366317  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1672) took 1235 ms. Trace:
I20260709 12:14:56.368139  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:56.368851  5675 raft_consensus.cc:2410] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:56.366686  5752 rpcz_store.cc:276] 0709 12:14:55.131242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.131436 (+   194us) service_pool.cc:224] Handling call
0709 12:14:56.366144 (+1234708us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b5400053cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:56.366262 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645970176}
I20260709 12:14:56.318224  9865 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9.
I20260709 12:14:56.156443  9984 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:56.372278  5716 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:56.330696  9881 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:56.377691  6291 leader_election.cc:400] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13.
I20260709 12:14:56.379228  6291 leader_election.cc:403] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:14:56.382687  9969 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:56.383435  9969 raft_consensus.cc:697] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:56.384335  9969 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.384908  9981 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.385432  9981 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.386611  9414 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.387183  9414 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.306121  9534 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.389046  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:56.399096  5675 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
W20260709 12:14:56.399252  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 68232.2us
I20260709 12:14:56.400893  5675 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:56.370805  9982 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.404843  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.405653  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.370200  9992 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.406132  5670 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 13. Current term is 14. Ops: []
I20260709 12:14:56.378475  9894 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:56.408108  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:56.438253  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:56.374840  9693 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:56.438416  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.407299  5718 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:56.440738  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:56.407361  6324 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
W20260709 12:14:56.388904  9905 log.cc:927] Time spent T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.840s	user 0.009s	sys 0.015s
I20260709 12:14:56.446786  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:56.465946  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.387548  9981 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.448365  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:56.448045  6320 raft_consensus.cc:2393] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:56.449306  6328 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.448838  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:56.468312  6325 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
W20260709 12:14:56.478060  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 78084.9us
I20260709 12:14:56.486443  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.490100  6291 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:56.484637  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.491899  5642 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:56.496402  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 50557.4us
I20260709 12:14:56.407758  9700 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:56.506484  6319 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:14:56.443192  9894 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:56.450277  9721 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:56.511217  6321 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:56.395946  9980 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:14:56.409374  9534 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.448205  9950 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:56.479859  9829 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.445989  9990 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:14:56.528362  9950 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.448298  9862 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 12:14:56.543361  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 51550.9us
I20260709 12:14:56.544260  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:56.546491  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 67362.5us
I20260709 12:14:56.547309  6291 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:56.517902  9865 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:56.516777  9733 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:56.519387  9894 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.552816  9992 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:56.548139  9950 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:56.541361  9829 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.526866  9721 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.544932  9988 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.573500  9860 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.574019  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 787) took 2464 ms. Trace:
I20260709 12:14:56.576581  9984 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:56.526060  9924 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.511327  9881 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.580837  6327 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:14:56.594203  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:56.581491  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:56.583498  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:56.582706  5642 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:14:56.571810  9942 consensus_meta.cc:287] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.000s
I20260709 12:14:56.587239  5671 rpcz_store.cc:276] 0709 12:14:54.109869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.110033 (+   164us) service_pool.cc:224] Handling call
0709 12:14:54.110392 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:54.110767 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:54.110791 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:54.111368 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 12:14:54.305165 (+193797us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:54.305203 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.305558 (+   355us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:56.388263 (+2082705us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:14:56.568480 (+180217us) raft_consensus.cc:1685] finished
0709 12:14:56.568502 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:56.573937 (+  5435us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4442,"raft.queue_time_us":1636,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3614,"spinlock_wait_cycles":17205632,"thread_start_us":193424,"threads_started":1,"wal-append.queue_time_us":344953}
I20260709 12:14:56.590372  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:56.591986  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.573551  9414 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.597285  6323 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.597358  6320 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
W20260709 12:14:56.597934  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 75222.8us
I20260709 12:14:56.598520  5642 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:14:56.599903  6324 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
W20260709 12:14:56.600605  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 53389.5us
I20260709 12:14:56.586477  9721 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:56.602537  5642 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:14:56.587051  9992 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:56.608563  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.611900  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.584203  9865 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:56.609298  5671 raft_consensus.cc:1275] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:14:56.616461  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.617146  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:14:56.617794  5671 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:56.619216  9992 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:56.612583  6320 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:56.619386  6291 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:14:56.622764  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.612350  6325 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:14:56.629079  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.629865  6321 raft_consensus.cc:2410] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:56.604308  9984 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:56.630338  5718 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:56.631875  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.635411  6320 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:14:56.632332  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:56.636550  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.609555  9573 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:56.637111  9992 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:56.647511  9996 log.cc:927] Time spent T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:14:56.650647  9829 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.651376  9700 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13.
I20260709 12:14:56.652529  6328 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:14:56.652892  6328 pending_rounds.cc:85] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 7
I20260709 12:14:56.653158  6328 pending_rounds.cc:107] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.8
I20260709 12:14:56.640027  9573 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.653733  9573 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:56.653869  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.654484  6328 raft_consensus.cc:2917] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Aborting config change with OpId 9.8: Aborted: Op aborted by new leader
I20260709 12:14:56.654872  6328 raft_consensus.cc:2889] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 10 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:56.603535  9942 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:56.657085  9942 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:56.657976 10000 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:56.658411 10000 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.658717 10000 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.622599  9924 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:56.643226  5719 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:56.664387  5672 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:56.667759  6323 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:56.635123  9984 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.672775  9988 consensus_queue.cc:1059] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:14:56.686342  9974 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:56.686815  9974 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.687147  9974 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:56.687985  9992 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.696866  6326 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:14:56.634266  9980 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:14:56.696638  9894 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:56.674373  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 55044us
I20260709 12:14:56.667155  9898 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:14:56.703596  5642 connection.cc:256] RPC call timeout handler was delayed by -1.2646667960000286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 12:14:56.706893  5642 connection.cc:256] RPC call timeout handler was delayed by -1.1656667960000959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 12:14:56.707229  5642 connection.cc:256] RPC call timeout handler was delayed by -1.0603667959999257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 12:14:56.707506  5642 connection.cc:256] RPC call timeout handler was delayed by -1.0234667960000934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 12:14:56.707783  5642 connection.cc:256] RPC call timeout handler was delayed by -1.0036667960000614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 12:14:56.708631  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:14:56.677525  9984 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.719498  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:56.719772  9973 raft_consensus.cc:3055] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:56.720103 10000 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.720450  9993 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:56.722259 10000 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.722515  6291 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:56.724105  5675 raft_consensus.cc:1240] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:56.724274  9889 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:56.725678  9889 consensus_queue.cc:1059] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:14:56.726362  6291 leader_election.cc:400] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13.
I20260709 12:14:56.727531  9573 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.720747  9992 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.725904  9989 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:56.730207  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:56.677208  9924 raft_consensus.cc:697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:56.735499  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:14:56.737884  6291 connection.cc:256] RPC call timeout handler was delayed by -2.0791007410000475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:14:56.739588  9978 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:56.743038  5675 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:56.743916  9999 log.cc:927] Time spent T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:14:56.744953  9992 consensus_queue.cc:1059] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:56.742610  9924 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:56.746598  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.745972  9992 raft_consensus.cc:3055] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:56.748246  5642 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:56.750577  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:56.731739  9973 raft_consensus.cc:740] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:56.734674  9989 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:56.761039  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:56.762283  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.748543  9984 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:56.754225  6323 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:14:56.748587  9992 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:56.757840  9534 raft_consensus.cc:2764] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:14:56.766100  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.759127  9889 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.764380  6323 pending_rounds.cc:85] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 8
I20260709 12:14:56.766683  6320 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 10 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:56.767683  6323 pending_rounds.cc:107] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:14:56.767508  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.768297  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:56.768610  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.768815  6320 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:56.767972  6323 raft_consensus.cc:2889] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:56.764149  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:56.764999  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.763581  9989 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.738790  9582 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:56.777010  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 109414us
I20260709 12:14:56.747756  9978 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:56.748730  9865 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:56.752342  9573 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:56.787793  5719 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:56.789577  5753 raft_consensus.cc:1240] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:56.796795  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 123797us
I20260709 12:14:56.790841  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.765955  9886 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.813289  5719 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:56.776885  9582 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:56.827804  5719 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:56.830639  5719 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:56.831550  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:56.832170  5675 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:14:56.834710  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 70651.3us
I20260709 12:14:56.835443  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:56.837677  9924 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.838869  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:56.811327  9982 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:56.765535  9721 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:56.839583  6323 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:56.822767  9727 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:56.833114 10000 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:57.141192  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:57.144925  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 314350us
I20260709 12:14:56.788968  9889 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.147859  6323 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.842073 10009 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:56.811619  9978 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:57.160373  6320 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:57.154559  9721 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:57.078883  9727 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:14:56.833560  9977 consensus_queue.cc:1059] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.310s
I20260709 12:14:57.176597  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:57.177198  6320 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:57.201741  6320 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:57.203291  6323 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:56.848937  9982 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:14:57.175565 10007 log.cc:927] Time spent T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 12:14:57.183001  9727 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:57.173363 10000 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:14:57.240217 10008 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:14:57.240734  9984 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:57.217859  9894 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:57.081806  9973 consensus_queue.cc:260] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.208994  9948 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:57.243337  9998 log.cc:927] Time spent T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:14:57.253688  9948 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:57.254334 10000 raft_consensus.cc:697] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:14:57.259394  9974 consensus_meta.cc:287] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 12:14:57.259284  9973 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:57.265260  5675 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:14:57.271461  9948 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:57.291814  9978 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:14:57.295996  9950 consensus_meta.cc:287] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.003s
I20260709 12:14:57.274344  9974 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.288494  9948 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:57.304041  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:57.299477  9889 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:57.314960  9987 raft_consensus.cc:3055] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:57.326025  9853 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:57.326771  9853 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.328902  9853 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:57.331425  9982 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:57.299723 10000 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.338047  9966 raft_consensus.cc:3055] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:57.338464  9966 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:57.339274  9966 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.329739  9987 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:57.300417  9950 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:57.349953  5600 raft_consensus.cc:1240] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:57.353026  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:57.353870  5595 raft_consensus.cc:2393] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 12: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:57.358495  9987 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.342269  9853 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:57.372022  5752 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:57.373204  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:57.374015  5750 raft_consensus.cc:2368] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 11. Current term is 12.
W20260709 12:14:57.368330  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.370757  5595 raft_consensus.cc:1240] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:57.375788  5744 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:14:57.359655  9987 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:57.381549  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:57.381877  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:57.382743  6323 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:14:57.383520  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:57.383744  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:57.384429  5744 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:14:57.376652  9853 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:57.386469  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:57.387048  6320 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:57.388895  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:57.390089  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:57.390215  5747 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:57.390793  5745 raft_consensus.cc:2368] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11.
I20260709 12:14:57.396075  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:57.391345  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:57.399071  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:57.399904  5751 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 13: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:14:57.400520  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:57.400806  5747 raft_consensus.cc:2393] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 12: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:57.401173  5673 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:57.403347  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:57.403959  5749 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:57.384456  9950 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:57.407234  5746 raft_consensus.cc:1240] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:57.402884  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:57.402194  9978 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.379840  9948 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:14:57.423100  6291 leader_election.cc:400] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 11. Current term is 12.
I20260709 12:14:57.423484  6291 leader_election.cc:403] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:57.424624  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:57.425311 10028 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:57.425920  9989 consensus_meta.cc:287] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.613s	user 0.004s	sys 0.007s
I20260709 12:14:57.425804  9978 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.426321  9989 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.427826  9973 consensus_queue.cc:1059] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:57.428208  9989 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:57.413295  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:57.428787  9989 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:57.429255  5751 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:57.428850  9700 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:57.414140  9853 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:57.430168  9700 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.430568  9700 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:57.427953  9978 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:57.414950  9727 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.418670  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:14:57.418467  5748 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
W20260709 12:14:57.439471  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 62053.6us
I20260709 12:14:57.442741  5567 leader_election.cc:400] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9.
I20260709 12:14:57.443571  5567 leader_election.cc:403] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:57.444105  9853 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:57.446105 10037 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.446745 10037 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.448761 10037 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:57.454559 10028 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for earlier term 11. Current term is 12.
I20260709 12:14:57.434010  9909 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:14:57.458519  9909 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:57.459434  9909 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:57.460439  9909 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:57.463759  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:57.464388  6327 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:57.467341  5718 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:57.470055  5749 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:14:57.430516  9974 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:57.473964  5673 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:14:57.468623  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:57.480955  6327 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:14:57.487700  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:57.487107  5748 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14. Ops: []
I20260709 12:14:57.489219  5749 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:57.489702  5718 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:57.486663  6291 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:14:57.487977  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:57.492010  6327 raft_consensus.cc:2376] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 13. Re-sending same reply.
I20260709 12:14:57.495134  5642 leader_election.cc:400] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11.
I20260709 12:14:57.495754  5642 leader_election.cc:403] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:57.497015  5642 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:57.497645  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:57.498073  5642 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:57.498222  6327 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:57.500733  9978 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:57.486330 10036 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:57.503523  9721 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:57.479982 10028 consensus_queue.cc:1059] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:14:57.507027  5749 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:14:57.507301 10028 raft_consensus.cc:3055] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:57.511392 10028 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:57.507668  9691 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11.
I20260709 12:14:57.512133  9691 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:57.508096 10014 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:57.512638  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:57.512639 10014 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.510843  6327 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:14:57.514771  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:57.512280 10028 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.516166 10028 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:57.507349  9721 raft_consensus.cc:697] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:57.515071 10036 raft_consensus.cc:697] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:14:57.517668  9727 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:57.517868  9691 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.518328  9691 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:57.518556 10036 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.521188  9853 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 8. Current term is 9.
I20260709 12:14:57.522082  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:57.522603  6328 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:14:57.511652  9978 consensus_queue.cc:1059] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:14:57.526708  9978 raft_consensus.cc:3055] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:57.527056  9978 raft_consensus.cc:740] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:57.517455  9721 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.531553  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:57.532433  5602 raft_consensus.cc:2410] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:57.508661  5642 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:14:57.513525 10014 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:57.537230  6319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 929) took 1097 ms. Trace:
I20260709 12:14:57.527827  9978 consensus_queue.cc:260] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:57.537628  6319 rpcz_store.cc:276] 0709 12:14:56.439701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.439803 (+   102us) service_pool.cc:224] Handling call
0709 12:14:56.448477 (+  8674us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:56.511833 (+ 63356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:57.536933 (+1025100us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b5400595bd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:57.537142 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132378880}
I20260709 12:14:57.538069  9984 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:57.538586  9984 raft_consensus.cc:697] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:57.539425  9984 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:14:57.540041  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 59007.3us
I20260709 12:14:57.541940  9987 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:57.543237  9894 consensus_queue.cc:1059] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:57.544173 10015 raft_consensus.cc:3055] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:14:57.544517 10015 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:14:57.544974  5746 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:14:57.545279 10015 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:57.542104  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:14:57.550698  6323 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
W20260709 12:14:57.551128  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.551548  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:57.552232  6323 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:14:57.552819 10037 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:14:57.553333 10037 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:57.555408  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:14:57.555975  9873 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.556460  9873 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:57.486527  9700 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.556012 10037 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:57.559466  9948 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.559969  9948 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:57.563103  9700 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:57.563855  9873 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:14:57.564584  9948 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:57.565737 10015 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:57.569444  6322 raft_consensus.cc:2376] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 8. Re-sending same reply.
I20260709 12:14:57.574756  6320 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:14:57.563133  5570 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:57.579428  9948 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:14:57.582921  9978 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:57.587671  5570 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:57.589979  9948 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:57.649367  5570 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:14:57.651888  5570 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:14:57.792132  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 140309us
W20260709 12:14:57.841434  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 48537.3us
I20260709 12:14:57.842363  5570 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:14:57.865434  5570 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:14:57.892454  5570 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:14:58.013545  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 121180us
W20260709 12:14:58.014830  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:58.462586 10014 consensus_meta.cc:287] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.928s	user 0.009s	sys 0.000s
W20260709 12:14:58.599995  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.515923 10014 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:58.700959 10014 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:58.926775  5625 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8100 after lost signal to thread 4412
W20260709 12:14:59.264776  5567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.249s	user 0.008s	sys 0.050s
W20260709 12:14:59.265237  5567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.008s	sys 0.050s
I20260709 12:14:57.791060  9948 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:59.441079  9966 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:59.454285  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:59.505404  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.468864  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 841) took 1974 ms. Trace:
I20260709 12:14:59.506139  6328 rpcz_store.cc:276] 0709 12:14:57.494838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.467982 (+1973144us) service_pool.cc:224] Handling call
0709 12:14:59.468339 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:59.468539 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:59.468565 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:59.468605 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:59.468636 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.468686 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.468802 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:59.437618  9948 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.520161  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:14:59.559356  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:59.574402  5604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 581) took 2225 ms (client timeout 2795 ms). Trace:
W20260709 12:14:59.574855  5604 rpcz_store.cc:269] 0709 12:14:57.348546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.519836 (+2171290us) service_pool.cc:224] Handling call
0709 12:14:59.574330 (+ 54494us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:59.610438  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.597396  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1673) took 4463 ms. Trace:
I20260709 12:14:59.620680  5753 rpcz_store.cc:276] 0709 12:14:55.133988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.134683 (+   695us) service_pool.cc:224] Handling call
0709 12:14:55.914769 (+780086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:56.811396 (+896627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:57.543689 (+732293us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54002175d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:14:59.597154 (+2053465us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54002175d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:14:59.597293 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3623746176}
I20260709 12:14:59.574617  9948 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.615408 10037 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:59.629750 10037 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.632736 10037 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:59.643333 10037 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:59.644449 10037 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:59.645648 10037 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:59.646306 10037 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.646932 10037 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.650375  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:59.651674  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:59.652379  5749 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 14: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:59.683125  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:59.683822  5751 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:59.716996  9948 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:59.653108  9414 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.724620  5749 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:59.753582  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:59.727125  9721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.195s	user 0.013s	sys 0.024s
W20260709 12:14:59.739485  5671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.204s	user 0.058s	sys 0.101s
I20260709 12:14:59.744175  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:59.759829  5671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.225s	user 0.060s	sys 0.102s
I20260709 12:14:59.760293  5748 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:59.761348  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:59.761860  5748 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:59.762657  9414 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:14:59.764803  9414 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:59.765924  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:59.767051  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:59.767985  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:14:59.768620  5749 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 11: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:14:59.769299  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:14:59.759740  9721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.227s	user 0.014s	sys 0.025s
I20260709 12:14:59.798552 10037 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:59.816461  9948 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:14:59.746403  5716 connection.cc:256] RPC call timeout handler was delayed by -1.7080490180001107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 12:14:59.839543  5716 connection.cc:256] RPC call timeout handler was delayed by -1.6684490180000466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 12:14:59.839989  5716 connection.cc:256] RPC call timeout handler was delayed by -1.557749018000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
W20260709 12:14:59.840308  5716 connection.cc:256] RPC call timeout handler was delayed by -1.4191490180000983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260709 12:14:59.840621  5716 connection.cc:256] RPC call timeout handler was delayed by -1.2265490180000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 12:14:59.840925  5716 connection.cc:256] RPC call timeout handler was delayed by -1.2058490179999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
I20260709 12:14:59.847386  5748 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:14:59.754676  5751 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:14:59.860069  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:14:59.870121  5751 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:59.862797  5749 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:59.890234  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.817101  9948 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.817117  9988 raft_consensus.cc:3055] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:59.924597  5749 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:14:59.860096 10037 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:59.912634  9988 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:14:59.972246  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:14:59.976511  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:14:59.978399  5602 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:59.982661  9980 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.983219  9980 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:59.985275  9980 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:59.986083  9461 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.986544  9461 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:59.988531  9461 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:59.988991  9461 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.989915  9981 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:14:59.990438  9981 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:14:59.992489  9981 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:14:59.989388  9461 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:00.004619  9461 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:14:59.913726  9948 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:00.011466  6320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 939) took 2623 ms (client timeout 1936 ms). Trace:
W20260709 12:15:00.061018  6320 rpcz_store.cc:269] 0709 12:14:57.388222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.388673 (+   451us) service_pool.cc:224] Handling call
0709 12:15:00.011195 (+2622522us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400572954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:00.011331 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358983040}
I20260709 12:15:00.065007  9988 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:00.069700  9978 consensus_meta.cc:287] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 2.486s	user 0.004s	sys 0.020s
I20260709 12:15:00.116392  5744 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:00.119128  5744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44966 (request call id 2252) took 2730 ms. Trace:
I20260709 12:15:00.120203  5744 rpcz_store.cc:276] 0709 12:14:57.388593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.388731 (+   138us) service_pool.cc:224] Handling call
0709 12:15:00.115930 (+2727199us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5800044198. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:15:00.116177 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:00.118801 (+  2624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:00.119034 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5575424}
I20260709 12:15:00.081558  9948 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:00.067538  9988 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:00.166711  9948 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.167280  9948 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:00.168892  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2386) took 3879 ms. Trace:
I20260709 12:15:00.169302  5676 rpcz_store.cc:276] 0709 12:14:56.289558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.294651 (+  5093us) service_pool.cc:224] Handling call
0709 12:14:56.294912 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:56.371881 (+ 76969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:56.371912 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:56.371952 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:56.371987 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:00.168644 (+3796657us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b54003561d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:00.168695 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:00.168833 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176574848}
I20260709 12:15:00.043303 10037 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:00.571345 10037 raft_consensus.cc:697] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:00.629609 10037 consensus_queue.cc:237] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:00.828074  5748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.021s	sys 0.053s
W20260709 12:15:00.828589  5748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.021s	sys 0.053s
W20260709 12:15:00.842820  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:00.843936  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:00.844426  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:00.169402  9948 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:00.578215  9969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.000s	sys 0.013s
W20260709 12:15:01.269104  6291 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.4.78.126:44725, user_credentials={real_user=slave}} blocked reactor thread for 65089.9us
W20260709 12:15:01.270358  6291 connection.cc:256] RPC call timeout handler was delayed by -2.0846116660000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:15:01.273294  9969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.291s	user 0.000s	sys 0.014s
I20260709 12:15:01.231192  9948 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:01.634693  9948 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:01.637142  9948 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:01.637692  9948 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.638159  9948 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:01.640836  9948 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:01.641341  9948 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:15:01.767431  5716 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.826s	user 0.011s	sys 0.006s
W20260709 12:15:01.767891  5716 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.827s	user 0.011s	sys 0.006s
W20260709 12:15:01.768186  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 1.86351e+06us
W20260709 12:15:01.768746  5716 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.717s (SENT) [suppressed 12 similar messages]
W20260709 12:15:01.419835 10037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.010s	sys 0.008s
W20260709 12:15:01.892130 10037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.010s	sys 0.008s
I20260709 12:15:01.893163 10037 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.893824 10037 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:01.896100 10037 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:01.928254  5752 raft_consensus.cc:1240] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:01.935197  5717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.024s	sys 0.076s
W20260709 12:15:01.950790  5717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.066s	user 0.024s	sys 0.076s
W20260709 12:15:01.955581  6291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.001s	sys 0.014s
W20260709 12:15:01.956980  6291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.002s	sys 0.014s
I20260709 12:15:01.870874  9948 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:01.977039  9948 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:01.977567  9948 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:01.979621  9948 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:01.980962  9948 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:01.964483 10037 consensus_queue.cc:1059] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:15:01.984035 10037 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:57.547646  5642 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:01.987705 10037 raft_consensus.cc:3055] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:01.981393  9948 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:01.988230  9988 consensus_meta.cc:287] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 1.832s	user 0.011s	sys 0.002s
I20260709 12:15:02.005724 10020 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.006377 10020 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:02.008919 10020 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:15:02.018837  9987 consensus_meta.cc:287] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 4.476s	user 0.043s	sys 0.047s
I20260709 12:15:02.019407  9987 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:02.020188  6319 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:02.020716  9693 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.021258  9693 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:02.020155  9987 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:02.028141  9987 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:02.030501  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:02.031126  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:02.031417  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.033273  9987 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:02.029356  9853 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:15:01.991060 10037 raft_consensus.cc:740] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:02.045073 10037 consensus_queue.cc:260] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:02.042423  9948 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:02.042809  9691 consensus_meta.cc:287] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 4.524s	user 0.017s	sys 0.030s
I20260709 12:15:02.163925  9691 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:02.164392  9889 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.165022  9889 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:02.250231  9988 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.305534  9988 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:02.368804  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:02.546118  5717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.005s	sys 0.002s
W20260709 12:15:02.547176  5717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.006s	sys 0.002s
I20260709 12:15:02.571067  9988 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:02.571918  9988 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.572481  9988 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:02.574714  9988 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:02.575379  6291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.008s
W20260709 12:15:03.025221  6291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.000s	sys 0.008s
W20260709 12:15:03.025604  6291 connection.cc:256] RPC call timeout handler was delayed by -1.4199381050000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 12:15:03.025974  6291 connection.cc:256] RPC call timeout handler was delayed by -1.3866381049999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 12:15:03.026309  6291 connection.cc:256] RPC call timeout handler was delayed by -1.3866381049999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 12:15:03.026607  6291 connection.cc:256] RPC call timeout handler was delayed by -1.3412116659999356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2795s for a response
W20260709 12:15:03.026880  6291 connection.cc:256] RPC call timeout handler was delayed by -1.1162116659997992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3045s for a response
I20260709 12:15:03.028363  6320 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:03.028451  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:03.029127  6327 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:03.029445  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:03.029682  6291 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:02.575958  9691 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:03.030076  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:03.030604  6327 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:03.026041  6292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.004s	sys 0.009s
I20260709 12:15:03.031381  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:03.032238  6320 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 10 LEARNER]: Advancing to term 11
W20260709 12:15:03.032202  6292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.005s	sys 0.010s
I20260709 12:15:03.030205  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:03.056591  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:03.057284  6323 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:15:03.058058  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:03.058706  6328 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:15:02.547262 10037 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:03.167330  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:03.176309  6320 raft_consensus.cc:2410] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 11 LEARNER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:15:03.176234  6327 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:03.161998 10001 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.177798 10001 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:03.179286  9889 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:03.179842  9889 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.180269  9889 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:03.187206  9889 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:03.195587  9889 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:03.197510 10001 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:03.198489  9889 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:03.212481  9889 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:03.215704  9889 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.218093  9889 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:03.230923  9889 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:03.234027  9889 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.237375  9889 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:03.249701  5569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.302s	user 0.014s	sys 0.014s
W20260709 12:15:03.250134  5569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.302s	user 0.017s	sys 0.014s
W20260709 12:15:03.251042  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.251677  9889 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:03.257414 10029 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:15:03.258836  6293 connection.cc:256] RPC call timeout handler was delayed by -4.2690389550000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 12:15:03.268226  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:03.260605 10029 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:03.270849  5600 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 13: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:03.277096  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:03.277921  5602 raft_consensus.cc:2393] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:03.272991  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:03.280625  6321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:15:03.281220  6321 raft_consensus.cc:606] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:03.282949  6321 raft_consensus.cc:614] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:03.283174  9889 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.279121 10029 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:03.295799 10029 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:03.295723  9889 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:03.305589  5602 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:03.306991  5602 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:03.280754  5600 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:03.299853 10029 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:03.314079  9889 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:03.883421  5569 connection.cc:256] RPC call timeout handler was delayed by -2.0418547849999413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 12:15:09.095386  5569 connection.cc:256] RPC call timeout handler was delayed by -1.9248547849997522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:15:09.095806  5569 connection.cc:256] RPC call timeout handler was delayed by -1.8240547849998165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 12:15:09.096174  5569 connection.cc:256] RPC call timeout handler was delayed by -1.6998547849998431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:15:09.096462  5569 connection.cc:256] RPC call timeout handler was delayed by -1.64225478499975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 12:15:09.096727  5569 connection.cc:256] RPC call timeout handler was delayed by -1.6215547849997165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 12:15:09.096974  5569 connection.cc:256] RPC call timeout handler was delayed by -1.5540547849998347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260709 12:15:09.097293  5569 connection.cc:256] RPC call timeout handler was delayed by -1.5000547849997474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
W20260709 12:15:09.098966  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:09.099829  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:03.883618  5600 consensus_meta.cc:287] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.002s
I20260709 12:15:09.103729  5600 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:03.460489  5602 raft_consensus.cc:1240] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:04.039136  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:15:04.339793  5700 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2ae0 after lost signal to thread 4409
W20260709 12:15:09.109495  5700 debug-util.cc:398] Leaking SignalData structure 0x7b08002ccc20 after lost signal to thread 4412
I20260709 12:15:00.088217  5598 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:04.414196  5597 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:09.111634 10051 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.409536  5747 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:09.112367 10051 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.113158  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1682) took 9462 ms. Trace:
I20260709 12:15:09.113876 10088 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.111658  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 583) took 11762 ms. Trace:
I20260709 12:15:09.113559  5747 rpcz_store.cc:276] 0709 12:14:59.650643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.408332 (+4757689us) service_pool.cc:224] Handling call
0709 12:15:04.409198 (+   866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.112897 (+4703699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.113082 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:09.114637 10088 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:04.431337  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.496088 10057 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.500873 10046 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:04.394814  6319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 942) took 6986 ms. Trace:
I20260709 12:15:09.117388 10086 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:04.188522  6324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58720 (request call id 933) took 7740 ms (client timeout 2606 ms). Trace:
W20260709 12:15:09.130057  6324 rpcz_store.cc:269] 0709 12:14:56.447360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.486044 (+ 38684us) service_pool.cc:224] Handling call
0709 12:15:04.187831 (+7701787us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400092ed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:04.188154 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258176384}
I20260709 12:15:04.503684 10049 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.519915 10071 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.132077 10071 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.135156 10071 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:04.509900 10055 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.136111 10055 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:04.524300 10072 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:04.524905 10074 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.525826 10077 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:05.128852 10059 log.cc:927] Time spent T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.585s	user 0.000s	sys 0.001s
W20260709 12:15:05.901832  6293 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.004s	sys 0.011s
W20260709 12:15:05.942845  5750 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.164s	user 0.012s	sys 0.002s
I20260709 12:15:06.139675  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2401) took 9529 ms. Trace:
W20260709 12:15:06.717139  5599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 585) took 9367 ms (client timeout 1969 ms). Trace:
W20260709 12:15:05.988888  6353 heartbeater.cc:646] Failed to heartbeat to 127.4.78.126:44725 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.78.126:44725 timed out after 15.000s (SENT)
I20260709 12:15:09.148474  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 582) took 11799 ms. Trace:
I20260709 12:15:09.148937  5603 rpcz_store.cc:276] 0709 12:14:57.348808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.348899 (+    91us) service_pool.cc:224] Handling call
0709 12:14:57.353865 (+  4966us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:57.366016 (+ 12151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:57.366053 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:57.367487 (+  1434us) log.cc:844] Serialized 52 byte log entry
0709 12:14:59.619647 (+2252160us) spinlock_profiling.cc:243] Waited 990 us on lock 0x7b18003bdb80. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:14:59.750231 (+130584us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:59.914822 (+164591us) log.cc:844] Serialized 14 byte log entry
0709 12:14:59.928890 (+ 14068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.928971 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:09.147849 (+9218878us) raft_consensus.cc:1685] finished
0709 12:15:09.147981 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:09.148270 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9003,"prepare.queue_time_us":4775691,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":3105,"raft.queue_time_us":2079510,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":5407,"spinlock_wait_cycles":2277248,"thread_start_us":191116,"threads_started":2,"wal-append.queue_time_us":7168902}
W20260709 12:15:09.141389  5599 rpcz_store.cc:269] 0709 12:14:57.349588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.716702 (+9367114us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:06.716924 (+   222us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:15:09.152616  9873 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.162022  9630 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.538748  9909 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.179584  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 1.16308e+07us
I20260709 12:15:09.183307  9909 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:04.447078  9910 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.186663  9910 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:06.957960  9989 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.153106  9992 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.196820  9992 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:07.782150  5595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2338) took 4529 ms (client timeout 1541 ms). Trace:
W20260709 12:15:09.197952  5595 rpcz_store.cc:269] 0709 12:15:03.252420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.781740 (+4529320us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:07.781945 (+   205us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:15:09.199025  5595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2351) took 5736 ms (client timeout 1959 ms). Trace:
W20260709 12:15:09.199398  5595 rpcz_store.cc:269] 0709 12:15:03.462430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.198812 (+5736382us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:09.198962 (+   150us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:15:09.200378  5595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2356) took 5736 ms (client timeout 1965 ms). Trace:
W20260709 12:15:09.200727  5595 rpcz_store.cc:269] 0709 12:15:03.463631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.200164 (+5736533us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:09.200317 (+   153us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:15:07.999559  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:00.012703  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:09.202204  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:09.202781  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.202874 10014 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.560851  5601 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:09.203917  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2341) took 5941 ms. Trace:
I20260709 12:15:09.203682 10014 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.204506  5601 rpcz_store.cc:276] 0709 12:15:03.262731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.559762 (+5297031us) service_pool.cc:224] Handling call
0709 12:15:08.560272 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.203548 (+643276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.203828 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:08.447304  9956 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.205673  5601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2347) took 5744 ms (client timeout 2142 ms). Trace:
I20260709 12:15:08.723851  9973 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:15:09.206077  5601 rpcz_store.cc:269] 0709 12:15:03.461456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.205444 (+5743988us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:09.205607 (+   163us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:15:09.206936 10014 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:08.925350  5673 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:08.959442  6291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 5.819s	user 0.026s	sys 0.044s
I20260709 12:15:08.962181  9982 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.965822  5748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1691) took 9255 ms. Trace:
W20260709 12:15:08.971868  4414 debug-util.cc:398] Leaking SignalData structure 0x7b080000fe00 after lost signal to thread 5642
W20260709 12:15:08.974184 10037 consensus_meta.cc:287] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 5.800s	user 0.040s	sys 0.042s
I20260709 12:15:09.207929  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2418) took 11703 ms. Trace:
W20260709 12:15:08.982177  5705 maintenance_manager.cc:445] Time spent finding best maintenance operation: real 12.204s	user 0.057s	sys 0.093s
I20260709 12:15:08.996309  9832 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.996867  9983 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.207034  5601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2355) took 5743 ms (client timeout 2152 ms). Trace:
I20260709 12:15:09.206159  9956 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:08.997462  5716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 5.902s	user 0.027s	sys 0.042s
I20260709 12:15:08.998765 10001 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.000015  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 575) took 11623 ms. Trace:
I20260709 12:15:09.001991  9962 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:08.997500  9878 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.167127  6293 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 4.627s	user 0.004s	sys 0.012s
W20260709 12:15:09.212579  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 4.67294e+06us
W20260709 12:15:09.072484  5625 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8380 after lost signal to thread 5535
I20260709 12:15:09.207864  5748 rpcz_store.cc:276] 0709 12:14:59.710035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.909165 (+199130us) service_pool.cc:224] Handling call
0709 12:14:59.930328 (+ 21163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:59.930769 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:59.930798 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:59.942323 (+ 11525us) log.cc:844] Serialized 26 byte log entry
0709 12:15:00.829007 (+886684us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:00.829058 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:00.829143 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.965280 (+8136137us) raft_consensus.cc:1685] finished
0709 12:15:08.965314 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:08.965597 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":7203,"thread_start_us":701823,"threads_started":1,"wal-append.queue_time_us":4498884,"wal-append.run_cpu_time_us":2732,"wal-append.run_wall_time_us":1594429}
I20260709 12:15:09.082690  5745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 578) took 11690 ms. Trace:
I20260709 12:15:09.084234  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:03.173323  9693 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:09.104660  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2342) took 5841 ms (client timeout 2109 ms). Trace:
I20260709 12:15:09.208976  9983 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.106897  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2345) took 5647 ms. Trace:
W20260709 12:15:09.215831  5600 rpcz_store.cc:269] 0709 12:15:03.263002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.272505 (+  9503us) service_pool.cc:224] Handling call
0709 12:15:09.104526 (+5832021us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:09.212807  5716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 6.118s	user 0.028s	sys 0.043s
I20260709 12:15:09.108042  5604 raft_consensus.cc:2368] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10.
I20260709 12:15:09.112730 10087 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.216856  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2346) took 5755 ms (client timeout 2245 ms). Trace:
I20260709 12:15:09.213230  9962 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:09.217373  5604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2337) took 5965 ms (client timeout 1754 ms). Trace:
I20260709 12:15:09.217482 10087 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:09.218067  5604 rpcz_store.cc:269] 0709 12:15:03.252169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.038305 (+786136us) service_pool.cc:224] Handling call
0709 12:15:09.217294 (+5178989us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:09.218894  5604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2349) took 5757 ms (client timeout 2591 ms). Trace:
I20260709 12:15:09.116711  9833 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.210769  5752 rpcz_store.cc:276] 0709 12:14:57.376096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.376219 (+   123us) service_pool.cc:224] Handling call
0709 12:14:57.376487 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:01.950657 (+4574170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.999457 (+7048800us) spinlock_profiling.cc:243] Waited 4.55 s on lock 0x7b5400257954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:08.999835 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10467439872}
I20260709 12:15:09.116325 10057 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:09.219434  5600 rpcz_store.cc:269] 0709 12:15:03.461192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.216658 (+5755466us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:09.216802 (+   144us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:15:09.220432  5716 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.65:38715 timed out after 1.533s (SENT) [suppressed 5 similar messages]
I20260709 12:15:09.220118  9833 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:09.219188  5604 rpcz_store.cc:269] 0709 12:15:03.461939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.218711 (+5756772us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:09.218844 (+   133us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:15:09.220762  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:04.510727 10065 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.222309  9833 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.222190 10065 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.219774 10087 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.223206  9956 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.223889  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.224398 10065 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:09.116483  5719 connection.cc:256] RPC call timeout handler was delayed by -5.46200508600009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 12:15:09.224997  5719 connection.cc:256] RPC call timeout handler was delayed by -5.2125187690000985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 12:15:09.225314  5719 connection.cc:256] RPC call timeout handler was delayed by -5.1729187690000344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
I20260709 12:15:09.117676  6319 rpcz_store.cc:276] 0709 12:14:57.408693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.558748 (+150055us) service_pool.cc:224] Handling call
0709 12:14:57.559052 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.020701 (+4461649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.394160 (+2373459us) spinlock_profiling.cc:243] Waited 4.46 s on lock 0x7b54005cd854. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:04.394577 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10259112320}
I20260709 12:15:09.114533  5597 rpcz_store.cc:276] 0709 12:14:57.349063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.413007 (+7063944us) service_pool.cc:224] Handling call
0709 12:15:04.413722 (+   715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.111391 (+4697669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.111603 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:09.118566 10088 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.202836 10095 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.235208  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.235961  5600 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:09.236573  5719 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:09.235340 10095 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.237413  9833 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:09.221361  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.238102  9833 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:09.234390  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.120369 10085 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.122539  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1686) took 9469 ms. Trace:
I20260709 12:15:09.226596 10014 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:15:09.119259  5700 debug-util.cc:398] Leaking SignalData structure 0x7b08002e6300 after lost signal to thread 5535
I20260709 12:15:09.239542 10014 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.122224 10089 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.240458  5700 debug-util.cc:398] Leaking SignalData structure 0x7b0800169b00 after lost signal to thread 5628
I20260709 12:15:09.240762 10089 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:09.241596  5700 debug-util.cc:398] Leaking SignalData structure 0x7b0800087520 after lost signal to thread 5703
W20260709 12:15:09.241914  5700 debug-util.cc:398] Leaking SignalData structure 0x7b0800087500 after lost signal to thread 5704
W20260709 12:15:09.120455  5746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2261) took 11685 ms (client timeout 2591 ms). Trace:
W20260709 12:15:09.097610  5569 connection.cc:256] RPC call timeout handler was delayed by -1.2957547849998718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24710000000000001s for a response
I20260709 12:15:09.116087  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:04.523559 10058 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.143123 10055 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.243436  5747 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:09.132016 10049 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.146013 10074 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.140460  5671 rpcz_store.cc:276] 0709 12:14:56.609589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.618379 (+  8790us) service_pool.cc:224] Handling call
0709 12:14:56.618711 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:56.627788 (+  9077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:56.627816 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:56.628243 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 12:14:57.535206 (+906963us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b18003a5520. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:14:59.760288 (+2225082us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:59.760327 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.760391 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:06.138966 (+6378575us) raft_consensus.cc:1685] finished
0709 12:15:06.139003 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:06.139386 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12222,"raft.queue_time_us":8754,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":9652,"spinlock_wait_cycles":5554048,"thread_start_us":2224895,"threads_started":1,"wal-append.queue_time_us":7910377,"wal-append.run_cpu_time_us":2518,"wal-append.run_wall_time_us":1002545}
W20260709 12:15:09.152024  5603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2350) took 5689 ms (client timeout 1557 ms). Trace:
I20260709 12:15:04.425232  9898 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.267997  9898 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.268591 10095 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:09.153410  5599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2348) took 5691 ms (client timeout 1936 ms). Trace:
I20260709 12:15:09.154351 10077 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.275614  6323 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:09.276571  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.277408 10077 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.158166  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2320) took 14440 ms. Trace:
W20260709 12:15:09.256546  5645 connection.cc:256] RPC call timeout handler was delayed by -1.2449506750001547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2606s for a response
I20260709 12:15:09.285945  5598 rpcz_store.cc:276] 0709 12:14:54.717254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.718439 (+  1185us) service_pool.cc:224] Handling call
0709 12:14:55.600025 (+881586us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b5800002d98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:14:55.600239 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.111075 (+13510836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.141730 (+ 30655us) spinlock_profiling.cc:243] Waited 4.49 s on lock 0x7b540009c9d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:09.157856 (+ 16126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10325784192}
I20260709 12:15:09.287454  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.288663  9983 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:09.160305 10091 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.289482 10091 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.216199  5745 rpcz_store.cc:276] 0709 12:14:57.392239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.392341 (+   102us) service_pool.cc:224] Handling call
0709 12:14:57.392644 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:57.407487 (+ 14843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:57.407517 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:59.510416 (+2102899us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b2c000e2328. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fc344a11 00007f44fc354372 00007f44fda86a01 00007f44fda4b43a 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2
0709 12:14:59.510909 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:14:59.669998 (+159089us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:59.674471 (+  4473us) log.cc:844] Serialized 14 byte log entry
0709 12:14:59.674706 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.675581 (+   875us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:00.123781 (+448200us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b48001a01d8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4502974aa1 00007f450296bb37 00007f450296b9ca 00007f4502a6326f 00007f4502a62f37 00007f4502a7755c 00007f4502a77508 00007f4502a77488 00007f4502a77443 00007f4502a766ec 00007f45019a0a96
0709 12:15:09.082268 (+8958487us) raft_consensus.cc:1685] finished
0709 12:15:09.082308 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:09.082521 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14491,"prepare.queue_time_us":4879881,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":110,"raft.queue_time_us":14948,"raft.run_cpu_time_us":12931,"raft.run_wall_time_us":2736444,"spinlock_wait_cycles":54965632,"thread_start_us":162696,"threads_started":2,"wal-append.queue_time_us":5618299,"wal-append.run_cpu_time_us":2995,"wal-append.run_wall_time_us":1003034}
I20260709 12:15:09.291313  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:15:09.167992  5750 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 4.637s	user 0.013s	sys 0.003s
I20260709 12:15:09.170435 10051 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.172036  9978 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.292033  5745 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:09.175038  5630 maintenance_manager.cc:445] Time spent finding best maintenance operation: real 11.180s	user 0.076s	sys 0.153s
I20260709 12:15:09.175699 10015 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.181908  9691 raft_consensus.cc:2804] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:09.182199  9630 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.179514  9886 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.192245  9910 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.192909  5753 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:09.181910  9894 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.193742  9306 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.194721  9909 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:09.194654  9989 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:09.203188  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.206643  9973 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:08.797899  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8520 after lost signal to thread 4409
W20260709 12:15:09.300630  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0020 after lost signal to thread 4412
W20260709 12:15:09.300944  6349 debug-util.cc:398] Leaking SignalData structure 0x7b080015ede0 after lost signal to thread 4414
W20260709 12:15:08.923563  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:09.207688  6291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 6.068s	user 0.026s	sys 0.044s
I20260709 12:15:08.981690  5596 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:15:09.208961  9832 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:09.203316 10093 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:15:09.208834  5601 rpcz_store.cc:269] 0709 12:15:03.463399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.206843 (+5743444us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:09.206979 (+   136us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:15:09.209118  5673 rpcz_store.cc:276] 0709 12:14:57.504660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.924358 (+11419698us) service_pool.cc:224] Handling call
0709 12:15:08.924978 (+   620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.207632 (+282654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.207833 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:09.209841  9878 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.042950 10029 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.304801  9894 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.306028 10093 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.306483  9886 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.308395 10093 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.308871  9978 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.310947  6321 pending_rounds.cc:85] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 8
I20260709 12:15:09.311290  6321 pending_rounds.cc:107] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:15:09.311548  6321 raft_consensus.cc:2889] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:09.211182 10092 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.306206  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.211561 10001 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.077601  5749 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:09.221464 10057 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.116488 10046 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.216053  5602 rpcz_store.cc:276] 0709 12:15:03.459784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.459943 (+   159us) service_pool.cc:224] Handling call
0709 12:15:03.460288 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.106363 (+5646075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.106735 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:09.215113  5625 debug-util.cc:398] Leaking SignalData structure 0x7b0800302a20 after lost signal to thread 5628
I20260709 12:15:09.225389  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:15:09.201572  5595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2352) took 5738 ms (client timeout 2083 ms). Trace:
I20260709 12:15:09.219370  9962 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.234090 10072 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.359773 10072 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.361860 10015 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:09.363584  5625 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb980 after lost signal to thread 5703
W20260709 12:15:09.363924  5625 debug-util.cc:398] Leaking SignalData structure 0x7b08003e89a0 after lost signal to thread 5704
I20260709 12:15:09.364040 10015 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:09.365082  5625 debug-util.cc:398] Leaking SignalData structure 0x7b08001133c0 after lost signal to thread 5777
W20260709 12:15:09.365075  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 6.33488e+06us
I20260709 12:15:09.207989  9982 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.367448  5753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1678) took 9719 ms. Trace:
I20260709 12:15:09.367851  5753 rpcz_store.cc:276] 0709 12:14:59.647691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.647833 (+   142us) service_pool.cc:224] Handling call
0709 12:14:59.648167 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.365115 (+9716948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.367167 (+  2052us) spinlock_profiling.cc:243] Waited 9.54 s on lock 0x7b540001fed4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:09.367387 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21940751232}
I20260709 12:15:09.298911 10098 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:09.369133  9982 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:09.238806  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:09.243029  5569 connection.cc:256] RPC call timeout handler was delayed by -1.1535547849998693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2629s for a response
I20260709 12:15:09.369639 10098 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.370810  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.372069  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.372733  5604 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:09.138936 10086 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.362046 10072 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:15:09.250133  5603 rpcz_store.cc:269] 0709 12:15:03.462172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.151763 (+5689591us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:09.151926 (+   163us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:15:09.362563  5752 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:09.298017 10095 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.374604 10095 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.374964  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.375840 10086 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:09.242964  5746 rpcz_store.cc:269] 0709 12:14:57.435318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.435448 (+   130us) service_pool.cc:224] Handling call
0709 12:15:09.120097 (+11684649us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b5400052dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:09.120264 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148351360}
I20260709 12:15:09.257009 10089 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.376673 10095 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.377204  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.254643 10097 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.258719 10049 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.262271 10014 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.264493 10074 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:09.264969  5597 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:09.265708  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.266100 10058 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:09.269986  5599 rpcz_store.cc:269] 0709 12:15:03.461691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.153174 (+5691483us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:09.153332 (+   158us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:15:09.274194  5600 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:09.274890  5748 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:09.269193  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.153450  9873 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.400413  6326 raft_consensus.cc:2410] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:15:09.278234  6320 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:09.278523  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.275002  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.239188  5751 rpcz_store.cc:276] 0709 12:14:59.653454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.872443 (+218989us) service_pool.cc:224] Handling call
0709 12:15:09.120632 (+9248189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.121156 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:09.121184 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:09.121240 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:09.121300 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.121372 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:09.122235 (+   863us) spinlock_profiling.cc:243] Waited 9.25 s on lock 0x7b5400052dd0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:09.122375 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":520,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"spinlock_wait_cycles":21267925248}
I20260709 12:15:09.279314  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.239369 10085 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.173295  9984 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.288851  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:09.296226  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 75830.4us
I20260709 12:15:09.291687 10091 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:09.301841  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8720 after lost signal to thread 5535
I20260709 12:15:09.299132  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.324632  5747 raft_consensus.cc:2410] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:15:09.358485  5595 rpcz_store.cc:269] 0709 12:15:03.462674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.201372 (+5738698us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:09.201516 (+   144us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:15:09.407593  6349 debug-util.cc:398] Leaking SignalData structure 0x7b080015eba0 after lost signal to thread 5597
I20260709 12:15:09.372164 10098 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:09.245277  5700 debug-util.cc:398] Leaking SignalData structure 0x7b0800247f60 after lost signal to thread 5777
I20260709 12:15:09.376271  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:09.257972  6293 connection.cc:256] RPC call timeout handler was delayed by -4.6128193770000507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:15:09.410197  6293 connection.cc:256] RPC call timeout handler was delayed by -4.6047193770000376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 12:15:09.410516  6293 connection.cc:256] RPC call timeout handler was delayed by -4.42201937699997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
I20260709 12:15:09.313750  5744 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:15:09.322589  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2339) took 6049 ms. Trace:
I20260709 12:15:09.310900  9978 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.369048  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:09.398099  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.403473  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.396294  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.308614  9886 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.373943  9630 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.417316  5602 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:09.418020  5600 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:09.418792  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2353) took 5955 ms. Trace:
I20260709 12:15:09.419097  5600 rpcz_store.cc:276] 0709 12:15:03.462913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.404908 (+5941995us) service_pool.cc:224] Handling call
0709 12:15:09.417729 (+ 12821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.418475 (+   746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.418706 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:09.421240  9977 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:09.421988  9977 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:09.422540  5642 connection.cc:256] RPC call timeout handler was delayed by -11.159247577000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 12:15:09.422695  5750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 577) took 12039 ms. Trace:
W20260709 12:15:09.422976  5642 connection.cc:256] RPC call timeout handler was delayed by -11.118747577000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 12:15:09.423358  5642 connection.cc:256] RPC call timeout handler was delayed by -11.012547577000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 12:15:09.423755  5642 connection.cc:256] RPC call timeout handler was delayed by -10.967547577000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 12:15:09.424052  5642 connection.cc:256] RPC call timeout handler was delayed by -10.943554898000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 12:15:09.424322  5642 connection.cc:256] RPC call timeout handler was delayed by -10.885062105000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:15:09.424605  5642 connection.cc:256] RPC call timeout handler was delayed by -10.803747576999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 12:15:09.424888  5642 connection.cc:256] RPC call timeout handler was delayed by -10.648047576999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 12:15:09.425153  5642 connection.cc:256] RPC call timeout handler was delayed by -10.618347577000122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
I20260709 12:15:09.367449 10046 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:09.425410  5642 connection.cc:256] RPC call timeout handler was delayed by -10.525647576999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
W20260709 12:15:09.425737  5642 connection.cc:256] RPC call timeout handler was delayed by -10.335728462000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 12:15:09.426035  5642 connection.cc:256] RPC call timeout handler was delayed by -10.214247577000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25910000000000005s for a response
W20260709 12:15:09.426308  5642 connection.cc:256] RPC call timeout handler was delayed by -10.214247577000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25910000000000005s for a response
W20260709 12:15:09.426579  5642 connection.cc:256] RPC call timeout handler was delayed by -10.10226362100002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
W20260709 12:15:09.426859  5642 connection.cc:256] RPC call timeout handler was delayed by -9.9874707090000356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 12:15:09.427131  5642 connection.cc:256] RPC call timeout handler was delayed by -9.9504087249999884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260709 12:15:09.411564  6349 debug-util.cc:398] Leaking SignalData structure 0x7b080015eec0 after lost signal to thread 5599
W20260709 12:15:09.410796  6293 connection.cc:256] RPC call timeout handler was delayed by -4.42122112800007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 12:15:09.322034  9910 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 12:15:09.299018  9306 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:09.427845  6293 connection.cc:256] RPC call timeout handler was delayed by -4.3905193769999187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
W20260709 12:15:09.442027  6293 connection.cc:256] RPC call timeout handler was delayed by -4.3140193770000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 12:15:09.442389  6293 connection.cc:256] RPC call timeout handler was delayed by -4.1925193770000533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 12:15:09.442714  6293 connection.cc:256] RPC call timeout handler was delayed by -3.8847193770000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2331s for a response
W20260709 12:15:09.427881  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8b80 after lost signal to thread 5608
W20260709 12:15:09.428740  5625 debug-util.cc:398] Leaking SignalData structure 0x7b08003fc700 after lost signal to thread 6352
I20260709 12:15:09.411268  5596 rpcz_store.cc:276] 0709 12:15:03.262103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.980609 (+5718506us) service_pool.cc:224] Handling call
0709 12:15:08.981068 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.302290 (+321222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.303897 (+  1607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:09.414712  5753 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:09.417337  6323 raft_consensus.cc:2410] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:15:09.430179  5700 debug-util.cc:398] Leaking SignalData structure 0x7b080039e480 after lost signal to thread 6352
I20260709 12:15:09.430629  5603 raft_consensus.cc:2410] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:15:09.445433  6324 raft_consensus.cc:2410] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:15:09.446578  6328 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:09.431190  5745 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:09.296223  9833 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.448477  9886 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:09.449366  5745 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:15:09.449126  9886 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.450222  6327 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:09.421909 10014 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:15:09.443274  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002cf6c0 after lost signal to thread 5622
I20260709 12:15:09.451356  6319 raft_consensus.cc:2410] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:15:09.369750  9982 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 12:15:09.456830  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc460 after lost signal to thread 5628
I20260709 12:15:09.456542  9886 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.450853 10092 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.457332 10046 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.457837  9306 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.440440  9978 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.462683  5599 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:09.462844  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 56527.7us
W20260709 12:15:09.463603  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0000 after lost signal to thread 5629
W20260709 12:15:09.463975  5567 connection.cc:256] RPC call timeout handler was delayed by -7.2765930150001168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 12:15:09.472098  5604 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
W20260709 12:15:09.481392  5567 connection.cc:256] RPC call timeout handler was delayed by -7.14113979800004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
I20260709 12:15:09.423561 10096 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.406411 10015 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.409034 10093 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:09.462147  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.492075  5675 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
W20260709 12:15:09.481297  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0060 after lost signal to thread 5643
I20260709 12:15:09.423259 10099 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:15:09.486953  5625 debug-util.cc:398] Leaking SignalData structure 0x7b08002eba20 after lost signal to thread 9904
I20260709 12:15:09.442020 10098 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:09.490272  5602 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
W20260709 12:15:09.490542  5700 debug-util.cc:398] Leaking SignalData structure 0x7b080037fdc0 after lost signal to thread 9984
W20260709 12:15:09.492717  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0260 after lost signal to thread 5644
I20260709 12:15:09.473640  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:09.494099  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51908 (request call id 2354) took 6026 ms. Trace:
I20260709 12:15:09.498230  5599 rpcz_store.cc:276] 0709 12:15:03.463153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.410666 (+5947513us) service_pool.cc:224] Handling call
0709 12:15:09.462510 (+ 51844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.489036 (+ 26526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.489250 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:09.503747  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0100 after lost signal to thread 5645
I20260709 12:15:09.464145 10095 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.494704  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.472321  9898 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:15:09.504156  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800384ee0 after lost signal to thread 5651
W20260709 12:15:09.510694  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800402fc0 after lost signal to thread 5653
W20260709 12:15:09.511071  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800386e80 after lost signal to thread 5660
W20260709 12:15:09.511428  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003477e0 after lost signal to thread 5670
W20260709 12:15:09.511683  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800262340 after lost signal to thread 5673
W20260709 12:15:09.511904  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800326c40 after lost signal to thread 5674
W20260709 12:15:09.512183  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800325360 after lost signal to thread 5680
W20260709 12:15:09.512403  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800340060 after lost signal to thread 5681
W20260709 12:15:09.512648  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7940 after lost signal to thread 5686
W20260709 12:15:09.512948  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb1e0 after lost signal to thread 5694
I20260709 12:15:09.430864  5750 rpcz_store.cc:276] 0709 12:14:57.382867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.383060 (+   193us) service_pool.cc:224] Handling call
0709 12:14:57.395613 (+ 12553us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:57.408052 (+ 12439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:57.408083 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:04.450386 (+7042303us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b2c000e2328. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fc344a11 00007f44fc354372 00007f44fda86a01 00007f44fda4b43a 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2
0709 12:15:04.451880 (+  1494us) log.cc:844] Serialized 52 byte log entry
0709 12:15:04.516213 (+ 64333us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:09.292101 (+4775888us) log.cc:844] Serialized 14 byte log entry
0709 12:15:09.396336 (+104235us) log.cc:844] Serialized 14 byte log entry
0709 12:15:09.396582 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.404079 (+  7497us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:09.422450 (+ 18371us) raft_consensus.cc:1685] finished
0709 12:15:09.422476 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:09.422644 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12039,"prepare.queue_time_us":603598,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":14492,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":14470,"spinlock_wait_cycles":69311744,"thread_start_us":4927645,"threads_started":3,"wal-append.queue_time_us":902561,"wal-append.run_cpu_time_us":9553,"wal-append.run_wall_time_us":1540408}
I20260709 12:15:09.471659 10091 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.516729  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003acfa0 after lost signal to thread 5699
W20260709 12:15:09.517091  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800293020 after lost signal to thread 5703
W20260709 12:15:09.517320  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800340440 after lost signal to thread 5704
W20260709 12:15:09.517519  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800239840 after lost signal to thread 5705
W20260709 12:15:09.517829  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003cbc60 after lost signal to thread 5719
W20260709 12:15:09.518117  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800239be0 after lost signal to thread 5724
W20260709 12:15:09.518392  6349 debug-util.cc:398] Leaking SignalData structure 0x7b080035cec0 after lost signal to thread 5730
W20260709 12:15:09.518630  6349 debug-util.cc:398] Leaking SignalData structure 0x7b080035bf40 after lost signal to thread 5733
W20260709 12:15:09.518875  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800327800 after lost signal to thread 5737
W20260709 12:15:09.519111  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3460 after lost signal to thread 5739
W20260709 12:15:09.519586  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb0a0 after lost signal to thread 5741
W20260709 12:15:09.519955  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003e29a0 after lost signal to thread 5746
W20260709 12:15:09.520288  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003e5780 after lost signal to thread 5750
W20260709 12:15:09.520689  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800385120 after lost signal to thread 5762
W20260709 12:15:09.520965  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0bc0 after lost signal to thread 5763
W20260709 12:15:09.521364  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800406100 after lost signal to thread 5775
I20260709 12:15:09.457860 10014 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:09.523912  6349 debug-util.cc:398] Leaking SignalData structure 0x7b080033a8c0 after lost signal to thread 5777
I20260709 12:15:09.515377  5748 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 12:15:09.554589  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800406040 after lost signal to thread 6287
I20260709 12:15:09.533838 10096 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.534982 10085 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.478645  9984 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:09.536729  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.537828 10093 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.538619 10099 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.538856  9978 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.539413 10098 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.540096 10015 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:09.540973  5625 debug-util.cc:398] Leaking SignalData structure 0x7b0800379220 after lost signal to thread 9960
I20260709 12:15:09.543465  5598 raft_consensus.cc:1275] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:09.544323 10103 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:09.545300 10104 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:09.546511  9894 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:09.554934  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800142920 after lost signal to thread 6294
I20260709 12:15:09.560657  5601 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:15:09.560545  5753 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:09.560823  5597 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:15:09.433187 10097 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.578336  6320 raft_consensus.cc:2410] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:15:09.578965  5569 connection.cc:256] RPC call timeout handler was delayed by -4.5284620160000486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 12:15:09.618009  5569 connection.cc:256] RPC call timeout handler was delayed by -4.3745620160000271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 12:15:09.618377  5569 connection.cc:256] RPC call timeout handler was delayed by -4.3412620159999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 12:15:09.618678  5569 connection.cc:256] RPC call timeout handler was delayed by -4.1603620159999082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260709 12:15:09.618940  5569 connection.cc:256] RPC call timeout handler was delayed by -4.1558620159999009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:15:09.619189  5569 connection.cc:256] RPC call timeout handler was delayed by -3.6617620160000115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24940000000000004s for a response
W20260709 12:15:09.571277  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 139577us
I20260709 12:15:09.557313  9691 raft_consensus.cc:697] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:15:09.612527  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 168218us
I20260709 12:15:09.559034  9989 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.622936  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.619956  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:09.616497  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd440 after lost signal to thread 6297
W20260709 12:15:09.624262  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800130ec0 after lost signal to thread 6301
W20260709 12:15:09.624545  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800406120 after lost signal to thread 6304
W20260709 12:15:09.624833  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08004061c0 after lost signal to thread 6310
W20260709 12:15:09.625207  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003d48a0 after lost signal to thread 6322
W20260709 12:15:09.625531  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003bda00 after lost signal to thread 6330
W20260709 12:15:09.625845  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800343100 after lost signal to thread 6336
W20260709 12:15:09.626175  6349 debug-util.cc:398] Leaking SignalData structure 0x7b080020e4c0 after lost signal to thread 6344
W20260709 12:15:09.626488  6349 debug-util.cc:398] Leaking SignalData structure 0x7b080027dd40 after lost signal to thread 6352
W20260709 12:15:09.627250  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800412900 after lost signal to thread 9978
W20260709 12:15:09.627492  6349 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3700 after lost signal to thread 9980
W20260709 12:15:09.629616  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800303a40 after lost signal to thread 9984
W20260709 12:15:09.630177  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800360680 after lost signal to thread 10014
W20260709 12:15:09.630420  6349 debug-util.cc:398] Leaking SignalData structure 0x7b0800250b80 after lost signal to thread 10015
I20260709 12:15:09.583308 10085 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.609987  9886 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:09.534022 10095 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.534029 10046 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.640427  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.633653  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.559010 10091 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:09.641688  5570 connection.cc:256] RPC call timeout handler was delayed by -8.7441531410001971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3229s for a response
I20260709 12:15:09.639760  5598 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:09.656317  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.656560  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.657253  5676 raft_consensus.cc:2410] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:15:09.657811  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.658365  5598 raft_consensus.cc:2376] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11. Re-sending same reply.
I20260709 12:15:09.659130  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.660181  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.660674  5598 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:15:09.661367  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.665855  9988 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.651682 10085 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.666643 10102 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.667466  5716 connection.cc:256] RPC call timeout handler was delayed by -6.113793515999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 12:15:09.667286 10102 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.668382 10085 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:09.668649  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:09.669143  5716 connection.cc:256] RPC call timeout handler was delayed by -3.7910100409999359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2937s for a response
I20260709 12:15:09.669312 10102 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.670049  9984 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.670544 10015 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.671526 10098 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.671923 10058 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:09.673007  6291 connection.cc:256] RPC call timeout handler was delayed by -7.4014174980002281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 12:15:09.673385  6291 connection.cc:256] RPC call timeout handler was delayed by -7.4014174980002281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260709 12:15:09.673857  9973 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.674235  9691 consensus_queue.cc:237] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.675529 10095 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.676256 10014 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.676405  9873 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.676995  5675 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:09.678193 10091 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.679167  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.702876  5601 raft_consensus.cc:2376] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11. Re-sending same reply.
W20260709 12:15:09.679471  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:09.679687  5570 connection.cc:256] RPC call timeout handler was delayed by -8.3378697309999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3167s for a response
I20260709 12:15:09.682444  5674 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:09.666034  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.683302  9832 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:09.685467 10046 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.651813  5642 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:09.685860 10104 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.687032  5598 raft_consensus.cc:2376] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9. Re-sending same reply.
I20260709 12:15:09.679193  5678 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:09.673316 10099 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:09.706622  5570 connection.cc:256] RPC call timeout handler was delayed by -7.96428274699997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
I20260709 12:15:09.673627 10097 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:09.710078  5570 connection.cc:256] RPC call timeout handler was delayed by -7.5807679209999606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:15:09.712867  5570 connection.cc:256] RPC call timeout handler was delayed by -7.4202848919999269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
I20260709 12:15:09.712095  5671 raft_consensus.cc:2393] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:09.709527  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.633598 10103 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.716406 10103 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.717036  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.697845 10058 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.718115 10058 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.720717 10058 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.721386  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.721830  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.722770  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.722781  5673 raft_consensus.cc:2410] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:15:09.726538  5597 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
W20260709 12:15:09.707036 10108 log.cc:927] Time spent T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:15:09.730614  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.714138  5670 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 7.
I20260709 12:15:09.733995  5675 raft_consensus.cc:2393] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:15:09.734599  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 187462us
I20260709 12:15:09.733907  5676 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:15:09.736970  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.732142  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.705516  9977 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.740402  5677 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:15:09.737165  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.733314  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.747573  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.748673  5674 raft_consensus.cc:2393] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:09.750741  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.751436  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.751606  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.752766  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.753402  5675 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:15:09.730947 10001 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:09.741019 10103 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:09.754842  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.758319  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.758337  5716 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:15:09.760907 10110 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:15:09.748284  5671 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
I20260709 12:15:09.764034  5676 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:15:09.768186  5716 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:09.768668  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.702328  9988 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.759647 10092 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.769304  5674 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:09.769699  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.752103  5670 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:15:09.767270  9909 consensus_queue.cc:1048] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:15:09.773312  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.774164  5601 raft_consensus.cc:2410] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:15:09.776382  5716 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:09.777263  9988 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:09.777822  5716 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:09.778772  5716 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:09.779388  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.780046 10001 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:09.780620  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.780874  9832 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:09.781282  9832 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.779537  9910 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:09.782663  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.778201  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:09.772761  5645 leader_election.cc:336] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.704s (SENT)
I20260709 12:15:09.781456  5595 raft_consensus.cc:2410] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:15:09.786840  6323 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:15:09.781639  9832 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:09.795678  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 153519us
I20260709 12:15:09.780586 10001 raft_consensus.cc:697] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:15:09.798553  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.800673  5678 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:15:09.801919 10084 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:09.802407 10084 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.802773 10084 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:09.801916  5676 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:09.785626  9898 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:09.807018  5673 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:09.804193  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.812678  5672 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:09.813138  5601 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:09.808938  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.814566  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:09.822989  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 44309.9us
I20260709 12:15:09.826376  6328 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:15:09.826952  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.827677  5679 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:09.828737  6323 raft_consensus.cc:2393] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:09.836081  5595 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:09.839771  5719 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:09.841753  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.795830  9988 consensus_queue.cc:1059] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:15:09.846292  6320 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:15:09.843654  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.852838  6319 raft_consensus.cc:1240] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:09.820195 10096 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.855228  9631 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:09.854035  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.857311  9989 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:09.860889 10104 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.870424 10046 consensus_queue.cc:1059] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:09.871389  5642 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:09.872920  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.821027  9978 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:09.873474 10046 raft_consensus.cc:3055] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:09.862875  5679 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:15:09.865345  9989 consensus_queue.cc:1243] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:09.848227  9962 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:15:09.867631  9988 raft_consensus.cc:3055] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:09.867868  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.886201  5678 raft_consensus.cc:2393] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:09.855955 10001 consensus_queue.cc:237] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:09.875909  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.883960  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.888767  5753 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:15:09.889366  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.878332 10046 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:09.893003  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.885723  9988 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:09.894425  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.894819  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.895372  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.894369  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.899299  9988 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.900501  9988 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:09.896806  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:09.902689  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 129970us
I20260709 12:15:09.906391  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.902393  6293 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:09.907472  5597 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:15:09.908383  6293 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:09.902384  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.910302  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.910939  5672 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:15:09.911751  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.912671  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.913275  5672 raft_consensus.cc:2393] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:09.879783 10093 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:09.904784  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.917553  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.918355  5753 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:09.886814  9978 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:09.913852  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.923990  5679 raft_consensus.cc:2410] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:15:09.913021  5671 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:15:09.923998  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.925295  5748 raft_consensus.cc:2393] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:15:09.921224  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 97489.1us
I20260709 12:15:09.920794  5596 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13. Ops: [8.9-12.11]
I20260709 12:15:09.926414  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.928066  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.928963  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.930282  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.927186  5675 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:15:09.932770  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.932789  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.936336  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.939599  5749 raft_consensus.cc:2393] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:09.932265  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.941900  5672 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:15:09.920451  9973 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:09.949654  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.886293 10096 consensus_queue.cc:1059] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:15:09.950603  5604 raft_consensus.cc:2410] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:15:09.922981 10074 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:09.951943  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.954741  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:09.952526  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 81256.5us
I20260709 12:15:09.956630  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.893437 10046 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:09.959280  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.955325  5671 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:09.960671  5597 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:15:09.962414  6324 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:15:09.963181  5645 leader_election.cc:336] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.040s (SENT)
I20260709 12:15:09.965884  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:09.968010  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.968736  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.969480  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:09.969623  5674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:09.977191  5674 raft_consensus.cc:606] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:09.977646  5674 raft_consensus.cc:614] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:09.970460  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.951823  9973 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.971002  5718 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:09.971406  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.969441  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.971896  5744 raft_consensus.cc:1240] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:09.972468  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.973176  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.977142  5596 raft_consensus.cc:2376] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14. Re-sending same reply.
I20260709 12:15:09.935401  9978 raft_consensus.cc:697] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:09.979974  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:09.988899  5600 raft_consensus.cc:2410] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:15:09.989823  6319 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:09.981473  6321 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
W20260709 12:15:09.993768  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.994554  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:09.954910 10074 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.996647  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:09.997285  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 43600.9us
W20260709 12:15:09.986043 10117 log.cc:927] Time spent T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:15:09.998170  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.000396  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.999727  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.001715  5596 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 8.
I20260709 12:15:09.998824 10074 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:09.999346  5570 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:10.003739 10049 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:10.004102 10049 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:10.004452 10049 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.002095  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:09.987283  9973 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:10.008327  5753 raft_consensus.cc:2393] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 14: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:10.007053  6319 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:09.986351 10096 consensus_queue.cc:1243] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:10.009873  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.011426  5597 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:10.013188  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.014518  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.015084  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:10.015430  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.016043  5642 leader_election.cc:400] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10.
I20260709 12:15:10.016337  5642 leader_election.cc:403] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:15:10.014461  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:10.017020  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 103637us
I20260709 12:15:10.017707 10091 consensus_queue.cc:1059] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:10.018692 10091 raft_consensus.cc:3055] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:10.019044 10091 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:10.020596  6293 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:10.022254  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.016597  5746 raft_consensus.cc:2376] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9. Re-sending same reply.
I20260709 12:15:10.024317  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:09.970940 10085 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:15:10.028817  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.030903  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 12:15:10.034065  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.027585 10083 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:10.038872  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.039175  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:10.039737  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:10.041078  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 77926.1us
I20260709 12:15:10.023430  9898 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:10.028720 10096 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.043188  5596 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:10.044543  6293 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:10.046657  9982 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:10.046705  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.047150  9982 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.047541  9982 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.047940  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.048708  5596 raft_consensus.cc:2410] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:15:10.047492  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.053905  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.054428  5600 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:15:10.054782  5745 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:10.055703  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.056245  5745 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:10.057077  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.060923  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.062484  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.066597  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.066987  9832 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:10.067672  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.068176  5749 raft_consensus.cc:2368] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:15:10.068681  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.069188  9832 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:10.051973  9978 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.074096  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.074851  5744 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:15:10.051558  5596 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:15:10.091104  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 83062.2us
I20260709 12:15:10.092862  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.093044  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.094679  5750 raft_consensus.cc:2393] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:10.100982 10049 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:10.102425 10116 log.cc:927] Time spent T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.366s	user 0.005s	sys 0.000s
I20260709 12:15:10.103662  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:10.107834  6292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:10.113941  5645 leader_election.cc:336] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.168s (SENT)
W20260709 12:15:10.114642  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 70162.7us
W20260709 12:15:10.115813 10121 log.cc:927] Time spent T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:15:10.126731  5753 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:15:10.126756  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 131109us
I20260709 12:15:10.128388  5645 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.114529 10091 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.130205 10104 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:10.131340 10084 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:10.104313 10074 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:10.134188 10131 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:15:10.135114  5718 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.136337  5718 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:10.136960  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:10.137472  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.138557  9977 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.138837 10104 consensus_queue.cc:1059] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:10.139328  9977 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.140446  9894 raft_consensus.cc:3055] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:10.140703  5718 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:10.138496  5746 raft_consensus.cc:2393] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 12: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:10.142132  9894 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:10.143154  9894 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.146009 10097 consensus_queue.cc:1059] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:10.147172  9691 raft_consensus.cc:3055] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:10.147555  9691 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:10.117328  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 584) took 1090 ms. Trace:
I20260709 12:15:10.118515  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:10.153367  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.119616  9992 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:10.120360  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.158047  5748 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:10.121205  6291 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:10.153627  5752 raft_consensus.cc:2376] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11. Re-sending same reply.
I20260709 12:15:10.122314  5745 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:10.126389  6293 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:10.115913  9973 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:10.132906  5645 connection.cc:256] RPC call timeout handler was delayed by -9.66269033399999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2805s for a response
I20260709 12:15:10.154242  5750 raft_consensus.cc:2393] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 12: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:10.114174 10127 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:10.159039  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.160162  5567 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:10.162459  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.159888  9992 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:10.163251  6291 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:10.164295  6293 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:10.164513  9973 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:10.141672  9982 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.133559 10084 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:10.170532  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:10.177801  5603 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.153014  5751 rpcz_store.cc:276] 0709 12:15:09.026662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.405732 (+379070us) service_pool.cc:224] Handling call
0709 12:15:09.440785 (+ 35053us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:09.517018 (+ 76233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:09.517051 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:09.574664 (+ 57613us) log.cc:844] Serialized 52 byte log entry
0709 12:15:09.744802 (+170138us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:09.764030 (+ 19228us) log.cc:844] Serialized 14 byte log entry
0709 12:15:09.770155 (+  6125us) log.cc:844] Serialized 14 byte log entry
0709 12:15:09.772167 (+  2012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.772236 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:10.110377 (+338141us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b18003602e0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e522 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:15:10.117075 (+  6698us) raft_consensus.cc:1685] finished
0709 12:15:10.117111 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:10.117249 (+   138us) inbound_call.cc:177] Queueing success response
0709 12:15:10.118150 (+   901us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b18003602e0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e522 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
Metrics: {"mutex_wait_us":7999,"prepare.queue_time_us":52714,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":8056,"raft.queue_time_us":24402,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":26884,"spinlock_wait_cycles":59960320,"thread_start_us":105560,"threads_started":1,"wal-append.queue_time_us":151878}
I20260709 12:15:10.147568 10049 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:10.179212  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.053095 10132 consensus_queue.cc:1059] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.132s
I20260709 12:15:10.170064  9832 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:10.175414 10127 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.192006  5600 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:15:10.188095  9873 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.201071  5567 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:10.202768  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 44049.7us
I20260709 12:15:10.203724  5718 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:10.194085  9988 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:10.190838  9983 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:10.201972  5645 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:10.236344  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:10.244444  5600 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.198704  9973 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.198896 10127 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.169715 10096 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10.
I20260709 12:15:10.241732  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:10.205881 10058 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.236290  9988 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:10.248770  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 45183.1us
I20260709 12:15:10.238469 10083 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:10.251798  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:10.252810  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.248678 10092 raft_consensus.cc:2764] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:15:10.256328  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 61248.6us
I20260709 12:15:10.257021  9894 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.261906  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.262688  5670 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:15:10.262913 10046 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.264509  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.265853  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.266969 10049 raft_consensus.cc:3055] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:10.267449 10049 raft_consensus.cc:740] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:10.270116  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.270995  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.250185  9988 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.272154  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.273211  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.249344  9973 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.275702  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.276762  9721 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:10.277338  9973 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:10.276925  5718 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.280043  9962 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:10.284296 10125 log.cc:927] Time spent T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 12:15:10.286698  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.288335  9833 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.289924 10093 raft_consensus.cc:3055] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:10.290405 10093 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:10.245611  9691 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.291057  9982 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:10.245878  9992 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.291424  9691 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:10.292615 10124 log.cc:927] Time spent T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 12:15:10.292961  9992 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.294139  9982 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:10.294521  9982 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.294966  9982 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.295163  9878 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:10.298089  9973 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:10.298543  9973 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:10.298674  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.298991  9973 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.302302  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.304188  5677 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:10.305704  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.305968  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.306816  5675 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 12: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:10.305634  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.307722  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.288278  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2356) took 1123 ms. Trace:
I20260709 12:15:10.308933  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.309281  5602 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:10.310297  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:10.310842  5602 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.311496  9832 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:10.312026  5600 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:10.315946 10091 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.317062 10074 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:10.317797 10074 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.267002  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.318638  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 856) took 1023 ms. Trace:
I20260709 12:15:10.319558  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.319826 10129 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:10.320247  5598 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:10.321187  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:10.321995 10119 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.586s	user 0.004s	sys 0.000s
I20260709 12:15:10.322449  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:15:10.322572  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 70882us
I20260709 12:15:10.323890  6291 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:10.308779  5599 rpcz_store.cc:276] 0709 12:15:09.165258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.505939 (+340681us) service_pool.cc:224] Handling call
0709 12:15:09.536959 (+ 31020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.686063 (+149104us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:09.797955 (+111892us) log.cc:844] Serialized 14 byte log entry
0709 12:15:09.993483 (+195528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:09.993535 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:09.993583 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:10.288019 (+294436us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540048e754. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:10.288070 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:10.288209 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5446,"prepare.queue_time_us":78034,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":42,"raft.queue_time_us":75,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5346,"spinlock_wait_cycles":342402432,"thread_start_us":267108,"threads_started":2,"wal-append.queue_time_us":226802}
I20260709 12:15:10.305634  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.327963  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.328622  5599 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:15:10.330297  9898 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:10.329746  5496 catalog_manager.cc:5697] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:10.330766  9898 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.331399  9973 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.294550  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:10.329571  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.387593  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.327919  5676 raft_consensus.cc:2410] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 12:15:10.326864  6291 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:10.332669 10074 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.413504 10074 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:15:10.388895 10084 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:10.391312  9910 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:10.308928  9988 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:10.393924  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 104166us
I20260709 12:15:10.415191  5718 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:10.394340  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.416162  5600 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:10.394560 10001 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:10.291354 10093 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:10.397843 10127 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.399740  5496 catalog_manager.cc:5697] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 5, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 5 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:10.311970  9832 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:10.424219  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 97426.5us
I20260709 12:15:10.424396  5718 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:10.399595  9973 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:10.403087  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.404565  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.427635  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.401245  9982 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.405232  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.434458  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:10.404543  5642 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:10.405845  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.246831 10132 consensus_queue.cc:1059] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.159s
I20260709 12:15:10.319034  6325 rpcz_store.cc:276] 0709 12:15:09.295330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.297302 (+  1972us) service_pool.cc:224] Handling call
0709 12:15:09.322444 (+ 25142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.451693 (+129249us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:09.579527 (+127834us) log.cc:844] Serialized 14 byte log entry
0709 12:15:10.088254 (+508727us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:15:10.317966 (+229712us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b180026a520. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fd5f34bc 00007f44fa94148b 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb23a
0709 12:15:10.318273 (+   307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:10.318334 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:10.318383 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:10.318449 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:10.318569 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":243844,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"spinlock_wait_cycles":19432064,"thread_start_us":192175,"threads_started":2,"wal-append.queue_time_us":123738}
I20260709 12:15:10.405627  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.407827  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.408342  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.408602  5603 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:10.409632  9909 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:10.420689  5602 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:10.421869  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:10.428629  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 264373us
I20260709 12:15:10.424274  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:10.455281  5595 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:10.431768  5601 raft_consensus.cc:2410] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:15:10.455794  5598 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.430732  5597 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:10.434326  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:10.466799  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.467133  5599 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:10.466439  6320 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:10.438728  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:10.467013  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 62574.6us
W20260709 12:15:10.471251  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 221840us
I20260709 12:15:10.469798  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.469748  5670 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:15:10.458244  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.435314 10074 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:10.439352  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.434108  9962 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:10.426570 10085 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:10.477250  5642 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:10.496902  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.497612  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:10.498793  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:10.499300  5600 raft_consensus.cc:3060] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.500869  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:10.501426  5603 raft_consensus.cc:3060] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.435489  9910 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:10.502331  5498 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44240 (request call id 206) took 29350 ms (client timeout 15000 ms). Trace:
I20260709 12:15:10.502609  5496 catalog_manager.cc:5697] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 6 to 8, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 8 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:10.478410 10097 consensus_queue.cc:1059] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:15:10.505666  5751 raft_consensus.cc:2368] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 11. Current term is 12.
I20260709 12:15:10.504459  5496 catalog_manager.cc:5697] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 8, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 8 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:10.474267 10096 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:10.550781  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.551025 10096 raft_consensus.cc:697] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:10.551944  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.553059  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.554203  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.554854  5675 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:10.555737  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.556398  5675 raft_consensus.cc:2393] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:10.557103  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:10.557960  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 129845us
I20260709 12:15:10.560575  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:10.561046  6323 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 12. Ops: []
I20260709 12:15:10.561407  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:10.561685  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:10.562094  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:10.500171 10074 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.562816  6324 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:10.564247 10093 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.565311  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.566382  6325 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.514092  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.514981 10049 consensus_queue.cc:260] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.513965  5596 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:15:10.519825  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.522400 10092 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:15:10.523042  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 52636.8us
I20260709 12:15:10.526894  9982 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:10.527678  6293 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:10.529079 10127 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:10.529954  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.530648  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.583884  5748 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:15:10.584808  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.585916  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.532187  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.541007  9988 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:10.544886  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.545629  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.546070  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.546432  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.588610  5674 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:15:10.516985  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:10.588928  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.547523  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.590229  5745 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 11: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:10.478256 10083 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:15:10.587168  5670 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:15:10.562213  6320 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.562692 10074 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:10.596314 10092 raft_consensus.cc:697] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:10.597024  5642 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:10.562651 10141 consensus_queue.cc:1059] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:15:10.597373 10092 consensus_queue.cc:237] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.598210 10141 raft_consensus.cc:3055] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:10.598543 10141 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:10.599351 10141 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.600533 10141 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.600952  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:10.586990  5749 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:10.423830 10140 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:10.602492  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:10.602741  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 75143.7us
I20260709 12:15:10.603405 10074 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.551975 10096 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.604974  9832 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:10.605882 10139 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:10.606060 10074 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:10.607103  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.608199  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.609503  5670 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:10.611542  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.612085  5642 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:10.612666  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.613022  6327 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 14: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:10.613247  5671 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.613736  9894 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:10.614177  9894 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.614511  9894 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.516935  5567 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.603545  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.613482  9978 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:10.613435  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.616427  9978 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.616770  9978 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:10.616962  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.617717  5751 raft_consensus.cc:2393] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 13: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:10.618361  5747 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:10.618644  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.619699  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.620306  5746 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
W20260709 12:15:10.621546  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 104699us
I20260709 12:15:10.613902  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.622323  9898 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:10.622630  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:10.623091  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.623752  5642 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:10.624181  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.624730  5674 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.626318  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.626699  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.628172  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.572173  5676 raft_consensus.cc:2468] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:15:10.620956  5679 raft_consensus.cc:2410] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:15:10.629658  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.630744  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.631150  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.631745  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.632324  5676 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:10.633178  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.572463  5603 raft_consensus.cc:2468] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:10.634095  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.572832  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.634873  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.635654  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.635928  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.580938  5596 pending_rounds.cc:85] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 9
I20260709 12:15:10.655341  5596 pending_rounds.cc:107] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:15:10.655634  5596 raft_consensus.cc:2889] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:10.590351  5673 raft_consensus.cc:2410] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:15:10.593262  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.655995  5600 raft_consensus.cc:2468] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:10.632253  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.636137 10049 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.656814  5679 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:10.621865 10139 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:10.574118  5598 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:10.641321  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.624745 10085 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:10.641865 10001 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:15:10.503794  5498 rpcz_store.cc:269] 0709 12:14:41.152033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.152170 (+   137us) service_pool.cc:224] Handling call
0709 12:15:10.500371 (+29348201us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:55.054621 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:55.055186 (+   565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:55.055253 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:14:55.055278 (+    25us) tablet.cc:662] Decoding operations
0709 12:14:55.087733 (+ 32455us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:55.087811 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:55.087839 (+    28us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:14:55.089330 (+  1491us) tablet.cc:701] Row locks acquired
0709 12:14:55.089378 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:14:55.089604 (+   226us) write_op.cc:270] Start()
0709 12:14:55.089778 (+   174us) write_op.cc:276] Timestamp: P: 1783599295089489 usec, L: 0
0709 12:14:55.089799 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:14:55.090558 (+   759us) log.cc:844] Serialized 7439 byte log entry
0709 12:14:55.512031 (+421473us) op_driver.cc:464] REPLICATION: finished
0709 12:14:55.800058 (+288027us) write_op.cc:301] APPLY: starting
0709 12:14:55.802584 (+  2526us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:56.579481 (+776897us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:56.579590 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:56.759599 (+180009us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:56.830806 (+ 71207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:14:56.834634 (+  3828us) write_op.cc:312] APPLY: finished
0709 12:14:56.837694 (+  3060us) log.cc:844] Serialized 172 byte log entry
0709 12:14:57.161726 (+324032us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:57.162069 (+   343us) write_op.cc:454] Released schema lock
0709 12:14:57.162788 (+   719us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:57.163508 (+   720us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:57.163556 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1970549,"reported_tablets":34,"spinlock_wait_cycles":1767680,"child_traces":[["op",{"apply.queue_time_us":267891,"apply.run_cpu_time_us":197174,"apply.run_wall_time_us":1371078,"cfile_cache_hit":74,"cfile_cache_hit_bytes":77404,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":2,"lbm_read_time_us":48936,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":9,"num_ops":19,"prepare.queue_time_us":370354,"prepare.run_cpu_time_us":5924,"prepare.run_wall_time_us":36280,"replication_time_us":402146,"spinlock_wait_cycles":1792,"thread_start_us":532884,"threads_started":3,"wal-append.queue_time_us":418858,"wal-append.run_cpu_time_us":1528,"wal-append.run_wall_time_us":1081796}]]}
I20260709 12:15:10.645470  9832 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:10.646967  6291 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:10.641795  5567 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.651393  6293 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:10.652627  6320 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:10.653832  6325 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:10.656842  5599 raft_consensus.cc:1275] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:10.624423  9898 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:10.655995  5671 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
W20260709 12:15:10.660413  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:10.662617  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.671847  5567 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:10.666368  5675 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.667373  5674 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
W20260709 12:15:10.694053  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.705432  5672 raft_consensus.cc:2410] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:15:10.708490  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:10.714274  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.714931  5670 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:10.717413  5567 leader_election.cc:400] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:15:10.717955  5567 leader_election.cc:403] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:15:10.718606 10132 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:15:10.722200  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:10.723097  9873 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:10.723462  9873 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.723814  9873 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.739878  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:10.741936  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 266918us
I20260709 12:15:10.744058  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:10.666529 10139 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.747788  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:10.748621  6293 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:10.704847 10104 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:10.706159 10091 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:10.754522  6293 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:10.707509 10074 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:10.713882  9691 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:10.730007 10057 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:10.743556 10097 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:10.769261  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:10.774345  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 127444us
I20260709 12:15:10.775995  6291 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:10.769749  6293 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:10.761336  9898 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:15:10.770843 10092 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:10.778564 10092 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:10.778949 10092 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.764212 10074 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.781780 10074 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.707616  9721 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:15:10.781584 10140 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:10.786212  5716 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:10.787878  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:10.790171 10092 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:10.791560  9631 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:10.792675 10092 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:10.791643  9721 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:10.795239  9721 raft_consensus.cc:697] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:10.796162  9721 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:10.747431  9982 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:10.804754  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.808401  5716 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:10.754393 10093 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:10.764457 10127 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:10.764671  9691 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.744247 10132 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:15:10.762735  9909 raft_consensus.cc:697] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:10.767712 10057 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:10.825479  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 49558.1us
I20260709 12:15:10.771260 10097 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:10.833931  6291 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:10.835316  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.809739  9982 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.812249 10093 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.838891  6291 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:10.838989  6325 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:10.818492 10127 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.844622  5716 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:10.812160 10140 raft_consensus.cc:697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:10.826925  9973 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:10.822314  9992 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:10.823482  9691 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.865438  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.842793  9982 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.834880 10057 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.840077 10097 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.836830  9631 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:10.640518  5496 catalog_manager.cc:5697] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 5 to 6, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 6 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:10.841838 10093 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:10.881068  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.844359  9988 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.883188  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.864562 10142 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.881284  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.880983  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:10.862905 10127 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:10.898316  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:10.883512  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:15:10.888417  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 140677us
W20260709 12:15:10.891434  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 79952.3us
I20260709 12:15:10.899659  5679 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:10.881083  9973 raft_consensus.cc:697] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:10.918768  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:10.890695  9962 raft_consensus.cc:2804] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:10.930851  9988 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.934895  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:10.935698  5746 raft_consensus.cc:2393] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 10: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:10.939816  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:10.943156  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:10.944875  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 44667.9us
I20260709 12:15:10.913113  9631 raft_consensus.cc:697] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:10.890914  9977 consensus_queue.cc:1059] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:15:10.944613  9962 raft_consensus.cc:697] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:10.962298 10074 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.962143  5496 catalog_manager.cc:5697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:10.964547 10074 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:15:10.965960 10140 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.966607 10152 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:10.943919 10096 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:10.956498  5642 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:10.969708  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:11.015868  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:11.016517  5671 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.926260 10143 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 12:15:11.027416  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 117191us
W20260709 12:15:11.029345  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 72931.7us
W20260709 12:15:11.033548  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:11.029436  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.017565 10152 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:11.046005  5746 raft_consensus.cc:1240] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:10.947273  9909 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.990888  9978 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:11.073660  9894 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:11.014683  9973 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:10.964758  5496 catalog_manager.cc:5697] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 6 to 7, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 7 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:11.050614 10104 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:11.129148 10141 consensus_meta.cc:287] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.002s
I20260709 12:15:11.103627  5671 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
W20260709 12:15:11.073421 10148 log.cc:927] Time spent T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:15:11.125643  5675 raft_consensus.cc:2410] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:15:11.096776  5670 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 14.
W20260709 12:15:11.073864 10144 log.cc:927] Time spent T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 12:15:11.099839  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 216392us
I20260709 12:15:11.133096  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:11.145947  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:11.085913  5642 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:11.005827 10096 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:11.082414  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:10.991482 10139 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:11.268515  5678 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:15:11.277942  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 245529us
I20260709 12:15:11.298589  6293 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:11.300011  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:11.300803  5676 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:15:11.299533  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 131596us
W20260709 12:15:11.310624  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:11.305477  5679 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:11.305418  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 255951us
I20260709 12:15:11.237713 10104 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:11.313659  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:11.299069  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:11.309541  5675 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:11.313540  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 279054us
I20260709 12:15:11.328414 10152 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:11.132988  9873 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:11.342420  5672 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:11.356133  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.356884  6327 raft_consensus.cc:1240] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:11.374610  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.375829  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.381599  5675 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:11.382995  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.383752  5675 raft_consensus.cc:2368] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10.
I20260709 12:15:11.384524  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:11.389452 10150 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
I20260709 12:15:11.390033  9989 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:11.390429 10158 log.cc:927] Time spent T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 12:15:11.390610 10074 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:11.136847  9631 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:11.391033  5496 catalog_manager.cc:5697] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 7 to 10, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 10 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:11.321053 10141 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:15:11.390934  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 61590.1us
I20260709 12:15:11.395695  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:11.392900  5496 catalog_manager.cc:5697] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:11.385602  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.218314  9962 consensus_queue.cc:237] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:11.434353 10092 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:11.359100 10103 raft_consensus.cc:2804] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:15:11.448469  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 136030us
I20260709 12:15:11.335085 10152 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:11.474298  5718 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:15:11.448590  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 72821.8us
I20260709 12:15:11.476562  5718 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.443398 10142 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:11.479246  6291 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:15:11.474763 10140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.001s	sys 0.013s
I20260709 12:15:11.498311  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.439188 10141 raft_consensus.cc:697] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 13 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:15:11.493007 10155 log.cc:927] Time spent T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.488s	user 0.000s	sys 0.001s
I20260709 12:15:11.503050  5677 raft_consensus.cc:2368] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
W20260709 12:15:11.501960  9691 consensus_meta.cc:287] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.615s	user 0.005s	sys 0.005s
W20260709 12:15:11.497602 10140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.001s	sys 0.013s
W20260709 12:15:11.501482 10093 consensus_meta.cc:287] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.000s
W20260709 12:15:11.502206  9982 consensus_meta.cc:287] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.000s
W20260709 12:15:11.503077 10057 consensus_meta.cc:287] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.000s
I20260709 12:15:11.496613 10142 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:11.507903  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:15:11.515695 10169 log.cc:927] Time spent T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 12:15:11.518414 10154 log.cc:927] Time spent T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.382s	user 0.001s	sys 0.001s
I20260709 12:15:11.512916 10153 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:15:11.586834  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 157255us
I20260709 12:15:11.515630 10096 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:11.507623  9978 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:11.522908 10152 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:11.526631  9894 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:11.506937 10180 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:11.592381  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:11.595547  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 283733us
I20260709 12:15:11.510221  9691 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:11.625469  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 118876us
I20260709 12:15:11.566093 10093 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:11.593364 10180 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:11.631850 10180 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:11.632148 10165 log.cc:927] Time spent T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:15:11.627796  9873 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:11.638193  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:11.639155  5677 raft_consensus.cc:2368] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:15:11.569687  9982 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:11.569904 10057 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:11.598376 10153 raft_consensus.cc:697] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:11.620339 10139 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:11.719753 10092 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:15:11.735041  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:11.827266  5570 leader_election.cc:336] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 1.772s (SENT)
I20260709 12:15:11.828343  5674 raft_consensus.cc:2368] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 14. Current term is 15.
I20260709 12:15:11.832343  9691 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:11.833068 10104 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:11.834625  9894 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:11.837042 10127 consensus_meta.cc:287] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.909s	user 0.000s	sys 0.012s
W20260709 12:15:11.837713 10184 log.cc:927] Time spent T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.330s	user 0.006s	sys 0.002s
I20260709 12:15:11.638006 10141 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:11.599591 10096 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:15:11.832362  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.868086 10127 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:11.869735  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:11.845299 10159 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:11.844084  9982 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:11.872294 10104 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:11.865944  9894 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:15:11.838106 10097 consensus_meta.cc:287] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.941s	user 0.011s	sys 0.030s
I20260709 12:15:11.878417 10097 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:11.879612  9894 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:11.880642 10097 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:11.844614  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.879863  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 839) took 1269 ms. Trace:
I20260709 12:15:11.867895 10057 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:11.841871  5601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.042s	sys 0.040s
W20260709 12:15:11.882185  5601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.043s	sys 0.041s
W20260709 12:15:11.842166  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 344561us
I20260709 12:15:11.883579  5677 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:11.870498 10177 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:15:11.860484  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:11.860173  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:11.863457  5570 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:11.858510 10153 consensus_queue.cc:237] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:11.880810 10127 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:11.881316  5678 rpcz_store.cc:276] 0709 12:15:10.610299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.618427 (+  8128us) service_pool.cc:224] Handling call
0709 12:15:11.879626 (+1261199us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54004475d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:11.879779 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425587072}
W20260709 12:15:11.841746  5679 consensus_meta.cc:287] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.000s
I20260709 12:15:11.886656  5746 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:11.861505  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:11.887660  5679 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 15.
I20260709 12:15:11.887957  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:11.888815  5718 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.889424  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:11.889976  6320 raft_consensus.cc:2368] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
I20260709 12:15:11.890936  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:11.891213  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:11.891659  6324 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:11.893877  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:11.894273  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.894857  5679 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:15:11.901470  6321 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 11: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:11.901185  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.838831 10180 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:11.910307  6319 raft_consensus.cc:1240] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:11.910785  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:11.910458  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:15:11.911629  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 80413.6us
I20260709 12:15:11.912354  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.892439  5570 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:11.913056  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.916731  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.917490  5678 raft_consensus.cc:2410] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:15:11.918303  6328 raft_consensus.cc:2410] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 11 LEARNER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:15:11.918596  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.913455  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.916204  5570 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:11.924779  5677 raft_consensus.cc:2410] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:15:11.895565 10057 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:11.926390  5746 raft_consensus.cc:1240] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:11.928102  5747 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 14: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:11.927682  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.930032  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.930881  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:11.909651 10159 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.931603  6319 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 11: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:11.915660 10127 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.934597  5678 raft_consensus.cc:2368] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
I20260709 12:15:11.915824 10084 raft_consensus.cc:3055] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:11.936403 10156 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.936915 10156 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:11.938416 10166 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.496s	user 0.003s	sys 0.000s
I20260709 12:15:11.938645 10171 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:11.939023 10156 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:11.939158 10171 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 15 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:11.939951  6322 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:11.953874  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:11.954104 10171 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:11.955631  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.956347  5678 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:11.936417 10193 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:11.957427  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.928406 10097 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:11.940913  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:11.918800  9894 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:11.919785 10177 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:15:11.938336  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 49610.1us
I20260709 12:15:11.959475 10177 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:11.959854 10177 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:11.961885 10127 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:11.934059 10104 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:11.968492  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.936123  5642 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.947479 10183 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:11.972524 10104 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:11.973727 10143 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.974264 10143 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:11.958343  5678 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:15:11.977222  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.977499  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:11.977905  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:11.949056 10178 log.cc:927] Time spent T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:15:11.950834  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2411) took 1040 ms. Trace:
I20260709 12:15:11.982679  5600 rpcz_store.cc:276] 0709 12:15:10.909977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.910076 (+    99us) service_pool.cc:224] Handling call
0709 12:15:10.910352 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:10.910687 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:10.910716 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:10.928961 (+ 18245us) log.cc:844] Serialized 26 byte log entry
0709 12:15:11.013657 (+ 84696us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:11.013705 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:11.013792 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:11.883119 (+869327us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:15:11.950541 (+ 67422us) raft_consensus.cc:1685] finished
0709 12:15:11.950577 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:11.950775 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1276,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":27290,"spinlock_wait_cycles":10980736,"thread_start_us":44090,"threads_started":1,"wal-append.queue_time_us":379247}
W20260709 12:15:11.951555 10149 log.cc:927] Time spent T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.039s	user 0.003s	sys 0.000s
I20260709 12:15:11.951967 10092 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:11.952777 10162 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.646s	user 0.001s	sys 0.001s
I20260709 12:15:11.964320 10127 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:11.959060  5671 raft_consensus.cc:2376] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10. Re-sending same reply.
I20260709 12:15:11.980371  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.981525  5746 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:11.985253  6322 raft_consensus.cc:2410] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:15:11.989086  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:11.989252  5749 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:12.003188  5642 leader_election.cc:400] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 11. Current term is 12.
I20260709 12:15:11.990208  5677 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:11.927716 10057 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:11.995237  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:11.945277 10084 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:12.006898  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:12.007620  5678 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 14: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:11.999339  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:12.003517  5642 leader_election.cc:403] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:11.993649  9631 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:12.006156 10173 log.cc:927] Time spent T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.480s	user 0.000s	sys 0.004s
I20260709 12:15:11.998539  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:12.007529  6328 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:15:12.009995  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:12.015959  5642 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:12.018031  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:11.997828 10093 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:12.019454  6319 raft_consensus.cc:2368] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14.
I20260709 12:15:12.011157  9894 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.018805 10188 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:12.021643 10084 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.022994  9832 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.023340 10097 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:12.014703  9631 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.007167 10057 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:12.211539  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 193573us
I20260709 12:15:12.005342 10104 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:12.216830  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:11.892843  5496 catalog_manager.cc:5697] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 6 to 9, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:12.029038 10143 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:12.043200  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 875) took 1103 ms. Trace:
I20260709 12:15:12.048184  5751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1732) took 1037 ms. Trace:
W20260709 12:15:12.211092  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 77189.9us
I20260709 12:15:12.217599  6328 raft_consensus.cc:2376] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 11. Re-sending same reply.
W20260709 12:15:12.221956  5570 leader_election.cc:336] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.022s (SENT)
I20260709 12:15:12.221134  5751 rpcz_store.cc:276] 0709 12:15:11.010300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.024135 (+ 13835us) service_pool.cc:224] Handling call
0709 12:15:11.040146 (+ 16011us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:11.083022 (+ 42876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:11.086631 (+  3609us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:11.087252 (+   621us) log.cc:844] Serialized 52 byte log entry
0709 12:15:11.431645 (+344393us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:11.650233 (+218588us) log.cc:844] Serialized 14 byte log entry
0709 12:15:11.846256 (+196023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:11.846330 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:12.047912 (+201582us) raft_consensus.cc:1685] finished
0709 12:15:12.047936 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.048113 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68352,"prepare.queue_time_us":444368,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":70386,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":15400,"thread_start_us":366646,"threads_started":2,"wal-append.queue_time_us":453170}
I20260709 12:15:12.221050  6325 rpcz_store.cc:276] 0709 12:15:10.934872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.936410 (+  1538us) service_pool.cc:224] Handling call
0709 12:15:10.936757 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:10.937160 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:10.937190 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:10.937778 (+   588us) log.cc:844] Serialized 52 byte log entry
0709 12:15:11.011383 (+ 73605us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:11.319665 (+308282us) log.cc:844] Serialized 14 byte log entry
0709 12:15:11.319907 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:11.319977 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:11.952163 (+632186us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:15:12.036786 (+ 84623us) raft_consensus.cc:1685] finished
0709 12:15:12.038120 (+  1334us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.038306 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":419503,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":4204,"raft.queue_time_us":1777,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":11183,"spinlock_wait_cycles":101619584,"thread_start_us":360516,"threads_started":2,"wal-append.queue_time_us":98301}
I20260709 12:15:12.212307  5642 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:12.233634  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:12.234002  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:12.234773  6319 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:12.214584  9832 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.246819 10193 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:12.251700  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:12.255964  5642 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:15:12.273862  5570 leader_election.cc:336] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Timed out: RequestConsensusVote RPC to 127.4.78.68:42181 timed out after 2.184s (SENT)
I20260709 12:15:12.220118 10093 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:12.276708  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 274611us
I20260709 12:15:12.279644  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:12.281283  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2408) took 1372 ms. Trace:
I20260709 12:15:12.281665  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:12.236542 10162 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:15:12.283071  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:12.283931  6325 raft_consensus.cc:2410] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:15:12.281780  5603 rpcz_store.cc:276] 0709 12:15:10.909176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.919023 (+  9847us) service_pool.cc:224] Handling call
0709 12:15:10.945098 (+ 26075us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:10.951502 (+  6404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:10.951540 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:10.957569 (+  6029us) log.cc:844] Serialized 52 byte log entry
0709 12:15:11.303514 (+345945us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:11.332420 (+ 28906us) log.cc:844] Serialized 14 byte log entry
0709 12:15:11.332779 (+   359us) log.cc:844] Serialized 14 byte log entry
0709 12:15:11.332916 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:11.332985 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:11.974535 (+641550us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:15:12.280995 (+306460us) raft_consensus.cc:1685] finished
0709 12:15:12.281024 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.281190 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":189293,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":2683,"raft.queue_time_us":9500,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":3154,"spinlock_wait_cycles":14048000,"thread_start_us":333708,"threads_started":1,"wal-append.queue_time_us":560149}
I20260709 12:15:12.293089  5642 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:12.247968 10097 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:12.281873 10204 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:12.285899 10206 log.cc:927] Time spent T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:15:12.305068  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:12.306985  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:12.307519  6319 raft_consensus.cc:1240] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:12.282617 10104 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:12.276722 10103 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.004s	sys 0.015s
I20260709 12:15:12.298831 10188 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:12.304167 10097 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:12.317437  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:15:12.313555 10103 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.006s	sys 0.016s
I20260709 12:15:12.320493  9978 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:15:12.318588 10097 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:12.310134  9691 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:12.309860 10204 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:12.332509  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 870) took 1664 ms. Trace:
I20260709 12:15:12.300230 10193 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:15:12.299021 10177 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.354168  5603 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:12.355182 10177 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:12.316193 10093 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:12.338994 10188 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:12.336651  6327 rpcz_store.cc:276] 0709 12:15:10.668307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.668532 (+   225us) service_pool.cc:224] Handling call
0709 12:15:10.739242 (+ 70710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:11.357339 (+618097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.332183 (+974844us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400596ad4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:12.332424 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390454016}
I20260709 12:15:12.342038  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:12.337620 10204 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.365680  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:12.366413  5600 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:15:12.345506  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2466) took 1300 ms. Trace:
I20260709 12:15:12.362004  6328 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:15:12.322319 10103 raft_consensus.cc:697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:15:12.348353 10164 log.cc:927] Time spent T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.019s	user 0.000s	sys 0.012s
I20260709 12:15:12.348073 10097 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.351251  9978 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.367532  5597 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:15:12.330050  9631 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:12.380168 10097 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:12.360486  5496 catalog_manager.cc:5697] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:12.387485  5496 catalog_manager.cc:5697] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:12.391729  9894 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 11. Current term is 12.
I20260709 12:15:12.394917  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:12.395530  6327 raft_consensus.cc:2376] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 11. Re-sending same reply.
I20260709 12:15:12.395635  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:12.396238  6320 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:12.396692  6327 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:12.396981  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:12.397636  6325 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 11: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:12.398067  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:12.399143  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:12.399822  6326 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:12.366320  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:12.369408 10180 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:12.402647  6320 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:12.403584  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:12.403967  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:12.404505  5750 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.404842  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:12.405601  6323 raft_consensus.cc:2410] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:15:12.406308  6328 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:12.409015  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:12.409570  6321 raft_consensus.cc:2376] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 11. Re-sending same reply.
W20260709 12:15:12.411646  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.376092  9978 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.412197  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:12.412784  5745 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.413597  9978 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:12.374686  5595 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:12.411520  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:12.416447  6327 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:12.417408  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:12.419078  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:15:12.419180  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 107478us
I20260709 12:15:12.420130  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.420677  5600 raft_consensus.cc:3060] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:12.367081  5672 rpcz_store.cc:276] 0709 12:15:11.045425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.027120 (+981695us) service_pool.cc:224] Handling call
0709 12:15:12.027380 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:12.027743 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.027769 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:12.028231 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:15:12.039702 (+ 11471us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:12.039742 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.039807 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:12.345306 (+305499us) raft_consensus.cc:1685] finished
0709 12:15:12.345326 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.345452 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":165,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":11096,"threads_started":1,"wal-append.queue_time_us":16023}
I20260709 12:15:12.422997  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.423125  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:12.426635  5645 leader_election.cc:400] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14.
I20260709 12:15:12.426949  5645 leader_election.cc:403] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:12.427440  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:12.428169  5745 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:12.428314  5598 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:15:12.429001  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:12.430565  5597 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:12.431367  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.432687  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:12.445304  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.444195  5748 raft_consensus.cc:1275] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:12.446201  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.446743  5603 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.434484  5597 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 14: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:12.432987  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:12.448065  5672 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 14: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:12.452206  5600 raft_consensus.cc:2468] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:15:12.453025  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.433034  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:12.440928  5598 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:15:12.404505 10103 consensus_queue.cc:237] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.456113  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.456796  5601 raft_consensus.cc:3060] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:12.458180  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.458701  5604 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.461212  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.463536  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:12.464071  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:12.464674  5744 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:12.468971  5600 raft_consensus.cc:1275] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:12.469930  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.470537  5599 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:12.472570  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2469) took 1426 ms. Trace:
I20260709 12:15:12.472966  5672 rpcz_store.cc:276] 0709 12:15:11.046195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.471811 (+1425616us) service_pool.cc:224] Handling call
0709 12:15:12.472112 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.472273 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.472298 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.472340 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:12.472369 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.472417 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.472518 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.474380  5672 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:12.474917  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2470) took 1428 ms. Trace:
I20260709 12:15:12.475230  5672 rpcz_store.cc:276] 0709 12:15:11.046422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.473935 (+1427513us) service_pool.cc:224] Handling call
0709 12:15:12.474209 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.474710 (+   501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.474868 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.389165  5496 catalog_manager.cc:5697] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:12.478349  6291 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:12.480295  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2471) took 1433 ms. Trace:
I20260709 12:15:12.432199  9978 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.422732 10177 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.422124  9631 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:12.485245  6321 raft_consensus.cc:1240] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:15:12.487172  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:12.489833  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:12.490984  6321 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 14: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:12.460433 10188 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:12.496162  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:12.480768  5672 rpcz_store.cc:276] 0709 12:15:11.046644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.475886 (+1429242us) service_pool.cc:224] Handling call
0709 12:15:12.478889 (+  3003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.479070 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.479094 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.479132 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:12.479162 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.479210 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.480235 (+  1025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.498771  5603 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:12.491308 10127 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:12.502168 10084 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.503149  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:12.503937  6327 raft_consensus.cc:2393] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
W20260709 12:15:12.505365 10209 log.cc:927] Time spent T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:15:12.506462  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 845) took 1887 ms. Trace:
I20260709 12:15:12.507069  5601 raft_consensus.cc:2468] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:15:12.456179 10145 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:15:12.468904 10046 consensus_queue.cc:1059] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:15:12.511459 10093 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:12.511902 10093 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.512243 10093 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:12.517211  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 62915.6us
I20260709 12:15:12.517977  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2472) took 1466 ms. Trace:
I20260709 12:15:12.518028  5645 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:12.518467  5672 rpcz_store.cc:276] 0709 12:15:11.051313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.517160 (+1465847us) service_pool.cc:224] Handling call
0709 12:15:12.517462 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.517651 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.517673 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.517711 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:12.517745 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.517815 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.517920 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.519717  5645 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:12.468667 10183 consensus_queue.cc:1059] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:15:12.520277  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2473) took 1432 ms. Trace:
I20260709 12:15:12.506868  5673 rpcz_store.cc:276] 0709 12:15:10.611877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.669109 (+ 57232us) service_pool.cc:224] Handling call
0709 12:15:10.738394 (+ 69285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:10.738642 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:10.738665 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:10.749678 (+ 11013us) log.cc:844] Serialized 26 byte log entry
0709 12:15:11.014112 (+264434us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:11.014170 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:11.014250 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:12.347788 (+1333538us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:15:12.491587 (+143799us) raft_consensus.cc:1685] finished
0709 12:15:12.491623 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.498913 (+  7290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58902912,"thread_start_us":189448,"threads_started":1,"wal-append.queue_time_us":323301}
I20260709 12:15:12.521579  5672 rpcz_store.cc:276] 0709 12:15:11.087438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.519502 (+1432064us) service_pool.cc:224] Handling call
0709 12:15:12.519779 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.519938 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.519962 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.520000 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:12.520034 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.520129 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.520232 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.525003  5645 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:12.471228  9894 consensus_queue.cc:1048] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:15:12.523458 10097 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:12.546149 10097 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:12.546514 10097 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:12.557189  5569 connection.cc:256] RPC call timeout handler was delayed by -1.1826054350001414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
I20260709 12:15:12.524272 10092 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:12.560881  5569 connection.cc:256] RPC call timeout handler was delayed by -1.1727054350001254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
W20260709 12:15:12.561496  5569 connection.cc:256] RPC call timeout handler was delayed by -1.1126284690001285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 12:15:12.561878  5569 connection.cc:256] RPC call timeout handler was delayed by -1.1056469900001957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:15:12.562353  5569 leader_election.cc:336] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Timed out: RequestConsensusVote RPC to 127.4.78.66:33011 timed out after 1.531s (SENT)
I20260709 12:15:12.563020  5569 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:12.565037  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 108460us
I20260709 12:15:12.529839 10057 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.495505 10177 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.534081  9691 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:12.535032  5645 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:12.537010  9978 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14.
I20260709 12:15:12.538942  5496 catalog_manager.cc:5697] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 7, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 7 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:12.495874  9631 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.520955 10183 raft_consensus.cc:3055] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:12.542233 10204 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:12.559278  5674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1674) took 1715 ms (client timeout 1642 ms). Trace:
I20260709 12:15:12.515513  5604 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 14.
I20260709 12:15:12.576411  5750 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 14.
I20260709 12:15:12.581328  5672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2474) took 1493 ms. Trace:
I20260709 12:15:12.606513  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2464) took 1561 ms. Trace:
W20260709 12:15:12.607966  5676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50284 (request call id 849) took 1995 ms (client timeout 2097 ms). Trace:
I20260709 12:15:12.649413  5602 raft_consensus.cc:2410] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:15:12.648154  5672 rpcz_store.cc:276] 0709 12:15:11.087701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.522685 (+1434984us) service_pool.cc:224] Handling call
0709 12:15:12.580781 (+ 58096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.580969 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.580997 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.581040 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:12.581073 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.581136 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.581268 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.650801  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:15:12.647902  5674 rpcz_store.cc:269] 0709 12:15:10.843986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.863220 (+ 19234us) service_pool.cc:224] Handling call
0709 12:15:12.559028 (+1695808us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54001b7e54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:12.559180 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707900288}
W20260709 12:15:12.608794  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 151036us
I20260709 12:15:12.615011  5678 raft_consensus.cc:1240] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:12.652170  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 855) took 1350 ms. Trace:
I20260709 12:15:12.652558  5678 rpcz_store.cc:276] 0709 12:15:11.301793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.614523 (+1312730us) service_pool.cc:224] Handling call
0709 12:15:12.614826 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.651926 (+ 37100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.652119 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:12.648478  5676 rpcz_store.cc:269] 0709 12:15:10.612911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.632952 (+ 20041us) service_pool.cc:224] Handling call
0709 12:15:12.607781 (+1974829us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54003ce1d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:12.607909 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1469837056}
I20260709 12:15:12.618570  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2476) took 1130 ms. Trace:
I20260709 12:15:12.619591  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2475) took 1531 ms. Trace:
I20260709 12:15:12.621569  9832 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:12.628397  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:12.628996  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:12.630916  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:12.655369  5673 rpcz_store.cc:276] 0709 12:15:11.087932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.526513 (+1438581us) service_pool.cc:224] Handling call
0709 12:15:12.618973 (+ 92460us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:15:12.619134 (+   161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.619303 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.619327 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.619366 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:12.619400 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.619449 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.619540 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123804416}
I20260709 12:15:12.634522 10141 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.635198 10127 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.635140  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:12.646828  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 111862us
I20260709 12:15:12.664851  6323 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:15:12.651573  5671 rpcz_store.cc:276] 0709 12:15:11.044938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.025305 (+980367us) service_pool.cc:224] Handling call
0709 12:15:12.025570 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.221159 (+195589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.221191 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.221230 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:12.221267 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.606285 (+385018us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002d3a54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:12.606330 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.606458 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449291520}
I20260709 12:15:12.616730 10091 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:12.654040  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:12.654455  5679 rpcz_store.cc:276] 0709 12:15:11.487985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.617788 (+1129803us) service_pool.cc:224] Handling call
0709 12:15:12.618062 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.618237 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.618269 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.618313 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:12.618345 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.618397 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.618510 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.662040  6321 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 14: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:12.557421 10093 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:12.656747  6327 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:15:12.516965 10188 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:12.663968  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 97958.7us
I20260709 12:15:12.669891  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:12.674445  5670 raft_consensus.cc:2368] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
I20260709 12:15:12.674438  5671 raft_consensus.cc:1240] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:12.670389  5677 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:12.671458  5673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2477) took 1183 ms. Trace:
I20260709 12:15:12.643237 10183 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:12.672240  5676 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:12.647871 10092 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:12.666067  5719 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:12.675467  5671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2479) took 1186 ms. Trace:
I20260709 12:15:12.678850  6291 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:12.683306  5671 rpcz_store.cc:276] 0709 12:15:11.488787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.665467 (+1176680us) service_pool.cc:224] Handling call
0709 12:15:12.674280 (+  8813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.675269 (+   989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.675418 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.675979  5673 rpcz_store.cc:276] 0709 12:15:11.488304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.656360 (+1168056us) service_pool.cc:224] Handling call
0709 12:15:12.670957 (+ 14597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.671147 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.671172 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.671216 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:12.671255 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.671305 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.671402 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:12.677218  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 211036us
I20260709 12:15:12.679781  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:12.682592  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2478) took 1194 ms. Trace:
I20260709 12:15:12.685117  5676 rpcz_store.cc:276] 0709 12:15:11.488548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.663626 (+1175078us) service_pool.cc:224] Handling call
0709 12:15:12.672067 (+  8441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.682377 (+ 10310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.682544 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.684110  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:12.686231  5603 raft_consensus.cc:2410] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:15:12.685014  5604 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:12.686699  5600 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.666435 10091 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:12.708264  5716 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:12.710973  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:12.711607  5604 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:15:12.712867  5599 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:15:12.714143  5603 raft_consensus.cc:1275] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:12.714855  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:12.720983  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:12.723657  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 57661.5us
I20260709 12:15:12.724332  5600 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:12.725194  5719 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:12.663527 10001 consensus_queue.cc:1059] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 12:15:12.727188  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 52419.1us
I20260709 12:15:12.732481  5645 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:12.733997  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 100339us
I20260709 12:15:12.669402 10127 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.667951 10141 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:12.730800  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 168436us
W20260709 12:15:12.742023  5569 leader_election.cc:336] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Timed out: RequestConsensusVote RPC to 127.4.78.66:33011 timed out after 1.642s (SENT)
I20260709 12:15:12.742620  5569 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:12.744489  5645 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:15:12.746865  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 68078.6us
I20260709 12:15:12.760174  6291 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:12.764338  5719 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:12.764487  5567 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:12.767423 10127 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:12.734074 10092 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:12.732072 10214 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:15:12.816253  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 56158.7us
I20260709 12:15:12.757560 10205 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:12.832620 10205 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.833092 10205 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:12.830725  5677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50284 (request call id 854) took 1558 ms. Trace:
I20260709 12:15:12.764237 10147 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:12.729961 10083 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:15:12.763049  9894 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:12.822113 10177 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:12.824139 10192 log.cc:927] Time spent T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.948s	user 0.001s	sys 0.002s
I20260709 12:15:12.826170  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:12.755575 10153 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:15:12.870388  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:12.870985  5679 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 7.
I20260709 12:15:12.871795  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e2707f4a0454db308e33ed24bc75f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:12.872730  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:12.826737 10057 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:12.731527 10103 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 12:15:12.802950 10143 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:12.827483 10230 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:12.830811 10156 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:12.834010  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 76470.4us
I20260709 12:15:12.806072  9691 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:15:12.832814  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:12.773363 10146 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:12.834359  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:12.834306  5677 rpcz_store.cc:276] 0709 12:15:11.272724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.613244 (+1340520us) service_pool.cc:224] Handling call
0709 12:15:12.613607 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.683519 (+ 69912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.830483 (+146964us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b5400491454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:12.830667 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123205376}
W20260709 12:15:12.839449  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 104625us
W20260709 12:15:12.840029  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 75764.6us
I20260709 12:15:12.895417  6293 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:12.762976 10222 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:12.817591  6291 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
W20260709 12:15:12.848078  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 83786.2us
I20260709 12:15:12.899223  5567 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:12.859834  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 117834us
I20260709 12:15:12.806388 10096 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.880576 10187 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:12.815316 10127 raft_consensus.cc:2804] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:12.878969  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:12.908046  5679 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.772033  9978 consensus_queue.cc:1059] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 12:15:12.819358  9833 raft_consensus.cc:3055] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:12.896291  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:15:12.901435  5569 leader_election.cc:336] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Timed out: RequestConsensusVote RPC to 127.4.78.66:33011 timed out after 1.772s (SENT)
I20260709 12:15:12.913442  5569 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:12.826686 10227 consensus_queue.cc:1048] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 12:15:12.826198 10211 log.cc:927] Time spent T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 12:15:12.914644  5569 connection.cc:256] RPC call timeout handler was delayed by -1.0480469900001026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 12:15:12.915052 10156 raft_consensus.cc:697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:12.915930 10156 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.917265  5672 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 14.
I20260709 12:15:12.917989 10234 raft_consensus.cc:2804] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:12.918467  5676 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:12.919469  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:12.915027  5569 connection.cc:256] RPC call timeout handler was delayed by -1.0457428950001031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 12:15:12.921747  5569 leader_election.cc:336] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Timed out: RequestConsensusVote RPC to 127.4.78.66:33011 timed out after 1.884s (SENT)
I20260709 12:15:12.922395  9978 raft_consensus.cc:3055] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:12.922936  9978 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:12.923763  9978 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.924863  9978 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.912879 10092 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.926896 10092 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:12.928572  9833 raft_consensus.cc:740] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:12.929423  9833 consensus_queue.cc:260] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.930569  9833 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.933000 10226 consensus_queue.cc:1059] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:12.863066 10147 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.935763 10147 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:12.905241  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:12.936503  5744 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.938247 10188 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:12.815953 10183 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:12.941015  9631 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:12.880293 10177 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:12.941743 10233 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:12.942399 10233 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.942973 10177 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:12.942806 10233 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:12.906282  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 88772.9us
I20260709 12:15:12.944026  6291 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:12.944810 10233 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:12.945115  6291 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:12.896642 10146 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.881024  9894 raft_consensus.cc:697] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:12.946635  9894 consensus_queue.cc:237] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.880906  5496 catalog_manager.cc:5697] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 3 to 6, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 6 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:12.948589  5496 catalog_manager.cc:5697] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 5, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 5 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:12.806617 10091 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:12.950165 10091 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:12.892809 10224 consensus_queue.cc:1059] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:15:12.902420 10057 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:12.922438  5569 connection.cc:256] RPC call timeout handler was delayed by -1.0273469900000691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 12:15:12.952787  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.835731 10214 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:12.869041 10216 consensus_queue.cc:1059] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:15:12.955610  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.945771 10146 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:12.960410  5679 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:12.961678  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:12.964596  5677 raft_consensus.cc:2393] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 14: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:12.961984  5598 raft_consensus.cc:1240] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:12.966892  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.966820  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.907708 10187 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.950466 10141 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:12.967777  5600 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 11: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:12.968480  5596 raft_consensus.cc:2393] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:12.974879  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:12.969120  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:12.975452  5679 raft_consensus.cc:3060] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:12.951766 10057 raft_consensus.cc:697] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:12.976373  5600 raft_consensus.cc:2468] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:15:12.910648 10232 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:12.978228  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.978816  5747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 604) took 1116 ms. Trace:
I20260709 12:15:12.980157  5747 rpcz_store.cc:276] 0709 12:15:11.860351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.860600 (+   249us) service_pool.cc:224] Handling call
0709 12:15:12.976155 (+1115555us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b5400363dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:12.976272 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131121536}
I20260709 12:15:12.981400  5600 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:12.984030  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:12.984341  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.963232 10227 raft_consensus.cc:3055] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:12.985615  5597 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:13.000298  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:13.000908  5597 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:13.001645  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:13.002174  5597 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.983764  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.989380  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:12.990175 10057 consensus_queue.cc:237] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:12.991277 10225 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.994087 10204 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:12.967768  5744 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:12.998770  5677 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:12.953233 10097 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:13.014253  5670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1681) took 1879 ms (client timeout 2184 ms). Trace:
I20260709 12:15:13.001670  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2482) took 1040 ms. Trace:
I20260709 12:15:13.003702  5600 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:15:12.975071 10187 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:12.912792 10096 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:13.014698  5670 rpcz_store.cc:269] 0709 12:15:11.134869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.270489 (+135620us) service_pool.cc:224] Handling call
0709 12:15:12.630780 (+1360291us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b5800175598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:15:13.014061 (+383281us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5400064854. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:13.014194 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96861696}
I20260709 12:15:13.023466 10096 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:13.003015  5603 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:12.983114 10141 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:13.016865  5674 rpcz_store.cc:276] 0709 12:15:11.960862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.675081 (+714219us) service_pool.cc:224] Handling call
0709 12:15:12.675320 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.675499 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:15:12.835149 (+159650us) log.cc:844] Serialized 14 byte log entry
0709 12:15:13.001262 (+166113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:13.001319 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:13.001370 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.001499 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:13.001613 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":297915,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":80,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":274495,"threads_started":2}
I20260709 12:15:13.019991  5597 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:13.020972  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:12.999141 10216 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:13.030126  5676 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:13.009150 10232 raft_consensus.cc:3055] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:12.999753 10227 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:15:13.036546  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 91517.1us
I20260709 12:15:13.028815 10127 raft_consensus.cc:697] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:15:13.037951  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 130694us
I20260709 12:15:13.039923  5679 raft_consensus.cc:1275] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:13.046459  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:13.051040 10097 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:13.012079 10225 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.060900  5569 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.036607 10232 raft_consensus.cc:740] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:13.034572 10141 raft_consensus.cc:697] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:13.084929  5569 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.092554 10236 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:13.092387  5496 catalog_manager.cc:5697] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:13.093591 10216 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:13.095146 10225 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:13.034492 10220 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:15:13.096514  5603 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 15.
I20260709 12:15:13.097263  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:13.098089  5569 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:13.099726  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.112241  5679 raft_consensus.cc:1240] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:13.113662  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:13.114360 10146 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:13.119493  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 226371us
I20260709 12:15:13.122109  9878 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:13.126497 10141 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.131853 10245 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:13.132972 10231 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:13.092768 10127 consensus_queue.cc:237] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.132973  5642 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:13.138083  5569 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.138326  6293 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:15:13.155371  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 108996us
I20260709 12:15:13.106164 10238 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:13.161561  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:13.162221  5599 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:13.099018 10216 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:15:13.164410  5569 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.165290  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:13.165993  5603 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:15:13.171030  6291 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:13.152582 10245 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:13.173123  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:13.179178  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 57740.4us
I20260709 12:15:13.173867  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:13.159389 10204 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:13.161346 10231 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:13.184058  5600 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 12:15:13.184090  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:13.196715  5602 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:13.167443 10232 consensus_queue.cc:260] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.202093 10232 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:13.205902  5595 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:13.170384 10046 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:13.218333  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:13.184402  5569 leader_election.cc:400] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
W20260709 12:15:13.234225  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 57223.3us
I20260709 12:15:13.235018  5569 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.180521  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:13.178393 10093 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:13.196125 10245 raft_consensus.cc:697] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:15:13.259968  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 79556.7us
I20260709 12:15:13.281833  6291 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:13.260576 10127 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:13.264856 10146 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:13.105994 10227 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.214305 10092 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:13.312757  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:13.313297  5675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35876 (request call id 1689) took 1988 ms (client timeout 1603 ms). Trace:
I20260709 12:15:13.313575  6324 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:15:13.279682  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 44744us
I20260709 12:15:13.284778  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:13.285890 10246 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:15:13.313834  5675 rpcz_store.cc:269] 0709 12:15:11.325376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.385383 (+ 60007us) service_pool.cc:224] Handling call
0709 12:15:13.313025 (+1927642us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002e8bd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:13.313208 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2987767168}
I20260709 12:15:13.286556  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:13.286983 10230 raft_consensus.cc:3055] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:13.287595  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:13.287900  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:13.192029 10248 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:13.310194  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:13.314611  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:13.337924  6327 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:15:13.316687  5569 leader_election.cc:400] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:15:13.330303  6321 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 10: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:13.339154 10227 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:13.339654  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.340003  5569 leader_election.cc:403] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:15:13.340205  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.341084  5569 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:13.341885 10222 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 10. Current term is 11.
I20260709 12:15:13.342537 10222 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:13.342906 10222 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:13.342679 10210 consensus_queue.cc:1059] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:15:13.343304 10222 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:13.343534 10242 log.cc:927] Time spent T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.260s	user 0.002s	sys 0.000s
I20260709 12:15:13.344054  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:13.344661  6324 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.344424 10245 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.346874  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:13.347589  6321 raft_consensus.cc:2393] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:13.368979  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:13.370456  6319 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:15:13.380903  5569 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:15:13.384348  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 99886.8us
I20260709 12:15:13.386180  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:13.334501 10230 raft_consensus.cc:740] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:13.388372  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:13.396471 10205 consensus_meta.cc:287] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.563s	user 0.013s	sys 0.000s
I20260709 12:15:13.397106 10205 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:13.398206  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 148115us
I20260709 12:15:13.405961  5570 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:13.406510  5645 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:13.405043  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:13.378826 10231 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:13.408836  5569 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:13.410210  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 63297us
I20260709 12:15:13.412227 10057 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:13.413242 10093 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:13.414553  9721 consensus_queue.cc:1059] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:13.417207 10145 consensus_queue.cc:1059] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:13.418648 10215 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:13.418995 10203 consensus_queue.cc:1048] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:13.419440 10180 consensus_queue.cc:1059] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:13.454771 10183 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.403679 10236 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:13.456741 10187 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:13.458354 10243 log.cc:927] Time spent T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:15:13.463619  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 54856.2us
I20260709 12:15:13.482676  5569 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.407938 10204 raft_consensus.cc:697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:13.479387  5645 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:13.487866  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:13.459221 10057 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.491436  5569 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.492592  5569 leader_election.cc:400] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
I20260709 12:15:13.492895  5569 leader_election.cc:403] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:13.475893 10084 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.462569 10083 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:13.482831 10236 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:13.494948  5752 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:13.478327 10046 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:13.499754  5645 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:13.486687 10145 consensus_queue.cc:1243] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:15:13.504510 10083 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.502848 10092 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:13.510210  5719 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:13.511916  9721 consensus_queue.cc:1243] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:15:13.512552  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:13.517943 10213 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:13.488535  9977 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:13.496443 10204 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:13.495182 10091 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:13.539319 10234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.007s	sys 0.019s
W20260709 12:15:13.543623 10234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.007s	sys 0.019s
I20260709 12:15:13.543905 10234 raft_consensus.cc:697] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:13.544734 10234 consensus_queue.cc:237] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.542130 10180 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:13.491882 10230 consensus_queue.cc:260] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.546761 10230 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:13.548954 10222 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:13.549961 10265 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:13.476552  9894 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:15:13.551017 10222 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:13.551323  9894 consensus_queue.cc:1243] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Peer c02ed29558db481589fd3db23e43a07f log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:15:13.495604 10177 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:13.495368 10057 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.563454 10214 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:13.503186 10084 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.541900  9978 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:13.565474  6328 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
W20260709 12:15:13.573616 10255 log.cc:927] Time spent T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.282s	user 0.002s	sys 0.000s
W20260709 12:15:13.574663 10244 log.cc:927] Time spent T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.305s	user 0.001s	sys 0.001s
W20260709 12:15:13.579351 10256 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 12:15:13.583129 10084 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:13.585506  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:13.586256  5752 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 11: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:15:13.591277 10252 log.cc:927] Time spent T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 12:15:13.593462  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:13.595202  5745 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:13.598805  9978 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.537338  5675 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:13.525122 10236 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:13.598965  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:13.541297 10092 raft_consensus.cc:697] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:13.545746  9977 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.557258  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:13.600957 10092 consensus_queue.cc:237] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.595242  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:13.536446  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 43962.7us
I20260709 12:15:13.606072  6324 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:13.611420  5569 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.617940  5674 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:13.601954  9977 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:13.631153  9978 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:13.634008  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:13.635823  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:13.636545  5749 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:13.642648  5675 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 12:15:13.643518 10143 raft_consensus.cc:3055] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:13.643967 10143 raft_consensus.cc:740] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:13.644783 10143 consensus_queue.cc:260] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:13.647010  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:13.648051  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:13.648906  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:13.657366  5569 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:13.667426 10239 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:13.651291 10143 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:13.673003  5569 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:13.640750 10145 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:15:13.637136  9631 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:15:13.645686 10215 consensus_queue.cc:1059] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:15:13.659360 10269 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:13.670773 10177 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:13.670141 10231 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:13.714676  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.689612 10215 consensus_queue.cc:1243] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:15:13.658886 10224 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:15:13.694527 10239 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:13.784946  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 432177us
W20260709 12:15:13.783000  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 59824.4us
I20260709 12:15:13.787019  5642 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:15:13.788352  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:13.796020  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 131903us
I20260709 12:15:13.796916  5569 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.798071  5569 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:13.800381  5569 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.801568  5569 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:13.801879  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.802871  5719 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:15:13.803634  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 289430us
I20260709 12:15:13.803571  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:13.804420  6322 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:15:13.799687 10097 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:13.806013 10097 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:13.807884  6322 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:13.787840 10188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.000s
I20260709 12:15:13.809211  5569 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.811308  5569 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.813100  6291 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:13.806391 10097 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:13.808007 10274 log.cc:927] Time spent T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.108s	user 0.006s	sys 0.000s
W20260709 12:15:13.833148 10259 log.cc:927] Time spent T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.547s	user 0.002s	sys 0.000s
I20260709 12:15:13.829630 10191 raft_consensus.cc:3055] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:13.835106 10191 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:13.836115 10191 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.837389 10191 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.807037 10177 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:13.838440 10177 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:13.810389 10188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.008s	sys 0.000s
I20260709 12:15:13.805879 10222 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:13.843186 10222 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:13.843592 10222 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:13.809839 10213 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:13.815026 10046 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:13.810868 10153 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:15:13.846422 10240 log.cc:927] Time spent T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.680s	user 0.000s	sys 0.003s
I20260709 12:15:13.853859 10153 raft_consensus.cc:697] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:13.798317 10091 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
I20260709 12:15:13.821062  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:13.860818  5676 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:15:13.861258  5676 pending_rounds.cc:85] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 11
I20260709 12:15:13.861518  5676 pending_rounds.cc:107] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:15:13.861747  5676 raft_consensus.cc:2889] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:13.821547  5719 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:13.822567  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:13.804544 10232 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:15:13.823555 10083 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:13.788269 10270 consensus_queue.cc:1059] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:15:13.872803  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 51333.7us
I20260709 12:15:13.835024 10219 raft_consensus.cc:3055] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:13.828614 10257 log.cc:927] Time spent T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.497s	user 0.000s	sys 0.011s
I20260709 12:15:13.828882 10236 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:13.829923 10205 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:13.830343 10187 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:13.832194 10250 log.cc:927] Time spent T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.566s	user 0.002s	sys 0.000s
I20260709 12:15:13.856400  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:13.782770 10152 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:13.891127 10152 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:13.892292 10236 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:13.892179 10001 consensus_queue.cc:1059] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:15:13.892973 10001 consensus_queue.cc:1243] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer c02ed29558db481589fd3db23e43a07f log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:13.807862 10214 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:13.893462 10001 raft_consensus.cc:3055] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:13.784711 10239 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:15:13.853296 10281 log.cc:927] Time spent T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:15:13.868165  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 55097.8us
I20260709 12:15:13.868494  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 624) took 1188 ms. Trace:
I20260709 12:15:13.902539  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:13.882402  9983 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:13.886497  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:13.805253 10057 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.919504 10153 consensus_queue.cc:237] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:13.920398 10057 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:13.890386  5596 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.890457  5675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:13.923727  5675 raft_consensus.cc:606] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:13.924093  5675 raft_consensus.cc:614] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:13.864519  6322 raft_consensus.cc:2393] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 9: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:13.894650  5603 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:13.869992 10227 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:13.900779  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.883334  5595 raft_consensus.cc:1240] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:13.902892  5601 rpcz_store.cc:276] 0709 12:15:12.679685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.679791 (+   106us) service_pool.cc:224] Handling call
0709 12:15:12.680068 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:12.680254 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.680269 (+    15us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:12.702534 (+ 22265us) log.cc:844] Serialized 26 byte log entry
0709 12:15:12.891178 (+188644us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:12.891215 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.891278 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:13.841653 (+950375us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:15:13.854834 (+ 13181us) raft_consensus.cc:1685] finished
0709 12:15:13.854853 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:13.868435 (+ 13582us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5029120,"thread_start_us":151033,"threads_started":1,"wal-append.queue_time_us":372786}
I20260709 12:15:13.905030  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:13.930003  6323 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.878815 10219 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:13.906569  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:13.894389 10246 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:15:13.897126 10001 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:13.904955 10239 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:13.916790 10269 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:13.927500  5602 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 11: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:13.930696  6324 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.932654  5676 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:15:13.887866 10195 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:15:13.934664  5676 pending_rounds.cc:85] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 9
I20260709 12:15:13.935227  5676 pending_rounds.cc:107] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:15:13.935482  5676 raft_consensus.cc:2889] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:13.927767  9983 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.936007  9983 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:13.936419  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:13.937024  5601 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.938246  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:13.940551  5595 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:13.940455 10219 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:13.941859 10219 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:13.943133  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:13.944037  9832 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:13.940900 10152 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:13.945815  5595 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:13.948288  5595 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:13.950055  5603 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:13.951364  5672 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:13.958621  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:13.988735  5749 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 11: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:15:13.989500  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 44972.8us
I20260709 12:15:13.957289  5601 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
W20260709 12:15:13.992885  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 181629us
I20260709 12:15:13.997419  6324 raft_consensus.cc:2410] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:15:14.005707  5569 leader_election.cc:400] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
I20260709 12:15:13.958153 10152 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.010706  5569 leader_election.cc:403] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:15:14.011027  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:13.986452 10103 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:14.014721  6324 pending_rounds.cc:85] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 10
I20260709 12:15:14.024432  6324 pending_rounds.cc:107] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:15:14.024706  6324 raft_consensus.cc:2889] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:14.025307  6328 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:14.017342  5719 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:14.018612  9910 consensus_queue.cc:1059] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:14.007045 10227 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:15:14.029903  9910 raft_consensus.cc:3055] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:14.030314  9910 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:14.031092  9910 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:14.031740  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:14.018836 10210 consensus_queue.cc:1059] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:14.021863  5672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:14.032968  5672 raft_consensus.cc:606] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:14.033353  5672 raft_consensus.cc:614] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:13.986259 10260 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:14.023761 10057 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
I20260709 12:15:14.034561  5596 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:14.036847  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:14.038064  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:14.039033  6291 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:14.039114  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:14.046485  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:14.042330  6328 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:14.047242  5679 raft_consensus.cc:2376] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12. Re-sending same reply.
I20260709 12:15:13.988922 10246 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:15:14.047430  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:14.050601  5642 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:14.060364  5569 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:14.045955  5671 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:14.046645  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:14.053655  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:14.063272  5679 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:14.065584  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:14.066370  5642 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:14.068328  5642 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:14.070317  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:14.071038  6322 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 12: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:14.066617  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:14.072423  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:13.998569 10147 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:15:14.075762  5570 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:14.040731  6323 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:14.078336  5570 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:13.936224 10001 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.077080  9978 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:14.084519  9978 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:14.084995  9978 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:14.065843 10227 raft_consensus.cc:2764] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:15:14.079098 10273 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:15:14.069841  9691 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:14.088979  5569 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:14.090222  5569 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:15:14.104527  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 87263.8us
I20260709 12:15:14.042413 10103 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:14.080082 10188 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:14.033953 10152 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.091132 10057 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:14.094424 10214 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:14.069571 10234 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:15:14.109475  9910 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:14.110057 10224 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:14.094336 10230 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:14.113584 10187 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:14.077245 10266 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:15:14.059432 10260 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.114866 10236 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:14.130091 10224 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:14.091354 10203 consensus_queue.cc:1059] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:15:14.173266  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:14.191965  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 86419.4us
I20260709 12:15:14.193115  5719 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:14.193683 10224 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:14.152767  9983 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.198460 10204 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:14.198267 10188 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:14.213609 10127 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:14.211941 10147 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:14.211879 10222 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:14.273465 10298 log.cc:927] Time spent T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:15:14.243917 10204 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.277726 10204 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:14.285157 10239 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:14.292589 10239 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:14.289557 10260 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:14.318022  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:14.322901  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:14.325569  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:15:14.326682  5600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.001s	sys 0.014s
W20260709 12:15:14.327340  5600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.001s	sys 0.014s
I20260709 12:15:14.150614  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:14.327382  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 237066us
I20260709 12:15:14.328711  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:14.329173  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:14.330093  5599 raft_consensus.cc:2376] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 12. Re-sending same reply.
I20260709 12:15:14.330467  5597 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:14.330665  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:14.331465  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:14.332209  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:14.333216  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:14.335204  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2450) took 1150 ms. Trace:
I20260709 12:15:14.329641  5569 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:14.337635  5600 rpcz_store.cc:276] 0709 12:15:13.184647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.209361 (+ 24714us) service_pool.cc:224] Handling call
0709 12:15:13.212100 (+  2739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:13.251448 (+ 39348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:13.251483 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:13.267916 (+ 16433us) log.cc:844] Serialized 26 byte log entry
0709 12:15:13.734026 (+466110us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b1800428f20. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:15:14.334403 (+600377us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:14.334519 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.334625 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:14.334716 (+    91us) raft_consensus.cc:1685] finished
0709 12:15:14.334731 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.335122 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38895,"raft.queue_time_us":39027,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":11553,"spinlock_wait_cycles":36751104,"thread_start_us":551907,"threads_started":1,"wal-append.queue_time_us":985194}
I20260709 12:15:14.340551  5569 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:14.341248  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:14.343137  5600 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:14.345137  5600 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:14.337302  5599 raft_consensus.cc:2393] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 11: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:14.347321  5596 raft_consensus.cc:1275] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:14.348661  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:14.350116  5603 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
W20260709 12:15:14.355747  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 287310us
I20260709 12:15:14.361688  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:14.363103  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:14.376827  5599 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:14.385040  9691 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:14.391304  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:14.393936  9978 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.395711 10046 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:14.378546  5595 raft_consensus.cc:2376] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a54957145d9647cb89f46531d107120c in term 15. Re-sending same reply.
I20260709 12:15:14.397670 10057 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:14.398182 10091 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:14.400254 10097 consensus_meta.cc:287] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.002s
I20260709 12:15:14.402186 10103 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:14.407848 10152 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:14.408509 10177 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:14.410079 10204 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:14.413388 10222 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:14.270375 10147 raft_consensus.cc:697] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:14.445581 10097 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.456380 10097 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:14.455965 10147 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:14.456897  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 65909.9us
I20260709 12:15:14.458886 10097 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:14.464803 10046 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.482144 10293 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:14.485543 10046 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:14.465955  5645 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:14.487542  5597 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 12:15:14.489519 10092 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:14.459400  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:14.244278 10188 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:14.478470  9962 raft_consensus.cc:3055] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:14.453668  9691 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:14.492249  9962 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:15:14.495342 10300 log.cc:927] Time spent T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.225s	user 0.003s	sys 0.000s
I20260709 12:15:14.495087  9962 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:14.496498  9962 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:14.495536 10188 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:14.499819  9691 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:14.500890  5679 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:14.510229  5679 raft_consensus.cc:1240] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 12:15:14.513564  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:14.515861  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:14.517418  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:14.518528  5671 raft_consensus.cc:1275] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:14.490216 10092 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:15:14.520139  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 60953.1us
I20260709 12:15:14.520406 10092 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.513783 10232 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:15:14.521773 10103 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:14.468206 10224 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:14.530057 10293 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:15:14.514130  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:14.543421 10245 consensus_queue.cc:1048] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:14.546844  9721 raft_consensus.cc:3055] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:14.552932 10188 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:14.553074  5569 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:14.523816 10001 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:14.566735  5569 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:14.568415 10091 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:14.569083 10091 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:14.516245  9983 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:14.572324  5601 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:14.575030 10127 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:14.575524 10127 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:14.579414  5595 raft_consensus.cc:1240] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 12. Current term is 13. Ops: []
W20260709 12:15:14.595214  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.580201  9691 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:15:14.598440  5750 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:14.581923  9721 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:15:14.606117  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.606437  5642 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:14.609421  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:14.611039  5642 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:14.612247 10307 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:14.613052 10307 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:14.615180 10264 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:14.615255 10248 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:14.610821  9691 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:14.624046  5642 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:14.632236 10264 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:14.633337 10264 consensus_queue.cc:1048] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:14.633623  5642 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:14.645556  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:14.646466  6327 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:14.648685  5567 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:14.651152  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 118520us
I20260709 12:15:14.654580  9978 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:14.656629 10057 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:14.665154 10264 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:14.678419  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:14.679639  6325 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:14.692770 10264 raft_consensus.cc:697] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:14.694353  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:15:14.698599  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 65146.5us
I20260709 12:15:14.698904  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:14.702296  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:14.702441  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:14.702725 10224 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:14.703315  5598 raft_consensus.cc:2410] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:15:14.704953  5673 raft_consensus.cc:1240] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:15:14.709947  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 48994.5us
I20260709 12:15:14.712941  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:14.713629  5598 raft_consensus.cc:1275] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:14.714056  5677 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:14.694068 10264 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:14.716962  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:14.717880  5750 raft_consensus.cc:2368] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14.
I20260709 12:15:14.718443  9631 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.718961  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:14.724200  5569 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:14.725430 10057 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.747014  5569 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:14.755213  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:14.756098  5750 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:14.725914  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:14.763525  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:14.763862  6327 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
I20260709 12:15:14.760784  5677 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
I20260709 12:15:14.757469  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:15:14.782487  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 54973.7us
I20260709 12:15:14.785727 10293 consensus_queue.cc:1059] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:14.786998 10232 raft_consensus.cc:3055] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:14.787452 10232 raft_consensus.cc:740] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:14.788681  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:14.790148  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:14.791563  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:14.794668 10187 consensus_meta.cc:287] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.600s	user 0.000s	sys 0.012s
I20260709 12:15:14.795207 10187 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:14.719031  9631 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.797026 10246 consensus_queue.cc:1048] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:14.798614  9631 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:14.788506 10232 consensus_queue.cc:260] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.802006  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:14.802933  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:14.803822  6327 raft_consensus.cc:2368] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14.
I20260709 12:15:14.789623  5601 raft_consensus.cc:2393] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:14.802933  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:14.692632  9721 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:14.842296  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:14.844065  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:14.854919  6324 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:14.856029  9721 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:14.859220  5569 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:14.833317 10057 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:14.873893  5719 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:14.867772  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:14.864957  5750 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
W20260709 12:15:14.857751 10318 log.cc:927] Time spent T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:15:14.885401  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.890066 10232 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:14.893937  5597 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:14.897902 10224 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:14.907311  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:14.929425  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:14.936146  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 76610.2us
I20260709 12:15:14.962096  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
W20260709 12:15:14.966277 10316 log.cc:927] Time spent T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.184s	user 0.003s	sys 0.000s
I20260709 12:15:14.967077  6328 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:15:14.970992  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.971771 10127 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:14.982394  5645 leader_election.cc:400] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14.
I20260709 12:15:14.982832  5645 leader_election.cc:403] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:15:14.983320  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 71588.1us
I20260709 12:15:14.985926 10103 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14.
I20260709 12:15:14.987226 10103 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:14.989596 10001 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:14.958763  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:14.901895 10203 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:15:15.009850  6326 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:15.031728  6328 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 11 LEARNER]: Advancing to term 12
W20260709 12:15:15.044333  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 109965us
W20260709 12:15:15.050437  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.051026  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:15.051369  9631 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:15.052035  9631 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.014331 10001 raft_consensus.cc:697] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:15.026297 10152 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:15.072595  5642 leader_election.cc:400] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14.
W20260709 12:15:15.094692  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 49574.4us
I20260709 12:15:15.113495  6328 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 12 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:15.107654  5642 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:15.094980 10246 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.121434  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:15.104915 10127 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:15:15.128245  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.122507 10246 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.129482  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:15.125208 10328 log.cc:927] Time spent T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:15:15.139689  5642 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:15.122942  9631 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:15.135411 10204 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:15.147100  5748 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:15:15.159272  5716 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:15.164011  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:15.165015  6323 raft_consensus.cc:2393] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 12: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:15.155212 10152 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:15.138657  9978 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:15:15.201435  5642 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:15.162941 10204 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:15.210927  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:15.198488 10152 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.208901 10264 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:15.221323 10152 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:15.168447 10001 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.226334 10103 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:15.222494 10204 raft_consensus.cc:697] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:15.245489  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:15.248217  9909 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:15.248792  9909 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:15.249738  9909 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.253000 10264 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:15.255359  5595 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:15.256083 10204 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:15.268795  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 132144us
W20260709 12:15:15.288162 10315 log.cc:927] Time spent T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.492s	user 0.000s	sys 0.005s
W20260709 12:15:15.290637 10320 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.398s	user 0.003s	sys 0.003s
I20260709 12:15:15.280651  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:15.281312 10246 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:15.255398 10264 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:15.297662 10103 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:15.324144  5750 raft_consensus.cc:1275] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:15:15.325729  5749 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:15.354041  5601 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:15:15.355767  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:15.356913 10246 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:15.357362 10246 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.357722 10246 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:15.338235 10248 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:15.385387 10046 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:15:15.434088 10323 log.cc:927] Time spent T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.526s	user 0.005s	sys 0.000s
I20260709 12:15:15.414721 10188 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 12:15:15.441673  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 207753us
W20260709 12:15:15.444154  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.444449  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:15:15.452069 10317 log.cc:927] Time spent T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.655s	user 0.002s	sys 0.000s
W20260709 12:15:15.454658 10232 consensus_meta.cc:287] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.564s	user 0.002s	sys 0.009s
I20260709 12:15:15.456096  6322 raft_consensus.cc:2410] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:15:15.457970 10188 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:15.413246 10248 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.465781  5601 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 12:15:15.472059  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 43576.1us
I20260709 12:15:15.476934  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:15.478371 10319 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.586s	user 0.003s	sys 0.000s
I20260709 12:15:15.479399  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:15.480255  6328 raft_consensus.cc:2393] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 12: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:15.477664  5749 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:15.432158 10046 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:15.482813  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:15.489049  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:15.489713  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.498296  5603 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:15.525382  6325 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:15.529467  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:15.530397  5750 raft_consensus.cc:2410] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:15:15.534236  5602 raft_consensus.cc:2393] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 12: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:15.523142 10001 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.524859  9983 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.559183 10296 consensus_queue.cc:1059] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:15:15.560424 10296 raft_consensus.cc:3055] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:15.560811 10296 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:15.536218  9631 consensus_queue.cc:1059] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:15:15.569476 10246 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.597227 10248 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:15.598423 10234 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.599088 10234 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.561743 10296 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:15.579128  9983 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:15.602463 10296 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:15.602906 10341 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.571350 10001 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.607137 10001 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:15.608336  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:15.609037  6322 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:15:15.611163 10246 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:15.616822  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:15.617472  5602 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:15.619140 10152 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.624584  5645 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:15.643100  5602 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:15:15.601486 10234 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:15.661127  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:15.663288  6320 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:15.659353  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:15.603572 10341 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.673817  5602 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:15.661248 10057 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.686185 10057 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:15.681463  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:15.688202  9909 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:15.688580  9909 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.688966  9909 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:15.673017 10152 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:15.690230 10341 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:15.685642  5679 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 12: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:15.676924 10353 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.683517  9721 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:15:15.684702 10321 log.cc:927] Time spent T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.916s	user 0.003s	sys 0.002s
W20260709 12:15:15.673306 10344 log.cc:927] Time spent T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:15:15.686517 10224 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:15.682804 10352 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:15:15.701404  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 91698.5us
I20260709 12:15:15.688592 10057 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:15.718860  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 46773.9us
W20260709 12:15:15.724726  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 139876us
I20260709 12:15:15.718969  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:15.742230  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:15.741647  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:15.746232  6326 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:15.741438  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:15.742034  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:15.738807 10103 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:15.717485  9978 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:15:15.740116 10232 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.717978 10224 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:15.746114 10273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.000s	sys 0.012s
I20260709 12:15:15.768110  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:15.724532 10152 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:15:15.717638 10351 consensus_queue.cc:1048] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:15:15.765178  6324 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:15.780488  5748 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:15.764437  9983 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:15.766089 10341 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:15.784550  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:15.785195  5601 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:15.770076 10103 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:15:15.781937 10273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.000s	sys 0.013s
I20260709 12:15:15.789618  5673 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:15.736528 10353 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.805825  5750 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:15:15.784372 10127 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.807432  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:15.807948  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:15.817437  5747 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:15.808259 10325 log.cc:927] Time spent T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.844s	user 0.001s	sys 0.006s
I20260709 12:15:15.807262 10355 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:15:15.827915  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 120294us
I20260709 12:15:15.788714 10341 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:15.825991 10355 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:15.801923 10232 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.840466 10057 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.845268 10357 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.848358 10232 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:15.848146 10357 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:15.849404 10358 log.cc:927] Time spent T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:15:15.846132 10356 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:15.847556  6319 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
W20260709 12:15:15.850045 10331 log.cc:927] Time spent T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.795s	user 0.003s	sys 0.010s
W20260709 12:15:15.851179 10354 log.cc:927] Time spent T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:15:15.852403  5752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 617) took 1055 ms. Trace:
I20260709 12:15:15.852823  5752 rpcz_store.cc:276] 0709 12:15:14.796566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.796787 (+   221us) service_pool.cc:224] Handling call
0709 12:15:14.797152 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:14.797543 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:14.797572 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:14.798232 (+   660us) log.cc:844] Serialized 52 byte log entry
0709 12:15:14.913294 (+115062us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:14.944048 (+ 30754us) log.cc:844] Serialized 14 byte log entry
0709 12:15:14.998627 (+ 54579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.998761 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:15.783054 (+784293us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:15:15.851918 (+ 68864us) raft_consensus.cc:1685] finished
0709 12:15:15.852045 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.852213 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53489,"prepare.queue_time_us":22189,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":55940,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":7070,"spinlock_wait_cycles":94849280,"thread_start_us":114635,"threads_started":1,"wal-append.queue_time_us":256119}
I20260709 12:15:15.833802 10341 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:15.855381 10330 log.cc:927] Time spent T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.798s	user 0.016s	sys 0.004s
I20260709 12:15:15.855924 10046 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:15.850188  6319 pending_rounds.cc:85] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 9
I20260709 12:15:15.856642  6319 pending_rounds.cc:107] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:15:15.858067  5596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 642) took 1146 ms. Trace:
W20260709 12:15:15.860538 10332 log.cc:927] Time spent T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.705s	user 0.006s	sys 0.001s
I20260709 12:15:15.862123  5569 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:15.864508  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 997) took 1030 ms. Trace:
I20260709 12:15:15.865007  6319 raft_consensus.cc:2889] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:15.847653 10057 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:15.874316 10046 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.864926  6327 rpcz_store.cc:276] 0709 12:15:14.837872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.842492 (+  4620us) service_pool.cc:224] Handling call
0709 12:15:14.845559 (+  3067us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:14.847773 (+  2214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:14.847802 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:14.848425 (+   623us) log.cc:844] Serialized 52 byte log entry
0709 12:15:14.994883 (+146458us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:14.994925 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.994991 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:15.819477 (+824486us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:15:15.864161 (+ 44684us) raft_consensus.cc:1685] finished
0709 12:15:15.864184 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.864418 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1259,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":117136768,"thread_start_us":146069,"threads_started":1,"wal-append.queue_time_us":271428}
I20260709 12:15:15.878921 10357 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:15.883242 10103 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.884717 10103 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:15.885986 10326 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.803s	user 0.003s	sys 0.003s
I20260709 12:15:15.888767 10224 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:15.889416 10224 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:15.889786 10224 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.890148 10224 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:15.830348 10127 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.892989  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:15.893427 10127 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:15.875113 10046 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.894812 10057 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:15.858433  5596 rpcz_store.cc:276] 0709 12:15:14.712050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.712164 (+   114us) service_pool.cc:224] Handling call
0709 12:15:14.712569 (+   405us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:15:14.713062 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:14.713089 (+    27us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:15:14.713943 (+   854us) log.cc:844] Serialized 104 byte log entry
0709 12:15:14.918801 (+204858us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:15.005736 (+ 86935us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.014054 (+  8318us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.018260 (+  4206us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.021074 (+  2814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.021164 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:15.253649 (+232485us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b18004126c0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:15:15.258135 (+  4486us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b18004126c0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:15:15.818921 (+560786us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:15:15.857829 (+ 38908us) raft_consensus.cc:1685] finished
0709 12:15:15.857850 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.858004 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3755,"prepare.queue_time_us":292951,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":101,"raft.queue_time_us":4279,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":25398,"spinlock_wait_cycles":26099328,"thread_start_us":204453,"threads_started":1,"wal-append.queue_time_us":342471}
I20260709 12:15:15.898554 10353 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:15.899188  5678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35876 (request call id 1720) took 1208 ms. Trace:
I20260709 12:15:15.899559 10355 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:15.901788  9909 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.902987  5748 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:15:15.903259 10324 log.cc:927] Time spent T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.837s	user 0.003s	sys 0.002s
I20260709 12:15:15.905395  5747 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 15.
I20260709 12:15:15.909314 10341 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:15.947960  5745 raft_consensus.cc:2393] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 12: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:15.948393 10353 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.949151 10353 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:15.950165  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:15.949486  9909 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:15.951431  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 639) took 1429 ms. Trace:
I20260709 12:15:15.952855  6324 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:15.953246  6326 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 15.
I20260709 12:15:15.953526  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:15.954123  6327 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:15:15.951891  5600 rpcz_store.cc:276] 0709 12:15:14.522258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.545506 (+ 23248us) service_pool.cc:224] Handling call
0709 12:15:14.555312 (+  9806us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:14.604849 (+ 49537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:14.604881 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:14.664211 (+ 59330us) log.cc:844] Serialized 26 byte log entry
0709 12:15:14.830766 (+166555us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:14.830808 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.830877 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:15.902589 (+1071712us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:15:15.951155 (+ 48566us) raft_consensus.cc:1685] finished
0709 12:15:15.951176 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.951371 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13102,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":22215,"spinlock_wait_cycles":25934208,"thread_start_us":132493,"threads_started":1,"wal-append.queue_time_us":374205}
I20260709 12:15:15.963613  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:15.931488  5678 rpcz_store.cc:276] 0709 12:15:14.690629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.699983 (+  9354us) service_pool.cc:224] Handling call
0709 12:15:14.700367 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:14.700841 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:14.700872 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:14.701493 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 12:15:14.763709 (+ 62216us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:14.763775 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.763836 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:15.742496 (+978660us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:15:15.898771 (+156275us) raft_consensus.cc:1685] finished
0709 12:15:15.898792 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.898988 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1225,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"spinlock_wait_cycles":62088064,"thread_start_us":53569,"threads_started":1,"wal-append.queue_time_us":207428}
I20260709 12:15:15.964309  9909 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:15.966930  6327 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:15.964474  5673 raft_consensus.cc:2393] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:15.972018  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:15:15.972971  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 239631us
I20260709 12:15:15.965328  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:15.983506  5601 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 15.
I20260709 12:15:15.951383 10341 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:15.993330 10364 consensus_queue.cc:1059] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:15.994689 10203 raft_consensus.cc:3055] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:15.995069 10203 raft_consensus.cc:740] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:15.995885 10203 consensus_queue.cc:260] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:15.997077 10203 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:15.999192 10188 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:16.005630  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:16.010288 10203 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:16.011996  9631 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:16.017553  9910 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.018177  9910 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.019778  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.020547  5752 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:16.021989  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.022707  5752 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:15.951479 10353 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:16.035750 10365 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:16.036437 10365 raft_consensus.cc:697] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:15.982215 10057 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.038853  6293 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:16.042222  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.037417 10365 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.043690  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:16.052953  6324 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 11: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:16.053689  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.054530  5752 raft_consensus.cc:2410] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 16 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
W20260709 12:15:16.054174  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 280880us
I20260709 12:15:16.057030  5642 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:16.033732 10353 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.058746  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.056219  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:16.068979  5748 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:16.070643  9909 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:16.071094 10092 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:16.020576  9910 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:16.052309 10357 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.075748  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.078068  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:16.057190 10046 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:16.087752  5677 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:16.086272  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.092832 10384 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.075420 10378 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:15:16.093607 10384 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.093911  5752 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:15:16.095781  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.096073 10384 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.096473  5679 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:16.105901  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.106633  5675 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:16.074597 10353 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.109257 10353 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:16.111186 10355 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.111984 10046 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.112543 10046 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.114530 10224 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.081282 10092 raft_consensus.cc:697] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:16.116834 10224 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.119544 10353 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.120165 10353 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.056627 10188 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:15:16.121611 10188 consensus_queue.cc:1243] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:16.074736 10374 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:15:16.122984 10374 consensus_queue.cc:1243] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Peer 831d76c5ee1045f0af923ce24fa4c301 log is divergent from this leader: its last log entry 14.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:15:16.124079 10353 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:16.116335 10092 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.130148  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.113472 10355 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.130882  5752 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:16.114635 10046 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.141894 10368 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:16.142520 10368 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:16.143491 10368 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.144913  5599 raft_consensus.cc:1240] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:16.146155  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:16.146955  5596 raft_consensus.cc:2393] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 13: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
W20260709 12:15:16.157672  5718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.167330  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.060220 10057 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.080364 10375 raft_consensus.cc:493] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:15:16.179557  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 169977us
I20260709 12:15:16.180336  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.183848  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:16.184661  5748 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:16.193102  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.198562  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:16.198922 10224 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.199424  5598 raft_consensus.cc:2393] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 12: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:16.199503 10224 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.205462  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.209189  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.195427  9910 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.210162 10313 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.210748 10313 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.202109 10224 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.191910 10379 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.216439  5567 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:16.219102  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:16.219718  5749 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.220335  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.195297 10375 raft_consensus.cc:515] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.210206  9910 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.223651 10375 leader_election.cc:290] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.224251  9910 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:16.226496  5567 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:16.202647 10353 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.227784  5567 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:16.228502 10224 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:16.219646 10388 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:16.229897 10388 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.230244 10388 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:16.238870  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:16.239675  5600 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 11: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:16.243863  5748 raft_consensus.cc:2410] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:15:16.245682 10353 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:16.247926 10380 log.cc:927] Time spent T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
I20260709 12:15:16.248165 10353 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:16.257591 10187 raft_consensus.cc:3055] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:16.258109 10187 raft_consensus.cc:740] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:16.258764 10313 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.259135 10187 consensus_queue.cc:260] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.231204 10224 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.260236 10187 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:16.260555 10224 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:16.231089 10375 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:16.224397 10379 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.275775 10379 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.260145 10057 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.287580 10353 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.261679  5749 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:16.306726 10363 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.307272 10363 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.288364 10353 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.306111 10379 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.315589 10379 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.309479 10343 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.323134 10363 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.308490 10057 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.355235 10103 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.382404  5600 pending_rounds.cc:85] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 7
I20260709 12:15:16.356459  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.355281 10092 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.357231 10264 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.357321  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.358698  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:16.390027  5679 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.383595  5718 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:16.358924 10353 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.360000  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:16.360502 10391 log.cc:927] Time spent T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 12:15:16.369977  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.382035 10057 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.376865 10224 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.377321  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:16.381359  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.385186  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.382982  5671 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:15:16.382123 10103 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.401855  5674 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:16.392004 10092 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.382722  5600 pending_rounds.cc:107] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.8
I20260709 12:15:16.392968 10264 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.396787  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:16.392259  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.402024  5677 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:15:16.402892  5679 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:16.408407  5596 raft_consensus.cc:2393] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 9: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:16.408622  5600 raft_consensus.cc:2917] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Aborting config change with OpId 9.8: Aborted: Op aborted by new leader
I20260709 12:15:16.415912  5569 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:16.411576  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:16.426443  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.423571  5597 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:16.425510  5567 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:16.428239  5645 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:16.433714  5567 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:16.405968 10364 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:15:16.399087  9721 raft_consensus.cc:2764] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:15:16.435407  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.440289  5749 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:16.434695  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.432610  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:16.438241  5600 raft_consensus.cc:2889] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:16.437291  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:16.442101 10382 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.442312  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:16.425534 10353 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:16.442663 10382 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.443075 10353 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.443470 10353 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:16.397720 10356 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:15:16.444950 10382 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.437318  5678 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:15:16.446182  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.451965  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:16.422031 10103 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.455214  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.437229 10375 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:16.445904 10046 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:16.458503 10046 raft_consensus.cc:697] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:16.458949 10264 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.459359 10046 consensus_queue.cc:237] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.422899 10384 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.461920 10384 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.463919 10384 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:16.469748  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:16.471593  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.472076  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.473167  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.464062 10313 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.435321 10187 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:16.478037 10313 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.479106  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.470470  5745 pending_rounds.cc:85] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: Aborting all ops after (but not including) 5
I20260709 12:15:16.481907  5745 pending_rounds.cc:107] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: Aborting uncommitted NO_OP operation due to leader change: 14.6
I20260709 12:15:16.477587 10351 raft_consensus.cc:1064] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:16.386696 10343 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.455256 10092 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.482156  5745 raft_consensus.cc:2889] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:16.485162  6291 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:16.512787  6291 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:16.477495  5747 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:15:16.497505  5674 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:16.498317  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:16.514174  5602 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:15:16.479122 10378 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:16.495842  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:16.516212  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:16.520716  6291 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:16.524029  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:16.525079  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:16.525913  6324 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:15:16.525107  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.529661  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:16.530603 10395 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.276s	user 0.003s	sys 0.000s
I20260709 12:15:16.524302 10273 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:16.531435 10273 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.531860 10273 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.544893  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:16.514200 10351 raft_consensus.cc:1068] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:15:16.478163 10187 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.515316 10374 raft_consensus.cc:2764] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:15:16.519549 10378 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.548784 10357 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:16.550303 10368 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:16.565724 10393 log.cc:927] Time spent T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:16.546703 10349 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.612850  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.613780  5747 raft_consensus.cc:2410] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:15:16.571614 10103 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.582933  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:16.619650  5569 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:16.619144  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:16.557833 10382 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.596191 10350 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.629992  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.559804 10001 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:16.614434  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:16.615723  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:16.616036  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:16.551273 10384 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.634584  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:16.577384 10378 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:16.583367  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:16.635202  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:16.632941 10264 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:16.636852  5670 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:15:16.638501  5599 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:15:16.643787 10224 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:16.640697 10264 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.634297 10350 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.647202 10353 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.647975 10350 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.648291  5597 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:16.633201 10313 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:16.633783 10379 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.632892 10382 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.651641 10382 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.633180 10273 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.655954 10273 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.656410  6327 raft_consensus.cc:1240] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:16.659176 10357 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:16.632268 10103 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.659610  5570 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:16.659832 10357 raft_consensus.cc:697] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:16.660764 10357 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.661718 10353 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.666736  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:16.669698 10350 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.670253 10350 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.672201 10350 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.672978 10350 consensus_queue.cc:1059] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:16.661577 10103 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.674002 10368 raft_consensus.cc:3055] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:16.674403 10368 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:16.675228 10368 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.676177 10368 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.679236 10384 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.681283 10384 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.686223 10388 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.687981  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:16.717278  5752 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:16.721979  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:16.723343  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 55198.2us
I20260709 12:15:16.728528  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.734071 10057 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:16.735623 10187 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:16.736219 10409 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:16.736727 10409 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.737136 10409 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:16.728528  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:16.743021  6320 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:16.746258  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:16.746781  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 87343.8us
I20260709 12:15:16.746997  5747 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:16.747970  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.748108  5570 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:16.748605  5749 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:15:16.749579 10375 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.750300 10375 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:16.751868  5570 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:16.753445  5570 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:16.758188 10057 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:16.759820  5570 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:16.645684 10264 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:16.767135  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 44157.8us
I20260709 12:15:16.769524  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:16.776252  6320 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:16.777176  5599 raft_consensus.cc:2393] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 11: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:16.778993  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:16.780731  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 90227.2us
I20260709 12:15:16.783074  5570 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:16.779755  5598 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:16.758358 10343 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:16.784669  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 96759us
I20260709 12:15:16.787763  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:15:16.800218  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 75623.3us
I20260709 12:15:16.803412  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:16.789475 10353 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:16.779119 10403 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:16.799347 10103 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.844893  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:16.848845  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 330048us
I20260709 12:15:16.852505  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.854748  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.832787 10360 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:16.856647  5718 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:16.858790  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:16.845100 10350 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:15:16.868484  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 80803.2us
I20260709 12:15:16.871543  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.848714  9691 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:16.849436 10046 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.879012  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.882349  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7972b9d3b424d0a82305768187e2573" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:16.884590  5601 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:16.841678 10353 raft_consensus.cc:697] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:16.832576 10378 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:16.880278 10377 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:16.898777 10350 raft_consensus.cc:697] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:15:16.922062 10413 log.cc:927] Time spent T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:15:16.874246 10360 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:16.886816  9691 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:16.973446  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 104079us
I20260709 12:15:16.975265  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:16.932360 10388 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:17.000744 10332 log.cc:927] Time spent T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:15:17.000836  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
W20260709 12:15:17.014662 10383 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:15:17.086649 10369 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:17.014878 10374 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:15:17.086722 10421 log.cc:927] Time spent T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:17.087395 10374 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.087200 10369 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:17.087934 10374 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.088270 10369 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:17.044883 10353 consensus_queue.cc:237] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:17.094830  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 94069.9us
I20260709 12:15:17.098913 10343 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:17.102030  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:17.102551  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.086972 10350 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:17.106074  5750 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:17.110757  9691 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:17.112856 10360 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.114418 10378 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:17.119836 10409 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:17.120994  5595 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:17.120812 10369 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:17.128492  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:17.138249  5673 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:17.138602 10423 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.139163 10423 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.143628 10411 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:17.149014 10423 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.165956 10426 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:17.178014 10369 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:17.201431  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:17.136070 10409 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:17.231110 10400 log.cc:927] Time spent T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.622s	user 0.007s	sys 0.000s
I20260709 12:15:17.236557  5750 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:15:17.237434  5673 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:17.227159 10264 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:17.242368  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:17.243323  5750 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:17.248307 10264 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:17.249194  5679 raft_consensus.cc:1240] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:17.250931  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 618303us
I20260709 12:15:17.254066  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:17.256405  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:17.259963 10374 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:17.260605 10416 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.414s	user 0.011s	sys 0.000s
I20260709 12:15:17.262106  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:17.262657  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:17.263259  5671 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:15:17.263401  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:17.264422  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:17.266016 10411 consensus_queue.cc:1059] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:17.267056 10411 raft_consensus.cc:3055] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:17.267390 10411 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:17.268185 10411 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:17.275177 10374 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:17.279235  5674 raft_consensus.cc:2368] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13.
I20260709 12:15:17.288898  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:17.269326 10411 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:17.304931 10418 log.cc:927] Time spent T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.395s	user 0.002s	sys 0.010s
I20260709 12:15:17.321851  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:17.322543  5752 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:15:17.315193 10363 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.331343  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:17.353878 10408 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:17.565542 10363 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.569890  5751 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:17.577600  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:17.578450  5752 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:15:17.590094  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:17.596262  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:17.597110  5752 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:17.599623 10409 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:17.600260 10409 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:17.605211 10409 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:17.566818 10408 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.606868  5676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2560) took 1158 ms. Trace:
I20260709 12:15:17.607703 10408 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.594765 10422 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:17.610476  5676 rpcz_store.cc:276] 0709 12:15:16.448433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.527777 (+ 79344us) service_pool.cc:224] Handling call
0709 12:15:16.528167 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:16.563683 (+ 35516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:16.563712 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:16.582757 (+ 19045us) log.cc:844] Serialized 26 byte log entry
0709 12:15:17.195861 (+613104us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18003a5280. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:15:17.561335 (+365474us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:17.561379 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.589013 (+ 27634us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:17.606579 (+ 17566us) raft_consensus.cc:1685] finished
0709 12:15:17.606599 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:17.606801 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27661,"raft.queue_time_us":35900,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7142,"spinlock_wait_cycles":6059392,"thread_start_us":305029,"threads_started":1,"wal-append.queue_time_us":995500}
I20260709 12:15:17.615995 10422 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.616326  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:17.598428 10374 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:17.623597  5751 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:17.627413  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:17.632242  5746 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
W20260709 12:15:17.632896  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.634929  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:17.677734  5599 raft_consensus.cc:2393] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:17.636255  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:17.679474  5719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.623345 10363 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.706102  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:17.706792  5598 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:17.707871  5596 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:17.617748 10374 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.707531  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:17.708832  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:17.701303 10408 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:17.707652  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:17.713946  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:17.677016 10353 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:17.714167 10408 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:17.718923  5600 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
W20260709 12:15:17.719280 10398 log.cc:927] Time spent T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 1.384s	user 0.007s	sys 0.004s
I20260709 12:15:17.719516  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:17.708076 10409 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:17.711346 10188 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:17.727509  5596 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:17.712142 10411 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:17.728030  5751 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:15:17.728729 10363 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:17.729444 10388 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:17.797422 10388 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:17.807451  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:17.734974 10411 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.808296  5601 raft_consensus.cc:2410] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:15:17.766530 10408 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:17.811137 10408 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:17.786448 10152 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:17.798704  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:17.799824  5567 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:17.813308  5567 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:17.814553 10374 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.815169  5567 leader_election.cc:304] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:17.731001 10409 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.803927  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:17.804847  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:17.822587  5604 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:17.805579  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:17.823297  5602 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.806072  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:17.731225 10188 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.767493  5749 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:15:17.815843  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:17.805491  5569 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:17.806046  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:17.827764  5599 raft_consensus.cc:2393] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 8: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:17.819188  5752 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:17.726024 10353 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.825600 10428 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:17.846822  5716 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:17.856532  5598 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:17.814471 10152 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.826267 10374 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:17.838516 10408 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:17.841078 10411 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.735888 10363 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.859834  9721 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:17.859997 10437 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:17.841463 10428 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:17.883241 10426 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.876420 10388 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:17.897673  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 82600.2us
W20260709 12:15:17.894263 10432 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.264s	user 0.001s	sys 0.001s
I20260709 12:15:17.898591  5567 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:17.901108 10152 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.905964  5604 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:17.907258 10353 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.919430 10363 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.922619  5567 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:17.942171  9631 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:17.927030  5595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2522) took 1059 ms. Trace:
I20260709 12:15:17.898277 10426 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.943219  5595 rpcz_store.cc:276] 0709 12:15:16.867772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.868927 (+  1155us) service_pool.cc:224] Handling call
0709 12:15:16.869219 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:17.121439 (+252220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.926751 (+805312us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540048f154. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:17.926946 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578614016}
I20260709 12:15:17.944960 10426 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.920279 10437 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:17.945701 10437 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:17.946081 10437 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.946408 10437 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:17.874053 10374 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:17.947705  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 946) took 1270 ms. Trace:
I20260709 12:15:17.948601 10374 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:17.948957  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 1.09015e+06us
I20260709 12:15:17.949159 10374 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:17.933528 10353 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:17.937881 10422 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.942981 10424 raft_consensus.cc:1064] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:17.939648 10057 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.920675 10388 raft_consensus.cc:2749] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:17.881412  5602 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:17.897126 10409 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:17.942880  5567 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:17.950299  6319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58720 (request call id 1012) took 1294 ms. Trace:
I20260709 12:15:17.954118  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51914 (request call id 2518) took 1539 ms. Trace:
I20260709 12:15:17.959000  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:17.951659  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:17.969182  5671 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:17.966328  6319 rpcz_store.cc:276] 0709 12:15:16.655418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.656915 (+  1497us) service_pool.cc:224] Handling call
0709 12:15:16.657216 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.657482 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:16.786113 (+128631us) log.cc:844] Serialized 14 byte log entry
0709 12:15:17.949967 (+1163854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:17.950019 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:17.950070 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.950145 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:17.950249 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1070191,"prepare.queue_time_us":128636,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":6007,"raft.queue_time_us":1070511,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":67,"thread_start_us":187616,"threads_started":2,"wal-append.queue_time_us":213698}
I20260709 12:15:18.000901 10363 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:17.961323  5567 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:17.952514  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:18.005880  5675 raft_consensus.cc:2410] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:15:18.001184  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:17.967859  5597 rpcz_store.cc:276] 0709 12:15:16.415001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.439656 (+ 24655us) service_pool.cc:224] Handling call
0709 12:15:16.471018 (+ 31362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.648699 (+177681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.953917 (+1305218us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002aba54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:17.954066 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407293696}
I20260709 12:15:18.003154  5567 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:17.948093  6322 rpcz_store.cc:276] 0709 12:15:16.677478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.723441 (+ 45963us) service_pool.cc:224] Handling call
0709 12:15:16.760838 (+ 37397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.761024 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:16.854905 (+ 93881us) log.cc:844] Serialized 14 byte log entry
0709 12:15:16.865885 (+ 10980us) log.cc:844] Serialized 14 byte log entry
0709 12:15:17.227474 (+361589us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b48000b07d8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4502974aa1 00007f450296bb37 00007f450296b9ca 00007f4502a6326f 00007f4502a62f37 00007f4502a7755c 00007f4502a77508 00007f4502a77488 00007f4502a77443 00007f4502a766ec 00007f45019a0a96
0709 12:15:17.947249 (+719775us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x7b18000f12a0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa8d8c0a 00007f4504018219 00007f44fa960a40 00007f44fa95b4e4 00007f44fa95b455 00007f44fda43060 00007f44fda55716 00007f44fda66287 00007f44fda66208
0709 12:15:17.947387 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:17.947437 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:17.947477 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.947536 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:17.947634 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":728565,"prepare.queue_time_us":166800,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":12404,"raft.queue_time_us":1083566,"raft.run_cpu_time_us":11699,"raft.run_wall_time_us":372055,"spinlock_wait_cycles":29852800,"thread_start_us":93537,"threads_started":1}
I20260709 12:15:18.032383  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.033684  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.034416  5752 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:18.034096  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.037799  6324 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 13: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:18.039039  6326 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:18.054742  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:17.943028 10408 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.057894  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:17.951910 10057 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.001508 10363 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:18.055922  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 52832.7us
I20260709 12:15:18.062119  5567 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:17.949930 10353 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.952929 10127 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:17.949733 10349 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.044935  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:17.954869 10388 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:17.952153 10313 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:17.951427 10248 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:18.065408  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.068305  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.066751  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.067550  6322 raft_consensus.cc:2410] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:15:18.025722 10422 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:18.058947 10355 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:18.070540  5567 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:17.949723 10374 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.063820 10368 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:18.064060 10353 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:18.058730 10438 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:18.081467  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.084087  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.087481  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.088106  6326 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:18.071075 10408 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:15:18.090265  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 284838us
I20260709 12:15:18.090965  5569 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:18.092119  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.094113  5752 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:18.091293  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:18.079209 10409 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:18.101824  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.080515 10388 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:18.106910  5602 raft_consensus.cc:1240] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:18.088321 10363 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.073865 10313 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.069159 10127 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.095032 10368 raft_consensus.cc:697] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:18.093458 10408 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.076215 10248 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:18.121963  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 54819.1us
I20260709 12:15:18.079533 10422 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.098204 10428 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.098341 10188 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.126188  5569 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.102147 10409 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.086617 10355 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.126557  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.119370 10438 raft_consensus.cc:2764] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:15:18.135488  6321 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:18.127218 10408 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:18.135949 10409 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.143028 10273 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:18.163406 10429 consensus_queue.cc:1059] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:15:18.128679  9631 consensus_queue.cc:1059] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:15:18.156418 10447 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.163161 10441 raft_consensus.cc:2764] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:15:18.159061 10428 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:18.205566  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.134248 10444 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:15:18.211263  5752 raft_consensus.cc:2410] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:15:18.156178  9691 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:15:18.174619 10438 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:18.200381 10349 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:18.182494 10188 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:18.183934 10454 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
W20260709 12:15:18.213106  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 86992.9us
I20260709 12:15:18.199868  9978 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:18.176192 10388 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:15:18.229439  5569 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.206459 10446 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:18.201452 10273 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.219177 10349 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:18.231106 10454 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.243623 10057 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.224217 10451 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:18.249490  6326 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:18.215240 10428 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.241735 10441 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:18.264786  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.261519  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.264719  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.265823  5604 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:18.227288 10188 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.266721  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.266813  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.267282  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.266896  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.211016 10447 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.277854 10447 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.279577 10437 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.250129 10349 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:18.251260 10446 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.275390 10422 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.212162 10368 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.291031  5597 raft_consensus.cc:2368] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14.
I20260709 12:15:18.241026  9978 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:18.299074  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 207839us
I20260709 12:15:18.267230 10461 raft_consensus.cc:493] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:18.299186  5598 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:18.273722 10374 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.304639 10248 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.305603  9978 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.310086  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.312829 10408 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.314988 10408 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.225728 10438 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.346160  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.347342  5602 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:18.347376 10438 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.348672 10424 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.345799  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.352705  9962 raft_consensus.cc:3055] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:18.353142  9962 raft_consensus.cc:740] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:18.319448 10313 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:18.320649 10273 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.320024 10454 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:18.320771 10449 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:15:18.356725  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 56826.5us
I20260709 12:15:18.358196  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.358554  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.359745  5604 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:18.323570 10411 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:18.360855  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.360986 10411 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.324753 10409 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.303485 10461 raft_consensus.cc:515] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.353044 10446 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.363246 10411 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.363421 10461 leader_election.cc:290] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.335999  6293 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:18.364023  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.364660  5753 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:18.339655  9832 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.365103 10461 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.365365  9832 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.365610 10461 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.367197  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.339968  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.367882  5751 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:18.368422  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.325618 10388 raft_consensus.cc:493] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:18.369403 10454 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:18.369522 10388 raft_consensus.cc:515] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.339643  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.370100 10454 raft_consensus.cc:493] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.370471 10454 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.370672  5747 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:18.364550  6293 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.342595 10374 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:18.372406 10374 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.370473  5749 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
W20260709 12:15:18.341185  5746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44966 (request call id 2370) took 1214 ms (client timeout 1588 ms). Trace:
I20260709 12:15:18.374393 10374 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.375154  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.376035 10428 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.345083  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.376734 10388 leader_election.cc:290] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.377310 10388 raft_consensus.cc:493] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:18.376649  5675 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:15:18.377557 10293 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:18.377554  5569 leader_election.cc:400] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13.
W20260709 12:15:18.374712  5746 rpcz_store.cc:269] 0709 12:15:17.127215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.616049 (+488834us) service_pool.cc:224] Handling call
0709 12:15:18.341052 (+725003us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b54002c8dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:18.341139 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8718720}
I20260709 12:15:18.367544  9832 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.359813  5642 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:18.380465  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.381031  5671 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:18.378587  9962 consensus_queue.cc:260] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.381560 10353 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.382028  9962 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:18.382586  5601 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:18.382752  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.380384  9978 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:18.383468  9978 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.383832  9978 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.384630  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.385775  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.386356  5675 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:18.387750  6319 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:15:18.390677 10353 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.392925  5569 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.392287 10349 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.379243  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.396669 10349 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.397171 10437 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.397324 10353 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:18.399765  9978 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.387657  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.400624 10388 raft_consensus.cc:515] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.401243 10127 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.402431  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:18.393316  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.405416  5569 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:18.410168  5569 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.400112  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.419514  6291 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:18.426008  5569 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:15:18.400238 10464 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 12:15:18.435434  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 78064.2us
I20260709 12:15:18.435611  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.392867 10188 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.437378  5569 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:18.435266  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:18.436374  5678 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
I20260709 12:15:18.440191  5569 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.438372  5602 raft_consensus.cc:2368] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 12. Current term is 13.
I20260709 12:15:18.443630 10438 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:18.430719 10437 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:18.431581 10046 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:17.712347  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:18.450659  5570 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.431355 10264 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:18.433501 10446 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.429539 10353 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:15:18.438699 10293 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:18.458427  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.447343 10188 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:18.443898 10403 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:18.464056  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.464331  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.449678 10438 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:18.442260 10428 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:15:18.476255  6319 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:18.451982 10437 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:18.477878  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.459156 10452 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:18.461042 10353 consensus_queue.cc:1243] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:15:18.485841  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.469964 10188 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:18.487232  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.498054 10188 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:18.498464  9978 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.498829  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.499588 10409 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.499971  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.501062  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.488955  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.485232  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.481526 10437 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:18.505362  6325 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:18.480386 10438 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.507169  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.519230  9909 raft_consensus.cc:3055] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:18.519677  9909 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:18.520488  9909 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.521449  9909 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:18.534379 10388 leader_election.cc:290] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.537902  5601 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:18.537994  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.538890  5598 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:18.540055 10458 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.540629 10458 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.542866 10458 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.544204  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.552634 10437 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:18.555563  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 112222us
I20260709 12:15:18.555696 10341 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:15:18.557911  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 109193us
I20260709 12:15:18.551599 10438 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.559671  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:18.560232  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.560751 10438 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.561295 10438 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:18.561394  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.555094 10454 raft_consensus.cc:515] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.562916 10437 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.563508 10454 leader_election.cc:290] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:18.564476  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:18.564993  5670 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.567790 10355 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.569808 10438 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.571208 10188 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.571916 10438 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:18.573287  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 60649.4us
I20260709 12:15:18.574445  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.573393 10187 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:15:18.575201  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:18.575765  5753 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:18.576426  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.577656  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:18.578739 10442 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.579105  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:18.579613  5746 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.574708  5719 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.582243  5642 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:18.583362 10296 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.586102  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7922e49f842f47c09c6aafbf9e70d646" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.586633 10424 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:18.583264  5498 catalog_manager.cc:5697] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 5 to 10, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 10 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:18.588536  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:18.589110  5674 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.592943  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75421a11c1284039a8a17196290f3c16" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.593823  5746 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 14.
I20260709 12:15:18.595559  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:18.595808  5679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 2558) took 2194 ms. Trace:
I20260709 12:15:18.596192  5677 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.596284  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:18.596889  5749 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.597872 10415 consensus_queue.cc:1059] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:18.598726  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.599538  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.600510 10296 raft_consensus.cc:3055] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:18.600874 10296 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:18.601645 10296 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.602766  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.602917 10296 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:18.583428  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:18.604526  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eda5739d0e2404c9dd25b6ebf5f6060" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.605187  9691 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:18.595733  5678 raft_consensus.cc:1217] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Deduplicated request from leader. Original: 7.4->[9.5-13.7]   Dedup: 9.5->[11.6-13.7]
I20260709 12:15:18.606153  5678 pending_rounds.cc:85] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 5
I20260709 12:15:18.606397  5678 pending_rounds.cc:107] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:15:18.596264  5679 rpcz_store.cc:276] 0709 12:15:16.401249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.463297 (+ 62048us) service_pool.cc:224] Handling call
0709 12:15:17.032178 (+568881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:17.249643 (+217465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:18.299142 (+1049499us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400270954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:18.595598 (+296456us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400270950. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:18.595729 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1806288000}
W20260709 12:15:18.569602 10439 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
I20260709 12:15:18.610244  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:18.596791 10461 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:18.616283  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 106411us
I20260709 12:15:18.617915  5749 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:18.618678  5677 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:18.619922  5670 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 14.
I20260709 12:15:18.621152  6293 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:18.621387  5753 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 9.
I20260709 12:15:18.605688  9691 raft_consensus.cc:697] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:18.622159  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:18.606580  5642 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:18.606639  5678 raft_consensus.cc:2889] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:18.624143  5642 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:18.628592  5679 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:18.629709 10458 raft_consensus.cc:2804] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:18.630260 10458 raft_consensus.cc:697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:18.629664 10092 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:18.631075 10458 consensus_queue.cc:237] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.631587 10092 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.632004 10092 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.634915  5718 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.633513  5674 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 14.
I20260709 12:15:18.655710  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:18.656257  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:18.656497  6327 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:18.662801  5717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.669143  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:18.669891  5679 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:18.670116  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.660324  5645 leader_election.cc:304] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.672360  6324 raft_consensus.cc:2393] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 13: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:18.659157  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:18.573253 10188 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:18.690665  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.692261  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.693413  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:18.700362  6327 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:18.687191  5679 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:18.702368  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:18.635515 10374 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:18.705495  5569 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.708429  6324 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 12 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:18.690022  5748 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:18.692942  6321 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 15.
I20260709 12:15:18.711748  5569 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.678409  5642 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.713110  5569 leader_election.cc:304] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.716396  5642 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.716974  5569 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:18.719586  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.720847  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.721167  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.640494 10453 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:18.725451  5603 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:18.726209  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.728801  5569 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.729928  5569 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:18.672811 10273 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:18.690003  9978 raft_consensus.cc:2749] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:18.737644  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.738188  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.738441  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.728183  5599 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:15:18.734196  5569 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:18.688589  9909 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:18.694586 10411 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:18.737442  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.694823 10341 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:18.738487  5603 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:15:18.742424  5602 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:18.670760 10422 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 12:15:18.748018  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:18.727542 10442 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:18.688491 10437 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:15:18.727015 10188 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:18.752688  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.728112 10264 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:18.733723 10446 raft_consensus.cc:2749] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:18.741596 10403 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:18.730865 10461 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:18.763473  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:18.753340 10408 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:18.743839 10411 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:18.719050  9691 consensus_queue.cc:237] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.738912 10452 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:18.739234 10441 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:18.694447 10368 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:15:18.783581  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.785167  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80dc3c97f640cc9ad6761e3aecfd36" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:18.800027  5597 raft_consensus.cc:3060] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.786984  5567 leader_election.cc:304] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.741379 10187 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:18.736374 10453 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.747272 10341 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:18.788671  6291 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.740329 10273 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.807914  5498 catalog_manager.cc:5697] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:18.826826  5567 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.795751 10411 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:18.834813  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 46233.4us
I20260709 12:15:18.839464  5567 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.840305  5567 leader_election.cc:304] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.805501 10403 raft_consensus.cc:697] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:18.811403 10441 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:15:18.841743  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 117438us
I20260709 12:15:18.843899  6291 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.837813 10293 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:18.831614 10341 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.822813 10452 raft_consensus.cc:697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:18.832464 10408 raft_consensus.cc:697] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:18.838783 10388 raft_consensus.cc:2749] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.853876  5642 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.869273  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.852144 10353 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:18.875331  6291 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:18.852912 10046 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:18.824908 10187 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.874447  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:18.881433  5645 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:18.852361 10374 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:18.855180 10446 raft_consensus.cc:2749] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:18.843381 10349 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:15:18.876693 10422 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:18.866556 10454 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:18.874538 10428 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.882956  5748 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:18.885351 10350 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:18.887341 10349 consensus_queue.cc:1243] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer 831d76c5ee1045f0af923ce24fa4c301 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:18.882580 10424 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:18.886859  5642 leader_election.cc:400] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14.
I20260709 12:15:18.885973  9978 consensus_queue.cc:1059] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:15:18.897936 10350 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:18.888213 10423 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:15:18.899362 10092 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.899353 10187 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:18.907341  5597 raft_consensus.cc:2468] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 14.
I20260709 12:15:18.911267  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:18.918485  5642 leader_election.cc:403] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:18.887723 10422 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:15:18.932127  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 47554us
I20260709 12:15:18.934206  5642 leader_election.cc:400] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 12. Current term is 13.
I20260709 12:15:18.934475  5642 leader_election.cc:403] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:18.918427 10424 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:18.921942 10454 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:18.963748  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:18.914932 10374 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.965848  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.936285 10422 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.971130  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:18.973181  5750 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:15:18.971899  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 131649us
I20260709 12:15:18.977083  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:18.979331  5567 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:18.993484  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:18.895923 10403 consensus_queue.cc:237] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:18.949784 10409 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:15:19.002285  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.004237  5599 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:19.008894  5745 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:18.968130 10424 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:19.010718  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:19.010918  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:19.011641  5749 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:18.969530 10428 raft_consensus.cc:3055] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:15:18.995824 10475 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:15:18.970400 10426 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 12. Current term is 13.
I20260709 12:15:19.011642 10273 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:19.014480  5642 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
W20260709 12:15:19.015523 10478 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 12:15:19.031872  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 238497us
I20260709 12:15:19.008711 10388 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:18.960808 10483 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715) with higher term. Message: Invalid argument: T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14.
I20260709 12:15:18.924284 10408 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:18.994421 10353 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:18.930935 10441 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.039779  5642 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:19.045383  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:19.040215  5750 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:19.015796 10428 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:15:19.031281 10476 log.cc:927] Time spent T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:15:19.048632  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:19.012902 10409 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.052704  5642 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:19.054337  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:19.049297  6328 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 15.
I20260709 12:15:19.055826  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:19.057951  9691 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:18.936138 10452 consensus_queue.cc:237] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:19.061965  5753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:19.047034 10353 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.063385 10428 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:19.064647 10428 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:19.043548 10188 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:19.067651 10188 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:19.068068 10188 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:19.045559 10479 log.cc:927] Time spent T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:15:19.062816  5753 raft_consensus.cc:606] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:15:19.082685  5753 raft_consensus.cc:614] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:19.049530 10388 raft_consensus.cc:697] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:19.050987 10368 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:19.146591 10388 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:19.150161 10478 log.cc:927] Time spent T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:15:19.081004 10426 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:19.152094  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 70387.9us
I20260709 12:15:19.138847 10472 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:19.012735 10350 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.081347 10483 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:19.161630 10472 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.176738  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:19.156071 10426 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:15:19.195883  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 49273.7us
W20260709 12:15:19.257992  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 62013.5us
I20260709 12:15:19.171612 10472 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.269018 10424 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.271409  5753 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:19.272451 10424 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.270351  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:19.197902 10426 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:19.185120 10483 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:19.290925  5749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:19.292609  5749 raft_consensus.cc:606] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:19.287568 10341 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:19.300709 10496 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:15:19.305351 10409 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.307144 10188 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.304795  5642 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:19.308312 10453 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:19.312049  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:19.312170  5678 raft_consensus.cc:1240] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:19.312085 10409 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:19.316498 10409 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:19.319455 10409 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:19.323403 10483 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:19.356070  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 51760.3us
I20260709 12:15:19.358042  5498 catalog_manager.cc:5697] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 8 to 12, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 12 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:19.364373  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:19.367831  5601 raft_consensus.cc:1240] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 8. Current term is 9. Ops: []
W20260709 12:15:19.369321 10411 consensus_meta.cc:287] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.002s
I20260709 12:15:19.369751 10411 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:19.365253 10477 log.cc:927] Time spent T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.513s	user 0.004s	sys 0.002s
I20260709 12:15:19.365346 10423 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:15:19.371918 10411 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.334858 10422 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.372663 10353 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.360098 10355 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:19.374289 10422 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.374636 10472 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.376772 10472 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.377002 10341 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.378062 10188 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.380578  5716 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:19.384147  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:19.384754  6320 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:19.384779  6291 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:19.379531  5567 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:19.391263  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:19.393973  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:19.396026  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:19.396687  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:19.405045  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:19.413398  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:19.420939 10355 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:19.421264  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:19.378670 10424 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:19.425539  6320 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:19.398306 10490 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:19.388631  9631 consensus_queue.cc:1059] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:15:19.404572 10349 raft_consensus.cc:2749] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:19.434067  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:19.411607 10388 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:19.435730  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:19.425549 10473 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:19.424628 10423 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:19.424036 10458 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:15:19.421657 10355 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:15:19.450495  5597 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:19.438570 10127 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.430405  9978 consensus_queue.cc:1059] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:15:19.442451 10357 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:19.444789 10423 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:19.470386  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:19.471819  5603 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.467185 10001 raft_consensus.cc:993] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
W20260709 12:15:19.481428 10500 log.cc:927] Time spent T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:15:19.446013 10493 consensus_queue.cc:1059] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:15:19.467657 10357 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:19.487802 10357 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.469314 10472 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.490015  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:19.473347 10423 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:19.475441 10152 raft_consensus.cc:3055] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:19.466763 10490 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:15:19.506174 10127 raft_consensus.cc:3055] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:19.503324 10472 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:19.508525  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:19.481268 10426 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.522830  5746 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:19.529285  5745 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 11. Current term is 12. Ops: [8.9-11.10]
I20260709 12:15:19.530817  5603 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:19.534579  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:19.496229  9962 raft_consensus.cc:1081] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:19.540163  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:19.544229  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:19.534478  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:19.548138  5746 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:19.552613  5677 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:19.555145  5670 raft_consensus.cc:1240] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:19.518195 10152 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:19.527694 10127 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:19.561654  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:19.562391  5673 raft_consensus.cc:1240] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:19.570314  5677 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:19.543198 10454 consensus_queue.cc:1059] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:15:19.575501  5673 raft_consensus.cc:1240] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:19.567799 10293 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:19.611835 10293 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.614095 10293 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:19.551105 10488 consensus_queue.cc:1059] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:15:19.615419 10453 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:19.615944 10453 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.617892  5719 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:19.618192 10453 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:19.618726 10415 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:19.615170 10488 raft_consensus.cc:3055] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:19.620002 10488 raft_consensus.cc:740] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:19.621028 10488 consensus_queue.cc:260] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.622220 10488 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:19.622278 10422 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:19.623202 10127 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.624447 10127 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.627664 10423 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:19.634686 10472 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:19.636868 10426 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.599970 10152 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:19.641028  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.646754  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:19.649371 10046 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:19.650012 10046 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.652215 10046 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.600446 10454 consensus_queue.cc:1243] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer 831d76c5ee1045f0af923ce24fa4c301 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:19.654500  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:19.724367 10423 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:19.725879 10388 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:19.727130  5746 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:15:19.728035  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:19.728628 10388 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.731351  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:19.731786 10296 raft_consensus.cc:3055] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:19.732180 10296 raft_consensus.cc:740] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:19.732944 10296 consensus_queue.cc:260] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:19.734596  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:19.735289  6319 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 12: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:19.736914 10490 raft_consensus.cc:3055] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:19.737308 10490 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:19.733320 10388 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.738186 10490 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.739428 10490 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.747202 10296 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.748533  5753 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:19.751669  6319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:15:19.752257  6319 raft_consensus.cc:606] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:19.752552  6319 raft_consensus.cc:614] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:19.761521 10046 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.763473  5603 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 11. Current term is 12. Ops: [8.9-11.10]
I20260709 12:15:19.764910  5675 raft_consensus.cc:1275] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:19.764422  5498 catalog_manager.cc:5697] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:19.769723  5567 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:19.773227  5753 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.778383  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:19.771687  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:19.780781  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:19.780225  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:19.788820  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:19.782847  5601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:15:19.814409  5601 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:19.814814  5601 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.798393 10491 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:19.797104 10388 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.808571 10426 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:19.834532  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:19.834825  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:19.785576 10046 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:19.842383  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:19.843189  5750 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 12: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:19.838050  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:19.838994  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:19.798137 10441 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:15:19.805130 10458 consensus_queue.cc:1059] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:15:19.805015 10493 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:15:19.846674  5645 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:19.848822  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:15:19.844825 10426 raft_consensus.cc:697] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:19.867223  5601 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.868957  5753 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:19.870998  5601 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.874205 10313 raft_consensus.cc:3055] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:19.874612 10313 raft_consensus.cc:740] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:19.874977 10046 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:19.855207 10092 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:19.805606 10357 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.875417 10313 consensus_queue.cc:260] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.876617 10313 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:19.877225 10357 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:19.811805 10454 consensus_queue.cc:1059] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:15:19.878304 10454 raft_consensus.cc:3055] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:19.878621 10454 raft_consensus.cc:740] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:19.879419 10454 consensus_queue.cc:260] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.863520  5604 raft_consensus.cc:2393] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 13: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:19.880474  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:19.880474 10454 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:19.881062  6328 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:19.882079 10453 consensus_queue.cc:1175] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b3083333af3348e4938f905ca4c4819f" responder_term: 13 status { last_received { term: 13 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 13 index: 10 } }
I20260709 12:15:19.815358 10488 consensus_queue.cc:1048] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:15:19.887055 10424 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:19.838613 10491 raft_consensus.cc:697] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:19.890653  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:19.896519  6321 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 15.
I20260709 12:15:19.898264  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:19.898603  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:19.898303  5748 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:19.899258  5746 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:19.900137  5567 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:19.901314  5753 raft_consensus.cc:3055] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:19.901659  5753 raft_consensus.cc:740] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:19.905148  5645 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:19.902336  5753 consensus_queue.cc:260] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:19.907749  5753 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.910248  5750 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:19.921468  5753 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:19.933786  5645 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:15:19.942412  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.941983  6328 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:19.943380  6321 raft_consensus.cc:1240] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:19.909346 10092 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:15:19.915982 10450 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:19.957913  6326 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:19.950516  6327 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:19.926537 10437 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.933737 10424 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:20.022115 10424 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:20.025167  6291 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.67:38189 timed out after 1.529s (SENT) [suppressed 86 similar messages]
W20260709 12:15:20.026268  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 74069us
W20260709 12:15:20.027148 10520 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:15:20.028999  5498 catalog_manager.cc:5697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:20.030705  5498 catalog_manager.cc:5697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:20.032909  5498 catalog_manager.cc:5697] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:20.033836  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:20.034721  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:19.931608 10441 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:20.026494 10521 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:15:19.932192 10353 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
W20260709 12:15:20.108918  5716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.037895 10355 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:19.913815 10491 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.107570  5567 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:19.954300 10341 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.158s
I20260709 12:15:20.118819  5567 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
W20260709 12:15:20.126223  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.130401 10514 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:20.134191 10409 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:20.096073 10528 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:20.099871 10441 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.137590 10355 raft_consensus.cc:697] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:20.158654 10355 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.147508 10388 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:20.159854 10388 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.143117 10409 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:20.144238 10522 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:15:20.142421 10452 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:20.161785 10409 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:20.162142 10452 raft_consensus.cc:697] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:20.163044 10452 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.138795 10438 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:20.171597  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 146456us
I20260709 12:15:20.174777  5670 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:20.157629 10441 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.099539 10426 consensus_queue.cc:237] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.143729 10514 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.203424  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:20.204195  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:20.204558  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:20.186950 10388 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:20.166067 10438 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.231212  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:20.205710 10424 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:20.146315 10528 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.196686 10454 consensus_queue.cc:1059] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:15:20.233354 10092 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:20.244565 10092 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.245690 10450 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:20.246266 10450 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.246860 10092 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.248183 10422 consensus_queue.cc:1059] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:20.248442 10450 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.248850 10422 consensus_queue.cc:1243] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Peer b3083333af3348e4938f905ca4c4819f log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:15:20.249323 10422 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:20.249792 10422 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.251737 10422 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.253479 10528 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.255213 10438 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.258417 10365 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:20.258939 10365 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.260954 10365 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:20.262979 10514 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:20.263267  5601 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:20.264039  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:20.264755  5596 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:20.268978 10437 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:20.276078 10409 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.277211  5595 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:20.279491 10409 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:20.283459  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 110217us
I20260709 12:15:20.285585  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:20.292975  5604 raft_consensus.cc:2393] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 10: Already voted for candidate b3083333af3348e4938f905ca4c4819f in this term.
I20260709 12:15:20.232784 10527 consensus_queue.cc:1059] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:15:20.296957  5604 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:20.300427  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:20.302877  5642 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:20.307291  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:20.307622  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:20.308002  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:20.292528 10438 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:20.306654  5642 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:20.309207  5596 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:20.309907 10188 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:20.241297 10424 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.316772 10424 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:20.319932 10152 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:20.320586 10424 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:20.322185  5642 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:20.323191 10355 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:20.325057 10441 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:20.329515 10438 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.333520 10355 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:20.333552 10438 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.325518 10441 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:20.337512 10441 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.338574 10355 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:20.338850 10441 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:20.344585  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.346464  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:20.348188 10092 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:20.348590 10092 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:20.348941 10092 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:20.350719  6291 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:20.351440  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:20.352034  6327 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:20.351863  6291 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:20.353567  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:20.356894  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 217629us
I20260709 12:15:20.358850  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.359987  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:20.359123  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.360531  5748 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:20.365109  5753 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:20.366304  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.366981  5752 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 10.
I20260709 12:15:20.373208  5748 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 14.
I20260709 12:15:20.374758  5567 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:20.388278  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.391755  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.391788  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.402665  5751 raft_consensus.cc:1240] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:15:20.404731  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.405745  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:20.407317  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:20.405659  5567 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:20.351469 10313 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:20.424173  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.368685 10355 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.389251 10349 raft_consensus.cc:2749] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:20.386615 10491 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.424616  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.426126  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.389794 10528 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:20.433905  6291 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:20.435336  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.431798  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:20.423614 10493 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:20.441079  5719 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:20.444103  5752 raft_consensus.cc:2376] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12. Re-sending same reply.
I20260709 12:15:20.448654  5678 raft_consensus.cc:2393] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:20.450930  5718 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:20.418417 10437 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:20.453321  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.459115  5642 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:20.430778 10147 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.454818 10527 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:20.454694 10313 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:20.455354 10437 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.460659 10422 raft_consensus.cc:2749] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:20.449975 10491 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.436792 10355 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.465546 10513 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:20.460662 10497 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:15:20.455001 10528 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.474063 10437 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:20.491784  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:20.490072  5677 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:15:20.465986 10147 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.463999 10350 consensus_queue.cc:1059] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:15:20.494405  5642 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:20.479025 10527 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:20.482146 10508 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:20.516539  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.509554  5751 raft_consensus.cc:2955] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 2 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:20.497364 10422 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:20.528324 10355 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.535198 10147 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:20.541579  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:20.543362  5596 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:20.543908  5670 raft_consensus.cc:1240] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:20.544763  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:20.507020 10508 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
W20260709 12:15:20.545926  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 54431.7us
I20260709 12:15:20.516657 10524 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:20.551509  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.552201  5747 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 9.
I20260709 12:15:20.553323 10313 consensus_queue.cc:1059] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:15:20.560470 10313 raft_consensus.cc:3055] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:20.560832 10313 raft_consensus.cc:740] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:20.561721 10313 consensus_queue.cc:260] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.562729 10313 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:20.566309  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.548874 10508 raft_consensus.cc:3060] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:20.548321 10531 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:20.569649 10092 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.587029  5752 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:15:20.588603 10537 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:15:20.590217 10542 log.cc:927] Time spent T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:15:20.575805 10531 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.593485 10531 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:20.614522  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:20.615267  5603 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:20.647958  5603 raft_consensus.cc:2468] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:20.649287  5642 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:20.680635  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:20.701253  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:20.709849  6293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.727336 10188 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:20.728040 10264 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:20.728609 10264 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.728056 10188 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.735380 10188 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.736272 10264 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.674899 10532 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:20.677019 10483 raft_consensus.cc:2804] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:20.682730 10443 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.573704 10527 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.771370 10491 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:20.772594 10528 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:20.773015 10458 raft_consensus.cc:3055] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:20.722500 10293 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:20.775861 10293 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.779747 10483 raft_consensus.cc:697] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:20.780751 10483 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.792028  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.792900  5678 raft_consensus.cc:2410] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:15:20.800874  5498 catalog_manager.cc:5697] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:20.755681 10092 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.773414 10458 raft_consensus.cc:740] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:20.815102 10293 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.819242  5498 catalog_manager.cc:5697] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 2 to 4, term changed from 3 to 9, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67), c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:20.827380  5498 catalog_manager.cc:5697] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:20.830276  6326 raft_consensus.cc:1240] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:20.832557  6326 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:15:20.832873  6326 pending_rounds.cc:85] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 9
I20260709 12:15:20.833076  6326 pending_rounds.cc:107] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:15:20.833300  6326 raft_consensus.cc:2889] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:20.843137 10458 consensus_queue.cc:260] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.844283 10458 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:20.789906 10443 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.846498 10443 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:20.834398 10497 raft_consensus.cc:3055] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:20.758394 10532 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.848923  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:20.847573  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.849749 10532 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.850518  5670 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:15:20.851714  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.852790  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:20.853452  6319 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:20.854593  5674 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:20.855808 10531 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.858872  5674 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:20.858702 10499 consensus_queue.cc:1059] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:20.859939  9962 raft_consensus.cc:3055] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:20.860314  9962 raft_consensus.cc:740] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:20.860574  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.847738 10497 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:20.861112  9962 consensus_queue.cc:260] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.862445  9962 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:20.862241 10497 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.863442 10497 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:20.863732  5673 raft_consensus.cc:1240] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:20.866556  5674 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:15:20.866937  5674 pending_rounds.cc:85] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 4
I20260709 12:15:20.867229  5674 pending_rounds.cc:107] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:15:20.867455  5674 raft_consensus.cc:2889] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:20.869138 10437 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:20.871572 10437 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:20.875196  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.877485  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.878790  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.871785  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:20.880863  5498 catalog_manager.cc:5697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 11, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 11 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:20.881947  6291 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
W20260709 12:15:20.866873  5496 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45214 (request call id 298) took 48103 ms (client timeout 15000 ms). Trace:
I20260709 12:15:20.883246 10454 raft_consensus.cc:2749] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:20.883996 10454 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:20.882740 10489 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:20.884263  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.884739 10489 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:20.885608 10489 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.890697  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.891861  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:20.892732  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:20.894291  5604 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 12:15:20.894645  5604 pending_rounds.cc:85] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Aborting all ops after (but not including) 12
I20260709 12:15:20.894870  5604 pending_rounds.cc:107] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 12:15:20.895084  5604 raft_consensus.cc:2889] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:20.895063  5719 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:20.882839  5498 catalog_manager.cc:5697] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 5 to 7, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 7 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:20.911000  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:20.915808  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.923946  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.924222  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.924870  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:20.933347  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:20.888640 10550 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:20.943727  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.947686  6326 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:20.949970  5744 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:20.952696  6291 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:20.954278  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:20.954865  5604 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:20.958877  5671 raft_consensus.cc:1240] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:20.892045  5595 raft_consensus.cc:2955] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 2 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:20.967026  5498 catalog_manager.cc:5697] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:20.935276 10203 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:20.912595 10293 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:20.968904 10203 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.972263  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e837d59ef1c7437eb44f1563f56086ad" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:20.962224 10349 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:20.988662  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 197829us
I20260709 12:15:20.962400 10488 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:20.991441  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:20.926251 10364 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:15:20.871580 10508 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.977612 10203 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:20.926329 10454 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:20.998307  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:20.992151  5673 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:20.998895  5751 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:20.986179  5604 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:20.994539  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af458034860a4f2b8eed91cd35b5b30f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:21.004691  5718 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:20.958577 10531 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:20.996366 10364 consensus_queue.cc:1243] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer c02ed29558db481589fd3db23e43a07f log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:21.007221  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:20.986501 10152 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:15:21.009812  5751 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:21.011579  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:21.005003  5603 raft_consensus.cc:1240] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:21.015843  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:21.023412  5603 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:21.028010  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:21.010931 10493 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.007808 10437 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:20.984719 10293 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.036548  5567 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:20.997043 10488 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.039994  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:21.014885 10429 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:21.044831  5744 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:15:21.037099  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:21.052479  5603 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:21.029861 10349 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.058734 10349 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:20.883742  5496 rpcz_store.cc:269] 0709 12:14:32.763227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.765656 (+  2429us) service_pool.cc:224] Handling call
0709 12:15:20.866652 (+48100996us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:13.668764 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:13.669408 (+   644us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:13.669454 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:15:13.669472 (+    18us) tablet.cc:662] Decoding operations
0709 12:15:13.695066 (+ 25594us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:13.799517 (+104451us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:13.806851 (+  7334us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:15:13.825295 (+ 18444us) tablet.cc:701] Row locks acquired
0709 12:15:13.825345 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:15:13.825520 (+   175us) write_op.cc:270] Start()
0709 12:15:13.825675 (+   155us) write_op.cc:276] Timestamp: P: 1783599313825460 usec, L: 0
0709 12:15:13.825711 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:15:13.826450 (+   739us) log.cc:844] Serialized 6614 byte log entry
0709 12:15:14.281142 (+454692us) op_driver.cc:464] REPLICATION: finished
0709 12:15:14.294013 (+ 12871us) write_op.cc:301] APPLY: starting
0709 12:15:14.294115 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:14.598868 (+304753us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:14.613113 (+ 14245us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:15.362478 (+749365us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:15.362891 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:15:15.362939 (+    48us) write_op.cc:312] APPLY: finished
0709 12:15:15.363514 (+   575us) log.cc:844] Serialized 156 byte log entry
0709 12:15:15.522119 (+158605us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:15.566733 (+ 44614us) write_op.cc:454] Released schema lock
0709 12:15:15.574269 (+  7536us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:15.681892 (+107623us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:15.681925 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3751752,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":12561,"apply.run_cpu_time_us":52226,"apply.run_wall_time_us":1375967,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75255,"num_ops":17,"prepare.queue_time_us":95041,"prepare.run_cpu_time_us":23735,"prepare.run_wall_time_us":380183,"raft.queue_time_us":144577,"raft.run_cpu_time_us":12043,"raft.run_wall_time_us":12888,"replication_time_us":455243,"thread_start_us":453640,"threads_started":5,"wal-append.queue_time_us":429760,"wal-append.run_cpu_time_us":13529,"wal-append.run_wall_time_us":2329016}]]}
I20260709 12:15:20.972045 10426 raft_consensus.cc:2955] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 2 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:21.061095 10349 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:21.064916 10454 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:21.065883 10438 raft_consensus.cc:493] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:21.066417 10438 raft_consensus.cc:515] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.066655  5716 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:21.067215 10293 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:21.067793  5716 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:21.068416 10438 leader_election.cc:290] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:21.069371 10364 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:21.041574 10493 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.072176 10493 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:21.078267 10488 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:21.046389 10437 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.079774 10508 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:21.080945  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 44457.7us
I20260709 12:15:21.081311 10437 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:21.081050 10046 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:21.082134 10046 raft_consensus.cc:697] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:21.083002 10046 consensus_queue.cc:237] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.085606  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:21.069564 10492 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:21.086431  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:21.086056  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:21.094341  6320 pending_rounds.cc:85] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 8
I20260709 12:15:21.094640  6320 pending_rounds.cc:107] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:15:21.094866  6320 raft_consensus.cc:2889] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:21.103010  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:21.103729  5603 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:21.105541 10365 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:21.106175  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:21.105360  5744 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:21.161912  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:15:21.172166  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 66676.6us
I20260709 12:15:21.110184 10187 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:15:21.161387  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 55322.3us
I20260709 12:15:21.111214 10493 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.183395 10493 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.185480 10493 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
W20260709 12:15:21.161474  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 56356.9us
W20260709 12:15:21.171303  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 63991.7us
I20260709 12:15:21.177232  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:21.178764  5679 raft_consensus.cc:2410] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:15:21.181562  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:21.186594  5748 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:15:21.216502  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 181289us
I20260709 12:15:21.173085 10203 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.220994 10203 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:21.221814  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:21.222446 10092 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:21.223335 10296 consensus_queue.cc:1059] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:21.226037  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:21.216732  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 174671us
I20260709 12:15:21.228498  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:21.229421  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:21.230019  5673 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:21.230921  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:21.231163  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:21.231467  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:21.231760  5596 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:21.230921  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:21.232630  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:21.233971  6291 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:21.231667  5676 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 14.
I20260709 12:15:21.238853  6322 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:21.239110  6328 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:21.241338  6326 raft_consensus.cc:2468] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:21.192242  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:21.233958  6293 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:21.245447  6293 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:21.247097  6293 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:21.186439 10429 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.250738  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:21.204154 10454 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:21.257249  5719 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:21.254251  5570 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:21.259680  5751 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:21.278014 10443 raft_consensus.cc:2804] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:21.267136 10454 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.253813 10489 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:21.280774 10489 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.254942 10488 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:21.251963 10349 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:21.284516 10349 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:21.285050 10349 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:21.286193  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:21.265583  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:21.291847  5569 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:21.294600  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:21.295457  5672 raft_consensus.cc:2393] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 11: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:21.254019 10313 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:21.280675 10454 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:21.252553 10429 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:21.308719  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:21.263684 10296 consensus_queue.cc:1243] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer a54957145d9647cb89f46531d107120c log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:21.242266 10437 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:15:21.320626  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:21.339097 10409 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:21.310626 10424 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:21.319571  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be82dd3c64146fabe5214109a9563f0" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:21.308360 10482 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:15:21.310432 10532 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:15:21.326740  5569 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:21.348985  5569 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:21.327167 10527 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:21.325578 10438 raft_consensus.cc:493] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:21.303200 10452 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:21.302671 10355 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.309281 10443 raft_consensus.cc:697] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:21.326856 10441 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:21.352768  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 44131.4us
I20260709 12:15:21.364240  5569 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:21.365422  5569 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:21.308586 10483 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.305931 10489 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:21.367857  5596 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:15:21.320079 10313 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.369096  5569 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:21.394604  5569 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:21.386816  5642 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:21.350554 10438 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.392321 10453 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:21.400857  5569 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:21.356768 10388 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:21.402652  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:21.364324 10092 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:21.367404 10437 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:21.408522  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 161490us
I20260709 12:15:21.384152 10546 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:21.388948 10537 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:21.404031  6326 raft_consensus.cc:2955] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 2 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:21.398027 10313 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:21.384670 10532 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:15:21.422878  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:21.363294 10528 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:15:21.410027 10450 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:21.433017  6291 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:21.389729 10046 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:15:21.407582 10452 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:21.363211 10355 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.410218 10441 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:21.431995 10443 consensus_queue.cc:237] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.394393 10424 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:15:21.419234 10454 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.429121 10365 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.447423  5569 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:21.394682 10483 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.421187 10353 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:21.413942 10557 consensus_queue.cc:1059] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:15:21.466440 10365 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.468859 10365 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:21.471258 10483 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:21.473101  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:21.475971 10264 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.476529 10264 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.478384 10556 raft_consensus.cc:3055] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:21.478809 10556 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:21.478518 10264 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:21.479615 10556 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.458719  5569 leader_election.cc:304] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:21.480894 10556 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:21.525481  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:21.525888  5749 raft_consensus.cc:3055] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:21.537485  5749 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:21.538448  5749 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.539695  5749 raft_consensus.cc:3060] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:21.457943 10497 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:21.545975  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 87338.6us
I20260709 12:15:21.461642 10458 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:21.488092 10441 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:21.457381 10450 raft_consensus.cc:697] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:21.553591  5672 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:15:21.558089  5672 pending_rounds.cc:85] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 7
I20260709 12:15:21.558359  5672 pending_rounds.cc:107] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:15:21.558573  5672 raft_consensus.cc:2889] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:21.553107  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:21.560329  5751 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
W20260709 12:15:21.557163  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 103578us
I20260709 12:15:21.561317  6293 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:21.564625  5749 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:21.565445  5601 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:21.566905  5600 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:21.568271  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:21.577109 10574 log.cc:927] Time spent T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:15:21.577721 10573 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:21.578293 10573 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.579929  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:21.484735 10454 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.596338  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:21.548646 10583 raft_consensus.cc:2749] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:21.606154 10438 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:21.654848  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 58595.2us
I20260709 12:15:21.555063 10497 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.682914  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:21.581581 10441 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:21.582222 10458 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.679293  6322 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:15:21.688438  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 60004.7us
I20260709 12:15:21.711226 10573 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:15:21.723412  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 330655us
I20260709 12:15:21.726166  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:21.726181  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 45330.5us
I20260709 12:15:21.629573 10046 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.136s
I20260709 12:15:21.815104  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:21.640769 10428 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 12:15:21.822750  5716 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:21.764667 10493 raft_consensus.cc:2749] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:21.680255 10429 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.839074 10582 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:21.846727 10582 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:21.847685 10582 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.748896 10441 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.769618 10458 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:21.881774  5745 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:15:21.723759 10450 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:21.906483  5599 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:21.904440 10355 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:21.918259  5717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.036s
W20260709 12:15:21.926661  5717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.009s	sys 0.036s
I20260709 12:15:21.956414  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:21.964859  5673 raft_consensus.cc:2393] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 14: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:22.004709  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:22.007953  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 252342us
I20260709 12:15:22.009008  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:22.019532  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.006444 10454 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:22.033071  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:22.019583 10349 consensus_meta.cc:287] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.003s
I20260709 12:15:22.036336  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.066942  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:22.028187 10497 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:22.055047 10428 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:22.085968 10428 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:22.086796 10592 log.cc:927] Time spent T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:15:22.061846 10349 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.037678 10423 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:15:22.086381 10443 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:15:22.102478 10591 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
I20260709 12:15:22.109297  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:22.115994  6322 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:22.096858 10441 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:22.097721 10092 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.092453 10428 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:22.111861 10458 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:22.126691 10092 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.130237 10092 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:22.130527 10349 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:22.131243 10596 log.cc:927] Time spent T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:15:22.134320  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:22.132584 10556 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.115645 10443 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:22.149287 10589 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 12:15:22.157590 10489 consensus_meta.cc:287] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.753s	user 0.004s	sys 0.006s
W20260709 12:15:22.158607 10515 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:15:22.152520 10443 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:22.145721 10429 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:22.157369 10349 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.150198 10556 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.174059  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:22.174635  5752 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:22.174736  6327 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
W20260709 12:15:22.175957  5744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.003s	sys 0.022s
W20260709 12:15:22.176317  5744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.003s	sys 0.022s
I20260709 12:15:22.171089 10422 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:22.171195 10573 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.206722  5645 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:22.224442  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:22.180408 10426 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:15:22.170799 10489 raft_consensus.cc:515] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.216233 10573 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.175242 10349 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.247577 10349 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:15:22.234699 10313 consensus_meta.cc:287] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.003s
I20260709 12:15:22.248373 10313 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.249589  6320 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:15:22.250715 10313 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:15:22.257654 10593 log.cc:927] Time spent T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:15:22.259781 10489 leader_election.cc:290] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:15:22.260576  6324 raft_consensus.cc:2368] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 14. Current term is 15.
I20260709 12:15:22.234668  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:22.238225 10606 log.cc:927] Time spent T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:15:22.243901  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:22.272306  6319 raft_consensus.cc:3055] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:22.272742  6319 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:22.273568  6319 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.279633  6319 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:22.281471 10489 consensus_queue.cc:1175] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "831d76c5ee1045f0af923ce24fa4c301" responder_term: 13 status { last_received { term: 13 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:22.299345 10573 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:22.301568  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 94951.2us
I20260709 12:15:22.304847  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:22.305637  9978 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.307719 10092 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:22.305485  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:22.308145 10092 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.306073  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:22.308555 10092 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:22.308763  5671 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:22.308468  5749 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:22.306574  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:22.307466  9978 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.310783  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:22.311887  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:15:22.324095 10603 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.157s	user 0.000s	sys 0.003s
I20260709 12:15:22.306113 10482 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:22.326581  5671 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:15:22.326864  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:22.328176  6293 leader_election.cc:304] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:22.329183 10458 raft_consensus.cc:2804] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:22.329787 10458 raft_consensus.cc:697] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 15 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:22.330741 10458 consensus_queue.cc:237] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.320169 10573 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:22.342139 10573 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.342530 10573 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:22.349277  5672 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:22.353127  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:22.356479  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:22.364761  5675 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:15:22.365314  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:22.319546 10613 consensus_queue.cc:1059] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:15:22.366788 10582 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:22.367168 10613 raft_consensus.cc:3055] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:22.367550 10613 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:22.368278 10613 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.372393  5718 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:22.376291  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:22.383193 10491 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:22.349221 10482 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:22.387526 10482 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:22.369508 10613 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:22.388861  6319 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:15:22.389266  6319 pending_rounds.cc:85] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Aborting all ops after (but not including) 10
I20260709 12:15:22.389479  6319 pending_rounds.cc:107] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:15:22.389704  6319 raft_consensus.cc:2889] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:22.395790  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:22.378135 10296 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:22.399721 10092 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.402681 10428 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:22.403788  5673 raft_consensus.cc:2368] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13.
I20260709 12:15:22.402568 10588 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:15:22.405354 10428 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:22.396467  6324 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:22.413151  6293 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:22.383621  9978 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:22.413722  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603cb46af0854d75be95bd9fc4acf254" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:22.414402  5602 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:22.416103  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.423125 10441 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:22.423993  5570 leader_election.cc:400] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 14. Current term is 15.
I20260709 12:15:22.424327  5570 leader_election.cc:403] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:22.424942 10046 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:22.425827 10388 raft_consensus.cc:3060] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:15:22.426293  6320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58722 (request call id 820) took 1023 ms. Trace:
I20260709 12:15:22.426710  6320 rpcz_store.cc:276] 0709 12:15:21.402832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.402964 (+   132us) service_pool.cc:224] Handling call
0709 12:15:21.403278 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:22.250038 (+846760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.426026 (+175988us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540051e354. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:15:22.426232 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945718528}
W20260709 12:15:22.427438  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 251741us
I20260709 12:15:22.423655 10441 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.430454  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.431013  5597 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:22.431843 10441 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:22.424989 10438 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:22.435322 10438 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:22.437491 10438 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:22.444684  5601 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:22.454293 10092 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:22.459208 10556 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:22.455070  5602 raft_consensus.cc:2468] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:22.431792 10349 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:22.470556  6320 raft_consensus.cc:1275] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:15:22.468768  5569 leader_election.cc:400] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13.
I20260709 12:15:22.481958  5569 leader_election.cc:403] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:22.482529 10582 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.482863 10441 consensus_queue.cc:1059] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:22.483088 10582 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:22.485220 10582 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:22.485911 10349 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.486917 10349 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:22.488003 10613 consensus_queue.cc:1048] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:22.488893  5716 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:22.494084 10313 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:22.494411 10438 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:22.494599 10313 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.496567 10313 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:22.496918  5744 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:22.497929 10515 raft_consensus.cc:2804] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:22.498481 10388 raft_consensus.cc:2749] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 14. Current term is 15.
I20260709 12:15:22.490726 10513 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:22.498857  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:22.499454  5746 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:22.503372 10438 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13.
I20260709 12:15:22.498420 10515 raft_consensus.cc:697] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:22.504647 10515 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:22.523986  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.530084  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:22.530773  6328 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:22.532392  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:22.536839  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 160630us
I20260709 12:15:22.563920  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:22.566859  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:22.567520  6328 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:22.570789  5718 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:22.576237  5645 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:22.526549 10524 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:22.528465 10438 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:22.578852  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8681cf4244cb90615903ffda5c62" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:22.580036  5570 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:15:22.578482  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 155623us
I20260709 12:15:22.576292 10187 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:22.525925 10573 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.605142  5674 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:15:22.605707  5674 pending_rounds.cc:85] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 5
I20260709 12:15:22.606699  5674 pending_rounds.cc:107] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:15:22.607020  5674 raft_consensus.cc:2889] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:22.584506 10532 raft_consensus.cc:493] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:22.608304 10532 raft_consensus.cc:515] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.613346  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:22.615285  5675 raft_consensus.cc:2368] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
W20260709 12:15:22.622488  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:22.633778  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.636116  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.638113  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:22.639132  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:22.647162  5748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:22.647884  5748 raft_consensus.cc:606] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:22.649645  6328 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:22.652098  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:22.600708 10441 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:22.588230 10438 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.675751  5642 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:22.610483 10497 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:22.692546  5645 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:22.697731  5645 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:22.703493 10598 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:22.706382  5597 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:22.708442  5748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:22.709092  5748 raft_consensus.cc:606] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:22.709403  5748 raft_consensus.cc:614] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:22.711616 10423 raft_consensus.cc:2804] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:22.712198 10423 raft_consensus.cc:697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:22.713097 10423 consensus_queue.cc:237] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.661808 10441 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting leader election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:22.680521 10497 raft_consensus.cc:493] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.700730 10341 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:22.750993 10441 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:22.752569 10187 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:22.756464 10497 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:22.807070  6328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b92bb11ba2c8484d8bba9f5e2ac5b9c5"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:15:22.807806  6328 raft_consensus.cc:606] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:15:22.808212  6328 raft_consensus.cc:614] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:22.738291  5601 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:22.707276 10429 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:22.782605 10415 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:15:22.824309 10623 log.cc:927] Time spent T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:15:22.824290 10438 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:22.832947  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:15:22.868287  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:22.829398 10573 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:22.871239  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 285915us
I20260709 12:15:22.875352  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:22.876166  5748 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:22.808326 10532 leader_election.cc:290] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:22.878917  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:22.881345  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.881637  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.881932  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.807834 10187 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.886281  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:22.812480 10349 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.864125 10429 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.906281 10429 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:22.906466  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
W20260709 12:15:22.915030  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 274453us
I20260709 12:15:22.862418 10415 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:22.925489  5569 leader_election.cc:400] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 pre-election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
I20260709 12:15:22.925980  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:22.931116  5603 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:22.937593  5748 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:22.943306  6291 leader_election.cc:304] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:22.962213  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25119dffb65d40f48346fb5615d100e5" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:22.930361  5642 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:22.963248  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:22.964085  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.964273 10524 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.964756 10524 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:22.966965 10524 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:22.973933 10573 raft_consensus.cc:2804] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:22.974617 10573 raft_consensus.cc:697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 13 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:22.975513 10573 consensus_queue.cc:237] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:22.979055 10630 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:15:22.986135  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.986795  5595 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:15:22.987128 10409 raft_consensus.cc:493] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c02ed29558db481589fd3db23e43a07f)
I20260709 12:15:22.987636 10409 raft_consensus.cc:515] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.988086  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:22.878115 10438 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:15:22.894260 10364 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:22.995702  6291 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:15:22.996160  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 65857us
I20260709 12:15:22.987637  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
W20260709 12:15:22.924937 10626 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:15:23.002132  5595 raft_consensus.cc:3060] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:22.985113 10497 raft_consensus.cc:515] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:22.989873 10409 leader_election.cc:290] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:23.055721  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:23.061666  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:23.067437  5595 raft_consensus.cc:2468] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:23.058351 10364 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:23.074740 10641 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:23.077189  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 85220.6us
W20260709 12:15:23.077322  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 74079.5us
I20260709 12:15:23.080513 10415 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:23.082542  5676 raft_consensus.cc:2368] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 13. Current term is 14.
I20260709 12:15:23.058872 10188 raft_consensus.cc:2804] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:23.083329 10627 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:15:23.096349  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:23.075599 10491 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:23.109586 10415 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:23.118578  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 122950us
I20260709 12:15:23.120893  6291 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:23.121902  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:23.123100  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:23.110463 10187 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:23.128623  6291 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:23.110316 10422 consensus_queue.cc:1059] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:15:23.132540 10426 raft_consensus.cc:3055] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:23.132908 10426 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:23.122663 10458 raft_consensus.cc:2749] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:23.134119 10458 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.133668 10426 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:23.134881 10458 raft_consensus.cc:2749] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.135337 10426 raft_consensus.cc:3060] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:23.135895 10349 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:23.137929 10497 leader_election.cc:290] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:23.118352 10188 raft_consensus.cc:697] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:23.139120 10188 consensus_queue.cc:237] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:23.112845 10441 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:23.144138  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:23.145314 10441 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:23.115024 10491 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:23.146540  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:23.147703 10491 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:23.148101  5602 raft_consensus.cc:3060] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:23.116721 10415 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:23.153573 10415 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:23.156391  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:23.157127  5749 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
W20260709 12:15:23.162343 10624 log.cc:927] Time spent T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.379s	user 0.005s	sys 0.000s
I20260709 12:15:23.163707  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:23.164517  5749 raft_consensus.cc:2368] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13.
I20260709 12:15:23.168572  5674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:23.170849  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:23.176712 10583 raft_consensus.cc:3055] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:23.177171 10583 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:23.177865  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:23.182104  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:23.186129  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:23.186338  5678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:23.187389  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:23.188014  5675 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:23.214120  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:23.191824 10583 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:23.216588  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:23.223973  6320 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:23.219839  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:23.224918  5744 raft_consensus.cc:3060] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:23.220329  5598 raft_consensus.cc:2468] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:15:23.221251  5751 raft_consensus.cc:1240] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:23.222923  5750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:23.226456  5750 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:23.227202  5602 raft_consensus.cc:2468] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
W20260709 12:15:23.229611  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:23.231726  5677 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:23.218051  5567 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:23.270008  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:23.125862 10573 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.271520  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:23.273481  5567 leader_election.cc:400] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13.
I20260709 12:15:23.273897  5567 leader_election.cc:403] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:15:23.341221  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 69338.5us
I20260709 12:15:23.276510 10438 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:23.350339  5744 raft_consensus.cc:2468] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:23.380249  5718 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:23.408926  5718 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:23.277700 10613 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:23.410578 10613 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:23.413020 10613 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:23.343096 10583 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:23.344797 10622 raft_consensus.cc:2749] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) with higher term. Message: Invalid argument: T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13.
I20260709 12:15:23.416015 10438 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:23.354898 10364 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:15:23.356326  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 227762us
I20260709 12:15:23.467409  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:15:23.345377  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 58648.9us
W20260709 12:15:23.456476 10423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.009s	sys 0.015s
I20260709 12:15:23.473662  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:23.454181 10515 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:23.480177  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:23.475662 10454 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:23.455204 10491 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:23.399293 10640 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.149s
I20260709 12:15:23.456836 10438 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:23.515412 10092 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:23.516256 10642 log.cc:927] Time spent T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:15:23.516633  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:23.517225  5569 leader_election.cc:400] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 13. Current term is 14.
I20260709 12:15:23.517534  5569 leader_election.cc:403] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:23.518002  5604 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Rejecting Update request from peer c02ed29558db481589fd3db23e43a07f for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:23.499451  5719 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
W20260709 12:15:23.495712  6291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:23.526525  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a91e24ad9ae49729bb9bc3ebcc36f9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:15:23.480335 10423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.009s	sys 0.016s
I20260709 12:15:23.517946 10600 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:23.528203  5719 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:23.521998 10452 raft_consensus.cc:3060] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:23.568961  6320 raft_consensus.cc:1240] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:15:23.573592  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 296945us
I20260709 12:15:23.576751  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62908e35e9554ef2af86598ce28bcf21" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:23.570591 10582 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:23.561731 10600 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.580659 10600 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:23.527204 10645 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:23.583846  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba4203e7f7c4e46bd83c6bdda936a65" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:23.530586 10587 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:23.585805  6328 raft_consensus.cc:2368] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
I20260709 12:15:23.653855  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:23.654757  6320 raft_consensus.cc:2368] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 13. Current term is 14.
I20260709 12:15:23.589730 10587 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
W20260709 12:15:23.677994  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:23.691377  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 104768us
I20260709 12:15:23.594914 10645 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:23.680207 10587 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:23.703634  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 294803us
I20260709 12:15:23.704506  5718 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:23.709381  5601 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:23.720006  5601 raft_consensus.cc:1275] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:23.720495  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:23.726213  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0305464a3879473e825bbe12c2df9cd9" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:23.730706 10652 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:23.734273  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51908 (request call id 2551) took 1089 ms. Trace:
W20260709 12:15:23.735035 10650 log.cc:927] Time spent T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:15:23.736722  5602 rpcz_store.cc:276] 0709 12:15:22.637167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:22.637886 (+   719us) service_pool.cc:224] Handling call
0709 12:15:23.726869 (+1088983us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b540048e254. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:15:23.726991 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171324800}
W20260709 12:15:23.743628 10654 log.cc:927] Time spent T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:15:23.747222  5671 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:15:23.747663  5671 pending_rounds.cc:85] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: Aborting all ops after (but not including) 7
I20260709 12:15:23.747870  5671 pending_rounds.cc:107] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:15:23.748076  5671 raft_consensus.cc:2889] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:23.772336  6324 raft_consensus.cc:2393] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 14: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:23.777240  5602 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:23.789238 10454 consensus_queue.cc:1048] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:23.724864 10438 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:23.807423 10438 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:23.807968 10600 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:23.809535  5673 raft_consensus.cc:1240] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:15:23.736377 10652 raft_consensus.cc:493] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:23.810215 10652 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:23.811941 10600 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:23.824498 10636 consensus_queue.cc:1059] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:15:23.835127 10636 raft_consensus.cc:3055] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:23.835505 10636 raft_consensus.cc:740] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:23.820686 10645 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:23.821642  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:23.836421 10636 consensus_queue.cc:260] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:23.837574 10636 raft_consensus.cc:3060] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:23.823477 10452 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011) with higher term. Message: Invalid argument: T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 13. Current term is 14.
I20260709 12:15:23.843925 10587 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:23.851455  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:23.852530  5597 raft_consensus.cc:2468] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 14.
W20260709 12:15:23.824146  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 86973.2us
I20260709 12:15:23.870340 10637 raft_consensus.cc:993] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:23.864789 10587 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:23.902843  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:23.904785  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:23.898864  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:23.916774  5746 raft_consensus.cc:1240] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:23.920476 10652 raft_consensus.cc:515] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:23.915035 10588 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 12:15:23.929941  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 151267us
I20260709 12:15:23.930480  5748 raft_consensus.cc:1275] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:23.932353  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:23.932984  5748 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:23.935094  6291 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:23.938784  5570 leader_election.cc:304] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:23.915139 10415 raft_consensus.cc:1081] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:23.940922  5645 leader_election.cc:304] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:23.941649  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:15:23.945215  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 346943us
I20260709 12:15:23.949600  5570 leader_election.cc:400] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 13. Current term is 14.
I20260709 12:15:23.952275  5570 leader_election.cc:400] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
I20260709 12:15:23.952695  5570 leader_election.cc:403] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:15:23.936416 10640 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:15:23.965306  5595 raft_consensus.cc:1240] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:23.945418 10658 raft_consensus.cc:2749] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:23.971845  5747 raft_consensus.cc:1275] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:23.948668 10556 raft_consensus.cc:2749] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:23.972260  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:23.976373  6324 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 13: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:23.972218 10671 raft_consensus.cc:2804] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:23.982213  5718 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:23.984664  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:23.988173  5718 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:23.991317  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:23.958843 10632 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181) with higher term. Message: Invalid argument: T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f for earlier term 11. Current term is 12.
I20260709 12:15:23.978232 10472 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:15:24.014266 10652 leader_election.cc:290] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:24.014969 10600 consensus_queue.cc:1048] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:23.996846 10582 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.998613 10671 raft_consensus.cc:697] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:24.017458 10671 consensus_queue.cc:237] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:23.996718 10663 raft_consensus.cc:2749] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.038384  5603 raft_consensus.cc:2410] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:15:24.054785  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 45014.3us
W20260709 12:15:24.089565  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 80636.2us
I20260709 12:15:24.090616  5716 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
W20260709 12:15:24.123677  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 98556.3us
I20260709 12:15:24.133279  5601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:15:24.133919  5601 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:24.134289  5601 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:24.137530  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 131172us
I20260709 12:15:24.139187  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:24.139914  5676 raft_consensus.cc:2393] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 12: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:24.142446  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:24.007020 10646 consensus_queue.cc:1048] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.114s
W20260709 12:15:24.146871  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 125341us
I20260709 12:15:24.147734  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:24.149027 10631 consensus_queue.cc:1059] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:24.150436 10046 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:24.150803 10046 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:24.151144 10046 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:24.154047 10409 raft_consensus.cc:3055] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:24.156024 10409 raft_consensus.cc:740] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:24.156939 10409 consensus_queue.cc:260] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:24.158493 10409 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:24.168496  5567 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:24.168807  5601 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:24.141587 10296 raft_consensus.cc:2749] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:15:24.186662  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 43931.5us
I20260709 12:15:24.192346  5604 raft_consensus.cc:2468] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:24.194470  5642 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:24.181587 10598 consensus_queue.cc:1059] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:15:24.181699 10388 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:24.222568  5601 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:24.225216  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:24.225865  6319 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:24.236645  6319 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 14.
I20260709 12:15:24.238379  5570 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:15:24.243786  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 49422.6us
I20260709 12:15:24.206605 10423 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:24.243615  5716 leader_election.cc:304] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:15:24.261035  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:24.261616  5746 raft_consensus.cc:3055] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:24.261981  5746 raft_consensus.cc:740] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:24.262686  5746 consensus_queue.cc:260] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:24.270602  5746 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:24.276285  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 47112.5us
I20260709 12:15:24.252878 10631 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:24.265187 10426 raft_consensus.cc:2749] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:24.301848  6322 raft_consensus.cc:1240] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:24.269543 10423 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:24.311678 10614 raft_consensus.cc:3055] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:24.312134 10614 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:24.312641 10423 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:24.277742 10472 raft_consensus.cc:2804] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:24.314533 10472 raft_consensus.cc:697] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:24.314088  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:24.315579  6322 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 13: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:24.315399 10472 consensus_queue.cc:237] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:24.325695  5497 catalog_manager.cc:5697] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 5 to 8, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 8 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:24.327668  5497 catalog_manager.cc:5697] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 2 to 4, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:24.338414  5498 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44240 (request call id 207) took 11828 ms (client timeout 15000 ms). Trace:
I20260709 12:15:24.364921  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:24.365690  5595 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:24.371650  5642 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:24.380496  5746 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 14.
I20260709 12:15:24.362977 10631 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
W20260709 12:15:24.345786  5498 rpcz_store.cc:269] 0709 12:15:12.510197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.510352 (+   155us) service_pool.cc:224] Handling call
0709 12:15:24.338316 (+11827964us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:21.376406 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:21.377069 (+   663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:21.377117 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:15:21.377135 (+    18us) tablet.cc:662] Decoding operations
0709 12:15:21.378883 (+  1748us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:21.378991 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:21.379025 (+    34us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:15:21.380213 (+  1188us) tablet.cc:701] Row locks acquired
0709 12:15:21.380264 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:15:21.380431 (+   167us) write_op.cc:270] Start()
0709 12:15:21.380585 (+   154us) write_op.cc:276] Timestamp: P: 1783599321380363 usec, L: 0
0709 12:15:21.380610 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:15:21.381294 (+   684us) log.cc:844] Serialized 5112 byte log entry
0709 12:15:22.157181 (+775887us) op_driver.cc:464] REPLICATION: finished
0709 12:15:22.374896 (+217715us) write_op.cc:301] APPLY: starting
0709 12:15:22.383211 (+  8315us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:22.489986 (+106775us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:22.490110 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:23.341507 (+851397us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5c0020fd8c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503c3d331 00007f4503c3d221 00007f4503c37f6c 00007f450139830b 00007f4501397fd3 00007f4501496e34 00007f450148297c 00007f4501486d61 00007f4501486d19 00007f4501486ca9 00007f4501486c71
0709 12:15:23.492159 (+150652us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:23.492408 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:15:23.492453 (+    45us) write_op.cc:312] APPLY: finished
0709 12:15:23.570586 (+ 78133us) log.cc:844] Serialized 121 byte log entry
0709 12:15:23.751653 (+181067us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fa9410ac 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b
0709 12:15:23.948404 (+196751us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:23.959528 (+ 11124us) write_op.cc:454] Released schema lock
0709 12:15:23.972873 (+ 13345us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:23.996371 (+ 23498us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:23.998391 (+  2020us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2215696,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":191135,"apply.run_cpu_time_us":74402,"apply.run_wall_time_us":1614391,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58519,"num_ops":13,"prepare.queue_time_us":90679,"prepare.run_cpu_time_us":32861,"prepare.run_wall_time_us":76397,"raft.queue_time_us":437263,"raft.run_cpu_time_us":14848,"raft.run_wall_time_us":170668,"replication_time_us":755143,"spinlock_wait_cycles":139981568,"thread_start_us":894941,"threads_started":5,"wal-append.queue_time_us":578109,"wal-append.run_cpu_time_us":24372,"wal-append.run_wall_time_us":1486606}]]}
I20260709 12:15:24.378693 10428 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:24.312902 10614 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:24.400864 10614 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:24.402079 10631 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:24.395471 10428 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:24.415128 10428 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:24.416620  5497 catalog_manager.cc:5697] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 3, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:24.426196 10046 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:24.423151  5497 catalog_manager.cc:5697] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 1 to 3, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 3 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:24.463131 10046 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:24.465303 10428 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:24.468186 10428 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:24.455542 10684 log.cc:927] Time spent T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:15:24.490063  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:24.495394  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:24.496313  6322 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b3083333af3348e4938f905ca4c4819f in current term 13: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:24.499398  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:24.514127  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:24.515012  6322 raft_consensus.cc:2393] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 13: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:24.516866  5675 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:24.519173 10313 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:24.576766  5601 raft_consensus.cc:1275] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:24.580403  5599 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:24.581713  5642 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:24.582986 10428 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:24.583470 10428 raft_consensus.cc:697] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:24.584295 10428 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:24.597170  5746 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:24.598446  5567 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:24.599227 10631 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:24.599689 10631 raft_consensus.cc:697] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:24.600534 10631 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:24.640185 10313 consensus_queue.cc:1048] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:24.840385  5672 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:24.843357 10663 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:15:24.851037  5746 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:24.862383 10409 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:24.876369  6324 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:24.877931 10409 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:24.891009  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:24.927084  5498 catalog_manager.cc:5697] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 8 to 11, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 11 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:24.943078  5597 raft_consensus.cc:1275] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:24.949055  5498 catalog_manager.cc:5697] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 10 to 15, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 15 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:24.948817 10472 consensus_queue.cc:1048] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 12:15:24.974836  5497 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45224 (request call id 307) took 72309 ms (client timeout 15000 ms). Trace:
W20260709 12:15:24.975347  5497 rpcz_store.cc:269] 0709 12:14:12.667033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.667825 (+   792us) service_pool.cc:224] Handling call
0709 12:15:24.974516 (+72306691us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:24.506561 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:24.507093 (+   532us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:24.507125 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:15:24.507144 (+    19us) tablet.cc:662] Decoding operations
0709 12:15:24.507726 (+   582us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:24.507799 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:24.507825 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:15:24.508190 (+   365us) tablet.cc:701] Row locks acquired
0709 12:15:24.508208 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:15:24.508346 (+   138us) write_op.cc:270] Start()
0709 12:15:24.508457 (+   111us) write_op.cc:276] Timestamp: P: 1783599324508299 usec, L: 0
0709 12:15:24.508483 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:15:24.509085 (+   602us) log.cc:844] Serialized 1677 byte log entry
0709 12:15:24.586469 (+ 77384us) op_driver.cc:464] REPLICATION: finished
0709 12:15:24.657893 (+ 71424us) write_op.cc:301] APPLY: starting
0709 12:15:24.657993 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:24.660421 (+  2428us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:24.660516 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:24.662749 (+  2233us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:24.662936 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:15:24.662979 (+    43us) write_op.cc:312] APPLY: finished
0709 12:15:24.663205 (+   226us) log.cc:844] Serialized 49 byte log entry
0709 12:15:24.663397 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:24.663495 (+    98us) write_op.cc:454] Released schema lock
0709 12:15:24.663537 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:24.663988 (+   451us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:24.664016 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":187442,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":71094,"apply.run_cpu_time_us":5980,"apply.run_wall_time_us":6069,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20863,"num_ops":4,"prepare.queue_time_us":48849,"prepare.run_cpu_time_us":2834,"prepare.run_wall_time_us":49030,"replication_time_us":77837,"thread_start_us":140239,"threads_started":2}]]}
I20260709 12:15:24.996783  5498 catalog_manager.cc:5697] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.003055  5601 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:24.998505  5498 catalog_manager.cc:5697] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.006078 10614 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:25.011793  5498 catalog_manager.cc:5697] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.024251  5498 catalog_manager.cc:5697] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 11 to 13, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 13 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.026070  5498 catalog_manager.cc:5697] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 7 to 12, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 12 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.027756  5498 catalog_manager.cc:5697] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 8 to 11, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 11 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.029265  5498 catalog_manager.cc:5697] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 11, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 11 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.042992  6324 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:25.044485 10614 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:25.030810  5498 catalog_manager.cc:5697] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 7 to 11, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.080147 10675 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:25.080940 10675 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.086733 10675 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:25.089344  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:25.091542  5746 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 12: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:25.107681  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:25.117043  5597 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:25.121302  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:25.122833 10680 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:25.124323 10680 raft_consensus.cc:493] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:25.125470 10680 raft_consensus.cc:3060] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:25.123116  5498 catalog_manager.cc:5697] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.166200  5498 catalog_manager.cc:5697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 2 to 10, term changed from 8 to 12, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66), c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.169138  5498 catalog_manager.cc:5697] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 11 to 15, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 15 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.187055  5498 catalog_manager.cc:5697] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.188709  5498 catalog_manager.cc:5697] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 10, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 10 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.203384 10675 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.204032 10675 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.207803  5498 catalog_manager.cc:5697] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.209630  5498 catalog_manager.cc:5697] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 10 to 14, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 14 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.214145  5498 catalog_manager.cc:5697] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 10 to 12, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 12 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.215991  5498 catalog_manager.cc:5697] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.221719  5744 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:25.222755 10675 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:25.225737 10388 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:25.225481 10680 raft_consensus.cc:515] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.230973  6319 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:25.233163  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:25.232460  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:25.233831  5746 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:25.235092 10680 leader_election.cc:290] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:25.238749  5498 catalog_manager.cc:5697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 9 to 14, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 14 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.240299  5498 catalog_manager.cc:5697] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 10 to 11, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.241729  5498 catalog_manager.cc:5697] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 8 to 11, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 11 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.242519 10388 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:25.243394  5498 catalog_manager.cc:5697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 11 to 14, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 14 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.244859  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:25.249241  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b8cda7467d4abb9e997bacb7d063ef" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:25.250476  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:25.253796  5746 raft_consensus.cc:2393] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 12: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:25.244881  5498 catalog_manager.cc:5697] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 3 to 11, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 11 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.255429 10680 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:25.263681 10680 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.273886 10680 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:25.270478  5498 catalog_manager.cc:5697] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.291164  5747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:25.294328  5747 raft_consensus.cc:606] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:15:25.292840  5498 catalog_manager.cc:5697] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 8 to 9, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 9 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:25.320120  5746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:25.320712  5746 raft_consensus.cc:606] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:15:25.343786  5597 raft_consensus.cc:2468] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:25.347396  6291 leader_election.cc:304] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:25.353945  5744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:25.354794  5744 raft_consensus.cc:606] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:25.355125 10675 raft_consensus.cc:2804] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:25.355688 10675 raft_consensus.cc:697] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:25.356706 10675 consensus_queue.cc:237] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.365487  6319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:15:25.366111  6319 raft_consensus.cc:606] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:15:25.369338  5744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:25.370064  5744 raft_consensus.cc:606] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:15:25.370456  5744 raft_consensus.cc:614] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:25.345711 10680 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.374316  6324 raft_consensus.cc:1240] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Rejecting Update request from peer b3083333af3348e4938f905ca4c4819f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:15:25.377225 10452 consensus_queue.cc:1059] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:25.378082 10452 raft_consensus.cc:3055] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:25.378412 10452 raft_consensus.cc:740] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:25.379305 10452 consensus_queue.cc:260] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.380643 10452 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:25.383805  5746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:25.384464  5746 raft_consensus.cc:606] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:25.386174  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:15:25.387964  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:25.388969  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:25.395778  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:25.396253 10680 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:25.396996  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:25.431005 10675 raft_consensus.cc:993] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:25.431504 10675 raft_consensus.cc:1081] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:25.435156  5673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:50284
I20260709 12:15:25.435864  5673 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:25.436195  5673 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:25.477586  5597 raft_consensus.cc:2410] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:15:25.490010  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:25.490860 10680 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:25.550133  5673 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.571252  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:25.571852  5597 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:25.570643  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c895f37947b04f8c8b0f3a8ac1874b71" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:25.572614  6319 raft_consensus.cc:3055] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:25.572927  6319 raft_consensus.cc:740] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:25.573673  6319 consensus_queue.cc:260] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.574805  6319 raft_consensus.cc:3060] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:25.575620 10491 raft_consensus.cc:993] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:25.576920 10491 raft_consensus.cc:1081] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:25.583041  5599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:15:25.583590  5599 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:25.583957  5599 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:25.590168  6319 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 15.
I20260709 12:15:25.590782  5673 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:25.593025  5597 raft_consensus.cc:2468] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 15.
I20260709 12:15:25.596338  5599 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.607366  5642 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:25.608585 10152 raft_consensus.cc:2804] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:25.609112 10152 raft_consensus.cc:697] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:25.612006 10152 consensus_queue.cc:237] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.636869  5599 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:25.638953  6319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:25.639663  6319 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:25.654448  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 48138.1us
I20260709 12:15:25.657002  6319 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:25.675077  5570 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:25.698706 10637 raft_consensus.cc:993] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:25.700846  9978 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.693109 10668 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:25.706604 10668 raft_consensus.cc:697] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:25.711855 10668 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:25.707032  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 48470.2us
I20260709 12:15:25.714775 10637 raft_consensus.cc:1081] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:25.717555  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:25.719998  5752 raft_consensus.cc:3055] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:25.720284  5752 raft_consensus.cc:740] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:25.725818  5672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35874
I20260709 12:15:25.727068  5672 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:25.727429  5672 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:25.723014  9978 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:25.731779  9978 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:25.725922  5752 consensus_queue.cc:260] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.739154  5752 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:25.741407  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:25.743525  5599 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:25.750169  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:25.750937 10714 raft_consensus.cc:993] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:25.751441 10714 raft_consensus.cc:1081] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:25.751811 10423 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:25.752244 10423 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.752559 10423 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:25.753113  5673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35874
I20260709 12:15:25.753657  5673 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:25.754001  5673 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:25.761291 10491 raft_consensus.cc:993] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:25.761870 10637 raft_consensus.cc:1081] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:25.763185  5673 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.768904  5597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:15:25.778628  5673 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:25.780242  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:25.780917  6324 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:25.769611  5597 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:25.793273  5752 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:25.795324  5597 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:25.800360  6324 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:25.817438  5645 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:25.818364 10556 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:25.818847 10556 raft_consensus.cc:697] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:25.819684 10556 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.829043  5672 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.833612  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:25.834615  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:25.845709  5747 raft_consensus.cc:3055] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:25.846170  5747 raft_consensus.cc:740] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:25.847021  5747 consensus_queue.cc:260] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.848151  5747 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:25.845709  5744 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:25.851306 10423 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:25.853281 10423 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:25.840489  5599 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:25.878734  5597 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.883450  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:25.884032  5599 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:25.886340  5672 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:25.895865  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:25.896464  6328 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:25.903183  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:25.903754  5744 raft_consensus.cc:3055] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:25.903455  5597 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:25.904101  5744 raft_consensus.cc:740] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:25.904639  5747 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:25.902175 10671 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:15:25.906061  5744 consensus_queue.cc:260] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.907392  5744 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:25.907831  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:25.908366  6324 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:25.907197  6328 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:15:25.914738  6324 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:25.915601  5645 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:25.920512 10717 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:25.921007 10717 raft_consensus.cc:697] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:25.921847 10717 consensus_queue.cc:237] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.914731  5744 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 8.
I20260709 12:15:25.936410  5570 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:25.937338 10388 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:25.938072  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:25.938310 10388 raft_consensus.cc:697] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:25.938686  5747 raft_consensus.cc:3055] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:25.939005  5747 raft_consensus.cc:740] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:25.942574  5747 consensus_queue.cc:260] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.948462  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:25.981436  5746 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:25.939225 10388 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:25.988492  5752 raft_consensus.cc:1275] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:25.989722  5747 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:25.993355  5599 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:26.006717  5747 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:26.006780  5642 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:26.010023  9978 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:26.006108 10675 consensus_queue.cc:1048] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:15:26.032590  5498 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44240 (request call id 208) took 1482 ms. Trace:
I20260709 12:15:26.052739  5746 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:26.061551  5499 catalog_manager.cc:5697] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 6 to 7, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 7 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.067112  5499 catalog_manager.cc:5697] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 8 to 9, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 9 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:26.073473  5499 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.075958  5499 catalog_manager.cc:5697] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 5 to 8, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 8 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.034339  5498 rpcz_store.cc:276] 0709 12:15:24.545106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.545306 (+   200us) service_pool.cc:224] Handling call
0709 12:15:26.027476 (+1482170us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:25.560084 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:25.560739 (+   655us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:25.560790 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:15:25.560807 (+    17us) tablet.cc:662] Decoding operations
0709 12:15:25.563545 (+  2738us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:25.563660 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:25.563687 (+    27us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:15:25.566415 (+  2728us) tablet.cc:701] Row locks acquired
0709 12:15:25.566462 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:15:25.566638 (+   176us) write_op.cc:270] Start()
0709 12:15:25.566790 (+   152us) write_op.cc:276] Timestamp: P: 1783599325566580 usec, L: 0
0709 12:15:25.566826 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:15:25.567781 (+   955us) log.cc:844] Serialized 10074 byte log entry
0709 12:15:25.638131 (+ 70350us) op_driver.cc:464] REPLICATION: finished
0709 12:15:25.707442 (+ 69311us) write_op.cc:301] APPLY: starting
0709 12:15:25.707552 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:25.829016 (+121464us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:25.829121 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:25.895196 (+ 66075us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:25.925801 (+ 30605us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 12:15:25.925850 (+    49us) write_op.cc:312] APPLY: finished
0709 12:15:25.926359 (+   509us) log.cc:844] Serialized 228 byte log entry
0709 12:15:25.926540 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:25.926755 (+   215us) write_op.cc:454] Released schema lock
0709 12:15:25.926827 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:25.927232 (+   405us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:25.927259 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53643,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":64145,"apply.run_cpu_time_us":30595,"apply.run_wall_time_us":219847,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112911,"num_ops":26,"prepare.queue_time_us":19609,"prepare.run_cpu_time_us":6984,"prepare.run_wall_time_us":9482,"replication_time_us":71100,"spinlock_wait_cycles":10112,"thread_start_us":62683,"threads_started":2}]]}
I20260709 12:15:26.086871  9978 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
W20260709 12:15:26.100345  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 72109.7us
I20260709 12:15:26.108542  9978 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:26.111171  5499 catalog_manager.cc:5697] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 4 to 7, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 7 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.122622  5597 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:26.123919  5499 catalog_manager.cc:5697] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.134856 10152 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:26.143800  5672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59220
I20260709 12:15:26.144632  5672 raft_consensus.cc:606] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Received request to transfer leadership
I20260709 12:15:26.143358  5499 catalog_manager.cc:5697] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.149595  5499 catalog_manager.cc:5697] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.189072  5672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59220
I20260709 12:15:26.189673  5672 raft_consensus.cc:606] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Received request to transfer leadership
W20260709 12:15:26.188896  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 69703.8us
I20260709 12:15:26.199235  6328 raft_consensus.cc:1275] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:26.228483  5752 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:15:26.232213  5487 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 08b7de4c4716494894a4643e09fb86f0 already in progress
I20260709 12:15:26.236301 10556 raft_consensus.cc:993] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:26.237726 10556 raft_consensus.cc:1081] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:26.225546 10152 consensus_queue.cc:1048] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:15:26.260615 10668 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
W20260709 12:15:26.283730  5487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 71713.1us
I20260709 12:15:26.289290  5744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:15:26.290051  5744 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:26.290490  5744 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:26.294940  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 64667.2us
I20260709 12:15:26.296882  5672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59220
I20260709 12:15:26.297394  5672 raft_consensus.cc:606] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Received request to transfer leadership
I20260709 12:15:26.302259  6324 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:15:26.337695 10668 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:15:26.357231  6319 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:26.360816  5744 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:26.366998  5752 raft_consensus.cc:1275] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:26.370067  5752 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:26.379428 10737 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:15:26.379647 10736 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:15:26.397260  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:26.398005  5672 raft_consensus.cc:3055] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:26.398285  5672 raft_consensus.cc:740] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:26.399091  5672 consensus_queue.cc:260] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:26.400435  5672 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:26.402608  5744 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:26.404474  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:26.405133  5604 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:26.414700  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b7de4c4716494894a4643e09fb86f0" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:26.424631  6328 raft_consensus.cc:3060] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:26.414443  5604 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 16.
I20260709 12:15:26.426076  5672 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 16.
I20260709 12:15:26.391268 10152 consensus_queue.cc:1048] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:15:26.441496  6328 raft_consensus.cc:2468] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 16.
I20260709 12:15:26.444902  6319 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:26.448374  5719 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:26.449266 10739 raft_consensus.cc:2804] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:26.449738 10739 raft_consensus.cc:697] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:26.450709 10739 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:26.452571 10729 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:26.454106  6324 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:26.468497 10152 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 12:15:26.501317  5550 auto_rebalancer.cc:893] Removing replace marker failed: Replica a54957145d9647cb89f46531d107120c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:15:26.502054  5550 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 08b7de4c4716494894a4643e09fb86f0 already in progress
W20260709 12:15:26.502398  5550 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 08b7de4c4716494894a4643e09fb86f0 already in progress
I20260709 12:15:26.519826  5752 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:26.524520 10452 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:26.567824  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:26.601100  5604 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:26.603819 10724 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:26.616737  5752 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:26.618861 10737 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:26.740868  5496 catalog_manager.cc:5697] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 11 to 12, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 12 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.742879  5496 catalog_manager.cc:5697] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 14, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 14 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:26.744498  5496 catalog_manager.cc:5697] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 13, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:26.854449 10637 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:26.855029 10637 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:26.857110 10637 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:26.858623  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:26.859267  5604 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
I20260709 12:15:26.865316  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:26.866828 10714 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:26.867244 10714 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:26.867595 10714 raft_consensus.cc:3060] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:26.874677  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:26.875494  6324 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 14: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:26.889492 10714 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:26.904453  5498 catalog_manager.cc:5697] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:26.912364  5498 catalog_manager.cc:5697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 6 to 13, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 13 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.917310  5498 catalog_manager.cc:5697] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 6 to 11, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:26.918895  5498 catalog_manager.cc:5697] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 8 to 11, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:26.920416  5498 catalog_manager.cc:5697] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 5 to 9, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:26.921744  5498 catalog_manager.cc:5697] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 8 to 13, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:26.923130  5498 catalog_manager.cc:5697] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 8 to 12, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 12 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.927953  5498 catalog_manager.cc:5697] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 10 to 11, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 11 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.930181  5498 catalog_manager.cc:5697] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 7 to 10, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 10 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:26.932190  5498 catalog_manager.cc:5697] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 11 to 12, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 12 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.934520  5498 catalog_manager.cc:5697] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 7 to 14, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 14 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:26.935940  5499 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45224 (request call id 308) took 54424 ms (client timeout 15000 ms). Trace:
W20260709 12:15:26.937498  5487 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 08b7de4c4716494894a4643e09fb86f0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader a54957145d9647cb89f46531d107120c (127.4.78.66:33011) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a54957145d9647cb89f46531d107120c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:26.939558  5498 catalog_manager.cc:5697] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 12, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 12 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:26.940546  5498 catalog_manager.cc:5697] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 10 to 15, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 15 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:26.941412  5498 catalog_manager.cc:5697] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 5 to 9, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 9 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.943390  5498 catalog_manager.cc:5697] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:26.948238  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:26.953424  5747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:26.954088  5747 raft_consensus.cc:606] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:26.954416  5747 raft_consensus.cc:614] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:26.958215 10714 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:26.959471  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:26.960270  6324 raft_consensus.cc:2393] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 14: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:26.963681  5673 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 16 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:26.965195 10714 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:15:26.936353  5499 rpcz_store.cc:269] 0709 12:14:32.511697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.517932 (+  6235us) service_pool.cc:224] Handling call
0709 12:15:26.935863 (+54417931us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:26.366115 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:26.366662 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:26.366704 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:15:26.366737 (+    33us) tablet.cc:662] Decoding operations
0709 12:15:26.367620 (+   883us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:26.367677 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:26.367711 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:15:26.368337 (+   626us) tablet.cc:701] Row locks acquired
0709 12:15:26.368354 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:15:26.368507 (+   153us) write_op.cc:270] Start()
0709 12:15:26.368618 (+   111us) write_op.cc:276] Timestamp: P: 1783599326368456 usec, L: 0
0709 12:15:26.368638 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:15:26.420939 (+ 52301us) log.cc:844] Serialized 3210 byte log entry
0709 12:15:26.501041 (+ 80102us) op_driver.cc:464] REPLICATION: finished
0709 12:15:26.557062 (+ 56021us) write_op.cc:301] APPLY: starting
0709 12:15:26.557150 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:26.629537 (+ 72387us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:26.629628 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:26.712266 (+ 82638us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:26.712496 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:15:26.712550 (+    54us) write_op.cc:312] APPLY: finished
0709 12:15:26.712838 (+   288us) log.cc:844] Serialized 81 byte log entry
0709 12:15:26.713019 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:26.713136 (+   117us) write_op.cc:454] Released schema lock
0709 12:15:26.713176 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:26.715605 (+  2429us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:26.715688 (+    83us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43388,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":55776,"apply.run_cpu_time_us":12442,"apply.run_wall_time_us":158346,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37599,"num_ops":8,"prepare.queue_time_us":184828,"prepare.run_cpu_time_us":3787,"prepare.run_wall_time_us":55151,"replication_time_us":131058,"thread_start_us":211478,"threads_started":2}]]}
I20260709 12:15:26.970533  5604 raft_consensus.cc:2468] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
I20260709 12:15:26.971827  5716 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: c02ed29558db481589fd3db23e43a07f
I20260709 12:15:26.950067  5498 catalog_manager.cc:5697] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 9 to 13, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:26.975008  5744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:26.996695  5744 raft_consensus.cc:606] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:26.976351 10637 raft_consensus.cc:2804] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:26.992807  5498 catalog_manager.cc:5697] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 9 to 12, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 12 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:27.004243  5498 catalog_manager.cc:5697] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 7 to 13, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 13 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.997148  5744 raft_consensus.cc:614] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:27.006372  5498 catalog_manager.cc:5697] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 7 to 10, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 10 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:27.007984  5498 catalog_manager.cc:5697] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:27.009961  5498 catalog_manager.cc:5697] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 7 to 14, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 14 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:27.014478  5498 catalog_manager.cc:5697] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:27.021569 10637 raft_consensus.cc:697] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:27.023617 10637 consensus_queue.cc:237] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:27.028141  5672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a65b178e0ee4e48a8e13521e3909d60"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:27.028832  5672 raft_consensus.cc:606] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:27.029140  5672 raft_consensus.cc:614] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:27.036150  5498 catalog_manager.cc:5697] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:27.045333  5744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:27.044868  5498 catalog_manager.cc:5697] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 6 to 11, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:27.046059  5744 raft_consensus.cc:606] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:27.046586  5498 catalog_manager.cc:5697] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 10 to 15, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 15 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:27.061837  5744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:27.062682  5744 raft_consensus.cc:606] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:15:27.066356  5747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:27.066967  5747 raft_consensus.cc:606] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:27.067266  5747 raft_consensus.cc:614] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:27.069082  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:15:27.070955  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:27.071774  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:27.142077  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 111733us
I20260709 12:15:27.145738  6319 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:27.147889  5604 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:27.153855 10714 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:27.160609 10757 raft_consensus.cc:993] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:27.161098 10757 raft_consensus.cc:1081] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:27.162837 10714 raft_consensus.cc:993] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:27.163365 10714 raft_consensus.cc:1081] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:27.163564  5599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:15:27.164180  5599 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:27.164546  5599 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:27.165516 10714 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:27.169246  6319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58714
I20260709 12:15:27.169814  6319 raft_consensus.cc:493] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:27.170156  6319 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:27.178248  5599 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:27.185395  6319 raft_consensus.cc:515] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:27.196007  6319 leader_election.cc:290] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:27.196318  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:27.196973  5672 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:27.200861  5599 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:27.202554  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:27.203142  5747 raft_consensus.cc:3055] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:27.203454  5747 raft_consensus.cc:740] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:27.204192  5747 consensus_queue.cc:260] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:27.206779  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:27.207448  5744 raft_consensus.cc:3055] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:27.207733  5744 raft_consensus.cc:740] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:27.208458  5744 consensus_queue.cc:260] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:27.214630  5595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ec4e9962d74fb9bbf294f2dc0911cf" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:27.215260  5595 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:27.224479  5672 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:27.225831  5569 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:27.226289  5744 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:27.228480 10729 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:27.229025 10729 raft_consensus.cc:697] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:27.229878 10729 consensus_queue.cc:237] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:27.239774  5747 raft_consensus.cc:3060] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:27.241534  5595 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:27.244412  6291 leader_election.cc:304] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:27.245163 10671 raft_consensus.cc:2804] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:27.245627 10671 raft_consensus.cc:697] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:27.246723 10671 consensus_queue.cc:237] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:27.261332  5744 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:27.270397  5747 raft_consensus.cc:2468] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:27.447000 10671 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.447777 10671 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:27.452263 10671 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:27.535702  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:27.536367  5604 raft_consensus.cc:2410] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:15:28.115103  6324 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:28.138717  5496 catalog_manager.cc:5697] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 12 to 13, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:28.140615  5496 catalog_manager.cc:5697] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 14 to 15, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 15 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:28.142371  5496 catalog_manager.cc:5697] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 7 to 8, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 8 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:28.145572  5676 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:28.147650 10759 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:28.148717 10668 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:28.177454  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4aecf80db140ca828a80dc93220fba" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:28.180305  5599 raft_consensus.cc:1275] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:28.209998 10637 consensus_queue.cc:1048] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 12:15:28.250643  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 148464us
W20260709 12:15:28.337809  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 43540.2us
W20260709 12:15:28.362627  5567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.004s	sys 0.008s
W20260709 12:15:28.363029  5567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.004s	sys 0.008s
I20260709 12:15:28.270126  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:28.404793  5601 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:15:28.430239  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 114933us
I20260709 12:15:28.489009  5498 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45214 (request call id 300) took 2262 ms. Trace:
I20260709 12:15:28.489513  5498 rpcz_store.cc:276] 0709 12:15:26.202565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.202696 (+   131us) service_pool.cc:224] Handling call
0709 12:15:28.464969 (+2262273us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:27.071685 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:27.072183 (+   498us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:27.072219 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:15:27.072233 (+    14us) tablet.cc:662] Decoding operations
0709 12:15:27.094679 (+ 22446us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:27.094741 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:27.094776 (+    35us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:15:27.096778 (+  2002us) tablet.cc:701] Row locks acquired
0709 12:15:27.096798 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:15:27.096976 (+   178us) write_op.cc:270] Start()
0709 12:15:27.097097 (+   121us) write_op.cc:276] Timestamp: P: 1783599327096922 usec, L: 0
0709 12:15:27.097119 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:15:27.099638 (+  2519us) log.cc:844] Serialized 9690 byte log entry
0709 12:15:27.114129 (+ 14491us) op_driver.cc:464] REPLICATION: finished
0709 12:15:27.114424 (+   295us) write_op.cc:301] APPLY: starting
0709 12:15:27.114512 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:27.129565 (+ 15053us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:27.129684 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:27.240489 (+110805us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:27.249212 (+  8723us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 12:15:27.249260 (+    48us) write_op.cc:312] APPLY: finished
0709 12:15:27.249700 (+   440us) log.cc:844] Serialized 220 byte log entry
0709 12:15:27.263758 (+ 14058us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:27.272909 (+  9151us) write_op.cc:454] Released schema lock
0709 12:15:27.288467 (+ 15558us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:27.313684 (+ 25217us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:27.313713 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":147233,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":100,"apply.run_cpu_time_us":28430,"apply.run_wall_time_us":193971,"cfile_cache_hit":100,"cfile_cache_hit_bytes":104600,"num_ops":25,"prepare.queue_time_us":2053,"prepare.run_cpu_time_us":6093,"prepare.run_wall_time_us":45753,"replication_time_us":16854}]]}
W20260709 12:15:28.502682  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 182730us
W20260709 12:15:28.505983  5487 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 08b7de4c4716494894a4643e09fb86f0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader a54957145d9647cb89f46531d107120c (127.4.78.66:33011) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a54957145d9647cb89f46531d107120c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:28.517513  5747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:28.518533  5747 raft_consensus.cc:606] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:28.520928 10783 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:15:28.521262 10775 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:28.521950 10775 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:28.523936 10775 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:28.528951 10777 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:15:28.529551 10777 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:28.532013 10777 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:28.550769  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 190283us
I20260709 12:15:28.569458  5747 raft_consensus.cc:1275] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:28.572002  5744 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:28.559383  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:28.575253  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:28.582720  5752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:28.583283  5752 raft_consensus.cc:606] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
W20260709 12:15:28.585160  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 153871us
I20260709 12:15:28.587541  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:28.590916 10778 consensus_queue.cc:1048] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:28.631843  5673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:28.632582  5673 raft_consensus.cc:606] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:28.635039  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:28.655537 10757 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:28.664217  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:28.664261 10671 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:28.690964  5747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:28.691720  5747 raft_consensus.cc:606] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
W20260709 12:15:28.692299  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08000ef780 after lost signal to thread 4412
W20260709 12:15:28.695475  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08001a4fe0 after lost signal to thread 5535
W20260709 12:15:28.696743  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08003c9620 after lost signal to thread 5628
I20260709 12:15:28.709415 10714 raft_consensus.cc:993] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:28.710093 10759 raft_consensus.cc:1081] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:28.711653  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3877dfaf52344867b58b6fa860f49dcb" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:28.724145 10760 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:28.724875 10760 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:28.727285 10760 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:28.735100  5774 debug-util.cc:398] Leaking SignalData structure 0x7b0800402b20 after lost signal to thread 5703
W20260709 12:15:28.735695  5774 debug-util.cc:398] Leaking SignalData structure 0x7b0800048b00 after lost signal to thread 5704
W20260709 12:15:28.736922  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2520 after lost signal to thread 5777
W20260709 12:15:28.737619  5774 debug-util.cc:398] Leaking SignalData structure 0x7b080032f1c0 after lost signal to thread 5778
W20260709 12:15:28.738942  5774 debug-util.cc:398] Leaking SignalData structure 0x7b080036b560 after lost signal to thread 6352
W20260709 12:15:28.741942  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08003bffe0 after lost signal to thread 6353
W20260709 12:15:28.742911  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6d00 after lost signal to thread 10739
I20260709 12:15:28.752138  5747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:28.753021  5747 raft_consensus.cc:606] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:15:28.753350  5747 raft_consensus.cc:614] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:28.762768  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58714
I20260709 12:15:28.764221  6327 raft_consensus.cc:493] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:28.764678  6327 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:28.768679  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:28.769948 10729 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:28.770401  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:28.771147  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:28.768481  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:28.789000 10780 raft_consensus.cc:993] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:28.789521 10780 raft_consensus.cc:1081] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:28.815642 10780 raft_consensus.cc:993] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:28.816170 10780 raft_consensus.cc:1081] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:28.825919  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3083333af3348e4938f905ca4c4819f" is_pre_election: true
I20260709 12:15:28.808866  6327 raft_consensus.cc:515] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:28.829676  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 65242.8us
I20260709 12:15:28.840840  5604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:15:28.841401  5604 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:28.841807  5604 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.841720  5716 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:28.845479 10780 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:28.847919  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:28.850109  5672 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:28.853714  5602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:15:28.858844  5602 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:28.859195  5602 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:28.849289  5567 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:28.874514  6327 leader_election.cc:290] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:28.876679  5672 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:15:28.879119  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3590ec2a21d04c1c9948d0b4cba00790" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:28.879705  5747 raft_consensus.cc:3055] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:28.879988  5747 raft_consensus.cc:740] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:28.880697 10772 raft_consensus.cc:993] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:28.881204 10772 raft_consensus.cc:1081] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:28.880699  5747 consensus_queue.cc:260] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:28.892205  5747 raft_consensus.cc:3060] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:28.889225  6293 leader_election.cc:304] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:28.896374  5602 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:28.907455  5603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51908
I20260709 12:15:28.908082  5603 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:28.908459  5603 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.909909  5596 raft_consensus.cc:1240] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:28.897608  5604 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:28.913414 10783 raft_consensus.cc:2804] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:28.918751  5602 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:28.917688  5747 raft_consensus.cc:2468] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:15:28.920037  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:28.920619  5676 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:28.920842 10785 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:28.921648 10783 raft_consensus.cc:697] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 15 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:28.922578 10783 consensus_queue.cc:237] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:28.926779  5604 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:28.936780  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:28.937429  6327 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.941110  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:28.941902  5747 raft_consensus.cc:3055] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:28.945641  5747 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:28.946676  5747 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:28.952186  5747 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:28.954692  5676 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:28.955889  5569 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:28.970920 10785 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:29.063634  6327 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:29.067792  5747 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
W20260709 12:15:29.071538  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 96776.4us
W20260709 12:15:29.071935  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 113387us
W20260709 12:15:29.071513  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 113261us
I20260709 12:15:29.067894  5603 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:29.077957 10818 log.cc:927] Time spent T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.119s	user 0.009s	sys 0.003s
I20260709 12:15:29.090562  5603 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:29.092034  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:29.092618  5676 raft_consensus.cc:3055] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:29.092911  5676 raft_consensus.cc:740] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:29.093647  5676 consensus_queue.cc:260] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:29.093565  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:29.094770  5676 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:29.095203  5744 raft_consensus.cc:3055] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:29.095511  5744 raft_consensus.cc:740] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:29.101994  5604 raft_consensus.cc:1240] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:29.104664  5676 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:29.099068  5744 consensus_queue.cc:260] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:29.069819 10785 raft_consensus.cc:697] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:29.110373 10785 consensus_queue.cc:237] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:29.117350  5744 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:29.134749  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 44322.9us
I20260709 12:15:29.172477  5569 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:29.179857  5744 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:29.217833 10452 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:29.218379 10452 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:29.219220 10452 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:29.228018  5570 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:29.230731  5603 raft_consensus.cc:1240] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 12. Current term is 13. Ops: []
W20260709 12:15:29.232672  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 162937us
I20260709 12:15:29.236490  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:29.237030  5747 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:29.254698 10729 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:29.255581 10729 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:29.256479 10729 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:29.263546  5747 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 13.
I20260709 12:15:29.306329  5496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44240 (request call id 210) took 2397 ms. Trace:
I20260709 12:15:29.306725  5496 rpcz_store.cc:276] 0709 12:15:26.909272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.909422 (+   150us) service_pool.cc:224] Handling call
0709 12:15:29.306252 (+2396830us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:28.549396 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:28.549935 (+   539us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:28.549973 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:15:28.549991 (+    18us) tablet.cc:662] Decoding operations
0709 12:15:28.550532 (+   541us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:28.550585 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:28.550610 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:15:28.550918 (+   308us) tablet.cc:701] Row locks acquired
0709 12:15:28.550933 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:15:28.551063 (+   130us) write_op.cc:270] Start()
0709 12:15:28.551181 (+   118us) write_op.cc:276] Timestamp: P: 1783599328551022 usec, L: 0
0709 12:15:28.551203 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:15:28.551827 (+   624us) log.cc:844] Serialized 1284 byte log entry
0709 12:15:28.910986 (+359159us) op_driver.cc:464] REPLICATION: finished
0709 12:15:29.163249 (+252263us) write_op.cc:301] APPLY: starting
0709 12:15:29.163342 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:29.165379 (+  2037us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:29.165467 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:29.225367 (+ 59900us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:29.225575 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:15:29.225633 (+    58us) write_op.cc:312] APPLY: finished
0709 12:15:29.247872 (+ 22239us) log.cc:844] Serialized 41 byte log entry
0709 12:15:29.276412 (+ 28540us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:29.280153 (+  3741us) write_op.cc:454] Released schema lock
0709 12:15:29.282251 (+  2098us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:29.301112 (+ 18861us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:29.301142 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":992594,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":252029,"apply.run_cpu_time_us":5771,"apply.run_wall_time_us":137853,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16679,"num_ops":3,"prepare.queue_time_us":150844,"prepare.run_cpu_time_us":11371,"prepare.run_wall_time_us":133937,"raft.queue_time_us":170530,"raft.run_cpu_time_us":31178,"raft.run_wall_time_us":194292,"replication_time_us":359631,"thread_start_us":520100,"threads_started":4,"wal-append.queue_time_us":152141}]]}
I20260709 12:15:29.349844  5748 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:29.353560 10783 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:29.413353  5495 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:29.469928  5672 raft_consensus.cc:1275] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:29.490114 10671 consensus_queue.cc:1048] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:15:29.554816  5495 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45214 (request call id 299) took 18772 ms (client timeout 15000 ms). Trace:
W20260709 12:15:29.555344  5495 rpcz_store.cc:269] 0709 12:15:10.782265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.783799 (+  1534us) service_pool.cc:224] Handling call
0709 12:15:29.554703 (+18770904us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:29.458471 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:29.459026 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:29.459062 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:15:29.459080 (+    18us) tablet.cc:662] Decoding operations
0709 12:15:29.459407 (+   327us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:29.459481 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:29.459514 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:15:29.459695 (+   181us) tablet.cc:701] Row locks acquired
0709 12:15:29.459713 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:15:29.473341 (+ 13628us) write_op.cc:270] Start()
0709 12:15:29.473465 (+   124us) write_op.cc:276] Timestamp: P: 1783599329459823 usec, L: 0
0709 12:15:29.473488 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:15:29.474140 (+   652us) log.cc:844] Serialized 535 byte log entry
0709 12:15:29.476444 (+  2304us) op_driver.cc:464] REPLICATION: finished
0709 12:15:29.476893 (+   449us) write_op.cc:301] APPLY: starting
0709 12:15:29.476975 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:29.478536 (+  1561us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:29.478651 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:29.479459 (+   808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:29.479633 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:15:29.479688 (+    55us) write_op.cc:312] APPLY: finished
0709 12:15:29.479921 (+   233us) log.cc:844] Serialized 25 byte log entry
0709 12:15:29.480105 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:29.480192 (+    87us) write_op.cc:454] Released schema lock
0709 12:15:29.480234 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:29.480651 (+   417us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:29.480681 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":219,"apply.run_cpu_time_us":3031,"apply.run_wall_time_us":3690,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":27526,"prepare.run_cpu_time_us":2508,"prepare.run_wall_time_us":15954,"replication_time_us":2828,"thread_start_us":27170,"threads_started":1}]]}
I20260709 12:15:29.580374  5496 catalog_manager.cc:5697] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 6 to 14, leader changed from c02ed29558db481589fd3db23e43a07f (127.4.78.68) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 14 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:29.581847  5496 catalog_manager.cc:5697] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 15 to 16, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 16 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:29.583321  5496 catalog_manager.cc:5697] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 11 to 12, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 12 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.584755  5496 catalog_manager.cc:5697] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 14 to 15, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 15 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.586989  5744 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:29.588872 10729 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:29.606889  5672 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:29.611953 10452 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:29.623065  5673 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:29.626747  5498 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 10 to 13, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } }
I20260709 12:15:29.628435  5498 catalog_manager.cc:5697] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 10 to 11, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 11 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.670238 10774 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:29.824047  5744 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:15:29.830339 10838 log.cc:927] Time spent T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:15:29.830817 10776 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:29.862205  5498 catalog_manager.cc:5697] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 11 to 12, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 12 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.864112  5498 catalog_manager.cc:5697] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 12 to 13, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 13 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.906841  6326 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:29.919078  5498 catalog_manager.cc:5697] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 12 to 13, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 13 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.917919 10729 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:15:29.928719  5748 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:15:29.971658  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 56037.4us
I20260709 12:15:29.971370 10776 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:15:30.152582  5497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45224 (request call id 310) took 4740 ms. Trace:
I20260709 12:15:30.153093  5497 rpcz_store.cc:276] 0709 12:15:25.412033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.412255 (+   222us) service_pool.cc:224] Handling call
0709 12:15:30.152493 (+4740238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":244290,"reported_tablets":48}
I20260709 12:15:30.157997  5494 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45220 (request call id 295) took 11139 ms. Trace:
I20260709 12:15:30.158538  5494 rpcz_store.cc:276] 0709 12:15:19.025895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.044686 (+ 18791us) service_pool.cc:224] Handling call
0709 12:15:30.157880 (+11113194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305983,"reported_tablets":49}
I20260709 12:15:30.199416  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:30.203604  5747 consensus_queue.cc:237] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:30.215329  5744 consensus_queue.cc:237] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:30.324492  5676 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:15:30.333911 10637 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 12:15:30.383471  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 74730.3us
I20260709 12:15:30.384869  6321 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:15:30.450670  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 148031us
I20260709 12:15:30.481873  5604 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:30.531224 10860 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:30.532011 10862 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:30.499954  6321 raft_consensus.cc:1275] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:15:30.538816 10854 log.cc:927] Time spent T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 12:15:30.578991  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 78378.5us
W20260709 12:15:30.570750 10851 log.cc:927] Time spent T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:15:30.590626  5671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:30.591261  5671 raft_consensus.cc:606] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:30.595340  5671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:30.595957  5671 raft_consensus.cc:606] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:30.598484  5671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:30.599062  5671 raft_consensus.cc:606] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:15:30.601680  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:30.602236  5677 raft_consensus.cc:606] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:30.605010  5677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:30.605502  5677 raft_consensus.cc:606] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:15:30.609135  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:30.609493 10637 consensus_queue.cc:1048] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:30.629819  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:30.631178  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:30.659153 10871 raft_consensus.cc:2955] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index 4 to 7, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:30.660220  5676 raft_consensus.cc:2955] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 4 to 7, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:15:30.662473  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 359509us
I20260709 12:15:30.722116  6321 raft_consensus.cc:2955] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 4 to 7, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:15:30.746034  5501 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45220 (request call id 294) took 45933 ms (client timeout 15000 ms). Trace:
W20260709 12:15:30.751075  5501 rpcz_store.cc:269] 0709 12:14:44.812755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.813564 (+   809us) service_pool.cc:224] Handling call
0709 12:15:30.745838 (+45932274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17209,"reported_tablets":49}
I20260709 12:15:30.766484  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 27e6e6d757f74b3a95066ebc6b0e8589 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:30.796309 10866 raft_consensus.cc:993] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:30.796916 10866 raft_consensus.cc:1081] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:30.814249 10869 raft_consensus.cc:993] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:30.814891 10869 raft_consensus.cc:1081] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:30.826226 10760 raft_consensus.cc:2955] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 7 to 11, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:30.836143  6327 raft_consensus.cc:2955] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 7 to 11, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:30.842074  5501 catalog_manager.cc:5697] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 4 to 7, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:15:30.874627  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 82875.7us
I20260709 12:15:30.878882  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08b7de4c4716494894a4643e09fb86f0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
W20260709 12:15:30.882617  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 94720.5us
I20260709 12:15:30.884238 10092 raft_consensus.cc:993] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:30.884718 10856 raft_consensus.cc:1081] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:30.895785  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58720
I20260709 12:15:30.896364  6327 raft_consensus.cc:493] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.896704  6327 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:30.906553  6327 raft_consensus.cc:515] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:30.907879  5747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:15:30.908440  5747 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.908795  5747 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:30.916078  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:30.921221  5671 raft_consensus.cc:3055] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:30.921556  5671 raft_consensus.cc:740] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:30.915390  6327 leader_election.cc:290] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:30.919282  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:30.941857  5744 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:30.948518  5744 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:30.922415  5671 consensus_queue.cc:260] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:30.918550  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5b12e3f8d847ddaa3bcba52b39ba9b" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:30.949921  5598 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:30.951309  5671 raft_consensus.cc:3060] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:30.952706  5602 raft_consensus.cc:2955] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 7 to 11, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:30.937795  5603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51908
I20260709 12:15:30.955986  5603 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.956368  5603 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.938629  6327 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:30.957281  5598 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:30.958961  6291 leader_election.cc:304] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:30.959882 10870 raft_consensus.cc:2804] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:30.960393 10870 raft_consensus.cc:697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 13 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:30.961302 10870 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:30.963555 10853 raft_consensus.cc:993] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:30.964138 10853 raft_consensus.cc:1081] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:30.982542  5598 raft_consensus.cc:1240] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Rejecting Update request from peer a54957145d9647cb89f46531d107120c for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:30.986892  9978 raft_consensus.cc:993] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:30.987368  9978 raft_consensus.cc:1081] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:30.993935  6322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58720
I20260709 12:15:30.994557  6322 raft_consensus.cc:493] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.994930  6322 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:31.003140  5485 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 27e6e6d757f74b3a95066ebc6b0e8589 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 7
I20260709 12:15:31.003412  6322 raft_consensus.cc:515] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:31.004568  5500 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45224 (request call id 309) took 21042 ms (client timeout 15000 ms). Trace:
W20260709 12:15:31.004945  5500 rpcz_store.cc:269] 0709 12:15:09.962500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.962676 (+   176us) service_pool.cc:224] Handling call
0709 12:15:31.004393 (+21041717us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":350705,"reported_tablets":48}
I20260709 12:15:30.940972  5747 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:31.008546  5747 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:31.009078  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:31.009690  6327 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:31.011495  5677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642b3c7e6044747893b0e74e79ec49b" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:31.012096  5677 raft_consensus.cc:3055] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:31.012355  5677 raft_consensus.cc:740] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:31.013025  5745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:15:31.013634  5745 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:31.014078  5745 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:31.014498  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:31.017422  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a87e1fb9c364e85bc7c296e4c7b6642" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:31.018059  5676 raft_consensus.cc:3055] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:31.018332  5676 raft_consensus.cc:740] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:31.019079  5676 consensus_queue.cc:260] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:31.020149  5676 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.015133  5598 raft_consensus.cc:3060] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.005421  6322 leader_election.cc:290] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:31.013051  5677 consensus_queue.cc:260] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:31.025404  5677 raft_consensus.cc:3060] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:31.029153  5671 raft_consensus.cc:2468] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 13.
I20260709 12:15:31.040587  5677 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:15:31.042896  5598 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:15:31.044831  6327 raft_consensus.cc:2468] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:15:31.042125  5718 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:31.044195  6291 leader_election.cc:304] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:31.045218  5745 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:31.048344 10805 raft_consensus.cc:2804] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:31.048969 10805 raft_consensus.cc:697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 15 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:31.049803  5745 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:31.049908 10805 consensus_queue.cc:237] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:31.055378  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:31.056344  5598 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:31.064090  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6905b9f5774928a465ac1a443f56a4" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:31.064736  5672 raft_consensus.cc:3055] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:31.065014  5672 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:31.065667  5672 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:31.066537  5676 raft_consensus.cc:2468] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:15:31.047219 10860 raft_consensus.cc:2804] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:31.070320  5672 raft_consensus.cc:3060] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:31.071412  5487 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ac5b12e3f8d847ddaa3bcba52b39ba9b with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader a54957145d9647cb89f46531d107120c (127.4.78.66:33011) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a54957145d9647cb89f46531d107120c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:31.073099  5603 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:31.074604  5598 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:15:31.075807  5716 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:31.092219  5672 raft_consensus.cc:2468] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:15:31.097999  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:31.101442  5603 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:31.102083  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:31.102689  6327 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.075930 10860 raft_consensus.cc:697] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:31.106139 10860 consensus_queue.cc:237] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:31.107229  5672 raft_consensus.cc:3055] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:31.107836  5672 raft_consensus.cc:740] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:31.109375  6327 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
I20260709 12:15:31.110066  5672 consensus_queue.cc:260] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:31.112712  5672 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.115590 10760 raft_consensus.cc:2804] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:31.116212 10760 raft_consensus.cc:697] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:31.117069 10760 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:31.123807  5672 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 11.
W20260709 12:15:31.155720  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 52753us
I20260709 12:15:31.159318  5570 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:31.167649 10857 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:31.240152 10868 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:15:31.262230 10868 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:31.264844 10868 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:31.265988  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:31.267361  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:31.225039  5500 catalog_manager.cc:5697] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 7 to 11, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 16 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:31.285964  5567 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3083333af3348e4938f905ca4c4819f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:15:31.292058 10868 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:31.292058 10857 raft_consensus.cc:697] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:31.306945 10857 consensus_queue.cc:237] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:31.341970  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 91541us
I20260709 12:15:31.345500  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:31.356297  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet 08b7de4c4716494894a4643e09fb86f0 with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:59220
I20260709 12:15:31.363788 10893 tablet_replica.cc:333] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:15:31.370075 10893 raft_consensus.cc:2243] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:31.381664 10893 raft_consensus.cc:2272] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:31.392547 10893 ts_tablet_manager.cc:1916] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:31.405339  5497 catalog_manager.cc:5697] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 8 to 9, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.409351  5497 catalog_manager.cc:5697] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 12 to 13, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 13 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:31.412251  5500 catalog_manager.cc:5697] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 10 to 11, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 11 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.424664  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet 27e6e6d757f74b3a95066ebc6b0e8589 with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:43404
I20260709 12:15:31.439886  5494 catalog_manager.cc:5697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 12 to 13, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 13 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:31.442625  5494 catalog_manager.cc:5697] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 14 to 15, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 15 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:31.478893 10895 tablet_replica.cc:333] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:31.490701  6327 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:15:31.491348 10893 ts_tablet_manager.cc:1929] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.10
I20260709 12:15:31.491878  5672 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:15:31.494241 10871 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:31.495606 10893 log.cc:1199] T 08b7de4c4716494894a4643e09fb86f0 P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/08b7de4c4716494894a4643e09fb86f0
I20260709 12:15:31.493882 10895 raft_consensus.cc:2243] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:31.498036  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet 08b7de4c4716494894a4643e09fb86f0 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:15:31.497356 10870 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:15:31.500245 10895 raft_consensus.cc:2272] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:31.514389  5675 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:31.515906 10870 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:31.528348 10895 ts_tablet_manager.cc:1916] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:31.545969  5747 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:31.547521 10805 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:31.552929  5603 raft_consensus.cc:1275] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:15:31.557958 10805 consensus_queue.cc:1048] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:31.562475  5602 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:31.565064  5603 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:31.576926 10805 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:15:31.575043 10760 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:15:31.649096  5672 raft_consensus.cc:1275] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:15:31.704239  5672 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:31.711578 10895 ts_tablet_manager.cc:1929] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.6
I20260709 12:15:31.712087 10895 log.cc:1199] T 27e6e6d757f74b3a95066ebc6b0e8589 P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/27e6e6d757f74b3a95066ebc6b0e8589
I20260709 12:15:31.666615 10905 consensus_queue.cc:1048] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:15:31.726385  6321 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:31.737811 10885 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:15:31.811100  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet 27e6e6d757f74b3a95066ebc6b0e8589 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:15:31.840451  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:31.816726 10908 log.cc:927] Time spent T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:15:31.734037 10904 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 12:15:31.884721  6322 consensus_queue.cc:237] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:31.958094 10909 log.cc:927] Time spent T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:15:31.972231  5675 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:31.974036 10805 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:31.992974 10924 raft_consensus.cc:2955] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 10 to 12, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:32.000598  5671 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:32.008430  5675 raft_consensus.cc:2955] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 10 to 12, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:32.040747  5488 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac5b12e3f8d847ddaa3bcba52b39ba9b with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 5)
I20260709 12:15:32.046540  5600 raft_consensus.cc:1275] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:32.062438 10923 consensus_queue.cc:1048] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:32.075634  5602 raft_consensus.cc:2955] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 10 to 12, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:32.091938  5497 catalog_manager.cc:5697] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 10 to 12, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 13 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:32.130129 10927 log.cc:927] Time spent T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:15:32.146437 10911 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:32.204871  5675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:32.205510  5675 raft_consensus.cc:606] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:32.212827  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet ac5b12e3f8d847ddaa3bcba52b39ba9b with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:40108
I20260709 12:15:32.235577 10932 tablet_replica.cc:333] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:15:32.236644 10932 raft_consensus.cc:2243] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:32.255744 10932 raft_consensus.cc:2272] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:32.260545  5675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:32.261202  5675 raft_consensus.cc:606] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:15:32.273255 10932 ts_tablet_manager.cc:1916] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:32.373046  5598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:43420
I20260709 12:15:32.373553  5598 raft_consensus.cc:606] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:15:32.383405  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:15:32.384975  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:32.385824  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:32.401098 10932 ts_tablet_manager.cc:1929] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 12:15:32.404906 10932 log.cc:1199] T ac5b12e3f8d847ddaa3bcba52b39ba9b P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/ac5b12e3f8d847ddaa3bcba52b39ba9b
I20260709 12:15:32.412482  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet ac5b12e3f8d847ddaa3bcba52b39ba9b (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:15:32.518217 10918 raft_consensus.cc:993] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:32.518718 10918 raft_consensus.cc:1081] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:32.520404  6321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58720
I20260709 12:15:32.520916  6321 raft_consensus.cc:493] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.521209  6321 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:32.527691  6321 raft_consensus.cc:515] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:32.530362  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:32.530894  5675 raft_consensus.cc:3055] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:32.531158  5675 raft_consensus.cc:740] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:32.531832  5675 consensus_queue.cc:260] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:32.532845  5675 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:32.534168  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cc490802a84093b74474b1decbb6a2" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:32.534740  5598 raft_consensus.cc:3060] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:32.539613  5675 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 14.
I20260709 12:15:32.546059  5598 raft_consensus.cc:2468] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 14.
I20260709 12:15:32.546720  6293 leader_election.cc:304] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:32.540096  6321 leader_election.cc:290] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:32.547943 10915 raft_consensus.cc:2804] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:32.548382 10915 raft_consensus.cc:697] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:32.549170 10915 consensus_queue.cc:237] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:32.580269  5500 catalog_manager.cc:5697] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 13 to 14, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 14 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:32.721350  5675 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:32.733230 10868 raft_consensus.cc:993] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:32.733989 10868 raft_consensus.cc:1081] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:32.736132  5672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35876
I20260709 12:15:32.736835  5672 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.737869  5672 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:32.745398 10913 raft_consensus.cc:993] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:32.747658 10866 raft_consensus.cc:1081] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
W20260709 12:15:32.760797  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 43912.1us
I20260709 12:15:32.761878  5672 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:32.770665  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 55800.4us
I20260709 12:15:32.774667  5672 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:32.806200  5745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:15:32.806761  5745 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.807114  5745 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:32.807464  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:32.808033  5602 raft_consensus.cc:3055] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:32.808307  5602 raft_consensus.cc:740] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:32.809007  5602 consensus_queue.cc:260] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:32.811182  5596 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:32.813395 10940 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:32.813709  5745 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:32.815019  5602 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:32.816754  5596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:32.817062  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:32.818069  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e96a5089046e0ac15a436ca7377c5" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:32.825358  5596 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:32.825379  5672 raft_consensus.cc:3055] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:32.829587  5672 raft_consensus.cc:740] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:32.830482  5672 consensus_queue.cc:260] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:32.831532  5672 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:32.819018  5745 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:32.825969  5747 raft_consensus.cc:3060] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:32.835362  5645 consensus_peers.cc:597] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a74f8f1596b645eead550bee5422dee3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:32.843618  5745 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:32.848165  5672 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:32.854725  5718 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:32.855696 10865 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:32.856896 10865 raft_consensus.cc:697] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:32.857801 10865 consensus_queue.cc:237] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:32.850559  5747 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:32.862217  5602 raft_consensus.cc:2468] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:32.863530  5642 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:32.864184  5596 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:32.864555 10936 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:32.881086 10936 raft_consensus.cc:2804] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:32.899905 10936 raft_consensus.cc:697] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:32.901678 10936 consensus_queue.cc:237] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:32.900789 10913 raft_consensus.cc:2955] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:32.928848  5500 catalog_manager.cc:5697] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 10 to 11, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:32.937476  5744 raft_consensus.cc:2955] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:32.941016  5600 raft_consensus.cc:2955] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:32.979580  5500 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:32.999608  5600 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:33.010653 10923 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:15:33.011314  5497 catalog_manager.cc:5697] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 12 to 13, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.060360  5744 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:15:33.105191  5719 consensus_peers.cc:597] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 603cb46af0854d75be95bd9fc4acf254. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:33.106374  5675 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:33.107699 10860 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:33.108721  5675 raft_consensus.cc:1275] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:33.110183 10841 consensus_queue.cc:1048] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:33.114588  5598 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:33.116918 10860 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:33.183684 10865 raft_consensus.cc:2955] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:33.190941  5672 raft_consensus.cc:2955] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:33.202505  5671 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:33.207631  5497 catalog_manager.cc:5697] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 12 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.222925  5600 raft_consensus.cc:2955] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:15:33.249150  5645 consensus_peers.cc:597] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1010069429f44409ec1f93cc97f31bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:33.250568  5744 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:15:33.253983 10940 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:33.267220  5598 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:15:33.269440 10940 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:33.274554 10957 ts_tablet_manager.cc:933] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:33.279471  5600 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:33.282500 10905 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:33.323161 10936 raft_consensus.cc:2955] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:33.336957  5747 raft_consensus.cc:2955] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:33.354357  5672 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:33.359545 10905 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:33.365993 10957 tablet_copy_client.cc:323] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:15:33.369498  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet a74f8f1596b645eead550bee5422dee3 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:15:33.370218  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet a74f8f1596b645eead550bee5422dee3 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-a74f8f1596b645eead550bee5422dee3
I20260709 12:15:33.378880  5689 tablet_copy_source_session.cc:215] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:33.382555 10957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a74f8f1596b645eead550bee5422dee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.382091  5744 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:33.394722  5596 raft_consensus.cc:2955] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:33.409662 10957 tablet_copy_client.cc:806] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:33.410444 10957 tablet_copy_client.cc:670] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:33.414456  5598 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:33.417778 10940 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:33.425441 10957 tablet_copy_client.cc:538] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:33.446859 10957 tablet_bootstrap.cc:492] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:15:33.460839  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:33.501968  5752 raft_consensus.cc:1275] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:33.596746  5497 catalog_manager.cc:5697] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 8, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 15 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:33.619218  5744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "237f59937cc841be8b427e269f4581ae"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:33.622994  5744 raft_consensus.cc:606] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
W20260709 12:15:33.664418  5719 consensus_peers.cc:597] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a6905b9f5774928a465ac1a443f56a4. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:33.664271 10963 log.cc:927] Time spent T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:15:33.678856  5672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f894158ba41541198a905d0e18553078"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:33.684306  5672 raft_consensus.cc:606] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
W20260709 12:15:33.680917  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 166546us
I20260709 12:15:33.595850 10940 consensus_queue.cc:1048] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:15:33.707340  5672 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:33.707756  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:33.738171  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:33.739214  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:33.776630  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 54235us
I20260709 12:15:33.777200 10981 ts_tablet_manager.cc:933] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:33.779232  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 52311.2us
I20260709 12:15:33.722162 10969 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:15:33.825361  5598 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:15:33.830446  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 99695.1us
W20260709 12:15:33.872905  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 151216us
W20260709 12:15:33.887375  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 94131.7us
I20260709 12:15:33.895771 10981 tablet_copy_client.cc:323] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:15:33.896469 10983 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:15:33.976413 10975 raft_consensus.cc:993] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:33.977581 10975 raft_consensus.cc:1081] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
W20260709 12:15:34.010807  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 126438us
W20260709 12:15:34.012724  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 124370us
I20260709 12:15:34.015995  5604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "237f59937cc841be8b427e269f4581ae"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:15:34.016721  5604 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:34.017105  5604 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:34.028402  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet 603cb46af0854d75be95bd9fc4acf254 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:15:34.029060  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet 603cb46af0854d75be95bd9fc4acf254 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-603cb46af0854d75be95bd9fc4acf254
W20260709 12:15:34.043251  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 165614us
I20260709 12:15:34.053861 10999 raft_consensus.cc:993] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:34.054684 10940 raft_consensus.cc:1081] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:34.074234  5744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f894158ba41541198a905d0e18553078"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44966
I20260709 12:15:34.074803  5744 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:34.087031  5744 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:34.092939  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 45186.4us
I20260709 12:15:34.093453  5604 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:34.095342  5604 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:34.099191  5763 tablet_copy_source_session.cc:215] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:34.104377  5744 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:34.115983 10981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603cb46af0854d75be95bd9fc4acf254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.118692  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:34.119316  5671 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:34.131693 11003 ts_tablet_manager.cc:933] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:34.146510  5671 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
I20260709 12:15:34.149190  5675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:34.149710  5675 raft_consensus.cc:3055] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:34.150007  5675 raft_consensus.cc:740] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:34.150514  5675 consensus_queue.cc:260] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:34.151234  5675 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:34.164242  5675 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:34.173916 10983 raft_consensus.cc:2955] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:34.180408  5718 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:34.182680  5675 raft_consensus.cc:2955] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:15:34.178933 10957 log.cc:927] Time spent T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: Append to log took a long time: real 0.053s	user 0.002s	sys 0.001s
I20260709 12:15:34.188539  5569 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:34.198554  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:34.198814 10992 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:34.199623  5748 raft_consensus.cc:3055] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:34.199995  5748 raft_consensus.cc:740] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:34.204512 10989 raft_consensus.cc:2804] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:34.225236 10989 raft_consensus.cc:697] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:34.226646 10989 consensus_queue.cc:237] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:34.215724 10992 raft_consensus.cc:697] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:34.230773 10992 consensus_queue.cc:237] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:34.209882  5748 consensus_queue.cc:260] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:34.235034  5748 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:34.239054  5744 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:34.247200  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f894158ba41541198a905d0e18553078" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:34.247835  6321 raft_consensus.cc:3060] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:34.270128  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 83169.4us
I20260709 12:15:34.300465  6321 raft_consensus.cc:2468] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:34.305707 11003 tablet_copy_client.cc:323] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:15:34.306849  5748 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 8.
W20260709 12:15:34.317389  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.320472  5598 raft_consensus.cc:2955] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:34.345948  5596 raft_consensus.cc:1240] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Rejecting Update request from peer 831d76c5ee1045f0af923ce24fa4c301 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:34.364403  5494 catalog_manager.cc:5697] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 7 to 8, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 8 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:34.368264  5497 catalog_manager.cc:5697] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 13 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:34.378858 10981 tablet_copy_client.cc:806] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:34.379509 10981 tablet_copy_client.cc:670] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:34.380218  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet d1010069429f44409ec1f93cc97f31bc from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:15:34.380775  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet d1010069429f44409ec1f93cc97f31bc from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-d1010069429f44409ec1f93cc97f31bc
I20260709 12:15:34.405318 10957 tablet_bootstrap.cc:492] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:34.408574  5689 tablet_copy_source_session.cc:215] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:34.412334 11003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1010069429f44409ec1f93cc97f31bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.419776 11012 ts_tablet_manager.cc:933] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:34.466372 10957 tablet_bootstrap.cc:492] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:15:34.466630 11012 tablet_copy_client.cc:323] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:15:34.467306 10957 ts_tablet_manager.cc:1403] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 1.021s	user 0.033s	sys 0.020s
I20260709 12:15:34.468142 10981 tablet_copy_client.cc:538] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:34.478722 10957 raft_consensus.cc:359] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:34.480120 10957 raft_consensus.cc:740] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:15:34.490145 10957 consensus_queue.cc:260] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:34.499571 10957 ts_tablet_manager.cc:1434] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.032s	user 0.001s	sys 0.006s
I20260709 12:15:34.501009  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet 8a6905b9f5774928a465ac1a443f56a4 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:15:34.501660  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet 8a6905b9f5774928a465ac1a443f56a4 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-8a6905b9f5774928a465ac1a443f56a4
I20260709 12:15:34.511673  5763 tablet_copy_source_session.cc:215] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:34.516022 10981 tablet_bootstrap.cc:492] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:15:34.518930  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-a74f8f1596b645eead550bee5422dee3 received from {username='slave'} at 127.0.0.1:50284
I20260709 12:15:34.519431  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-a74f8f1596b645eead550bee5422dee3 on tablet a74f8f1596b645eead550bee5422dee3 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:15:34.519445 11012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6905b9f5774928a465ac1a443f56a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.598372  5500 catalog_manager.cc:5697] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 11 to 12, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 12 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:34.622596 11003 tablet_copy_client.cc:806] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:34.623996 11003 tablet_copy_client.cc:670] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:34.658341 11003 tablet_copy_client.cc:538] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:34.668817 11003 tablet_bootstrap.cc:492] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:15:34.718818 11012 tablet_copy_client.cc:806] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:34.719913 11012 tablet_copy_client.cc:670] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:34.726912  6320 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:34.731801 10969 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:15:34.733202  5675 raft_consensus.cc:1275] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:34.754706 10985 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:34.784247 11012 tablet_copy_client.cc:538] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:34.800597  5744 raft_consensus.cc:1275] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:34.804473  5675 raft_consensus.cc:1275] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:34.808796 10977 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:34.809495 10969 consensus_queue.cc:1048] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:34.862234  6321 raft_consensus.cc:1217] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Deduplicated request from leader. Original: 13.10->[13.11-13.11]   Dedup: 13.11->[]
I20260709 12:15:34.868678 10981 tablet_bootstrap.cc:492] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:34.869700 10981 tablet_bootstrap.cc:492] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:15:34.870452 10981 ts_tablet_manager.cc:1403] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.355s	user 0.033s	sys 0.018s
I20260709 12:15:34.894069 11003 tablet_bootstrap.cc:492] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:34.895098 11003 tablet_bootstrap.cc:492] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:15:34.895865 11003 ts_tablet_manager.cc:1403] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.227s	user 0.036s	sys 0.018s
I20260709 12:15:34.938186 10981 raft_consensus.cc:359] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:34.939216 10981 raft_consensus.cc:740] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:15:34.939941 10981 consensus_queue.cc:260] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:34.941486 11012 tablet_bootstrap.cc:492] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:15:34.943192 10981 ts_tablet_manager.cc:1434] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.003s
I20260709 12:15:34.944936 11003 raft_consensus.cc:359] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:34.945587 11003 raft_consensus.cc:740] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:15:34.946233 11003 consensus_queue.cc:260] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:34.948776 11003 ts_tablet_manager.cc:1434] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 12:15:35.047173  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-603cb46af0854d75be95bd9fc4acf254 received from {username='slave'} at 127.0.0.1:40216
I20260709 12:15:35.048611  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-603cb46af0854d75be95bd9fc4acf254 on tablet 603cb46af0854d75be95bd9fc4acf254 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:15:35.052178  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:35.071516 11012 tablet_bootstrap.cc:700] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: Time spent opening tablet: real 0.120s	user 0.001s	sys 0.001s
I20260709 12:15:35.103749  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-d1010069429f44409ec1f93cc97f31bc received from {username='slave'} at 127.0.0.1:50284
I20260709 12:15:35.104465  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-d1010069429f44409ec1f93cc97f31bc on tablet d1010069429f44409ec1f93cc97f31bc with peer c02ed29558db481589fd3db23e43a07f
W20260709 12:15:35.146056  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 103378us
I20260709 12:15:35.395560  6321 raft_consensus.cc:1217] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 12:15:35.464285  6321 raft_consensus.cc:1217] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 LEARNER]: Deduplicated request from leader. Original: 15.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 12:15:35.472316 11012 tablet_bootstrap.cc:492] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:35.477183 11012 tablet_bootstrap.cc:492] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:15:35.481649 11012 ts_tablet_manager.cc:1403] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.540s	user 0.034s	sys 0.018s
I20260709 12:15:35.489027 10979 raft_consensus.cc:1064] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:35.497061 10979 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:35.522516 11012 raft_consensus.cc:359] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:35.523468 11012 raft_consensus.cc:740] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:15:35.524242 11012 consensus_queue.cc:260] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:35.532543 11012 ts_tablet_manager.cc:1434] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:15:35.533639  6320 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:35.535812  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-8a6905b9f5774928a465ac1a443f56a4 received from {username='slave'} at 127.0.0.1:40216
I20260709 12:15:35.536249  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-8a6905b9f5774928a465ac1a443f56a4 on tablet 8a6905b9f5774928a465ac1a443f56a4 with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:15:35.536628  5752 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:35.536240 11042 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:35.538599 11042 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:35.538820  5602 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:35.545063 10979 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:35.550733  5604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "237f59937cc841be8b427e269f4581ae"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:43420
I20260709 12:15:35.551517  5604 raft_consensus.cc:606] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:35.566792  5744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:35.567497  5744 raft_consensus.cc:606] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:15:35.568964  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:35.570982  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:35.581161 10999 raft_consensus.cc:2955] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:35.582770  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:35.587965  5744 raft_consensus.cc:2955] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:35.600982  6320 raft_consensus.cc:2955] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:35.629743  5604 raft_consensus.cc:2955] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:35.644562  5500 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 11 to 12, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:35.808382 10989 raft_consensus.cc:993] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:35.808975 10989 raft_consensus.cc:1081] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:35.831202  5672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35874
I20260709 12:15:35.831925  5672 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.832686  5672 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:35.843065  6321 raft_consensus.cc:1217] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Deduplicated request from leader. Original: 13.10->[13.11-13.11]   Dedup: 13.11->[]
I20260709 12:15:35.864087 10978 raft_consensus.cc:993] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:35.864635 10978 raft_consensus.cc:1081] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:35.887811 11030 raft_consensus.cc:1064] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:35.891103 11030 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:35.894662  5672 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:35.897061  5748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "237f59937cc841be8b427e269f4581ae"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44980
I20260709 12:15:35.897744  5748 raft_consensus.cc:493] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.898180  5748 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:35.906574  5672 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Requested vote from peers 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:35.908318  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:35.909027  5747 raft_consensus.cc:3055] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:35.909332  5747 raft_consensus.cc:740] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:35.909643  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:35.910239  6321 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:35.910131  5747 consensus_queue.cc:260] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:35.911317  5747 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:35.919355  5748 raft_consensus.cc:515] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:35.930649  6321 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:35.937875  5747 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 10.
I20260709 12:15:35.939055  5645 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:35.951349  5748 leader_election.cc:290] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:35.956318  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:35.953405  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237f59937cc841be8b427e269f4581ae" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:35.958482  5602 raft_consensus.cc:3055] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:35.958803  5602 raft_consensus.cc:740] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:35.961391  5672 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:35.960764  5602 consensus_queue.cc:260] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:35.964443 11032 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:35.964998 11032 raft_consensus.cc:697] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:35.965987 11032 consensus_queue.cc:237] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:35.970728  5675 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:35.970878  5672 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:15:35.972640  5718 leader_election.cc:304] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:35.972628 10969 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:35.974915  5602 raft_consensus.cc:3060] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:35.975951  6321 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:35.988262 10990 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:15:35.989102 11042 raft_consensus.cc:1064] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:35.991853 11042 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 6, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:35.999082  5602 raft_consensus.cc:2468] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 9.
I20260709 12:15:36.003265 11039 raft_consensus.cc:2804] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:36.003866 11039 raft_consensus.cc:697] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:36.004778 11039 consensus_queue.cc:237] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:36.020503  5604 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:36.032173 10990 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:15:36.074514  6321 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:36.076257 11042 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:36.077034  5602 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:36.078383  5747 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:36.079145 11031 raft_consensus.cc:2955] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.080976  5675 raft_consensus.cc:2955] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.086042 11032 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:36.088929 10866 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:36.157696  5675 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:36.158443  5600 raft_consensus.cc:2955] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.173488  5748 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:36.175853  6327 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:36.178095 10913 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:36.181318 10979 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:36.187791 10979 raft_consensus.cc:2955] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index 8 to 9, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.228346  5747 raft_consensus.cc:2955] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.210129  5500 catalog_manager.cc:5697] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:36.241317  5604 raft_consensus.cc:2955] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.245249  5500 catalog_manager.cc:5697] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 8 to 9, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:36.227428  6321 raft_consensus.cc:2955] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.264247 11031 raft_consensus.cc:1064] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:36.267338 11031 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:36.270287 10866 raft_consensus.cc:2955] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.275935  5747 raft_consensus.cc:2955] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.304682  6322 raft_consensus.cc:2955] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.305632  6320 raft_consensus.cc:2955] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.309486  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a74f8f1596b645eead550bee5422dee3 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:36.340443  5604 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:36.340757  5672 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:36.341993 11031 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:36.342876 11030 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:36.345131  5497 catalog_manager.cc:5697] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 9 to 10, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 10 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.351941  5747 consensus_queue.cc:237] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:36.362521  5602 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:36.364298 10969 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:36.371914 10990 raft_consensus.cc:2955] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.373391  5602 raft_consensus.cc:2955] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.340333  6322 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:36.395170  6322 raft_consensus.cc:1275] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:36.396821 11039 raft_consensus.cc:2955] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.418035  5501 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 12 to 13, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.423727  6322 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:36.425191 10866 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:36.425611  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 603cb46af0854d75be95bd9fc4acf254 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:36.428490  5672 raft_consensus.cc:2955] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.434895  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet a74f8f1596b645eead550bee5422dee3 with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:43404
I20260709 12:15:36.442165 10969 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:36.447492 10969 consensus_queue.cc:1048] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:36.453464  5495 catalog_manager.cc:5697] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 10 to 11, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 12 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.455603  5495 catalog_manager.cc:5697] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 8 to 9, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.460469 11069 tablet_replica.cc:333] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:36.461580  5602 raft_consensus.cc:2955] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.462831 11069 raft_consensus.cc:2243] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.489815  6321 raft_consensus.cc:2955] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.575407 11069 raft_consensus.cc:2272] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.580971  6320 raft_consensus.cc:2955] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.603868  5673 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:36.610344  5602 raft_consensus.cc:1275] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:36.619761 11069 ts_tablet_manager.cc:1916] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:36.621352 10989 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:36.639206  5673 raft_consensus.cc:1275] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:36.648109  5500 catalog_manager.cc:5697] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 11 to 12, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.671389 11031 consensus_queue.cc:1048] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 12:15:36.686697  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 63864.1us
I20260709 12:15:36.699397  5748 raft_consensus.cc:1275] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:36.703001  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet 603cb46af0854d75be95bd9fc4acf254 with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:59220
W20260709 12:15:36.701977  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 45199.1us
I20260709 12:15:36.704727  5748 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:36.733644 10979 consensus_queue.cc:1048] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:15:36.752363  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 112591us
I20260709 12:15:36.764560 11042 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:15:36.774595  6321 raft_consensus.cc:1275] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:36.802743 11086 tablet_replica.cc:333] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:15:36.814836 11069 ts_tablet_manager.cc:1929] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.12
I20260709 12:15:36.815515 11069 log.cc:1199] T a74f8f1596b645eead550bee5422dee3 P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/a74f8f1596b645eead550bee5422dee3
I20260709 12:15:36.821787 11086 raft_consensus.cc:2243] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.834300 10979 consensus_queue.cc:1048] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:36.838088 11086 raft_consensus.cc:2272] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.852520  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet a74f8f1596b645eead550bee5422dee3 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:15:36.856434 11042 raft_consensus.cc:2955] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.859165  5752 raft_consensus.cc:2955] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.867549  6324 raft_consensus.cc:2955] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:36.878715 11086 ts_tablet_manager.cc:1916] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:36.908499  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1010069429f44409ec1f93cc97f31bc with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:36.941298  5497 catalog_manager.cc:5697] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 9 to 10, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 15 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:37.016371 11086 ts_tablet_manager.cc:1929] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:15:37.016878 11086 log.cc:1199] T 603cb46af0854d75be95bd9fc4acf254 P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/603cb46af0854d75be95bd9fc4acf254
I20260709 12:15:37.018891  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet 603cb46af0854d75be95bd9fc4acf254 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:15:37.039984  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet d1010069429f44409ec1f93cc97f31bc with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:43404
I20260709 12:15:37.040994 11069 tablet_replica.cc:333] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:37.042064 11069 raft_consensus.cc:2243] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:37.042793 11069 raft_consensus.cc:2272] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.056638 11069 ts_tablet_manager.cc:1916] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:37.073995  5748 consensus_queue.cc:237] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:37.079020  5604 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:37.079020  6322 raft_consensus.cc:1275] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:37.081679 11030 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:37.089453 10969 raft_consensus.cc:2955] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:37.099889  6324 raft_consensus.cc:2955] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:37.117066 11030 consensus_queue.cc:1048] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:37.128901  5604 raft_consensus.cc:2955] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 12 to 13, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:37.153110  5497 catalog_manager.cc:5697] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 12 to 13, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 13 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:37.153914  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8a6905b9f5774928a465ac1a443f56a4 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:37.174528 11069 ts_tablet_manager.cc:1929] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 12:15:37.175061 11069 log.cc:1199] T d1010069429f44409ec1f93cc97f31bc P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/d1010069429f44409ec1f93cc97f31bc
I20260709 12:15:37.176373  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet d1010069429f44409ec1f93cc97f31bc (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:15:37.189905  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a6905b9f5774928a465ac1a443f56a4 with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:59220
I20260709 12:15:37.190976 11086 tablet_replica.cc:333] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:15:37.192040 11086 raft_consensus.cc:2243] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:37.192843 11086 raft_consensus.cc:2272] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.197359 11086 ts_tablet_manager.cc:1916] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:37.240954 11086 ts_tablet_manager.cc:1929] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.12
I20260709 12:15:37.241743 11086 log.cc:1199] T 8a6905b9f5774928a465ac1a443f56a4 P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/8a6905b9f5774928a465ac1a443f56a4
I20260709 12:15:37.247910  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet 8a6905b9f5774928a465ac1a443f56a4 (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:15:37.253902  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:37.374267  5748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:37.374917  5748 raft_consensus.cc:606] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Received request to transfer leadership to TS b3083333af3348e4938f905ca4c4819f
I20260709 12:15:37.383701  5671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:37.384414  5671 raft_consensus.cc:606] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:15:37.386173  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:37.387835  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:37.388576  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:37.405320 10969 raft_consensus.cc:993] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:37.405915 11074 raft_consensus.cc:1081] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Signalling peer b3083333af3348e4938f905ca4c4819f to start an election
I20260709 12:15:37.408277  5604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
 from {username='slave'} at 127.0.0.1:51914
I20260709 12:15:37.408828  5604 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:37.409216  5604 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:37.421455  5604 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:37.439309  5604 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:37.440768  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:37.441738  5671 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:37.446409  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "b3083333af3348e4938f905ca4c4819f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:37.447001  5748 raft_consensus.cc:3055] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:37.447288  5748 raft_consensus.cc:740] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:37.448117  5748 consensus_queue.cc:260] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:37.449306  5748 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:37.457581  5671 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:37.472771  5748 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3083333af3348e4938f905ca4c4819f in term 12.
I20260709 12:15:37.478381  5569 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:37.479262 11076 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:37.479750 11076 raft_consensus.cc:697] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Becoming Leader. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:37.480563 11076 consensus_queue.cc:237] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:37.503178  5497 catalog_manager.cc:5697] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f reported cstate change: term changed from 11 to 12, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to b3083333af3348e4938f905ca4c4819f (127.4.78.65). New cstate: current_term: 12 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.651433 11042 raft_consensus.cc:993] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:37.651955 10866 raft_consensus.cc:1081] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:37.654172  6322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58720
I20260709 12:15:37.654765  6322 raft_consensus.cc:493] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:37.655095  6322 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:37.661718  6322 raft_consensus.cc:515] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:37.664708  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:37.665302  5671 raft_consensus.cc:3055] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:37.665586  5671 raft_consensus.cc:740] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:37.666455  5671 consensus_queue.cc:260] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:37.669507  5671 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:37.671372  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ac98436c3f4e54af415eb568349c1e" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:37.671839  6322 leader_election.cc:290] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:37.679463  5748 raft_consensus.cc:3060] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:37.702690  5748 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:37.705708  5671 raft_consensus.cc:2468] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:37.706822  6291 leader_election.cc:304] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:37.707561 11087 raft_consensus.cc:2804] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:37.708045 11087 raft_consensus.cc:697] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:37.708887 11087 consensus_queue.cc:237] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:37.760268  5497 catalog_manager.cc:5697] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 11 to 12, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 12 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:37.889305  5671 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:37.893814 11072 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:37.967799  5752 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:37.969215 11080 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:38.321560  5747 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:38.323029 11048 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:38.337132  5671 raft_consensus.cc:1275] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:38.339196 11048 consensus_queue.cc:1048] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:38.454355  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:38.462051 11102 log.cc:927] Time spent T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.087s	user 0.006s	sys 0.000s
I20260709 12:15:38.518679  5604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89"
dest_uuid: "b3083333af3348e4938f905ca4c4819f"
mode: GRACEFUL
new_leader_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:43420
I20260709 12:15:38.519260  5604 raft_consensus.cc:606] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Received request to transfer leadership to TS 831d76c5ee1045f0af923ce24fa4c301
I20260709 12:15:38.524689  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:15:38.525959  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:38.526775  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:38.543826  5604 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:38.573477  5673 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:38.576850  5748 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:38.579479 11076 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:38.581368 11076 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:38.606602  5570 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33c7eafd1e29492c92176daf22bdbbeb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:38.623890 11076 raft_consensus.cc:2955] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:38.626766  5671 raft_consensus.cc:2955] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:38.647825  5673 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:38.649837  5748 raft_consensus.cc:2955] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:38.655748  5500 catalog_manager.cc:5697] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 14 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.673625  5604 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:38.675177 10866 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:38.678910  5645 consensus_peers.cc:597] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e837d59ef1c7437eb44f1563f56086ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:38.680686  5748 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:38.687881 10866 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:38.750952 10866 raft_consensus.cc:2955] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:38.752707  5604 raft_consensus.cc:2955] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:38.767655  5752 consensus_queue.cc:237] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:38.777413  5497 catalog_manager.cc:5697] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:38.788975  5748 raft_consensus.cc:2955] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:15:38.820688  5719 consensus_peers.cc:597] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af458034860a4f2b8eed91cd35b5b30f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:38.831832  5604 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:15:38.837069 11073 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:38.844102  5673 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:15:38.846930 11030 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:38.870446 11072 raft_consensus.cc:993] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f: : Instructing follower 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:38.870926 11072 raft_consensus.cc:1081] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Signalling peer 831d76c5ee1045f0af923ce24fa4c301 to start an election
I20260709 12:15:38.873449  5752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
 from {username='slave'} at 127.0.0.1:44980
I20260709 12:15:38.874054  5752 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:38.874402  5752 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:38.881788 11073 raft_consensus.cc:2955] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:38.884899  5752 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:38.885993  5602 raft_consensus.cc:2955] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:38.887619  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:38.888195  5604 raft_consensus.cc:3055] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:38.888504  5604 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3083333af3348e4938f905ca4c4819f, State: Running, Role: LEADER
I20260709 12:15:38.889225  5604 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:38.890249  5604 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:38.900399  5494 catalog_manager.cc:5697] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index -1 to 7, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.915006  5604 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:15:38.918373  5716 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:38.923846 11030 raft_consensus.cc:2804] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:38.924355 11030 raft_consensus.cc:697] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:38.924583  5673 raft_consensus.cc:2955] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:38.927532  5671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706e5d138a9043668703dd0c4b4ffd89" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:38.928121  5671 raft_consensus.cc:3060] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:38.928670  5748 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:38.925192 11030 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:38.934875  5671 raft_consensus.cc:2468] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 10.
I20260709 12:15:38.936450  5752 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:15:38.980994  5719 consensus_peers.cc:597] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dabde4847e7648aeb6347e38342d8c3f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:38.987808  5673 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:38.990878  5604 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:38.990321  5494 catalog_manager.cc:5697] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 9 to 10, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 10 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:39.005978 11094 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:39.012144 11125 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:39.028870 11125 raft_consensus.cc:2955] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:39.033104  5673 raft_consensus.cc:2955] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:39.050889  5604 raft_consensus.cc:2955] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:39.078023  5494 catalog_manager.cc:5697] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 11, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 15 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:39.119277 11132 ts_tablet_manager.cc:933] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715)
I20260709 12:15:39.141888 11132 tablet_copy_client.cc:323] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.65:38715
I20260709 12:15:39.148551  5614 tablet_copy_service.cc:140] P b3083333af3348e4938f905ca4c4819f: Received BeginTabletCopySession request for tablet 33c7eafd1e29492c92176daf22bdbbeb from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:34012)
I20260709 12:15:39.149183  5614 tablet_copy_service.cc:161] P b3083333af3348e4938f905ca4c4819f: Beginning new tablet copy session on tablet 33c7eafd1e29492c92176daf22bdbbeb from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:34012: session id = c02ed29558db481589fd3db23e43a07f-33c7eafd1e29492c92176daf22bdbbeb
I20260709 12:15:39.165537  5614 tablet_copy_source_session.cc:215] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:39.172597 11132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c7eafd1e29492c92176daf22bdbbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:39.207804 11132 tablet_copy_client.cc:806] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:39.208484 11132 tablet_copy_client.cc:670] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:39.212598 11132 tablet_copy_client.cc:538] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:39.252775 11132 tablet_bootstrap.cc:492] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:15:39.260051 11135 ts_tablet_manager.cc:933] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:39.280221 11135 tablet_copy_client.cc:323] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:15:39.281978  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet af458034860a4f2b8eed91cd35b5b30f from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:15:39.282516  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet af458034860a4f2b8eed91cd35b5b30f from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-af458034860a4f2b8eed91cd35b5b30f
I20260709 12:15:39.296941  5763 tablet_copy_source_session.cc:215] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:39.305162 11135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af458034860a4f2b8eed91cd35b5b30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:39.300323 11134 ts_tablet_manager.cc:933] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:39.339327 11135 tablet_copy_client.cc:806] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:39.347574 11134 tablet_copy_client.cc:323] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.66:33011
I20260709 12:15:39.349259  5689 tablet_copy_service.cc:140] P a54957145d9647cb89f46531d107120c: Received BeginTabletCopySession request for tablet e837d59ef1c7437eb44f1563f56086ad from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:50284)
I20260709 12:15:39.349730  5689 tablet_copy_service.cc:161] P a54957145d9647cb89f46531d107120c: Beginning new tablet copy session on tablet e837d59ef1c7437eb44f1563f56086ad from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:50284: session id = c02ed29558db481589fd3db23e43a07f-e837d59ef1c7437eb44f1563f56086ad
I20260709 12:15:39.358217  5689 tablet_copy_source_session.cc:215] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:39.361495 11134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e837d59ef1c7437eb44f1563f56086ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:39.340147 11135 tablet_copy_client.cc:670] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:39.368041 11135 tablet_copy_client.cc:538] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:39.377031 11135 tablet_bootstrap.cc:492] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:15:39.394492  5673 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:39.405440 11094 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:39.415343 11134 tablet_copy_client.cc:806] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:39.417932 11134 tablet_copy_client.cc:670] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:39.423957 11134 tablet_copy_client.cc:538] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:39.433370 11132 tablet_bootstrap.cc:492] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:39.433588 11134 tablet_bootstrap.cc:492] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:15:39.434387 11132 tablet_bootstrap.cc:492] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:15:39.454493 11132 ts_tablet_manager.cc:1403] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.202s	user 0.033s	sys 0.012s
I20260709 12:15:39.469106 11132 raft_consensus.cc:359] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:39.469993 11132 raft_consensus.cc:740] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:15:39.478127 11132 consensus_queue.cc:260] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:39.486186 11132 ts_tablet_manager.cc:1434] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 12:15:39.490237 11139 ts_tablet_manager.cc:933] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:39.525622  5598 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:39.532254 11073 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:39.592056 11139 tablet_copy_client.cc:323] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:15:39.598513  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:39.599911  5614 tablet_copy_service.cc:342] P b3083333af3348e4938f905ca4c4819f: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-33c7eafd1e29492c92176daf22bdbbeb received from {username='slave'} at 127.0.0.1:34012
I20260709 12:15:39.600415  5614 tablet_copy_service.cc:434] P b3083333af3348e4938f905ca4c4819f: ending tablet copy session c02ed29558db481589fd3db23e43a07f-33c7eafd1e29492c92176daf22bdbbeb on tablet 33c7eafd1e29492c92176daf22bdbbeb with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:15:39.608960  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet dabde4847e7648aeb6347e38342d8c3f from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:15:39.609529  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet dabde4847e7648aeb6347e38342d8c3f from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-dabde4847e7648aeb6347e38342d8c3f
I20260709 12:15:39.655828  5763 tablet_copy_source_session.cc:215] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:15:39.706537  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 59868us
W20260709 12:15:39.708498  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 84523.1us
I20260709 12:15:39.724964  6321 raft_consensus.cc:1217] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 12:15:39.738767 11135 tablet_bootstrap.cc:492] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:39.739715 11135 tablet_bootstrap.cc:492] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:15:39.740939 11135 ts_tablet_manager.cc:1403] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.364s	user 0.026s	sys 0.015s
I20260709 12:15:39.751224 11135 raft_consensus.cc:359] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:39.752121 11135 raft_consensus.cc:740] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:15:39.752812 11135 consensus_queue.cc:260] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:39.756191 11135 ts_tablet_manager.cc:1434] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 12:15:39.759009 11139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabde4847e7648aeb6347e38342d8c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:39.767051  5748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f"
dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
mode: GRACEFUL
new_leader_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:59380
I20260709 12:15:39.767678  5748 raft_consensus.cc:606] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 15 LEADER]: Received request to transfer leadership to TS a54957145d9647cb89f46531d107120c
I20260709 12:15:39.771812  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:15:39.773427  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:39.774192  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:39.781486  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-af458034860a4f2b8eed91cd35b5b30f received from {username='slave'} at 127.0.0.1:40216
I20260709 12:15:39.782025  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-af458034860a4f2b8eed91cd35b5b30f on tablet af458034860a4f2b8eed91cd35b5b30f with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:15:39.830902 11139 tablet_copy_client.cc:806] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:39.831526 11139 tablet_copy_client.cc:670] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:39.861605 11139 tablet_copy_client.cc:538] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:39.862447 11134 tablet_bootstrap.cc:492] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=2 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:39.870288 11134 tablet_bootstrap.cc:492] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:15:39.878407 11134 ts_tablet_manager.cc:1403] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.445s	user 0.037s	sys 0.011s
I20260709 12:15:39.891120 11134 raft_consensus.cc:359] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:39.892004 11134 raft_consensus.cc:740] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:15:39.894133 11134 consensus_queue.cc:260] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:39.896581 11134 ts_tablet_manager.cc:1434] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:15:39.906714 11139 tablet_bootstrap.cc:492] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:15:39.907507  5689 tablet_copy_service.cc:342] P a54957145d9647cb89f46531d107120c: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-e837d59ef1c7437eb44f1563f56086ad received from {username='slave'} at 127.0.0.1:50284
I20260709 12:15:39.907931  5689 tablet_copy_service.cc:434] P a54957145d9647cb89f46531d107120c: ending tablet copy session c02ed29558db481589fd3db23e43a07f-e837d59ef1c7437eb44f1563f56086ad on tablet e837d59ef1c7437eb44f1563f56086ad with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:15:40.084403 11030 raft_consensus.cc:993] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: : Instructing follower a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:40.084923 11073 raft_consensus.cc:1081] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 15 LEADER]: Signalling peer a54957145d9647cb89f46531d107120c to start an election
I20260709 12:15:40.086789  5671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f"
dest_uuid: "a54957145d9647cb89f46531d107120c"
 from {username='slave'} at 127.0.0.1:35874
I20260709 12:15:40.087462  5671 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:40.087805  5671 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:40.090734 11139 tablet_bootstrap.cc:492] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:40.091591 11139 tablet_bootstrap.cc:492] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:15:40.092178 11139 ts_tablet_manager.cc:1403] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.186s	user 0.027s	sys 0.015s
I20260709 12:15:40.100149 11147 raft_consensus.cc:1064] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:40.101343 11139 raft_consensus.cc:359] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:40.110833 11139 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:15:40.102873 11147 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:40.108825  5671 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:40.114097 11139 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:40.118199 11139 ts_tablet_manager.cc:1434] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.006s
I20260709 12:15:40.120428  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-dabde4847e7648aeb6347e38342d8c3f received from {username='slave'} at 127.0.0.1:40216
I20260709 12:15:40.120909  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-dabde4847e7648aeb6347e38342d8c3f on tablet dabde4847e7648aeb6347e38342d8c3f with peer c02ed29558db481589fd3db23e43a07f
I20260709 12:15:40.133634  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "b3083333af3348e4938f905ca4c4819f"
I20260709 12:15:40.134249  5604 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:40.141217  5604 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 16.
I20260709 12:15:40.142658  5642 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f; no voters: 
I20260709 12:15:40.143558 10866 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:40.144019 10866 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 16 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:40.144826 10866 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:40.155906  5752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:40.156515  5752 raft_consensus.cc:3055] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:40.156800  5752 raft_consensus.cc:740] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:40.157584  5752 consensus_queue.cc:260] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:40.159343  5752 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:40.208454  5752 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 16.
I20260709 12:15:40.202265  5671 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:40.231865  5494 catalog_manager.cc:5697] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 15 to 16, leader changed from 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 16 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:40.302618 11156 log.cc:927] Time spent T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:15:40.326465  6321 raft_consensus.cc:1217] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 12:15:40.333478  6321 raft_consensus.cc:1217] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:15:40.353457  5752 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:40.355984 11166 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:40.365964  6321 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 LEARNER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:40.374818 11158 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:40.378849  5673 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:40.387140 11168 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:40.442597 11168 raft_consensus.cc:2955] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:40.456168  5673 raft_consensus.cc:2955] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:40.466115  5744 raft_consensus.cc:2955] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:40.470170  6320 raft_consensus.cc:2955] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:40.481887  5494 catalog_manager.cc:5697] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:40.523159  5604 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:40.540891  5672 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:40.541632  6320 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Refusing update from remote peer b3083333af3348e4938f905ca4c4819f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:40.542614 11167 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:40.550958 11167 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:40.559279  5672 raft_consensus.cc:2955] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:40.563831 11147 raft_consensus.cc:2955] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:40.580947  6324 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 15 LEARNER]: Advancing to term 16
I20260709 12:15:40.598830  6320 raft_consensus.cc:2955] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:40.637852  6324 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 16 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:40.641443 11042 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:40.653904  5497 catalog_manager.cc:5697] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 10 to 11, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 14 leader_uuid: "b3083333af3348e4938f905ca4c4819f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:40.659543  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 33c7eafd1e29492c92176daf22bdbbeb with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:40.677302  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet 33c7eafd1e29492c92176daf22bdbbeb with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:40108
I20260709 12:15:40.701553  5752 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:40.704038 11042 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:40.707716  5604 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:40.711468 11176 tablet_replica.cc:333] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:15:40.711596 11042 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:40.712623 11176 raft_consensus.cc:2243] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.713521 11176 raft_consensus.cc:2272] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.770211 11030 raft_consensus.cc:1064] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:40.795886 11030 consensus_queue.cc:237] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:40.802413  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 56467.5us
I20260709 12:15:40.803915 11042 raft_consensus.cc:1064] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
W20260709 12:15:40.804316 11042 raft_consensus.cc:1068] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: Unable to promote non-voter c02ed29558db481589fd3db23e43a07f: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:15:40.813057  5645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 78519.1us
I20260709 12:15:40.852258 11176 ts_tablet_manager.cc:1916] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:40.951714  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:40.972731  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 219004us
I20260709 12:15:40.994062  5673 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:40.995577 11130 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:41.005065 10866 raft_consensus.cc:1064] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:41.007311 10866 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:41.008241  5603 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:41.010221 11030 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:41.040608 11176 ts_tablet_manager.cc:1929] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 12:15:41.047438  6324 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:41.047804 11176 log.cc:1199] T 33c7eafd1e29492c92176daf22bdbbeb P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/33c7eafd1e29492c92176daf22bdbbeb
I20260709 12:15:41.046604 11030 raft_consensus.cc:2955] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.052505  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet 33c7eafd1e29492c92176daf22bdbbeb (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:15:41.054343  5673 raft_consensus.cc:2955] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.065042  5603 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:41.068830 10866 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:41.087321  6320 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:41.095423 11042 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:41.094007  5497 catalog_manager.cc:5697] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 7 to 8, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.105027 11073 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:15:41.132210  5603 raft_consensus.cc:2955] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.219038  5672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0"
dest_uuid: "a54957145d9647cb89f46531d107120c"
mode: GRACEFUL
new_leader_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:40398
I20260709 12:15:41.219718  5672 raft_consensus.cc:606] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Received request to transfer leadership to TS c02ed29558db481589fd3db23e43a07f
I20260709 12:15:41.221289  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 12:15:41.222962  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 131892us
I20260709 12:15:41.225492  5744 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:41.226822  6321 raft_consensus.cc:2955] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.223063  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:41.229461  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:41.246420 11178 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:15:41.288975 10866 raft_consensus.cc:1064] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:41.285334  5494 catalog_manager.cc:5697] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.291810 10866 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:41.223352 11184 raft_consensus.cc:2955] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.316326  6322 raft_consensus.cc:2955] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.328897  5744 raft_consensus.cc:2955] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.333177  6324 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 16 LEARNER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:41.338481 10866 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:41.345814  5748 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:41.346029  5604 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:41.352875 11042 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:41.360628 11153 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:15:41.398754 11178 raft_consensus.cc:2955] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 11 to 13, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.418709  6322 raft_consensus.cc:2955] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 11 to 13, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.421051  5602 raft_consensus.cc:2955] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } attrs { replace: true } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.446439  5672 consensus_queue.cc:237] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:41.490028  6320 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:15:41.489678 11199 log.cc:927] Time spent T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:15:41.490945  5500 catalog_manager.cc:5697] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 11 to 13, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.497540 11182 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:41.517498 10866 raft_consensus.cc:2955] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.526743  6322 raft_consensus.cc:2955] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:15:41.535113  5569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 74633.9us
I20260709 12:15:41.539731  5602 raft_consensus.cc:2955] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 11 to 13, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.556499  5744 raft_consensus.cc:2955] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 11 to 13, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:15:41.587137  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 79309.5us
I20260709 12:15:41.595686  5673 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:41.603510  6320 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:15:41.607335  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e837d59ef1c7437eb44f1563f56086ad with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:41.608168  5604 raft_consensus.cc:1275] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:41.608211 11184 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:15:41.627727 11184 consensus_queue.cc:1048] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:41.631888 11184 raft_consensus.cc:2955] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.636037  5744 raft_consensus.cc:1275] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:15:41.638769 11183 consensus_queue.cc:1048] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:15:41.642529  5602 raft_consensus.cc:2955] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.649583  5495 catalog_manager.cc:5697] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 10 to 11, VOTER 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67) evicted. New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.662467  6324 raft_consensus.cc:2955] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:15:41.683326  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 63328.1us
I20260709 12:15:41.712831  5744 raft_consensus.cc:2955] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.737998  5487 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dabde4847e7648aeb6347e38342d8c3f with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:15:41.737270  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 48629.8us
I20260709 12:15:41.753546  5741 tablet_service.cc:1558] Processing DeleteTablet for tablet e837d59ef1c7437eb44f1563f56086ad with delete_type TABLET_DATA_TOMBSTONED (TS 831d76c5ee1045f0af923ce24fa4c301 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:40108
W20260709 12:15:41.753715  6293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 55516.2us
I20260709 12:15:41.759297  5495 catalog_manager.cc:5697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 13 to 14, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 16 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.792014 10866 raft_consensus.cc:993] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: : Instructing follower c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:41.792508 10866 raft_consensus.cc:1081] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Signalling peer c02ed29558db481589fd3db23e43a07f to start an election
I20260709 12:15:41.810887  5592 tablet_service.cc:1558] Processing DeleteTablet for tablet dabde4847e7648aeb6347e38342d8c3f with delete_type TABLET_DATA_TOMBSTONED (TS b3083333af3348e4938f905ca4c4819f not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:43404
I20260709 12:15:41.814029  6324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0"
dest_uuid: "c02ed29558db481589fd3db23e43a07f"
 from {username='slave'} at 127.0.0.1:58720
I20260709 12:15:41.814739  6324 raft_consensus.cc:493] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:41.815055  6324 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:41.819729  5744 consensus_queue.cc:237] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:41.821982  6324 raft_consensus.cc:515] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:41.824709  5673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:41.825284  5673 raft_consensus.cc:3055] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:41.825595  5673 raft_consensus.cc:740] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:41.826510  6322 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:41.826397  5673 consensus_queue.cc:260] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:41.827486  5673 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:41.827971 11209 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:41.828449 11214 tablet_replica.cc:333] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:41.830026 11214 raft_consensus.cc:2243] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:41.831071 11214 raft_consensus.cc:2272] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:41.832629  5602 raft_consensus.cc:1275] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:41.835851 11209 raft_consensus.cc:2955] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.837412 11208 consensus_queue.cc:1048] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:41.839915  6321 raft_consensus.cc:2955] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.842530 11213 tablet_replica.cc:333] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:15:41.843690 11213 raft_consensus.cc:2243] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:41.835314 11214 ts_tablet_manager.cc:1916] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:41.835345  5673 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:15:41.845252  6293 leader_election.cc:304] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:41.846714 11212 raft_consensus.cc:2804] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:41.847204 11212 raft_consensus.cc:697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 15 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:41.848049 11212 consensus_queue.cc:237] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:41.839205  6324 leader_election.cc:290] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:41.850425  5604 raft_consensus.cc:2955] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.854918  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ad918df054a3080325a8ca6d4aed0" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:41.855593  5747 raft_consensus.cc:3060] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:41.875168  5747 raft_consensus.cc:2468] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:15:41.855142 11213 raft_consensus.cc:2272] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:41.898773  5500 catalog_manager.cc:5697] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f reported cstate change: config changed from index 8 to 9, VOTER a54957145d9647cb89f46531d107120c (127.4.78.66) evicted. New cstate: current_term: 9 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:41.900919 11213 ts_tablet_manager.cc:1916] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:41.908833  5495 catalog_manager.cc:5697] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 14 to 15, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 15 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:41.919680  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af458034860a4f2b8eed91cd35b5b30f with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:41.928570 11214 ts_tablet_manager.cc:1929] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 12:15:41.929136 11214 log.cc:1199] T dabde4847e7648aeb6347e38342d8c3f P b3083333af3348e4938f905ca4c4819f: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/wals/dabde4847e7648aeb6347e38342d8c3f
I20260709 12:15:41.930974  5485 catalog_manager.cc:5028] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): tablet dabde4847e7648aeb6347e38342d8c3f (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:15:41.937532  5663 tablet_service.cc:1558] Processing DeleteTablet for tablet af458034860a4f2b8eed91cd35b5b30f with delete_type TABLET_DATA_TOMBSTONED (TS a54957145d9647cb89f46531d107120c not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:59220
I20260709 12:15:41.951112 11216 tablet_replica.cc:333] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:15:41.952345 11216 raft_consensus.cc:2243] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:41.954157 11216 raft_consensus.cc:2272] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:41.964100 11216 ts_tablet_manager.cc:1916] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:41.972033 11213 ts_tablet_manager.cc:1929] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 12:15:41.972600 11213 log.cc:1199] T e837d59ef1c7437eb44f1563f56086ad P 831d76c5ee1045f0af923ce24fa4c301: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/wals/e837d59ef1c7437eb44f1563f56086ad
I20260709 12:15:41.974329  5485 catalog_manager.cc:5028] TS 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): tablet e837d59ef1c7437eb44f1563f56086ad (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:15:42.021509 11216 ts_tablet_manager.cc:1929] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 12:15:42.033746 11216 log.cc:1199] T af458034860a4f2b8eed91cd35b5b30f P a54957145d9647cb89f46531d107120c: Deleting WAL directory at /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/wals/af458034860a4f2b8eed91cd35b5b30f
I20260709 12:15:42.036458  5487 catalog_manager.cc:5028] TS a54957145d9647cb89f46531d107120c (127.4.78.66:33011): tablet af458034860a4f2b8eed91cd35b5b30f (table test-workload [id=2ca675ca795447e4a3909a514111745f]) successfully deleted
I20260709 12:15:42.320719  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:42.323853  5673 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:42.325752 11211 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:42.378423  5747 raft_consensus.cc:1275] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:42.380180 11088 consensus_queue.cc:1048] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:42.477293  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:42.478963  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:42.479647  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:42.528723  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 46113.7us
I20260709 12:15:42.539125  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:42.589200  4409 tablet_server.cc:179] TabletServer@127.4.78.65:0 shutting down...
W20260709 12:15:42.604910  5716 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:42.625422  5716 consensus_peers.cc:597] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.627795  6291 consensus_peers.cc:597] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.634692  5716 consensus_peers.cc:597] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.652078  5642 consensus_peers.cc:597] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.659081  6291 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.667697  5642 consensus_peers.cc:597] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.676357  5716 consensus_peers.cc:597] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.693485  5716 consensus_peers.cc:597] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.708387  6291 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.709192  6291 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.723285  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:15:42.727896  6291 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.728816  4409 tablet_replica.cc:333] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.730224  4409 raft_consensus.cc:2243] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.730989  4409 raft_consensus.cc:2272] T e25e2707f4a0454db308e33ed24bc75f P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.745975  4409 tablet_replica.cc:333] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.746855  4409 raft_consensus.cc:2243] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.747493  4409 raft_consensus.cc:2272] T 8a6905b9f5774928a465ac1a443f56a4 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.750165  4409 tablet_replica.cc:333] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.751005  4409 raft_consensus.cc:2243] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.752137  4409 raft_consensus.cc:2272] T 6cc3762193894e76b902a8405a8bd64f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:42.754851  5716 consensus_peers.cc:597] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.754931  4409 tablet_replica.cc:333] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.766650  4409 raft_consensus.cc:2243] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.767832  4409 raft_consensus.cc:2272] T 2fb6332de9984fc6a6f24ba3cfc5c947 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.770709  4409 tablet_replica.cc:333] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.771625  4409 raft_consensus.cc:2243] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.772321  4409 raft_consensus.cc:2272] T 08b7de4c4716494894a4643e09fb86f0 P b3083333af3348e4938f905ca4c4819f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.775208  4409 tablet_replica.cc:333] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.775988  4409 raft_consensus.cc:2243] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.776942  4409 raft_consensus.cc:2272] T 00b08ef158894418988e329c7d49ff9f P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.792332  4409 tablet_replica.cc:333] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.793241  4409 raft_consensus.cc:2243] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.793972  4409 raft_consensus.cc:2272] T 09cc490802a84093b74474b1decbb6a2 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:42.794682  5642 consensus_peers.cc:597] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.796294  6291 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.796852  4409 tablet_replica.cc:333] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.799463  4409 raft_consensus.cc:2243] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.800647  4409 raft_consensus.cc:2272] T 1fb3872bc132421d9b9adacd9cf89a22 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.805161  4409 tablet_replica.cc:333] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.812532  4409 raft_consensus.cc:2243] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.813297  4409 raft_consensus.cc:2272] T 60b8cda7467d4abb9e997bacb7d063ef P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.816421  4409 tablet_replica.cc:333] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.817791  4409 raft_consensus.cc:2243] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:42.807679  6291 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.826822  4409 raft_consensus.cc:2272] T 9eda5739d0e2404c9dd25b6ebf5f6060 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.829890  4409 tablet_replica.cc:333] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.830708  4409 raft_consensus.cc:2243] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:42.835351  6291 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.843189  4409 raft_consensus.cc:2272] T 0305464a3879473e825bbe12c2df9cd9 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:42.845649  5716 consensus_peers.cc:597] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.846215  4409 tablet_replica.cc:333] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.847103  4409 raft_consensus.cc:2243] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.847767  4409 raft_consensus.cc:2272] T 3877dfaf52344867b58b6fa860f49dcb P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.850651  4409 tablet_replica.cc:333] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.851497  4409 raft_consensus.cc:2243] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.852193  4409 raft_consensus.cc:2272] T 9f80dc3c97f640cc9ad6761e3aecfd36 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.855005  4409 tablet_replica.cc:333] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.866858  4409 raft_consensus.cc:2243] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.867475  4409 raft_consensus.cc:2272] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.869874  4409 tablet_replica.cc:333] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.870568  4409 raft_consensus.cc:2243] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.871663  4409 raft_consensus.cc:2272] T 33c7eafd1e29492c92176daf22bdbbeb P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.874131  4409 tablet_replica.cc:333] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.874881  4409 raft_consensus.cc:2243] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.875459  4409 raft_consensus.cc:2272] T af458034860a4f2b8eed91cd35b5b30f P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.877868  4409 tablet_replica.cc:333] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.878651  4409 raft_consensus.cc:2243] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.879221  4409 raft_consensus.cc:2272] T 5a65b178e0ee4e48a8e13521e3909d60 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:42.879777  5716 consensus_peers.cc:597] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.881831  4409 tablet_replica.cc:333] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.882609  4409 raft_consensus.cc:2243] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.883078  4409 raft_consensus.cc:2272] T 706e5d138a9043668703dd0c4b4ffd89 P b3083333af3348e4938f905ca4c4819f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.885489  4409 tablet_replica.cc:333] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.886237  4409 raft_consensus.cc:2243] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.886854  4409 raft_consensus.cc:2272] T 6be82dd3c64146fabe5214109a9563f0 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.889564  4409 tablet_replica.cc:333] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.890353  4409 raft_consensus.cc:2243] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.891026  4409 raft_consensus.cc:2272] T 25119dffb65d40f48346fb5615d100e5 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:42.893890  5642 consensus_peers.cc:597] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.894076  4409 tablet_replica.cc:333] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.894901  4409 raft_consensus.cc:2243] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.895449  4409 raft_consensus.cc:2272] T 237f59937cc841be8b427e269f4581ae P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.898487  4409 tablet_replica.cc:333] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.899241  4409 raft_consensus.cc:2243] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.899757  4409 raft_consensus.cc:2272] T 62908e35e9554ef2af86598ce28bcf21 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.902139  4409 tablet_replica.cc:333] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.903019  4409 raft_consensus.cc:2243] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.904017  4409 raft_consensus.cc:2272] T 67144d943ff44a2c85c35639ca4017fc P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.906445  4409 tablet_replica.cc:333] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.907145  4409 raft_consensus.cc:2243] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.908097  4409 raft_consensus.cc:2272] T 74092c83d74e4b2d92a17b981437ced6 P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.910494  4409 tablet_replica.cc:333] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.911219  4409 raft_consensus.cc:2243] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.911764  4409 raft_consensus.cc:2272] T b2ec4e9962d74fb9bbf294f2dc0911cf P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:42.912236  5642 consensus_peers.cc:597] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.914067  4409 tablet_replica.cc:333] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.914871  4409 raft_consensus.cc:2243] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.915465  4409 raft_consensus.cc:2272] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.918079  4409 tablet_replica.cc:333] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.918869  4409 raft_consensus.cc:2243] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.919620  4409 raft_consensus.cc:2272] T e837d59ef1c7437eb44f1563f56086ad P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:42.921593  6291 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.922055  4409 tablet_replica.cc:333] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.922887  4409 raft_consensus.cc:2243] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.923836  4409 raft_consensus.cc:2272] T 228ec6971a66439f85c6b6d788cf939c P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.928009  4409 tablet_replica.cc:333] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
W20260709 12:15:42.929564  6291 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.931080  5642 consensus_peers.cc:597] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.932487  5716 consensus_peers.cc:597] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.933161  4409 raft_consensus.cc:2243] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.934230  4409 raft_consensus.cc:2272] T e8638862e10a473ca889ec2b98a84132 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.937815  4409 tablet_replica.cc:333] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.938781  4409 raft_consensus.cc:2243] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.939810  4409 raft_consensus.cc:2272] T 45e8be48ea634f3a922604ba76b16e6a P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.942466  4409 tablet_replica.cc:333] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.943145  4409 raft_consensus.cc:2243] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.948197  4409 raft_consensus.cc:2272] T 75421a11c1284039a8a17196290f3c16 P b3083333af3348e4938f905ca4c4819f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.950968  4409 tablet_replica.cc:333] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.959447  4409 raft_consensus.cc:2243] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.963966  4409 raft_consensus.cc:2272] T 603cb46af0854d75be95bd9fc4acf254 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.966375  4409 tablet_replica.cc:333] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.967051  4409 raft_consensus.cc:2243] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.967720  4409 raft_consensus.cc:2272] T 1ba4203e7f7c4e46bd83c6bdda936a65 P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.970345  4409 tablet_replica.cc:333] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.971024  4409 raft_consensus.cc:2243] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.972033  4409 raft_consensus.cc:2272] T be69db606b5844b2ad9d8cdcd608216a P b3083333af3348e4938f905ca4c4819f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.974443  4409 tablet_replica.cc:333] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.975102  4409 raft_consensus.cc:2243] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.976114  4409 raft_consensus.cc:2272] T 3a5e338890f843678fd0689c8568ed9c P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.985085  4409 tablet_replica.cc:333] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.985860  4409 raft_consensus.cc:2243] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:42.986950  4409 raft_consensus.cc:2272] T 2645ab47c7304e87afd4e901bcd42fce P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:42.989605  4409 tablet_replica.cc:333] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:42.990350  4409 raft_consensus.cc:2243] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:42.996119  4409 raft_consensus.cc:2272] T ac5b12e3f8d847ddaa3bcba52b39ba9b P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:42.999375  5716 consensus_peers.cc:597] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.004829  4409 tablet_replica.cc:333] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:43.008634  4409 raft_consensus.cc:2243] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:43.009255  4409 raft_consensus.cc:2272] T 5a87e1fb9c364e85bc7c296e4c7b6642 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:43.011847  4409 tablet_replica.cc:333] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:43.012509  4409 raft_consensus.cc:2243] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:15:43.022636  5642 consensus_peers.cc:597] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.025214  4409 raft_consensus.cc:2272] T 8c29cd1d5fec4ed798574831b98a1c7f P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:43.028173  4409 tablet_replica.cc:333] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:43.028946  4409 raft_consensus.cc:2243] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:43.029178  5716 consensus_peers.cc:597] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.029577  4409 raft_consensus.cc:2272] T 1a4e96a5089046e0ac15a436ca7377c5 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:43.047608  4409 tablet_replica.cc:333] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:43.048401  4409 raft_consensus.cc:2243] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:43.049094  4409 raft_consensus.cc:2272] T e7972b9d3b424d0a82305768187e2573 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:43.051762  4409 tablet_replica.cc:333] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:43.052469  4409 raft_consensus.cc:2243] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:43.053030  4409 raft_consensus.cc:2272] T 7922e49f842f47c09c6aafbf9e70d646 P b3083333af3348e4938f905ca4c4819f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:43.055786  4409 tablet_replica.cc:333] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:43.056591  4409 raft_consensus.cc:2243] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:43.057307  4409 raft_consensus.cc:2272] T c895f37947b04f8c8b0f3a8ac1874b71 P b3083333af3348e4938f905ca4c4819f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:43.064067  6291 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.071331  4409 tablet_replica.cc:333] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:43.072180  4409 raft_consensus.cc:2243] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:43.073316  4409 raft_consensus.cc:2272] T 8ac03e19ba8d49feb196035d3b697b69 P b3083333af3348e4938f905ca4c4819f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:43.076143  4409 tablet_replica.cc:333] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f: stopping tablet replica
I20260709 12:15:43.076792  4409 raft_consensus.cc:2243] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:43.077592  4409 raft_consensus.cc:2272] T ba4aecf80db140ca828a80dc93220fba P b3083333af3348e4938f905ca4c4819f [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:43.082511  5716 consensus_peers.cc:597] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:43.141485  5716 consensus_peers.cc:597] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:43.287653  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 219544us
W20260709 12:15:43.321522  6291 connection.cc:769] client connection to 127.4.78.65:38715 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:15:43.502332  5642 connection.cc:769] client connection to 127.4.78.65:38715 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:15:43.684473  5744 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:15:43.713392  5719 consensus_peers.cc:597] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 706e5d138a9043668703dd0c4b4ffd89. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.714196 11207 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:43.714804 11207 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:43.720218 11207 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:43.721176  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
W20260709 12:15:43.723832  5716 leader_election.cc:336] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:43.723887  5672 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:43.724339  5716 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:43.726064 11236 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:43.726716 11236 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:15:43.743116  5716 consensus_peers.cc:597] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.787882 11207 raft_consensus.cc:2955] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:43.793519  5673 raft_consensus.cc:2955] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:43.815729  5495 catalog_manager.cc:5697] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 7, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 10 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:43.840588  5747 consensus_queue.cc:237] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
W20260709 12:15:43.874697  5719 consensus_peers.cc:597] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181): Couldn't send request to peer c02ed29558db481589fd3db23e43a07f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7972b9d3b424d0a82305768187e2573. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:43.888447  5716 consensus_peers.cc:597] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:44.202647  5672 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:44.241245 11229 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.242043 11229 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.244256 11229 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.315470 11243 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.342073 11229 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.342278 11243 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.342695 11229 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.337494 11228 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.344571 11229 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.345161 11229 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.345033 11228 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:44.345515  4409 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5625)
I20260709 12:15:44.340512 11250 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.344537 11243 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.347237 11228 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.347630 11250 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.350313 11250 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:44.351891  5495 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.011s
I20260709 12:15:44.345628 11229 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:44.355741  5495 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.003s	sys 0.011s
I20260709 12:15:44.357275 11245 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.340337 11248 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.360206 11248 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.360740  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:44.361456  5744 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:44.354943 11243 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.357863 11229 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.342028 11244 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.362385 11243 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.353154  5751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:44.363499  5751 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:44.362596 11244 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.364904 11243 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.365427 11245 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.366103 11244 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.366108 11248 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.367861  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:44.371440 11245 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.372334 11243 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:44.372701 11243 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.372994 11243 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.382727  5747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:44.383407  5747 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:44.395000 11253 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.395679 11253 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.397846 11253 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.402760 11243 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.403276 11254 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.413868 11243 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.407088 11255 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.420907 11255 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.423787 11255 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.408838 11253 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.410017 11257 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.413558 11254 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.438594 11253 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.438956 11257 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.440820 11254 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:44.441094 11257 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.444545 11248 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.445096 11248 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.445442  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:44.440836 11253 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:44.446125  6324 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:44.447165 11248 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:44.447515  5719 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.446316 11253 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.406890 11252 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.416909  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b08ef158894418988e329c7d49ff9f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:44.417253  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:44.419391  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:44.419900  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:44.449739 11207 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:44.498894 11207 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.499295 11207 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.451551  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:44.502576  6321 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:44.454490 11253 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.504940  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:44.469213  5748 raft_consensus.cc:3060] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.505673  5719 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.478948 11184 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:44.506698 11184 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.507078 11184 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:44.474660  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 54869.7us
I20260709 12:15:44.508587  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:44.509704 11244 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:44.462548 11247 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.510188 11244 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.474109  5746 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:44.510610 11244 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:44.510392 11247 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.513470 11247 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.470448  5753 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:44.492554 11233 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.516606 11233 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.518657  5748 raft_consensus.cc:2468] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:44.519537 11244 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.465401  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:44.520808  5670 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 14.
I20260709 12:15:44.518781 11263 ts_tablet_manager.cc:933] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.505869 11210 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.521996 11210 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.469300 11252 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.526962 11210 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.527125 11252 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.452731  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:44.529065  5749 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 11.
I20260709 12:15:44.520622 11236 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:44.529829 11236 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.530279 11236 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.530025  5670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:44.531937  5670 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:15:44.505571  5676 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:44.529661  6293 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.505573 11253 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.536638 11244 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.539188  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:44.539799  6322 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:44.491348 11248 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:15:44.543403 11211 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:44.543828 11211 raft_consensus.cc:493] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.544198 11211 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:44.518785 11233 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:44.488758 11235 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.552992  6293 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.556870 11236 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.550469 11235 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.567963 11184 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.569077 11235 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.569921 11262 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.570441  5719 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:15:44.574795  5642 leader_election.cc:336] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.575625 11263 tablet_copy_client.cc:323] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
I20260709 12:15:44.576759 11184 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:44.587225  5642 leader_election.cc:336] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.590569  5642 leader_election.cc:336] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.595649  5642 leader_election.cc:336] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.596338  5642 leader_election.cc:336] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.597448  5642 leader_election.cc:336] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.602348  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:44.614836  6322 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:15:44.603638  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:44.609928 11260 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:44.580937 11210 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.570477 11262 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.580099 11211 raft_consensus.cc:515] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:44.615113  5718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:33011, user_credentials={real_user=slave}} blocked reactor thread for 131432us
I20260709 12:15:44.615547  5749 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:44.617506  5719 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.573391 11259 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:44.615954  5642 leader_election.cc:336] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.618858  5642 leader_election.cc:336] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.619905 11264 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:44.620342 11264 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.620489 11236 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.621949  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:44.622490  6322 raft_consensus.cc:3060] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.589464 11207 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:15:44.619354  5642 leader_election.cc:336] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.625389  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb3872bc132421d9b9adacd9cf89a22" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:44.625561  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c" is_pre_election: true
I20260709 12:15:44.626165  5749 raft_consensus.cc:2393] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 13: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:44.626324  5672 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
I20260709 12:15:44.618209 11210 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.616777 11260 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.632524 11260 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:44.632835  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67144d943ff44a2c85c35639ca4017fc" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:44.633440  5745 raft_consensus.cc:3060] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:44.633606  6322 raft_consensus.cc:2468] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:15:44.620750 11264 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:44.635082 11262 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.636466 11211 leader_election.cc:290] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:44.637667  5672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:44.638352  5672 raft_consensus.cc:3060] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:44.639034  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:44.639441 11207 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.639647  6324 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
I20260709 12:15:44.644860  5745 raft_consensus.cc:2468] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:44.629464 11210 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.648038  5672 raft_consensus.cc:2468] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:15:44.652815  6293 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.619282 11259 raft_consensus.cc:493] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.649401  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be69db606b5844b2ad9d8cdcd608216a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:44.654495  6324 raft_consensus.cc:3060] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.649554  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:44.655405  6322 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 11.
I20260709 12:15:44.631486  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:44.650699 11264 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.657225  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:44.657783 11264 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.658483 11184 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:44.658874 11184 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.659277 11184 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:44.661552  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:44.662135 11259 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:44.661900  6324 raft_consensus.cc:2468] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:15:44.653662  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33c7eafd1e29492c92176daf22bdbbeb" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:15:44.653715 11211 raft_consensus.cc:2804] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:44.666963 11211 raft_consensus.cc:697] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 15 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:44.667934 11211 consensus_queue.cc:237] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.668486 11184 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.651582  5719 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.672314  5719 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.674674  5719 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.675727 11243 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:44.676157 11243 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.676513 11243 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.676565 11210 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:44.676994 11210 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.677349 11210 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:44.659883 11260 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.674814  5642 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:44.679378 11244 raft_consensus.cc:2804] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:44.679507 11260 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.679912 11244 raft_consensus.cc:697] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:44.681104 11244 consensus_queue.cc:237] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.681504 11267 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:44.682049 11267 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.682476 11267 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:44.685038  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:44.687021 11243 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.689283 11243 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.691689  5719 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.693899  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:44.697366  5749 raft_consensus.cc:2393] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 14: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:44.697548  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:44.685863 11264 raft_consensus.cc:2804] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:44.699371 11270 ts_tablet_manager.cc:933] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f: Initiating tablet copy from peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.699709 11227 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:44.714079 11227 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.699769 11184 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.693046 11229 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:44.704321  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:44.716403  6322 raft_consensus.cc:3060] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:44.716925  5718 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:44.704727  5749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:44.706429  5642 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:44.706772  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:44.707033  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e8be48ea634f3a922604ba76b16e6a" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:15:44.718230  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 57695.3us
I20260709 12:15:44.704337  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac03e19ba8d49feb196035d3b697b69" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:44.718946  6324 raft_consensus.cc:3060] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:44.710911  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet 706e5d138a9043668703dd0c4b4ffd89 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:15:44.714514 11227 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:44.718575  5748 raft_consensus.cc:2393] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 12: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:15:44.721704  5642 leader_election.cc:336] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.697477 11260 raft_consensus.cc:2804] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:44.723742 11265 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:44.722781  5718 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:44.724191  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet 706e5d138a9043668703dd0c4b4ffd89 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-706e5d138a9043668703dd0c4b4ffd89
I20260709 12:15:44.723733 11247 raft_consensus.cc:2804] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:44.726059 11247 raft_consensus.cc:697] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:44.726887 11247 consensus_queue.cc:237] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.724220 11265 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.728956 11265 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.725281  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3762193894e76b902a8405a8bd64f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:44.730212  5753 raft_consensus.cc:3060] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:44.716279 11229 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.732056 11229 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:44.737242 11265 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.739292  6322 raft_consensus.cc:2468] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:44.740657  5753 raft_consensus.cc:2468] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:44.743727  5719 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.745452 11236 raft_consensus.cc:2804] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:44.746039 11236 raft_consensus.cc:697] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:44.716480 11264 raft_consensus.cc:697] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:44.753723  5746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb6332de9984fc6a6f24ba3cfc5c947" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:44.713483 11267 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.754470  5746 raft_consensus.cc:3060] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:44.753839  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:44.755709  5753 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 13: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:44.743934 11235 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:44.760039  5642 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:44.765345 11236 consensus_queue.cc:237] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.743892 11260 raft_consensus.cc:697] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:44.769879  6324 raft_consensus.cc:2468] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
I20260709 12:15:44.771203  5719 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:15:44.777369  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 62017.2us
I20260709 12:15:44.714897 11259 raft_consensus.cc:515] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.774375 11207 raft_consensus.cc:2804] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:44.779490  5745 raft_consensus.cc:2393] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 12: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:15:44.789708  5642 leader_election.cc:336] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.801187  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
W20260709 12:15:44.808492  6291 leader_election.cc:336] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.814110  5642 leader_election.cc:336] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.814906  6291 leader_election.cc:336] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.815393  6291 leader_election.cc:336] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.819864  5500 catalog_manager.cc:5697] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 12 to 13, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 13 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.821002  5645 leader_election.cc:304] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:44.822049 11222 raft_consensus.cc:2749] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:44.822870  6327 raft_consensus.cc:2393] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 12: Already voted for candidate c02ed29558db481589fd3db23e43a07f in this term.
I20260709 12:15:44.815745  6291 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:44.759028 11235 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b3083333af3348e4938f905ca4c4819f)
I20260709 12:15:44.826035  5676 raft_consensus.cc:2393] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 13: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:44.774505 11244 raft_consensus.cc:2804] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:15:44.826465  6291 leader_election.cc:336] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.800268 11265 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:44.828958 11207 raft_consensus.cc:697] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:44.802488 11260 consensus_queue.cc:237] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.832638  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8638862e10a473ca889ec2b98a84132" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:44.833194  6324 raft_consensus.cc:3060] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:44.828298  5746 raft_consensus.cc:2468] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
I20260709 12:15:44.785319  5763 tablet_copy_source_session.cc:215] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:44.828748 11211 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:44.841034  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:44.831245 11207 consensus_queue.cc:237] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.784057 11210 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.842581  5642 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:44.826993 11235 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:44.855860  5676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5e338890f843678fd0689c8568ed9c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:44.846868  5645 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f, c02ed29558db481589fd3db23e43a07f
I20260709 12:15:44.847383  5749 raft_consensus.cc:2393] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c02ed29558db481589fd3db23e43a07f in current term 15: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
I20260709 12:15:44.851215  6324 raft_consensus.cc:2468] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:15:44.852264 11259 leader_election.cc:290] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:44.842733 11244 raft_consensus.cc:697] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:44.839659 11267 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:15:44.877095  5716 leader_election.cc:336] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.780769 11229 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.869038  5676 raft_consensus.cc:3060] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:44.870563  5495 catalog_manager.cc:5697] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 14 to 15, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 15 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.874357  5719 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.788661 11227 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.875706 11211 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:44.944778 11227 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.946630  5676 raft_consensus.cc:2468] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 12.
I20260709 12:15:44.947427 11183 raft_consensus.cc:2749] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:44.855566 11270 tablet_copy_client.cc:323] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.78.67:38189
W20260709 12:15:44.900570  5532 debug-util.cc:398] Leaking SignalData structure 0x7b080033e1c0 after lost signal to thread 4412
W20260709 12:15:44.949504  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 75232.3us
W20260709 12:15:44.949589  5532 debug-util.cc:398] Leaking SignalData structure 0x7b080033bf60 after lost signal to thread 5535
W20260709 12:15:44.950350  5532 debug-util.cc:398] Leaking SignalData structure 0x7b08002f68a0 after lost signal to thread 5550
W20260709 12:15:44.951524  5532 debug-util.cc:398] Leaking SignalData structure 0x7b08000915a0 after lost signal to thread 5703
W20260709 12:15:44.952605  5532 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9ec0 after lost signal to thread 5777
I20260709 12:15:44.951453 11236 raft_consensus.cc:2804] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:44.953469 11236 raft_consensus.cc:697] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
W20260709 12:15:44.953691  5532 debug-util.cc:398] Leaking SignalData structure 0x7b08003e50a0 after lost signal to thread 6352
I20260709 12:15:44.954658 11236 consensus_queue.cc:237] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.902640 11265 raft_consensus.cc:2955] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:44.907770  5672 raft_consensus.cc:2955] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
W20260709 12:15:44.898569  5716 leader_election.cc:336] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.960764  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 62223.9us
W20260709 12:15:44.961261  5716 leader_election.cc:336] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.962167  5716 leader_election.cc:336] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.963040  5716 leader_election.cc:336] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.874234 11222 raft_consensus.cc:2804] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:44.963645  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2645ab47c7304e87afd4e901bcd42fce" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:15:44.964259 11222 raft_consensus.cc:697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:44.964385  6324 raft_consensus.cc:3060] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:44.921823  5642 leader_election.cc:336] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.964931  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:15:44.965739  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 43966.5us
W20260709 12:15:44.966217  5642 leader_election.cc:336] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:44.921300  6291 leader_election.cc:336] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.966993 11227 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:44.926239 11229 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:44.968387 11222 consensus_queue.cc:237] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.956588  6293 leader_election.cc:304] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:15:44.971920  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 115409us
I20260709 12:15:44.972867 11211 raft_consensus.cc:2804] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:44.973160  6291 leader_election.cc:336] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.973582  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:44.974306 11259 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:44.974588 11211 raft_consensus.cc:697] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:15:44.898820 11210 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:15:44.916796 11235 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.877017 11244 consensus_queue.cc:237] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:44.975697 11211 consensus_queue.cc:237] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.976608 11235 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:15:44.789028 11264 consensus_queue.cc:237] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.976822  6324 raft_consensus.cc:2468] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 15.
I20260709 12:15:44.980777  5719 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:15:44.981583 11235 raft_consensus.cc:2804] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:44.982237 11235 raft_consensus.cc:697] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 15 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:15:44.983063 11235 consensus_queue.cc:237] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:44.980821  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c29cd1d5fec4ed798574831b98a1c7f" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:44.986274  5753 raft_consensus.cc:3060] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:44.981204  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:44.993059  5748 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a54957145d9647cb89f46531d107120c in current term 15: Already voted for candidate 831d76c5ee1045f0af923ce24fa4c301 in this term.
W20260709 12:15:44.974720  6291 leader_election.cc:336] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.995187  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:15:44.996484  6291 leader_election.cc:336] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:44.997267 11259 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:44.963712  5716 leader_election.cc:336] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:45.013868  5716 leader_election.cc:336] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:45.014817  5716 leader_election.cc:336] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:45.015597  5716 leader_election.cc:336] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:45.016460  5716 leader_election.cc:336] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:45.038182  5679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a54957145d9647cb89f46531d107120c"
I20260709 12:15:45.038975  5679 raft_consensus.cc:2393] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 831d76c5ee1045f0af923ce24fa4c301 in current term 15: Already voted for candidate a54957145d9647cb89f46531d107120c in this term.
I20260709 12:15:45.042538  5753 raft_consensus.cc:2468] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 12.
I20260709 12:15:45.060470  5763 tablet_copy_service.cc:140] P 831d76c5ee1045f0af923ce24fa4c301: Received BeginTabletCopySession request for tablet e7972b9d3b424d0a82305768187e2573 from peer c02ed29558db481589fd3db23e43a07f ({username='slave'} at 127.0.0.1:40216)
I20260709 12:15:45.061056  5763 tablet_copy_service.cc:161] P 831d76c5ee1045f0af923ce24fa4c301: Beginning new tablet copy session on tablet e7972b9d3b424d0a82305768187e2573 from peer c02ed29558db481589fd3db23e43a07f at {username='slave'} at 127.0.0.1:40216: session id = c02ed29558db481589fd3db23e43a07f-e7972b9d3b424d0a82305768187e2573
I20260709 12:15:45.068163 11265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:40116 (request call id 5) took 1229 ms. Trace:
I20260709 12:15:45.068688 11265 rpcz_store.cc:276] 0709 12:15:43.838530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:43.838650 (+   120us) service_pool.cc:224] Handling call
0709 12:15:43.848033 (+  9383us) log.cc:844] Serialized 492 byte log entry
0709 12:15:45.068067 (+1220034us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":551,"raft.run_cpu_time_us":1756,"raft.run_wall_time_us":7169,"thread_start_us":21051,"threads_started":1,"wal-append.queue_time_us":20884,"wal-append.run_cpu_time_us":1668,"wal-append.run_wall_time_us":1001696}
I20260709 12:15:45.077817  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:45.078619 11259 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:45.080058 11263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706e5d138a9043668703dd0c4b4ffd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:45.091151  5642 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:45.100980 11229 raft_consensus.cc:2804] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:45.101727 11229 raft_consensus.cc:697] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:45.102623 11229 consensus_queue.cc:237] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:45.113224  5763 tablet_copy_source_session.cc:215] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:15:45.125242  6291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 45889.7us
W20260709 12:15:45.125339  5642 leader_election.cc:336] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:45.138378  5642 leader_election.cc:336] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:45.138751  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a54957145d9647cb89f46531d107120c; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
W20260709 12:15:45.120158  5716 leader_election.cc:336] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:45.140041  5716 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:45.140764 11207 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:15:45.146834  6291 leader_election.cc:336] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:45.140928  5716 leader_election.cc:336] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:45.153620  5500 catalog_manager.cc:5697] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 11 to 12, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 12 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:45.157397  5716 leader_election.cc:336] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:45.158134  5716 leader_election.cc:336] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:45.158573  5495 catalog_manager.cc:5697] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 13 to 14, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 14 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.160159  5495 catalog_manager.cc:5697] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 13 to 14, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 14 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.181103 11244 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:45.181967 11270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7972b9d3b424d0a82305768187e2573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:45.174947  5494 catalog_manager.cc:5697] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 12 to 13, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 13 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.185591  5494 catalog_manager.cc:5697] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 12 to 13, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 13 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.186843 11263 tablet_copy_client.cc:806] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:45.187460 11263 tablet_copy_client.cc:670] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:45.187191  5494 catalog_manager.cc:5697] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 11 to 12, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 12 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.188974  5494 catalog_manager.cc:5697] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 13 to 14, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 14 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:45.193857  5716 leader_election.cc:336] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:45.194928  5716 leader_election.cc:336] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:45.195312  5716 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:15:45.207052 11207 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:45.229847 11263 tablet_copy_client.cc:538] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:15:45.232686  6291 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:45.236094  5744 raft_consensus.cc:1275] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:15:45.238324  5642 consensus_peers.cc:597] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:45.242323 11229 consensus_queue.cc:1048] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:45.250322 11270 tablet_copy_client.cc:806] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:45.250967 11270 tablet_copy_client.cc:670] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:45.249743 11263 tablet_bootstrap.cc:492] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
W20260709 12:15:45.250226  5642 consensus_peers.cc:597] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:45.257021  5672 raft_consensus.cc:1275] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:45.258541 11254 consensus_queue.cc:1048] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:45.266243 11270 tablet_copy_client.cc:538] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:45.279006 11270 tablet_bootstrap.cc:492] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f: Bootstrap starting.
I20260709 12:15:45.303962  6324 raft_consensus.cc:1275] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:45.305739 11207 consensus_queue.cc:1048] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:15:45.325156  5642 consensus_peers.cc:597] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.326447  6320 raft_consensus.cc:1275] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:45.328434 11264 consensus_queue.cc:1048] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:45.345078  6327 raft_consensus.cc:1275] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:45.362900  5753 raft_consensus.cc:1275] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:15:45.361171 11264 consensus_queue.cc:1048] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 12:15:45.420145  4409 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 5625)
I20260709 12:15:45.434020  5494 catalog_manager.cc:5697] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 13 to 14, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 14 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.437575  5494 catalog_manager.cc:5697] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index -1 to 8, NON_VOTER c02ed29558db481589fd3db23e43a07f (127.4.78.68) added. New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } } }
I20260709 12:15:45.458842 11183 consensus_queue.cc:1048] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 12:15:45.495464  5716 consensus_peers.cc:597] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:45.481992  5676 raft_consensus.cc:1275] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:15:45.496318  5716 consensus_peers.cc:597] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:45.496795  5716 consensus_peers.cc:597] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:45.515327  5642 consensus_peers.cc:597] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:45.515947  5642 consensus_peers.cc:597] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:45.527747 11301 consensus_queue.cc:1048] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:45.530782  6322 raft_consensus.cc:1275] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:45.531194  6327 raft_consensus.cc:1275] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:45.505625 11263 tablet_bootstrap.cc:492] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:45.536422 11263 tablet_bootstrap.cc:492] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:15:45.538146 11263 ts_tablet_manager.cc:1403] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.289s	user 0.033s	sys 0.010s
I20260709 12:15:45.593863 11260 consensus_queue.cc:1048] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:15:45.607919  6291 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.614215  5500 catalog_manager.cc:5697] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 11 to 12, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 12 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:45.651386 11260 consensus_queue.cc:1048] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:15:45.670169  5642 consensus_peers.cc:597] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.674962  5642 consensus_peers.cc:597] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.633937  5494 catalog_manager.cc:5697] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 11 to 12, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 12 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:45.683342  5716 consensus_peers.cc:597] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:45.698139 11263 raft_consensus.cc:359] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:45.699150 11263 raft_consensus.cc:740] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
W20260709 12:15:45.699638  5642 consensus_peers.cc:597] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.699878 11263 consensus_queue.cc:260] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:45.705070  6322 raft_consensus.cc:1275] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:45.708408 11263 ts_tablet_manager.cc:1434] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.000s
W20260709 12:15:45.713267  6291 consensus_peers.cc:597] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:45.719795  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-706e5d138a9043668703dd0c4b4ffd89 received from {username='slave'} at 127.0.0.1:40216
I20260709 12:15:45.720502  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-706e5d138a9043668703dd0c4b4ffd89 on tablet 706e5d138a9043668703dd0c4b4ffd89 with peer c02ed29558db481589fd3db23e43a07f
W20260709 12:15:45.722286  6291 consensus_peers.cc:597] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.726737  5716 consensus_peers.cc:597] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:45.727380  5716 consensus_peers.cc:597] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.731312  5753 raft_consensus.cc:1275] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:45.732786  5495 catalog_manager.cc:5697] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 14 to 15, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 15 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.734851  5753 raft_consensus.cc:1275] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:45.736778  5753 raft_consensus.cc:1275] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:15:45.755234  6291 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.763181 11270 tablet_bootstrap.cc:492] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:45.764477 11270 tablet_bootstrap.cc:492] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f: Bootstrap complete.
I20260709 12:15:45.765473 11270 ts_tablet_manager.cc:1403] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f: Time spent bootstrapping tablet: real 0.487s	user 0.042s	sys 0.018s
I20260709 12:15:45.781405 11207 consensus_queue.cc:1048] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:15:45.801380 11270 raft_consensus.cc:359] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:45.802582 11270 raft_consensus.cc:740] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Initialized, Role: LEARNER
I20260709 12:15:45.803403 11270 consensus_queue.cc:260] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: NON_VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: true } }
I20260709 12:15:45.806357 11270 ts_tablet_manager.cc:1434] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
W20260709 12:15:45.808701  5716 consensus_peers.cc:597] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:45.821117 11183 consensus_queue.cc:1048] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:45.828161 11183 consensus_queue.cc:1048] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:15:45.833544  5716 consensus_peers.cc:597] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.834190 11183 consensus_queue.cc:1048] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:15:45.845132  5642 consensus_peers.cc:597] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:45.861107  5763 tablet_copy_service.cc:342] P 831d76c5ee1045f0af923ce24fa4c301: Request end of tablet copy session c02ed29558db481589fd3db23e43a07f-e7972b9d3b424d0a82305768187e2573 received from {username='slave'} at 127.0.0.1:40216
I20260709 12:15:45.861583  5763 tablet_copy_service.cc:434] P 831d76c5ee1045f0af923ce24fa4c301: ending tablet copy session c02ed29558db481589fd3db23e43a07f-e7972b9d3b424d0a82305768187e2573 on tablet e7972b9d3b424d0a82305768187e2573 with peer c02ed29558db481589fd3db23e43a07f
W20260709 12:15:45.888682  5642 consensus_peers.cc:597] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.906116  6322 raft_consensus.cc:1217] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
W20260709 12:15:45.975854  6291 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.988780  6320 raft_consensus.cc:1217] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
W20260709 12:15:45.997294  5716 consensus_peers.cc:597] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.998622  6291 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.999264  6291 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.014847  5716 consensus_peers.cc:597] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.026513  5642 consensus_peers.cc:597] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.039338  5716 consensus_peers.cc:597] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.050896  5716 consensus_peers.cc:597] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.092208  5716 consensus_peers.cc:597] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.094753  5642 consensus_peers.cc:597] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.104511  5716 consensus_peers.cc:597] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.173199  6291 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.204885  6291 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.236462  5716 consensus_peers.cc:597] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.335638  5716 consensus_peers.cc:597] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.421103  4409 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:46.422493  6291 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.436053  6291 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:46.448413 11207 raft_consensus.cc:1064] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:46.452244 11207 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:46.455148 11235 raft_consensus.cc:1064] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301: attempting to promote NON_VOTER c02ed29558db481589fd3db23e43a07f to VOTER
I20260709 12:15:46.471863 11235 consensus_queue.cc:237] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:46.513515  5672 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:46.516135  6320 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:46.518217 11260 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:46.519979 11260 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:15:46.557092  5716 consensus_peers.cc:597] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:46.575132  6291 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:46.589006  6320 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f [term 11 LEARNER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:46.588167 11260 raft_consensus.cc:2955] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:46.589134  6322 raft_consensus.cc:2955] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:46.590606 11265 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:46.614579  5672 raft_consensus.cc:1275] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:46.616304 11316 consensus_queue.cc:1048] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:46.656025  5494 catalog_manager.cc:5697] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f reported cstate change: config changed from index 7 to 8, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:46.659358 11265 raft_consensus.cc:2955] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:46.669997  5670 raft_consensus.cc:2955] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:46.656921  5672 raft_consensus.cc:2955] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } attrs { replace: true } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:15:46.717017  5716 consensus_peers.cc:597] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:46.750911 11222 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.751637 11222 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:46.771080 11222 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:46.814760  6327 raft_consensus.cc:2955] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
W20260709 12:15:46.816298  5642 leader_election.cc:336] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:46.818305  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:46.835086  5753 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 13.
I20260709 12:15:46.847384  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:46.850772 11330 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:46.851840 11330 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.852375 11330 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:46.887754  5753 consensus_queue.cc:237] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:15:46.899372 11330 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:46.904425  6321 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:46.906849 11235 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:46.907861 11330 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:46.908851  5670 raft_consensus.cc:1275] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:46.908711  5494 catalog_manager.cc:5697] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c reported cstate change: config changed from index 8 to 9, c02ed29558db481589fd3db23e43a07f (127.4.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } attrs { replace: true } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:46.913977 11235 consensus_queue.cc:1048] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:46.923803 11316 raft_consensus.cc:2955] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:46.931668  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228ec6971a66439f85c6b6d788cf939c" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:46.932343  5745 raft_consensus.cc:3060] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:46.947563  6327 raft_consensus.cc:2955] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:46.928332  5670 raft_consensus.cc:2955] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } } }
I20260709 12:15:46.951915  5745 raft_consensus.cc:2468] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 14.
W20260709 12:15:46.954876  5642 leader_election.cc:336] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:46.957652  5642 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:46.965157 11330 raft_consensus.cc:2804] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:46.965849 11330 raft_consensus.cc:697] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:46.966679  5485 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 706e5d138a9043668703dd0c4b4ffd89 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:46.966750 11330 consensus_queue.cc:237] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:46.971442 11329 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.972013 11329 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:46.974118 11329 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:15:46.986119  5642 leader_election.cc:336] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:46.987031  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:15:46.989501  5745 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 15.
I20260709 12:15:46.992291  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: b3083333af3348e4938f905ca4c4819f
I20260709 12:15:46.993052 11329 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:46.994817 11329 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.995196 11329 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:47.020198  5500 catalog_manager.cc:5697] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: config changed from index 8 to 9, VOTER b3083333af3348e4938f905ca4c4819f (127.4.78.65) evicted. New cstate: current_term: 10 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:47.069085  5500 catalog_manager.cc:5697] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 12 to 14, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 14 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:47.076602  5485 catalog_manager.cc:4755] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 706e5d138a9043668703dd0c4b4ffd89: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:47.081462 11329 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:15:47.101316 11329 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 election: Requested vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:15:47.105289  5753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74092c83d74e4b2d92a17b981437ced6" candidate_uuid: "a54957145d9647cb89f46531d107120c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:15:47.105950  5753 raft_consensus.cc:3060] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:47.113541  5753 raft_consensus.cc:2468] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54957145d9647cb89f46531d107120c in term 16.
I20260709 12:15:47.150065  5642 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c; no voters: 
I20260709 12:15:47.151999 11329 raft_consensus.cc:2804] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:47.152485 11329 raft_consensus.cc:697] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 16 LEADER]: Becoming Leader. State: Replica: a54957145d9647cb89f46531d107120c, State: Running, Role: LEADER
I20260709 12:15:47.153390 11329 consensus_queue.cc:237] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:15:47.171440  5642 leader_election.cc:336] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:15:47.216424  5500 catalog_manager.cc:5697] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c reported cstate change: term changed from 14 to 16, leader changed from b3083333af3348e4938f905ca4c4819f (127.4.78.65) to a54957145d9647cb89f46531d107120c (127.4.78.66). New cstate: current_term: 16 leader_uuid: "a54957145d9647cb89f46531d107120c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:47.421738  4409 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 5625)
I20260709 12:15:47.521518  5753 raft_consensus.cc:1275] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:47.568332 11329 consensus_queue.cc:1048] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:47.620839  6291 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111) [suppressed 368 similar messages]
W20260709 12:15:47.653355  5642 consensus_peers.cc:597] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:47.690217  5753 raft_consensus.cc:1275] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Refusing update from remote peer a54957145d9647cb89f46531d107120c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:15:47.747663 11325 consensus_queue.cc:1048] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:47.774369  5642 consensus_peers.cc:597] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:47.783937  5642 consensus_peers.cc:597] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:47.812829  5716 consensus_peers.cc:597] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:47.869493  5716 consensus_peers.cc:597] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:47.934752  5716 consensus_peers.cc:597] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:47.972918  5642 consensus_peers.cc:597] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:48.002360  5716 consensus_peers.cc:597] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:48.018901  6291 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.030821  5642 consensus_peers.cc:597] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.034433  6291 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:48.037645  6291 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.039928  5716 consensus_peers.cc:597] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:48.136282  5716 consensus_peers.cc:597] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:48.147706  5642 consensus_peers.cc:597] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:48.188333  5642 consensus_peers.cc:597] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:48.227864  5642 consensus_peers.cc:597] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.234032  6291 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.257835  5716 consensus_peers.cc:597] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.272202  6291 consensus_peers.cc:597] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:48.277830  5642 consensus_peers.cc:597] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.307238  5485 catalog_manager.cc:4755] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 706e5d138a9043668703dd0c4b4ffd89: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:48.307842  6291 consensus_peers.cc:597] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.308429  6291 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.369573  5716 consensus_peers.cc:597] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.396327  5642 consensus_peers.cc:597] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.410749  5642 consensus_peers.cc:597] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.423856  4409 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:48.452066  5716 consensus_peers.cc:597] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.538755  5716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 44124.3us
W20260709 12:15:48.546043  5716 consensus_peers.cc:597] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.573810  5716 consensus_peers.cc:597] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.606544  5642 consensus_peers.cc:597] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:48.705981  6291 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.704411  5642 consensus_peers.cc:597] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.731240  6291 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.736343  5716 consensus_peers.cc:597] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.756071  5716 consensus_peers.cc:597] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.771526  5716 consensus_peers.cc:597] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.773459  6291 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.779261  5642 consensus_peers.cc:597] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.840284  5716 consensus_peers.cc:597] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.966349  6291 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.997227  6291 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:49.058446  5716 consensus_peers.cc:597] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:49.103757  6291 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:49.143205  5716 consensus_peers.cc:597] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:49.412240  5485 catalog_manager.cc:4755] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 706e5d138a9043668703dd0c4b4ffd89: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:49.424350  4409 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:49.751744  5642 consensus_peers.cc:597] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:49.950146  5642 consensus_peers.cc:597] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:49.998279  5642 consensus_peers.cc:597] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:50.145880  5716 consensus_peers.cc:597] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.303519  6291 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.358343  5642 consensus_peers.cc:597] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.416339  6291 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.425329  4409 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:50.434589  5642 consensus_peers.cc:597] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.437522  5716 consensus_peers.cc:597] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.440780  6291 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.509178  5716 consensus_peers.cc:597] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.514402  5716 consensus_peers.cc:597] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.524694  5642 consensus_peers.cc:597] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.590816  5642 consensus_peers.cc:597] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.676947  5642 consensus_peers.cc:597] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.677474  6291 consensus_peers.cc:597] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.682281  5642 consensus_peers.cc:597] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.742895  6291 consensus_peers.cc:597] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.771749  5642 consensus_peers.cc:597] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.775717  5716 consensus_peers.cc:597] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.779479  5716 consensus_peers.cc:597] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.806337  6291 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.836381  5716 consensus_peers.cc:597] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.837337  5642 consensus_peers.cc:597] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.859217  5716 consensus_peers.cc:597] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.918311  6291 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.965592  5716 consensus_peers.cc:597] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.003950  5716 consensus_peers.cc:597] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.185122  5716 consensus_peers.cc:597] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.197243  5716 consensus_peers.cc:597] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.203650  5716 consensus_peers.cc:597] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.208631  5716 consensus_peers.cc:597] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.208055  6291 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.240972  5642 consensus_peers.cc:597] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.260056  5642 consensus_peers.cc:597] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.324934  6291 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.406441  6291 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.412885  5642 consensus_peers.cc:597] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:51.415565  6291 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.425832  4409 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:51.436479  6291 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.624737  6291 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.699118  5716 consensus_peers.cc:597] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:51.699605  5716 consensus_peers.cc:597] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:51.707927  5485 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.78.65:38715, user_credentials={real_user=slave}} blocked reactor thread for 88783.3us
W20260709 12:15:51.712839  5485 catalog_manager.cc:4755] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 706e5d138a9043668703dd0c4b4ffd89: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:51.839864  5716 consensus_peers.cc:597] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:52.321147  5642 consensus_peers.cc:597] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:52.400313  5716 consensus_peers.cc:597] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:52.426710  4409 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:52.540966  5642 consensus_peers.cc:597] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:52.594148  5642 consensus_peers.cc:597] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:52.628626  5716 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111) [suppressed 445 similar messages]
W20260709 12:15:52.758838  5642 consensus_peers.cc:597] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:52.769589  5642 consensus_peers.cc:597] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:52.835306  6291 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:52.901013  6291 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:52.919363  6291 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:52.972229  5716 consensus_peers.cc:597] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:52.993098  5716 consensus_peers.cc:597] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:53.012503  5642 consensus_peers.cc:597] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:53.019970  5716 consensus_peers.cc:597] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:53.095649  6291 consensus_peers.cc:597] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.107242  5716 consensus_peers.cc:597] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:53.166932  6291 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.192123  5716 consensus_peers.cc:597] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.294191  5716 consensus_peers.cc:597] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:53.318256  5642 consensus_peers.cc:597] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.331954  5642 consensus_peers.cc:597] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.368184  6291 consensus_peers.cc:597] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:53.394268  5642 consensus_peers.cc:597] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.427886  4409 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:53.434867  5642 consensus_peers.cc:597] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.481638  5642 consensus_peers.cc:597] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.483256  5716 consensus_peers.cc:597] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.494839  6291 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.528714  5642 consensus_peers.cc:597] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.605443  5716 consensus_peers.cc:597] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.635567  5716 consensus_peers.cc:597] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.656087  6291 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.659943  5716 consensus_peers.cc:597] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.737071  5642 consensus_peers.cc:597] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.750845  5716 consensus_peers.cc:597] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.819123  5716 consensus_peers.cc:597] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.824837  6291 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.916204  5716 consensus_peers.cc:597] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.929482  6291 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.940398  6291 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:53.986773  5642 consensus_peers.cc:597] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:53.989558  6291 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:54.265993  6291 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:54.438011  4409 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:54.533516  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 77770.1us
W20260709 12:15:54.861265  6291 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.010s	sys 0.019s
W20260709 12:15:54.861601  6291 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.010s	sys 0.019s
W20260709 12:15:54.897744  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 100321us
W20260709 12:15:54.943586  5716 consensus_peers.cc:597] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:54.946640  5716 consensus_peers.cc:597] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:54.947204  5716 consensus_peers.cc:597] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:55.019618  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 44646.4us
W20260709 12:15:55.070039  5716 consensus_peers.cc:597] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:55.278813  5642 consensus_peers.cc:597] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:55.438758  4409 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:55.505018  5642 consensus_peers.cc:597] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:55.592602  5642 consensus_peers.cc:597] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:55.606817  6291 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:55.677606  5700 debug-util.cc:398] Leaking SignalData structure 0x7b0800407520 after lost signal to thread 4412
W20260709 12:15:55.680325  5700 debug-util.cc:398] Leaking SignalData structure 0x7b080023ede0 after lost signal to thread 5535
W20260709 12:15:55.684084  5700 debug-util.cc:398] Leaking SignalData structure 0x7b0800169400 after lost signal to thread 5703
W20260709 12:15:55.686335  5700 debug-util.cc:398] Leaking SignalData structure 0x7b080034ea20 after lost signal to thread 5777
W20260709 12:15:55.752245  5642 consensus_peers.cc:597] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:55.767095  5716 consensus_peers.cc:597] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:55.688717  5700 debug-util.cc:398] Leaking SignalData structure 0x7b0800156120 after lost signal to thread 6352
W20260709 12:15:55.793130  6291 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:55.796597  5716 consensus_peers.cc:597] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:55.805969  5716 consensus_peers.cc:597] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:55.819440  5642 consensus_peers.cc:597] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:55.852495  5716 consensus_peers.cc:597] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:55.873881  5719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:42181, user_credentials={real_user=slave}} blocked reactor thread for 83571.3us
W20260709 12:15:55.997565  5485 catalog_manager.cc:4755] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 706e5d138a9043668703dd0c4b4ffd89: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:15:56.025076  5642 consensus_peers.cc:597] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.086831  5642 consensus_peers.cc:597] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:56.104842  6291 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.105960  6291 consensus_peers.cc:597] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.132212  6291 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:56.140784  5716 consensus_peers.cc:597] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.156611  5642 consensus_peers.cc:597] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.226161  5716 consensus_peers.cc:597] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:56.257066  5716 consensus_peers.cc:597] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.321815  5642 consensus_peers.cc:597] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.341583  6291 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.344889  6291 consensus_peers.cc:597] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:56.363539  5642 consensus_peers.cc:597] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.382346  5642 consensus_peers.cc:597] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.392958  5642 consensus_peers.cc:597] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.439437  4409 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:56.472857  6291 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.488552  5716 consensus_peers.cc:597] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.499459  5716 consensus_peers.cc:597] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:56.530081  6291 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.560170  5716 consensus_peers.cc:597] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.596581  5642 consensus_peers.cc:597] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:56.606354  5716 consensus_peers.cc:597] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.615768  5716 consensus_peers.cc:597] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.749940  6291 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.794732  5642 consensus_peers.cc:597] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.812388  6291 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.854980  5716 consensus_peers.cc:597] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.856365  6291 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.894433  5716 consensus_peers.cc:597] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:57.027515  6291 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:57.128369  5716 consensus_peers.cc:597] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:57.439985  4409 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:57.632177  5716 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111) [suppressed 405 similar messages]
W20260709 12:15:57.636089  5716 consensus_peers.cc:597] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:57.703872  5716 consensus_peers.cc:597] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:57.962674  6291 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:57.988729  5642 consensus_peers.cc:597] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:58.050338  5642 consensus_peers.cc:597] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:58.106145  5642 consensus_peers.cc:597] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:58.133740  5716 consensus_peers.cc:597] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:58.138517  5642 consensus_peers.cc:597] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:58.206379  5642 consensus_peers.cc:597] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:58.287583  6291 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.288162  5716 consensus_peers.cc:597] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.405823  5642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:38189, user_credentials={real_user=slave}} blocked reactor thread for 71367.7us
W20260709 12:15:58.423688  5716 consensus_peers.cc:597] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:58.440536  4409 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:58.450892  6291 consensus_peers.cc:597] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.502485  5642 consensus_peers.cc:597] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:58.534710  5716 consensus_peers.cc:597] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:58.575197  5716 consensus_peers.cc:597] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:58.581899  5642 consensus_peers.cc:597] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.594795  6291 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.619974  5716 consensus_peers.cc:597] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.651616  5642 consensus_peers.cc:597] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.663863  5642 consensus_peers.cc:597] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.797703  5642 consensus_peers.cc:597] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.855602  5716 consensus_peers.cc:597] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.892225  6291 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:58.995695  5716 consensus_peers.cc:597] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:59.027987  5716 consensus_peers.cc:597] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.070089  6291 consensus_peers.cc:597] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:59.075330  6291 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.075958  6291 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.081799  5716 consensus_peers.cc:597] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.083740  5716 consensus_peers.cc:597] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.089723  6291 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.092178  5642 consensus_peers.cc:597] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.122052  5642 consensus_peers.cc:597] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.162499  6291 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.164614  5642 consensus_peers.cc:597] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.197305  5716 consensus_peers.cc:597] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.258237  5716 consensus_peers.cc:597] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.297255  5716 consensus_peers.cc:597] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.298458  5642 consensus_peers.cc:597] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:59.350000  6291 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.441018  4409 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 5625)
W20260709 12:15:59.455830  6291 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.469945  5716 consensus_peers.cc:597] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.548471  6291 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:00.205147  5716 consensus_peers.cc:597] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:00.441515  4409 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 5625)
W20260709 12:16:00.449663  6291 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:00.466709  5642 consensus_peers.cc:597] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:00.472597  5642 consensus_peers.cc:597] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:00.497731  5642 consensus_peers.cc:597] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:00.533345  5642 consensus_peers.cc:597] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:00.557086  5716 consensus_peers.cc:597] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:00.565394  5642 consensus_peers.cc:597] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:00.634358  5716 consensus_peers.cc:597] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:00.785986  5716 consensus_peers.cc:597] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:00.830173  5716 consensus_peers.cc:597] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:00.849458  6291 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:00.858321  5716 consensus_peers.cc:597] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:00.877548  5642 consensus_peers.cc:597] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:00.894305  5716 consensus_peers.cc:597] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:00.971061  5716 consensus_peers.cc:597] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:01.015192  6291 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:01.120913  5642 consensus_peers.cc:597] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:01.178563  6291 consensus_peers.cc:597] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:01.263705  5716 consensus_peers.cc:597] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:01.360360  6291 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:01.393141  6291 consensus_peers.cc:597] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:01.457401  6291 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:01.493026  4409 tablet_server.cc:196] TabletServer@127.4.78.65:0 shutdown complete.
W20260709 12:16:01.579663  6291 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:01.596202  5716 consensus_peers.cc:597] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:01.637423  4409 tablet_server.cc:179] TabletServer@127.4.78.66:0 shutting down...
W20260709 12:16:01.645826  6293 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:01.647751  5718 consensus_peers.cc:597] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:01.666879  6293 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:01.669399  5718 consensus_peers.cc:597] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:01.686719  6293 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:01.687414  5716 consensus_peers.cc:597] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:01.695118  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:01.696082  4409 tablet_replica.cc:333] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.697068  4409 raft_consensus.cc:2243] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.698480  4409 raft_consensus.cc:2272] T d1010069429f44409ec1f93cc97f31bc P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.701817  4409 tablet_replica.cc:333] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.702615  4409 raft_consensus.cc:2243] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.703480  4409 raft_consensus.cc:2272] T e25e2707f4a0454db308e33ed24bc75f P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.704629  6291 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:01.706033  4409 tablet_replica.cc:333] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c: stopping tablet replica
W20260709 12:16:01.706427  6291 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:01.707098  4409 raft_consensus.cc:2243] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.708043  4409 raft_consensus.cc:2272] T 6cc3762193894e76b902a8405a8bd64f P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.710904  4409 tablet_replica.cc:333] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.712015  4409 raft_consensus.cc:2243] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.713025  4409 raft_consensus.cc:2272] T a74f8f1596b645eead550bee5422dee3 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.716152  4409 tablet_replica.cc:333] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.717015  4409 raft_consensus.cc:2243] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.717938  4409 raft_consensus.cc:2272] T 903a8681cf4244cb90615903ffda5c62 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.720706  4409 tablet_replica.cc:333] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.721616  4409 raft_consensus.cc:2243] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.722637  4409 raft_consensus.cc:2272] T 00b08ef158894418988e329c7d49ff9f P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.725548  4409 tablet_replica.cc:333] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.726624  4409 raft_consensus.cc:2243] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.727746  4409 raft_consensus.cc:2272] T 2fb6332de9984fc6a6f24ba3cfc5c947 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.725678  5716 consensus_peers.cc:597] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:01.730207  5716 consensus_peers.cc:597] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:01.730988  4409 tablet_replica.cc:333] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.731896  4409 raft_consensus.cc:2243] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:16:01.732153  5718 consensus_peers.cc:597] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.732908  4409 raft_consensus.cc:2272] T 33b7e33743744392a4b0269b94aa07b3 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.735607  4409 tablet_replica.cc:333] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.736363  4409 raft_consensus.cc:2243] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.736930  4409 raft_consensus.cc:2272] T 09cc490802a84093b74474b1decbb6a2 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.739789  4409 tablet_replica.cc:333] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.740571  4409 raft_consensus.cc:2243] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.741313  4409 raft_consensus.cc:2272] T 9eda5739d0e2404c9dd25b6ebf5f6060 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.744127  4409 tablet_replica.cc:333] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.744896  4409 raft_consensus.cc:2243] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.745463  4409 raft_consensus.cc:2272] T 0305464a3879473e825bbe12c2df9cd9 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.748101  4409 tablet_replica.cc:333] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.748891  4409 raft_consensus.cc:2243] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.749837  4409 raft_consensus.cc:2272] T 3877dfaf52344867b58b6fa860f49dcb P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.750180  5718 consensus_peers.cc:597] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.755961  4409 tablet_replica.cc:333] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.756735  4409 raft_consensus.cc:2243] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.757267  4409 raft_consensus.cc:2272] T 3590ec2a21d04c1c9948d0b4cba00790 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.758339  5716 consensus_peers.cc:597] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:01.759164  6293 consensus_peers.cc:597] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.759974  4409 tablet_replica.cc:333] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.760833  4409 raft_consensus.cc:2243] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.761672  4409 raft_consensus.cc:2272] T c895f37947b04f8c8b0f3a8ac1874b71 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.764881  4409 tablet_replica.cc:333] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.765458  4409 raft_consensus.cc:2243] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.766258  4409 raft_consensus.cc:2272] T 1e88229af5094c9993c0ec228734763c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.768558  4409 tablet_replica.cc:333] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.769389  4409 raft_consensus.cc:2243] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.770041  4409 raft_consensus.cc:2272] T ac5b12e3f8d847ddaa3bcba52b39ba9b P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.771463  5718 consensus_peers.cc:597] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.772610  4409 tablet_replica.cc:333] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.773451  4409 raft_consensus.cc:2243] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.774096  4409 raft_consensus.cc:2272] T e5ac98436c3f4e54af415eb568349c1e P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.776525  4409 tablet_replica.cc:333] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.777127  4409 raft_consensus.cc:2243] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.777817  4409 raft_consensus.cc:2272] T 1a4e96a5089046e0ac15a436ca7377c5 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.779624  4409 tablet_replica.cc:333] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.780119  4409 raft_consensus.cc:2243] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.780823  4409 raft_consensus.cc:2272] T e7972b9d3b424d0a82305768187e2573 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.783330  4409 tablet_replica.cc:333] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.784021  4409 raft_consensus.cc:2243] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.784724  4409 raft_consensus.cc:2272] T 6be82dd3c64146fabe5214109a9563f0 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.787312  4409 tablet_replica.cc:333] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.788040  4409 raft_consensus.cc:2243] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.788614  4409 raft_consensus.cc:2272] T 1642b3c7e6044747893b0e74e79ec49b P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.791087  4409 tablet_replica.cc:333] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.791869  4409 raft_consensus.cc:2243] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.792414  4409 raft_consensus.cc:2272] T f894158ba41541198a905d0e18553078 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.794579  4409 tablet_replica.cc:333] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.795222  4409 raft_consensus.cc:2243] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:16:01.795236  6293 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.796003  4409 raft_consensus.cc:2272] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.798059  4409 tablet_replica.cc:333] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.798722  4409 raft_consensus.cc:2243] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.799643  4409 raft_consensus.cc:2272] T e837d59ef1c7437eb44f1563f56086ad P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.802211  4409 tablet_replica.cc:333] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.802891  4409 raft_consensus.cc:2243] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.804042  4409 raft_consensus.cc:2272] T 228ec6971a66439f85c6b6d788cf939c P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.803359  6293 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.806811  4409 tablet_replica.cc:333] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.807600  4409 raft_consensus.cc:2243] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.808068  4409 raft_consensus.cc:2272] T 1c0ad918df054a3080325a8ca6d4aed0 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.810268  4409 tablet_replica.cc:333] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.811033  4409 raft_consensus.cc:2243] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.811594  4409 raft_consensus.cc:2272] T 25119dffb65d40f48346fb5615d100e5 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.990128  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.997592  4409 tablet_replica.cc:333] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:01.998342  4409 raft_consensus.cc:2243] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.998989  4409 raft_consensus.cc:2272] T 237f59937cc841be8b427e269f4581ae P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:02.000072  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.001152  4409 tablet_replica.cc:333] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.001859  4409 raft_consensus.cc:2243] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:02.002307  4409 raft_consensus.cc:2272] T 62908e35e9554ef2af86598ce28bcf21 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.004124  4409 tablet_replica.cc:333] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.005029  4409 raft_consensus.cc:2243] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:02.005946  4409 raft_consensus.cc:2272] T 67144d943ff44a2c85c35639ca4017fc P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.014441  4409 tablet_replica.cc:333] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.015103  4409 raft_consensus.cc:2243] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:02.016296  4409 raft_consensus.cc:2272] T 74092c83d74e4b2d92a17b981437ced6 P a54957145d9647cb89f46531d107120c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.019688  4409 tablet_replica.cc:333] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.020527  4409 raft_consensus.cc:2243] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:02.021781  4409 raft_consensus.cc:2272] T dd3b2e7e31554c729a4604dbf4abbd29 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:02.027773  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:02.028800  6291 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:02.032809  5718 consensus_peers.cc:597] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:02.034497  5718 consensus_peers.cc:597] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:02.034898  4409 tablet_replica.cc:333] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.035753  4409 raft_consensus.cc:2243] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:02.036389  4409 raft_consensus.cc:2272] T 3a5e338890f843678fd0689c8568ed9c P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:02.038975  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.039348  4409 tablet_replica.cc:333] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.040132  4409 raft_consensus.cc:2243] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:02.041041  4409 raft_consensus.cc:2272] T 1ba4203e7f7c4e46bd83c6bdda936a65 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:02.043547  5718 consensus_peers.cc:597] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:02.043854  4409 tablet_replica.cc:333] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c: stopping tablet replica
W20260709 12:16:02.044266  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.045142  4409 raft_consensus.cc:2243] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:02.046017  4409 raft_consensus.cc:2272] T 75421a11c1284039a8a17196290f3c16 P a54957145d9647cb89f46531d107120c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.048825  4409 tablet_replica.cc:333] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.049654  4409 raft_consensus.cc:2243] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:16:02.050588  5716 consensus_peers.cc:597] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:02.054802  5645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:02.055917  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:02.061830  6293 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:02.062495  6291 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:02.065167  6293 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:02.066745  6293 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:02.067363  6293 consensus_peers.cc:597] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:02.067488  5642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:02.067974  6293 consensus_peers.cc:597] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:02.068637  6293 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:02.069453  6293 consensus_peers.cc:597] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:02.068070  4409 raft_consensus.cc:2272] T 27e6e6d757f74b3a95066ebc6b0e8589 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.076401  4409 tablet_replica.cc:333] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.087165  4409 raft_consensus.cc:2243] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:02.088105  4409 raft_consensus.cc:2272] T 706e5d138a9043668703dd0c4b4ffd89 P a54957145d9647cb89f46531d107120c [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:02.103919  5644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:02.108839  5643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.108989  4409 tablet_replica.cc:333] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.112409  4409 raft_consensus.cc:2243] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:02.113853  4409 raft_consensus.cc:2272] T dabde4847e7648aeb6347e38342d8c3f P a54957145d9647cb89f46531d107120c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.117187  4409 tablet_replica.cc:333] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.117933  4409 raft_consensus.cc:2243] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:02.118795  4409 raft_consensus.cc:2272] T 8c29cd1d5fec4ed798574831b98a1c7f P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.121356  4409 tablet_replica.cc:333] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.121892  4409 raft_consensus.cc:2243] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:02.122442  4409 raft_consensus.cc:2272] T 5a87e1fb9c364e85bc7c296e4c7b6642 P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.125041  4409 tablet_replica.cc:333] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.125836  4409 raft_consensus.cc:2243] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:02.129915  4409 raft_consensus.cc:2272] T b3ae5385212f45ceb104c78b3c149525 P a54957145d9647cb89f46531d107120c [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:02.132586  5718 consensus_peers.cc:597] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:02.132612  4409 tablet_replica.cc:333] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c: stopping tablet replica
W20260709 12:16:02.133564  5718 consensus_peers.cc:597] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:02.134244  4409 raft_consensus.cc:2243] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:02.135874  4409 raft_consensus.cc:2272] T 5a65b178e0ee4e48a8e13521e3909d60 P a54957145d9647cb89f46531d107120c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.137735  4409 tablet_replica.cc:333] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.138236  4409 raft_consensus.cc:2243] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:02.138724  4409 raft_consensus.cc:2272] T 7922e49f842f47c09c6aafbf9e70d646 P a54957145d9647cb89f46531d107120c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.140669  4409 tablet_replica.cc:333] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.141215  4409 raft_consensus.cc:2243] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:02.141963  4409 raft_consensus.cc:2272] T 9f80dc3c97f640cc9ad6761e3aecfd36 P a54957145d9647cb89f46531d107120c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.144636  4409 tablet_replica.cc:333] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c: stopping tablet replica
I20260709 12:16:02.145336  4409 raft_consensus.cc:2243] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:02.145998  4409 raft_consensus.cc:2272] T 33c7eafd1e29492c92176daf22bdbbeb P a54957145d9647cb89f46531d107120c [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:02.183545  5716 consensus_peers.cc:597] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:02.188576  5716 consensus_peers.cc:597] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:02.368736  6291 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:02.640246  6293 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111) [suppressed 453 similar messages]
I20260709 12:16:02.735335 11402 raft_consensus.cc:493] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.735901 11402 raft_consensus.cc:515] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:16:02.738106 11402 leader_election.cc:290] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:16:02.742928  5716 leader_election.cc:336] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:02.746830  5718 leader_election.cc:336] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:02.747254  5718 leader_election.cc:304] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:02.747941 11402 raft_consensus.cc:2749] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:02.777973  5716 consensus_peers.cc:597] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:02.855271 11413 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.855808 11413 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:02.858104 11413 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:16:02.859515  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:16:02.862264  5718 leader_election.cc:336] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:02.862694  5718 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:16:02.863333 11413 raft_consensus.cc:2749] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:02.872620 11413 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.873126 11413 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:02.876224  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:16:02.878400 11413 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:16:02.879770  5718 leader_election.cc:336] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:02.880259  5718 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:16:02.881280 11413 raft_consensus.cc:2749] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:02.885349 11425 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.886094 11425 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:02.889006 11425 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:02.890339  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:16:02.891047  5748 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:16:02.892300  6291 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:16:02.893271 11425 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:16:02.893484  6293 leader_election.cc:336] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:02.910990 11418 raft_consensus.cc:493] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.917719 11418 raft_consensus.cc:515] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:16:02.918191 11425 raft_consensus.cc:493] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.918637 11425 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:02.919831 11418 leader_election.cc:290] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:16:02.928619  5716 leader_election.cc:336] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:02.929193 11425 raft_consensus.cc:515] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:02.932889 11425 leader_election.cc:290] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:02.936132  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1010069429f44409ec1f93cc97f31bc" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
W20260709 12:16:02.936154  6293 leader_election.cc:336] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
W20260709 12:16:02.936062  5718 leader_election.cc:336] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:02.936820  5748 raft_consensus.cc:3060] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:02.936347 11425 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.937220  5718 leader_election.cc:304] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:02.937043 11421 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.937970 11413 raft_consensus.cc:2749] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:02.938171 11421 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:02.937597 11425 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:02.943790  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:16:02.945370  6293 leader_election.cc:336] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
W20260709 12:16:02.948190  6293 leader_election.cc:336] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:02.945905  5748 raft_consensus.cc:2468] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 16.
I20260709 12:16:02.948635  6293 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:16:02.950022  6291 leader_election.cc:304] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:16:02.951076 11423 raft_consensus.cc:2804] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:02.951200 11425 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:02.950238 11424 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.952239 11424 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:02.953557 11402 raft_consensus.cc:493] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.954038 11402 raft_consensus.cc:515] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:16:02.954311 11424 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:02.955796 11402 leader_election.cc:290] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:16:02.958933 11424 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:16:02.961336  5716 leader_election.cc:336] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:02.962266  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:16:02.963581 11421 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:02.965855 11423 raft_consensus.cc:697] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 16 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:16:02.966295  5718 leader_election.cc:336] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:02.966394  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:16:02.966868 11423 consensus_queue.cc:237] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:02.967069  5744 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 15.
I20260709 12:16:02.966881  5718 leader_election.cc:304] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:02.969319 11413 raft_consensus.cc:2749] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:16:02.969473  6293 leader_election.cc:336] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:02.969803 11402 raft_consensus.cc:493] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.969997  6293 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:16:02.970304 11402 raft_consensus.cc:515] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:16:02.972136 11402 leader_election.cc:290] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:16:02.972487  6291 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:16:02.973526 11421 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:02.974255 11421 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:02.974660 11421 raft_consensus.cc:493] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:02.975033 11421 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:02.978246  5716 leader_election.cc:336] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:02.984400  5494 catalog_manager.cc:5697] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 15 to 16, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 16 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:02.984393 11421 raft_consensus.cc:515] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:02.992626 11421 leader_election.cc:290] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:02.995775  5718 leader_election.cc:336] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:02.996296  5718 leader_election.cc:304] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:02.997249 11413 raft_consensus.cc:2749] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:02.997272  6293 leader_election.cc:336] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:02.998240  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd3b2e7e31554c729a4604dbf4abbd29" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:16:02.998808  5744 raft_consensus.cc:3060] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:02.999948 11413 raft_consensus.cc:493] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.000428 11413 raft_consensus.cc:515] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:16:03.002372 11413 leader_election.cc:290] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:16:03.007098  5744 raft_consensus.cc:2468] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 16.
W20260709 12:16:03.007093  5716 leader_election.cc:336] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:03.009984 11421 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.012122 11421 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:16:03.013108  5718 leader_election.cc:336] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.014281 11421 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:16:03.015408  5718 leader_election.cc:304] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:03.017858 11413 raft_consensus.cc:2749] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:03.018586  6291 leader_election.cc:336] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:03.019531  6291 leader_election.cc:304] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:16:03.020316 11413 raft_consensus.cc:493] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.020330 11421 raft_consensus.cc:2804] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:03.021097 11421 raft_consensus.cc:697] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 16 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:16:03.020925 11413 raft_consensus.cc:515] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:16:03.022097 11421 consensus_queue.cc:237] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:16:03.027014  5716 leader_election.cc:336] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:03.028007 11413 leader_election.cc:290] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:16:03.034488  5718 leader_election.cc:336] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.034940  5718 leader_election.cc:304] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
W20260709 12:16:03.035367  6293 leader_election.cc:336] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.035640 11413 raft_consensus.cc:2749] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:03.036360  6293 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:03.037197 11421 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:03.055912 11402 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.056463 11402 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.058391 11402 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:16:03.060992  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:16:03.061682  6321 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:16:03.062847  5719 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:16:03.063639 11402 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:03.063975 11402 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.064306 11402 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:03.065577  5718 leader_election.cc:336] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.069460  5494 catalog_manager.cc:5697] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 15 to 16, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 16 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:16:03.078941  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6de0 after lost signal to thread 4412
W20260709 12:16:03.079996  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8d00 after lost signal to thread 5535
W20260709 12:16:03.080554  5774 debug-util.cc:398] Leaking SignalData structure 0x7b0800094b60 after lost signal to thread 5703
W20260709 12:16:03.081627  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08001daf20 after lost signal to thread 5777
I20260709 12:16:03.082294 11402 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:16:03.082808  5774 debug-util.cc:398] Leaking SignalData structure 0x7b08003f6fe0 after lost signal to thread 6352
I20260709 12:16:03.084964 11421 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.085493 11421 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.087846 11421 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:16:03.088235  5718 leader_election.cc:336] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.085479 11423 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.089226 11423 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.091192 11423 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:16:03.092633 11402 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:16:03.094223  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74f8f1596b645eead550bee5422dee3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:16:03.094796  6321 raft_consensus.cc:3060] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:03.096633  6293 leader_election.cc:336] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.102500 11413 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:16:03.102886  6291 leader_election.cc:336] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:03.103045 11413 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.103515  6321 raft_consensus.cc:2468] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
W20260709 12:16:03.103885  6293 leader_election.cc:336] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.103381  6291 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:03.105152  5719 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:16:03.105330 11423 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:03.106200 11417 raft_consensus.cc:2804] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:03.106699 11417 raft_consensus.cc:697] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:16:03.107506  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:16:03.107564 11417 consensus_queue.cc:237] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:16:03.109709  5718 leader_election.cc:336] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.110136  5718 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:16:03.105232 11413 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:16:03.111467 11413 raft_consensus.cc:2749] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:16:03.105181  6291 leader_election.cc:336] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:03.112759  6291 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:03.113910 11423 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:16:03.128932  5716 consensus_peers.cc:597] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:03.131673  6291 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:03.132789 11402 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.133288 11402 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.135160 11402 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:16:03.136317  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:16:03.136961  6321 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 12.
I20260709 12:16:03.138216  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:16:03.139218 11417 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:03.139631 11417 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.140132 11417 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:03.140821  5494 catalog_manager.cc:5697] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 13 to 14, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 14 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:03.152127  5718 leader_election.cc:336] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.153292 11417 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.156524  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e88229af5094c9993c0ec228734763c" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:16:03.157087  6321 raft_consensus.cc:3060] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:03.160764 11402 raft_consensus.cc:493] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.161283 11402 raft_consensus.cc:515] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:16:03.163092 11402 leader_election.cc:290] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:16:03.165170  6321 raft_consensus.cc:2468] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:16:03.166272  5719 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:16:03.166958 11402 raft_consensus.cc:2804] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:03.167375 11402 raft_consensus.cc:697] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:16:03.168111 11402 consensus_queue.cc:237] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:16:03.170061  5718 leader_election.cc:336] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.174124 11418 raft_consensus.cc:493] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:16:03.174640  5718 leader_election.cc:336] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.174583 11418 raft_consensus.cc:515] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:16:03.176638 11418 leader_election.cc:290] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:16:03.182682  5716 leader_election.cc:336] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:03.183127  5716 leader_election.cc:304] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:03.184897 11421 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.186013 11413 raft_consensus.cc:2749] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:03.185441 11421 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.186662 11423 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.187180 11423 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.189145 11423 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:03.189643  5716 consensus_peers.cc:597] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:03.190548  5718 leader_election.cc:336] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.192766 11417 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:16:03.194448 11423 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.194976 11423 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.197121 11423 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:16:03.205880  6293 leader_election.cc:336] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
W20260709 12:16:03.207582  6291 leader_election.cc:336] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:03.210019 11421 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:03.213070  6293 leader_election.cc:336] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.213515  6293 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:03.214208 11421 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:03.216926  5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
W20260709 12:16:03.217191  5716 leader_election.cc:336] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:03.218111  5716 leader_election.cc:304] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:03.218792 11402 raft_consensus.cc:2749] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:03.223461  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:16:03.223057  5494 catalog_manager.cc:5697] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 12 to 13, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 13 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:03.224074  5745 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 9.
I20260709 12:16:03.228976  6291 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:16:03.231536 11423 raft_consensus.cc:2749] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:03.232501  6291 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:16:03.233546 11421 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:03.237525 11421 raft_consensus.cc:493] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.237985 11421 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:16:03.245910  6293 leader_election.cc:336] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.257983 11421 raft_consensus.cc:515] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:16:03.272718  6293 leader_election.cc:336] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.276175 11402 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.276795 11402 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.279767  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
W20260709 12:16:03.281380  5718 leader_election.cc:336] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.282599  5719 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, c02ed29558db481589fd3db23e43a07f
I20260709 12:16:03.283392 11417 raft_consensus.cc:2749] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:03.286430 11430 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.286983 11430 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.289022 11430 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:03.291313  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:16:03.291952  5745 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:16:03.293558  6291 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:16:03.299494 11423 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:03.298429 11402 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:16:03.299890 11423 raft_consensus.cc:493] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.300311 11423 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:03.307782 11423 raft_consensus.cc:515] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.309859 11423 leader_election.cc:290] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:03.316381  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e6e6d757f74b3a95066ebc6b0e8589" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:16:03.317003  5745 raft_consensus.cc:3060] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:03.324682  5745 raft_consensus.cc:2468] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 11.
I20260709 12:16:03.327386  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b7e33743744392a4b0269b94aa07b3" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301"
I20260709 12:16:03.327996  5748 raft_consensus.cc:3060] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:03.328372  6291 leader_election.cc:304] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
W20260709 12:16:03.325264  6293 leader_election.cc:336] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.300360 11430 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.330068 11430 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.332082 11430 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:03.332566 11430 raft_consensus.cc:2804] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:03.333035 11430 raft_consensus.cc:697] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
I20260709 12:16:03.334640  5748 raft_consensus.cc:2468] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c02ed29558db481589fd3db23e43a07f in term 10.
I20260709 12:16:03.338666  6291 leader_election.cc:304] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:16:03.339423 11430 consensus_queue.cc:237] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.339469  5748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "c02ed29558db481589fd3db23e43a07f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "831d76c5ee1045f0af923ce24fa4c301" is_pre_election: true
I20260709 12:16:03.344027 11423 raft_consensus.cc:2804] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:16:03.344596 11423 raft_consensus.cc:697] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Becoming Leader. State: Replica: c02ed29558db481589fd3db23e43a07f, State: Running, Role: LEADER
W20260709 12:16:03.341265  6293 leader_election.cc:336] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.345432 11423 consensus_queue.cc:237] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.326138 11421 leader_election.cc:290] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:03.349960  4409 tablet_server.cc:196] TabletServer@127.4.78.66:0 shutdown complete.
W20260709 12:16:03.358089  5716 consensus_peers.cc:597] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:03.359311  6293 leader_election.cc:336] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.360016  6293 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:16:03.362994 11425 raft_consensus.cc:2749] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:03.380080  5494 catalog_manager.cc:5697] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 10 to 11, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 11 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:03.402549  5500 catalog_manager.cc:5697] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f reported cstate change: term changed from 9 to 10, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to c02ed29558db481589fd3db23e43a07f (127.4.78.68). New cstate: current_term: 10 leader_uuid: "c02ed29558db481589fd3db23e43a07f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:16:03.413431  5716 consensus_peers.cc:597] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:03.421739  5748 raft_consensus.cc:1275] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Refusing update from remote peer c02ed29558db481589fd3db23e43a07f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:16:03.428779 11430 consensus_queue.cc:1048] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:16:03.437938  6293 consensus_peers.cc:597] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:03.463045  6293 consensus_peers.cc:597] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:03.470594  5716 consensus_peers.cc:597] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:03.493285  6291 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:03.538973  6321 raft_consensus.cc:1275] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:16:03.540982  4409 tablet_server.cc:179] TabletServer@127.4.78.67:0 shutting down...
I20260709 12:16:03.541671 11402 consensus_queue.cc:1048] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:16:03.552150 11413 raft_consensus.cc:493] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.552641 11413 raft_consensus.cc:515] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
W20260709 12:16:03.554379  5718 consensus_peers.cc:597] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:03.561290 11413 leader_election.cc:290] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
I20260709 12:16:03.562201 11417 raft_consensus.cc:493] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.562700 11417 raft_consensus.cc:515] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } }
I20260709 12:16:03.564508 11417 leader_election.cc:290] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:16:03.566391  5718 leader_election.cc:336] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
W20260709 12:16:03.570789  5718 leader_election.cc:336] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
W20260709 12:16:03.573427  5716 leader_election.cc:336] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:03.574572  5716 leader_election.cc:304] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:03.575673 11413 raft_consensus.cc:2749] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:03.573942 11417 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
W20260709 12:16:03.577029  5716 leader_election.cc:336] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:03.578143  5716 leader_election.cc:304] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:03.576695 11417 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.588775 11402 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.589298 11402 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.592192 11402 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
I20260709 12:16:03.587635 11413 raft_consensus.cc:2749] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:03.593657  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:16:03.594496  6321 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 13.
I20260709 12:16:03.595588  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: 
I20260709 12:16:03.598181 11417 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:16:03.599174  5718 leader_election.cc:336] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.600839 11417 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:03.602815  6321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f" is_pre_election: true
I20260709 12:16:03.603431  6321 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 16.
W20260709 12:16:03.603226  5718 leader_election.cc:336] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.606190  5719 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:16:03.601243 11417 raft_consensus.cc:493] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.607590 11413 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:03.608244 11413 raft_consensus.cc:493] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:03.608912 11413 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:03.607617 11417 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:03.618184  6291 consensus_peers.cc:597] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:03.633119  6291 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:03.635414  6291 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:03.649060  6321 raft_consensus.cc:1275] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Refusing update from remote peer 831d76c5ee1045f0af923ce24fa4c301: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:16:03.645480 11413 raft_consensus.cc:515] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.654150 11440 consensus_queue.cc:1048] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:03.662031 11413 leader_election.cc:290] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 17 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:16:03.664059  5718 leader_election.cc:336] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:03.665081  6320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabde4847e7648aeb6347e38342d8c3f" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:16:03.665660  6320 raft_consensus.cc:3060] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:03.674392 11417 raft_consensus.cc:515] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:03.678205  6320 raft_consensus.cc:2468] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 17.
I20260709 12:16:03.678414  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ae5385212f45ceb104c78b3c149525" candidate_uuid: "831d76c5ee1045f0af923ce24fa4c301" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c02ed29558db481589fd3db23e43a07f"
I20260709 12:16:03.678977  6322 raft_consensus.cc:3060] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:03.679397  5719 leader_election.cc:304] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:16:03.680418 11413 raft_consensus.cc:2804] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:03.680876 11413 raft_consensus.cc:697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 17 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:16:03.681895 11413 consensus_queue.cc:237] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:16:03.689831  5716 consensus_peers.cc:597] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:03.690647  5718 leader_election.cc:336] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
W20260709 12:16:03.692101  6291 consensus_peers.cc:597] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:03.692723  6291 consensus_peers.cc:597] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:03.695789  6322 raft_consensus.cc:2468] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 831d76c5ee1045f0af923ce24fa4c301 in term 14.
I20260709 12:16:03.696897  5719 leader_election.cc:304] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 831d76c5ee1045f0af923ce24fa4c301, c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c
I20260709 12:16:03.698225 11402 raft_consensus.cc:2804] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:03.698634 11402 raft_consensus.cc:697] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Becoming Leader. State: Replica: 831d76c5ee1045f0af923ce24fa4c301, State: Running, Role: LEADER
I20260709 12:16:03.699347 11402 consensus_queue.cc:237] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:16:03.709179  5716 consensus_peers.cc:597] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:03.713665  5716 consensus_peers.cc:597] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:03.717052 11417 leader_election.cc:290] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [CANDIDATE]: Term 14 election: Requested vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), c02ed29558db481589fd3db23e43a07f (127.4.78.68:42181)
W20260709 12:16:03.717564  5718 consensus_peers.cc:597] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:03.719177  6291 consensus_peers.cc:597] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:03.721210  5500 catalog_manager.cc:5697] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 16 to 17, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 17 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:03.741992  5500 catalog_manager.cc:5697] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 reported cstate change: term changed from 13 to 14, leader changed from a54957145d9647cb89f46531d107120c (127.4.78.66) to 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67). New cstate: current_term: 14 leader_uuid: "831d76c5ee1045f0af923ce24fa4c301" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:03.758926  6291 consensus_peers.cc:597] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:03.778405  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:03.781894  4409 tablet_replica.cc:333] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.782761  4409 raft_consensus.cc:2243] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.783785  4409 raft_consensus.cc:2272] T d1010069429f44409ec1f93cc97f31bc P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.786502  4409 tablet_replica.cc:333] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.787330  4409 raft_consensus.cc:2243] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.787917  4409 raft_consensus.cc:2272] T 6cc3762193894e76b902a8405a8bd64f P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.790457  4409 tablet_replica.cc:333] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.791256  4409 raft_consensus.cc:2243] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.792049  4409 raft_consensus.cc:2272] T e25e2707f4a0454db308e33ed24bc75f P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.794620  4409 tablet_replica.cc:333] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.795362  4409 raft_consensus.cc:2243] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.796378  4409 raft_consensus.cc:2272] T 903a8681cf4244cb90615903ffda5c62 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.798882  4409 tablet_replica.cc:333] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.799659  4409 raft_consensus.cc:2243] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.800208  4409 raft_consensus.cc:2272] T 3590ec2a21d04c1c9948d0b4cba00790 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.802659  4409 tablet_replica.cc:333] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.803380  4409 raft_consensus.cc:2243] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.803891  4409 raft_consensus.cc:2272] T 00b08ef158894418988e329c7d49ff9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.807353  4409 tablet_replica.cc:333] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.808131  4409 raft_consensus.cc:2243] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.809201  4409 raft_consensus.cc:2272] T 8a6905b9f5774928a465ac1a443f56a4 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.811617  4409 tablet_replica.cc:333] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.812331  4409 raft_consensus.cc:2243] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Raft consensus shutting down.
W20260709 12:16:03.812865  6291 consensus_peers.cc:597] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:03.813397  4409 raft_consensus.cc:2272] T a74f8f1596b645eead550bee5422dee3 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.816390  4409 tablet_replica.cc:333] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.817180  4409 raft_consensus.cc:2243] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.818244  4409 raft_consensus.cc:2272] T 1fb3872bc132421d9b9adacd9cf89a22 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.820756  4409 tablet_replica.cc:333] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.821475  4409 raft_consensus.cc:2243] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.822212  4409 raft_consensus.cc:2272] T 60b8cda7467d4abb9e997bacb7d063ef P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.824734  4409 tablet_replica.cc:333] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.825450  4409 raft_consensus.cc:2243] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.826498  4409 raft_consensus.cc:2272] T 9eda5739d0e2404c9dd25b6ebf5f6060 P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.829087  4409 tablet_replica.cc:333] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.829844  4409 raft_consensus.cc:2243] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.830396  4409 raft_consensus.cc:2272] T 3877dfaf52344867b58b6fa860f49dcb P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.832796  4409 tablet_replica.cc:333] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.833518  4409 raft_consensus.cc:2243] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.834275  4409 raft_consensus.cc:2272] T e5ac98436c3f4e54af415eb568349c1e P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.836778  4409 tablet_replica.cc:333] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.837488  4409 raft_consensus.cc:2243] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.838454  4409 raft_consensus.cc:2272] T 8ac03e19ba8d49feb196035d3b697b69 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.841169  4409 tablet_replica.cc:333] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.841987  4409 raft_consensus.cc:2243] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.842612  4409 raft_consensus.cc:2272] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:03.841686  6291 consensus_peers.cc:597] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:03.845077  4409 tablet_replica.cc:333] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.845837  4409 raft_consensus.cc:2243] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.846405  4409 raft_consensus.cc:2272] T 2fb6332de9984fc6a6f24ba3cfc5c947 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.848924  4409 tablet_replica.cc:333] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.849830  4409 raft_consensus.cc:2243] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.850349  4409 raft_consensus.cc:2272] T 33b7e33743744392a4b0269b94aa07b3 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.852674  4409 tablet_replica.cc:333] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.853385  4409 raft_consensus.cc:2243] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.854449  4409 raft_consensus.cc:2272] T 08b7de4c4716494894a4643e09fb86f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.858752  4409 tablet_replica.cc:333] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.859443  4409 raft_consensus.cc:2243] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.860396  4409 raft_consensus.cc:2272] T af458034860a4f2b8eed91cd35b5b30f P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.863041  4409 tablet_replica.cc:333] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.865216  4409 raft_consensus.cc:2243] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.865888  4409 raft_consensus.cc:2272] T 1c0ad918df054a3080325a8ca6d4aed0 P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.868441  4409 tablet_replica.cc:333] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.869132  4409 raft_consensus.cc:2243] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.870134  4409 raft_consensus.cc:2272] T 237f59937cc841be8b427e269f4581ae P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:03.860394  6291 consensus_peers.cc:597] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:03.872635  4409 tablet_replica.cc:333] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.873400  4409 raft_consensus.cc:2243] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.874025  4409 raft_consensus.cc:2272] T 67144d943ff44a2c85c35639ca4017fc P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.876433  4409 tablet_replica.cc:333] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.877163  4409 raft_consensus.cc:2243] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.877664  4409 raft_consensus.cc:2272] T 74092c83d74e4b2d92a17b981437ced6 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.880033  4409 tablet_replica.cc:333] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.880726  4409 raft_consensus.cc:2243] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.881717  4409 raft_consensus.cc:2272] T 6be82dd3c64146fabe5214109a9563f0 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.884104  4409 tablet_replica.cc:333] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.884785  4409 raft_consensus.cc:2243] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.885797  4409 raft_consensus.cc:2272] T 1642b3c7e6044747893b0e74e79ec49b P 831d76c5ee1045f0af923ce24fa4c301 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.888182  4409 tablet_replica.cc:333] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.888887  4409 raft_consensus.cc:2243] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.889930  4409 raft_consensus.cc:2272] T f894158ba41541198a905d0e18553078 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.892333  4409 tablet_replica.cc:333] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.893069  4409 raft_consensus.cc:2243] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.893577  4409 raft_consensus.cc:2272] T 27e6e6d757f74b3a95066ebc6b0e8589 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.896477  4409 tablet_replica.cc:333] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.897217  4409 raft_consensus.cc:2243] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.897837  4409 raft_consensus.cc:2272] T 228ec6971a66439f85c6b6d788cf939c P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.900334  4409 tablet_replica.cc:333] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.901017  4409 raft_consensus.cc:2243] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.902112  4409 raft_consensus.cc:2272] T 706e5d138a9043668703dd0c4b4ffd89 P 831d76c5ee1045f0af923ce24fa4c301 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:03.901731  6293 consensus_peers.cc:597] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:03.904623  4409 tablet_replica.cc:333] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.905382  4409 raft_consensus.cc:2243] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.906243  4409 pending_rounds.cc:70] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Trying to abort 1 pending ops.
I20260709 12:16:03.906490  4409 pending_rounds.cc:77] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301: Aborting op as it isn't in flight: id { term: 17 index: 15 } timestamp: 7305622993649950720 op_type: NO_OP noop_request { }
I20260709 12:16:03.906885  4409 raft_consensus.cc:2889] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 17 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:16:03.907212  4409 raft_consensus.cc:2272] T dabde4847e7648aeb6347e38342d8c3f P 831d76c5ee1045f0af923ce24fa4c301 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.909742  4409 tablet_replica.cc:333] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.910498  4409 raft_consensus.cc:2243] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:16:03.911419  6291 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:03.911496  4409 raft_consensus.cc:2272] T 603cb46af0854d75be95bd9fc4acf254 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.914176  4409 tablet_replica.cc:333] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.914891  4409 raft_consensus.cc:2243] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.915412  4409 raft_consensus.cc:2272] T b2ec4e9962d74fb9bbf294f2dc0911cf P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.917603  4409 tablet_replica.cc:333] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.918313  4409 raft_consensus.cc:2243] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.919283  4409 raft_consensus.cc:2272] T e8638862e10a473ca889ec2b98a84132 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.921578  4409 tablet_replica.cc:333] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.922392  4409 raft_consensus.cc:2243] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.923447  4409 raft_consensus.cc:2272] T 45e8be48ea634f3a922604ba76b16e6a P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.925773  4409 tablet_replica.cc:333] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.926468  4409 raft_consensus.cc:2243] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.927018  4409 raft_consensus.cc:2272] T dd3b2e7e31554c729a4604dbf4abbd29 P 831d76c5ee1045f0af923ce24fa4c301 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.929586  4409 tablet_replica.cc:333] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.930294  4409 raft_consensus.cc:2243] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.931263  4409 raft_consensus.cc:2272] T be69db606b5844b2ad9d8cdcd608216a P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:03.921501  6293 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:03.933600  4409 tablet_replica.cc:333] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.934427  4409 raft_consensus.cc:2243] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.935417  4409 raft_consensus.cc:2272] T 2645ab47c7304e87afd4e901bcd42fce P 831d76c5ee1045f0af923ce24fa4c301 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.937776  4409 tablet_replica.cc:333] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.938445  4409 raft_consensus.cc:2243] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.939179  4409 pending_rounds.cc:70] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Trying to abort 1 pending ops.
I20260709 12:16:03.939390  4409 pending_rounds.cc:77] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301: Aborting op as it isn't in flight: id { term: 14 index: 13 } timestamp: 7305622993720324096 op_type: NO_OP noop_request { }
I20260709 12:16:03.939702  4409 raft_consensus.cc:2889] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:16:03.940006  4409 raft_consensus.cc:2272] T b3ae5385212f45ceb104c78b3c149525 P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.943591  4409 tablet_replica.cc:333] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.944262  4409 raft_consensus.cc:2243] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.946318  4409 raft_consensus.cc:2272] T 8c29cd1d5fec4ed798574831b98a1c7f P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.949821  4409 tablet_replica.cc:333] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.950615  4409 raft_consensus.cc:2243] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.953900  4409 raft_consensus.cc:2272] T 5a65b178e0ee4e48a8e13521e3909d60 P 831d76c5ee1045f0af923ce24fa4c301 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.957715  4409 tablet_replica.cc:333] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.958572  4409 raft_consensus.cc:2243] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.959632  4409 raft_consensus.cc:2272] T 1e88229af5094c9993c0ec228734763c P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:03.950771  6291 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:03.961521  6293 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:03.962854  4409 tablet_replica.cc:333] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.964859  4409 raft_consensus.cc:2243] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.965909  4409 raft_consensus.cc:2272] T ba4aecf80db140ca828a80dc93220fba P 831d76c5ee1045f0af923ce24fa4c301 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.968295  4409 tablet_replica.cc:333] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.968955  4409 raft_consensus.cc:2243] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.969470  4409 raft_consensus.cc:2272] T 1a4e96a5089046e0ac15a436ca7377c5 P 831d76c5ee1045f0af923ce24fa4c301 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.971853  4409 tablet_replica.cc:333] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
W20260709 12:16:03.971915  6293 consensus_peers.cc:597] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:03.972479  4409 raft_consensus.cc:2243] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:16:03.964063  6291 consensus_peers.cc:597] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:03.974123  4409 raft_consensus.cc:2272] T e7972b9d3b424d0a82305768187e2573 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.976570  4409 tablet_replica.cc:333] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301: stopping tablet replica
I20260709 12:16:03.977154  4409 raft_consensus.cc:2243] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.978134  4409 raft_consensus.cc:2272] T 7922e49f842f47c09c6aafbf9e70d646 P 831d76c5ee1045f0af923ce24fa4c301 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:04.026712  6291 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:04.059350  6291 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:04.104362  6291 connection.cc:769] client connection to 127.4.78.67:38189 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260709 12:16:04.109459  6291 consensus_peers.cc:597] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f -> Peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Couldn't send request to peer 831d76c5ee1045f0af923ce24fa4c301. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:04.119436  6291 consensus_peers.cc:597] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:04.197293  6293 consensus_peers.cc:597] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:04.227432  6293 consensus_peers.cc:597] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:04.238394  5485 catalog_manager.cc:4755] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 706e5d138a9043668703dd0c4b4ffd89: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:04.341342  6293 consensus_peers.cc:597] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:04.371801  6293 consensus_peers.cc:597] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:04.385054  6293 consensus_peers.cc:597] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:04.493166  6291 consensus_peers.cc:597] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:04.499468  6291 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:04.516116  6293 consensus_peers.cc:597] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:04.549347  6293 consensus_peers.cc:597] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:04.556443  6293 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:04.603346  6293 consensus_peers.cc:597] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:04.655843  6291 consensus_peers.cc:597] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:04.699024 11423 raft_consensus.cc:493] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:04.699613 11423 raft_consensus.cc:515] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:04.701891 11423 leader_election.cc:290] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:16:04.706547  6291 leader_election.cc:336] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:04.709539  6293 leader_election.cc:336] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:04.710100  6293 leader_election.cc:304] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:04.710840 11430 raft_consensus.cc:2749] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:04.714403  6291 consensus_peers.cc:597] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:04.758540  6293 consensus_peers.cc:597] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:04.778748  6293 consensus_peers.cc:597] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f -> Peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Couldn't send request to peer a54957145d9647cb89f46531d107120c. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:04.919883 11430 raft_consensus.cc:493] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:04.920387 11430 raft_consensus.cc:515] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:04.922472 11430 leader_election.cc:290] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:16:04.928584  6293 leader_election.cc:336] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
W20260709 12:16:04.929584  6291 leader_election.cc:336] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:04.929997  6291 leader_election.cc:304] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:04.930711 11430 raft_consensus.cc:2749] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:04.956931 11430 raft_consensus.cc:493] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:04.957598 11430 raft_consensus.cc:515] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:04.959856 11430 leader_election.cc:290] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:16:04.963603  6291 leader_election.cc:336] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:04.965091  6293 leader_election.cc:336] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:04.965497  6293 leader_election.cc:304] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:04.966326 11430 raft_consensus.cc:2749] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:04.998741 11430 raft_consensus.cc:493] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:04.999274 11430 raft_consensus.cc:515] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.003278 11430 leader_election.cc:290] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.005375  6293 leader_election.cc:336] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
W20260709 12:16:05.007714  6291 leader_election.cc:336] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.008169  6291 leader_election.cc:304] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:16:05.008846 11423 raft_consensus.cc:2749] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:05.028983 11430 raft_consensus.cc:493] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.029606 11430 raft_consensus.cc:515] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.032778 11430 leader_election.cc:290] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.036459  6293 leader_election.cc:336] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
W20260709 12:16:05.040339  6291 leader_election.cc:336] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.040762  6291 leader_election.cc:304] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:16:05.041456 11430 raft_consensus.cc:2749] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:05.045583 11454 raft_consensus.cc:493] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.046241 11454 raft_consensus.cc:515] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.048362 11454 leader_election.cc:290] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:05.050817 11454 raft_consensus.cc:493] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.051369 11454 raft_consensus.cc:515] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.053642 11454 leader_election.cc:290] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.057698  6291 leader_election.cc:336] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:05.058420  6291 leader_election.cc:336] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.058820  6291 leader_election.cc:304] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.059559 11454 raft_consensus.cc:2749] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:16:05.063131  6291 leader_election.cc:336] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:05.063684  6291 leader_election.cc:336] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.064023  6291 leader_election.cc:304] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.064694 11430 raft_consensus.cc:2749] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:05.072317 11430 raft_consensus.cc:493] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a54957145d9647cb89f46531d107120c)
I20260709 12:16:05.072803 11430 raft_consensus.cc:515] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.074931 11430 leader_election.cc:290] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), a54957145d9647cb89f46531d107120c (127.4.78.66:33011)
W20260709 12:16:05.078975  6291 leader_election.cc:336] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:05.079826  6293 leader_election.cc:336] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:05.080228  6293 leader_election.cc:304] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: a54957145d9647cb89f46531d107120c, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.080906 11430 raft_consensus.cc:2749] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:05.116230 11454 raft_consensus.cc:493] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.116832 11454 raft_consensus.cc:515] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.119099 11454 leader_election.cc:290] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.123984  6291 leader_election.cc:336] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:05.124780  6291 leader_election.cc:336] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.125144  6291 leader_election.cc:304] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.125825 11454 raft_consensus.cc:2749] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:05.140707 11454 raft_consensus.cc:493] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.141242 11454 raft_consensus.cc:515] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.143339 11454 leader_election.cc:290] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.147701  6291 leader_election.cc:336] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
W20260709 12:16:05.148236  6293 leader_election.cc:336] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:05.148645  6293 leader_election.cc:304] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:16:05.149292 11454 raft_consensus.cc:2749] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:05.153360 11430 raft_consensus.cc:493] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.153936 11430 raft_consensus.cc:515] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.155891 11430 leader_election.cc:290] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.161383  6291 leader_election.cc:336] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:05.161984  6291 leader_election.cc:336] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.162348  6291 leader_election.cc:304] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.163009 11430 raft_consensus.cc:2749] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:05.168653 11430 raft_consensus.cc:493] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.169126 11430 raft_consensus.cc:515] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.171273 11430 leader_election.cc:290] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:05.173859 11430 raft_consensus.cc:493] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.174299 11430 raft_consensus.cc:515] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:16:05.175668  6293 leader_election.cc:336] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:05.176256 11430 leader_election.cc:290] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.179666  6291 leader_election.cc:336] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.180055  6291 leader_election.cc:304] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:16:05.180701 11430 raft_consensus.cc:2749] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:16:05.183868  6291 leader_election.cc:336] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
W20260709 12:16:05.184589  6291 leader_election.cc:336] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:05.184947  6291 leader_election.cc:304] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.185684 11430 raft_consensus.cc:2749] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:05.187263 11430 raft_consensus.cc:493] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.187701 11430 raft_consensus.cc:515] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.189841 11430 leader_election.cc:290] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.194767  6291 leader_election.cc:336] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:05.195314  6291 leader_election.cc:336] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.195645  6291 leader_election.cc:304] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.196290 11430 raft_consensus.cc:2749] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:05.204247  4409 tablet_server.cc:196] TabletServer@127.4.78.67:0 shutdown complete.
I20260709 12:16:05.204890 11430 raft_consensus.cc:493] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.205453 11430 raft_consensus.cc:515] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.207789 11430 leader_election.cc:290] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.212309  6293 leader_election.cc:336] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
W20260709 12:16:05.214637  6291 leader_election.cc:336] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.215130  6291 leader_election.cc:304] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:16:05.217036 11430 raft_consensus.cc:2749] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:05.244366 11430 raft_consensus.cc:493] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.244916 11430 raft_consensus.cc:515] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a54957145d9647cb89f46531d107120c" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 33011 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.247205 11430 leader_election.cc:290] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a54957145d9647cb89f46531d107120c (127.4.78.66:33011), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:05.250348 11430 raft_consensus.cc:493] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.250943 11430 raft_consensus.cc:515] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
W20260709 12:16:05.251680  6293 leader_election.cc:336] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a54957145d9647cb89f46531d107120c (127.4.78.66:33011): Network error: Client connection negotiation failed: client connection to 127.4.78.66:33011: connect: Connection refused (error 111)
I20260709 12:16:05.253258 11430 leader_election.cc:290] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.255093  6291 leader_election.cc:336] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.255712  6291 leader_election.cc:304] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, a54957145d9647cb89f46531d107120c
I20260709 12:16:05.256439 11430 raft_consensus.cc:2749] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:16:05.258684  6291 leader_election.cc:336] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
W20260709 12:16:05.260056  6291 leader_election.cc:336] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:05.260514  6291 leader_election.cc:304] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.261257 11430 raft_consensus.cc:2749] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:05.274485 11430 raft_consensus.cc:493] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.275059 11430 raft_consensus.cc:515] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.277596 11430 leader_election.cc:290] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.284276  6291 leader_election.cc:336] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:05.285215  6291 leader_election.cc:336] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.285640  6291 leader_election.cc:304] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.286406 11430 raft_consensus.cc:2749] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:05.315937  4409 tablet_server.cc:179] TabletServer@127.4.78.68:0 shutting down...
I20260709 12:16:05.316087 11430 raft_consensus.cc:493] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.317317 11430 raft_consensus.cc:515] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.317000 11454 raft_consensus.cc:493] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.318984 11454 raft_consensus.cc:515] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.320274 11430 leader_election.cc:290] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:05.320789 11454 leader_election.cc:290] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
W20260709 12:16:05.326973  6291 leader_election.cc:336] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:05.327693  6291 leader_election.cc:336] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
W20260709 12:16:05.330229  6291 leader_election.cc:336] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.330578  6291 leader_election.cc:304] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.331596 11454 raft_consensus.cc:2749] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:05.331722  6291 leader_election.cc:336] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.332209  6291 leader_election.cc:304] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.337333 11454 raft_consensus.cc:2749] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:05.353883  6291 consensus_peers.cc:597] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f -> Peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Couldn't send request to peer b3083333af3348e4938f905ca4c4819f. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:16:05.364511  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:05.365468  4409 tablet_replica.cc:333] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.366349  4409 raft_consensus.cc:2243] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.367424  4409 raft_consensus.cc:2272] T e7972b9d3b424d0a82305768187e2573 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.370404  4409 tablet_replica.cc:333] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.371335  4409 raft_consensus.cc:2243] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.372114  4409 raft_consensus.cc:2272] T 706e5d138a9043668703dd0c4b4ffd89 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.374955  4409 tablet_replica.cc:333] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.375573  4409 raft_consensus.cc:2243] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.376191  4409 raft_consensus.cc:2272] T af458034860a4f2b8eed91cd35b5b30f P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.378401  4409 tablet_replica.cc:333] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.378921  4409 raft_consensus.cc:2243] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.379760  4409 pending_rounds.cc:70] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: Trying to abort 1 pending ops.
I20260709 12:16:05.379911  4409 pending_rounds.cc:77] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f: Aborting op as it isn't in flight: id { term: 16 index: 11 } timestamp: 7305622990722457600 op_type: NO_OP noop_request { }
I20260709 12:16:05.380170  4409 raft_consensus.cc:2889] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:16:05.380419  4409 raft_consensus.cc:2272] T d1010069429f44409ec1f93cc97f31bc P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.382354  4409 tablet_replica.cc:333] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.382858  4409 raft_consensus.cc:2243] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.383240  4409 raft_consensus.cc:2272] T a74f8f1596b645eead550bee5422dee3 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.383419 11454 raft_consensus.cc:493] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 831d76c5ee1045f0af923ce24fa4c301)
I20260709 12:16:05.383929 11454 raft_consensus.cc:515] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b3083333af3348e4938f905ca4c4819f" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38715 } } peers { permanent_uuid: "831d76c5ee1045f0af923ce24fa4c301" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38189 } } peers { permanent_uuid: "c02ed29558db481589fd3db23e43a07f" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 42181 } attrs { promote: false } }
I20260709 12:16:05.386093 11454 leader_election.cc:290] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715), 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189)
I20260709 12:16:05.386118  4409 tablet_replica.cc:333] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.387033  4409 raft_consensus.cc:2243] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.388229  4409 raft_consensus.cc:2272] T ac5b12e3f8d847ddaa3bcba52b39ba9b P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.391100  4409 tablet_replica.cc:333] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
W20260709 12:16:05.391760  6291 leader_election.cc:336] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:05.391881  4409 raft_consensus.cc:2243] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.392856  4409 raft_consensus.cc:2272] T dabde4847e7648aeb6347e38342d8c3f P c02ed29558db481589fd3db23e43a07f [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:05.394446  6291 leader_election.cc:336] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 831d76c5ee1045f0af923ce24fa4c301 (127.4.78.67:38189): Network error: Client connection negotiation failed: client connection to 127.4.78.67:38189: connect: Connection refused (error 111)
I20260709 12:16:05.394903  6291 leader_election.cc:304] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c02ed29558db481589fd3db23e43a07f; no voters: 831d76c5ee1045f0af923ce24fa4c301, b3083333af3348e4938f905ca4c4819f
I20260709 12:16:05.395529  4409 tablet_replica.cc:333] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.395587 11454 raft_consensus.cc:2749] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:05.396467  4409 raft_consensus.cc:2243] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.397054  4409 raft_consensus.cc:2272] T e837d59ef1c7437eb44f1563f56086ad P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.399735  4409 tablet_replica.cc:333] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.400475  4409 raft_consensus.cc:2243] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.401069  4409 raft_consensus.cc:2272] T 603cb46af0854d75be95bd9fc4acf254 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.403625  4409 tablet_replica.cc:333] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.404404  4409 raft_consensus.cc:2243] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.405501  4409 pending_rounds.cc:70] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: Trying to abort 1 pending ops.
I20260709 12:16:05.405681  4409 pending_rounds.cc:77] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f: Aborting op as it isn't in flight: id { term: 11 index: 9 } timestamp: 7305622992272510976 op_type: NO_OP noop_request { }
I20260709 12:16:05.405951  4409 raft_consensus.cc:2889] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:16:05.406205  4409 raft_consensus.cc:2272] T 27e6e6d757f74b3a95066ebc6b0e8589 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.407913  4409 tablet_replica.cc:333] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.408421  4409 raft_consensus.cc:2243] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.409154  4409 raft_consensus.cc:2272] T 75421a11c1284039a8a17196290f3c16 P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.410885  4409 tablet_replica.cc:333] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.411405  4409 raft_consensus.cc:2243] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.412109  4409 raft_consensus.cc:2272] T 3590ec2a21d04c1c9948d0b4cba00790 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.413857  4409 tablet_replica.cc:333] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.414372  4409 raft_consensus.cc:2243] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.415083  4409 raft_consensus.cc:2272] T 5a87e1fb9c364e85bc7c296e4c7b6642 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.416777  4409 tablet_replica.cc:333] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.417259  4409 raft_consensus.cc:2243] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.417660  4409 raft_consensus.cc:2272] T 903a8681cf4244cb90615903ffda5c62 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.419433  4409 tablet_replica.cc:333] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.419957  4409 raft_consensus.cc:2243] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.420928  4409 raft_consensus.cc:2272] T 62908e35e9554ef2af86598ce28bcf21 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.423218  4409 tablet_replica.cc:333] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.423950  4409 raft_consensus.cc:2243] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.424554  4409 raft_consensus.cc:2272] T 08b7de4c4716494894a4643e09fb86f0 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.426940  4409 tablet_replica.cc:333] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.427678  4409 raft_consensus.cc:2243] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.428215  4409 raft_consensus.cc:2272] T 1e88229af5094c9993c0ec228734763c P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.430609  4409 tablet_replica.cc:333] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.431313  4409 raft_consensus.cc:2243] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.432301  4409 raft_consensus.cc:2272] T 09cc490802a84093b74474b1decbb6a2 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.434314  4409 tablet_replica.cc:333] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.434878  4409 raft_consensus.cc:2243] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.435473  4409 raft_consensus.cc:2272] T f894158ba41541198a905d0e18553078 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.437333  4409 tablet_replica.cc:333] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.437911  4409 raft_consensus.cc:2243] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.438418  4409 raft_consensus.cc:2272] T 8a6905b9f5774928a465ac1a443f56a4 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.440579  4409 tablet_replica.cc:333] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.441136  4409 raft_consensus.cc:2243] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.441944  4409 pending_rounds.cc:70] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Trying to abort 1 pending ops.
I20260709 12:16:05.442126  4409 pending_rounds.cc:77] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f: Aborting op as it isn't in flight: id { term: 10 index: 11 } timestamp: 7305622992275472384 op_type: NO_OP noop_request { }
I20260709 12:16:05.442394  4409 raft_consensus.cc:2889] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 10 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:16:05.442656  4409 raft_consensus.cc:2272] T 33b7e33743744392a4b0269b94aa07b3 P c02ed29558db481589fd3db23e43a07f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.444588  4409 tablet_replica.cc:333] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.445152  4409 raft_consensus.cc:2243] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.446048  4409 raft_consensus.cc:2272] T 33c7eafd1e29492c92176daf22bdbbeb P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.448154  4409 tablet_replica.cc:333] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.448678  4409 raft_consensus.cc:2243] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.449450  4409 raft_consensus.cc:2272] T 0a91e24ad9ae49729bb9bc3ebcc36f9f P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.451481  4409 tablet_replica.cc:333] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.452085  4409 raft_consensus.cc:2243] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.452584  4409 raft_consensus.cc:2272] T b3ae5385212f45ceb104c78b3c149525 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.454589  4409 tablet_replica.cc:333] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.455145  4409 raft_consensus.cc:2243] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.455678  4409 raft_consensus.cc:2272] T 2645ab47c7304e87afd4e901bcd42fce P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.457682  4409 tablet_replica.cc:333] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.458201  4409 raft_consensus.cc:2243] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.458958  4409 raft_consensus.cc:2272] T 9f80dc3c97f640cc9ad6761e3aecfd36 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.460875  4409 tablet_replica.cc:333] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.461373  4409 raft_consensus.cc:2243] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.461911  4409 raft_consensus.cc:2272] T be69db606b5844b2ad9d8cdcd608216a P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.463812  4409 tablet_replica.cc:333] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.464377  4409 raft_consensus.cc:2243] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.465175  4409 raft_consensus.cc:2272] T 3a5e338890f843678fd0689c8568ed9c P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.467048  4409 tablet_replica.cc:333] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.467548  4409 raft_consensus.cc:2243] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.468284  4409 raft_consensus.cc:2272] T dd3b2e7e31554c729a4604dbf4abbd29 P c02ed29558db481589fd3db23e43a07f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.470060  4409 tablet_replica.cc:333] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.470579  4409 raft_consensus.cc:2243] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.471311  4409 raft_consensus.cc:2272] T 1c0ad918df054a3080325a8ca6d4aed0 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.473171  4409 tablet_replica.cc:333] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.473682  4409 raft_consensus.cc:2243] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.474519  4409 raft_consensus.cc:2272] T b2ec4e9962d74fb9bbf294f2dc0911cf P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.476516  4409 tablet_replica.cc:333] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.477042  4409 raft_consensus.cc:2243] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.477515  4409 raft_consensus.cc:2272] T 45e8be48ea634f3a922604ba76b16e6a P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.479337  4409 tablet_replica.cc:333] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.479826  4409 raft_consensus.cc:2243] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.480237  4409 raft_consensus.cc:2272] T b92bb11ba2c8484d8bba9f5e2ac5b9c5 P c02ed29558db481589fd3db23e43a07f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.482205  4409 tablet_replica.cc:333] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.482692  4409 raft_consensus.cc:2243] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.483142  4409 raft_consensus.cc:2272] T 1fb3872bc132421d9b9adacd9cf89a22 P c02ed29558db481589fd3db23e43a07f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.484911  4409 tablet_replica.cc:333] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.485397  4409 raft_consensus.cc:2243] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.485826  4409 raft_consensus.cc:2272] T 1642b3c7e6044747893b0e74e79ec49b P c02ed29558db481589fd3db23e43a07f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.487941  4409 tablet_replica.cc:333] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.488447  4409 raft_consensus.cc:2243] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.488867  4409 raft_consensus.cc:2272] T 8ac03e19ba8d49feb196035d3b697b69 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.490731  4409 tablet_replica.cc:333] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.491217  4409 raft_consensus.cc:2243] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.491918  4409 raft_consensus.cc:2272] T 60b8cda7467d4abb9e997bacb7d063ef P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.494086  4409 tablet_replica.cc:333] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.494552  4409 raft_consensus.cc:2243] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.494931  4409 raft_consensus.cc:2272] T c895f37947b04f8c8b0f3a8ac1874b71 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.496688  4409 tablet_replica.cc:333] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.497169  4409 raft_consensus.cc:2243] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.497619  4409 raft_consensus.cc:2272] T ba4aecf80db140ca828a80dc93220fba P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.499619  4409 tablet_replica.cc:333] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.500226  4409 raft_consensus.cc:2243] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.500818  4409 raft_consensus.cc:2272] T e8638862e10a473ca889ec2b98a84132 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.503253  4409 tablet_replica.cc:333] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.503886  4409 raft_consensus.cc:2243] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.504830  4409 raft_consensus.cc:2272] T 25119dffb65d40f48346fb5615d100e5 P c02ed29558db481589fd3db23e43a07f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.506879  4409 tablet_replica.cc:333] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.507524  4409 raft_consensus.cc:2243] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:05.508085  4409 raft_consensus.cc:2272] T 1ba4203e7f7c4e46bd83c6bdda936a65 P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.509960  4409 tablet_replica.cc:333] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.510416  4409 raft_consensus.cc:2243] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.511162  4409 raft_consensus.cc:2272] T 0305464a3879473e825bbe12c2df9cd9 P c02ed29558db481589fd3db23e43a07f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:05.512916  4409 tablet_replica.cc:333] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f: stopping tablet replica
I20260709 12:16:05.513341  4409 raft_consensus.cc:2243] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:05.514061  4409 raft_consensus.cc:2272] T e5ac98436c3f4e54af415eb568349c1e P c02ed29558db481589fd3db23e43a07f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:06.007040  4409 tablet_server.cc:196] TabletServer@127.4.78.68:0 shutdown complete.
I20260709 12:16:06.169224  4409 master.cc:562] Master@127.4.78.126:44725 shutting down...
W20260709 12:16:06.212028  5550 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:16:06.212291  5550 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:16:06.212494  5550 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:16:20.635665  5485 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111) [suppressed 371 similar messages]
W20260709 12:16:20.639590  5485 catalog_manager.cc:4755] TS b3083333af3348e4938f905ca4c4819f (127.4.78.65:38715): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 706e5d138a9043668703dd0c4b4ffd89: Network error: Client connection negotiation failed: client connection to 127.4.78.65:38715: connect: Connection refused (error 111)
I20260709 12:16:23.224725  4409 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:23.225723  4409 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:23.226087  4409 tablet_replica.cc:333] T 00000000000000000000000000000000 P ce423f944eb64a23961a8a3bbc019610: stopping tablet replica
I20260709 12:16:23.361819  4409 master.cc:584] Master@127.4.78.126:44725 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (218155 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:16:23.468585  4409 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.78.126:38583
I20260709 12:16:23.469653  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:23.475111 11459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.475452 11460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.476778 11462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.477675  4409 server_base.cc:1061] running on GCE node
I20260709 12:16:23.480456  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:23.480682  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:23.480855  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599383480840 us; error 0 us; skew 500 ppm
I20260709 12:16:23.481385  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:23.483724  4409 webserver.cc:533] Webserver started at http://127.4.78.126:40509/ using document root <none> and password file <none>
I20260709 12:16:23.484223  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:23.484416  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:23.484660  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:23.485996  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/master-0-root/instance:
uuid: "4d291926a64f478391c9d85c49057312"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-9t7s"
I20260709 12:16:23.490423  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:16:23.493716 11467 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.494448  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:16:23.494719  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/master-0-root
uuid: "4d291926a64f478391c9d85c49057312"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-9t7s"
I20260709 12:16:23.494977  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:23.519126  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:23.520370  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:23.557991  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.126:38583
I20260709 12:16:23.558092 11518 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.126:38583 every 8 connection(s)
I20260709 12:16:23.562075 11519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.573971 11519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312: Bootstrap starting.
I20260709 12:16:23.578706 11519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.582886 11519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312: No bootstrap required, opened a new log
I20260709 12:16:23.585089 11519 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d291926a64f478391c9d85c49057312" member_type: VOTER }
I20260709 12:16:23.585528 11519 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.585749 11519 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d291926a64f478391c9d85c49057312, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.586340 11519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d291926a64f478391c9d85c49057312" member_type: VOTER }
I20260709 12:16:23.586784 11519 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:23.586998 11519 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:23.587250 11519 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.591847 11519 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d291926a64f478391c9d85c49057312" member_type: VOTER }
I20260709 12:16:23.592409 11519 leader_election.cc:304] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d291926a64f478391c9d85c49057312; no voters: 
I20260709 12:16:23.593562 11519 leader_election.cc:290] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:23.593982 11522 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.595291 11522 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [term 1 LEADER]: Becoming Leader. State: Replica: 4d291926a64f478391c9d85c49057312, State: Running, Role: LEADER
I20260709 12:16:23.595921 11522 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d291926a64f478391c9d85c49057312" member_type: VOTER }
I20260709 12:16:23.596467 11519 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:23.601862 11524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d291926a64f478391c9d85c49057312. Latest consensus state: current_term: 1 leader_uuid: "4d291926a64f478391c9d85c49057312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d291926a64f478391c9d85c49057312" member_type: VOTER } }
I20260709 12:16:23.602454 11524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:23.603408 11523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d291926a64f478391c9d85c49057312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d291926a64f478391c9d85c49057312" member_type: VOTER } }
I20260709 12:16:23.604079 11523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:23.604380 11529 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:23.609340 11529 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:23.612501  4409 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:23.618930 11529 catalog_manager.cc:1383] Generated new cluster ID: 6c0d0ee3462144e6a225be5d00328d2c
I20260709 12:16:23.619323 11529 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:23.660152 11529 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:23.661504 11529 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:23.676918 11529 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312: Generated new TSK 0
I20260709 12:16:23.677541 11529 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:23.682025  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:23.687844 11540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.688570 11541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.690894 11543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.691356  4409 server_base.cc:1061] running on GCE node
I20260709 12:16:23.693243  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:23.693436  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:23.693593  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599383693575 us; error 0 us; skew 500 ppm
I20260709 12:16:23.694118  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:23.696297  4409 webserver.cc:533] Webserver started at http://127.4.78.65:42943/ using document root <none> and password file <none>
I20260709 12:16:23.696776  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:23.696947  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:23.697180  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:23.698483  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/instance:
uuid: "ce38e95b93a640c1a7b16f37868b30fc"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-9t7s"
I20260709 12:16:23.702688  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:16:23.705840 11548 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.706509  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:16:23.706774  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-0-root
uuid: "ce38e95b93a640c1a7b16f37868b30fc"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-9t7s"
I20260709 12:16:23.707053  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:23.728672  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:23.729902  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:23.731299  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:23.733536  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:23.733727  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.733986  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:23.734158  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.773133  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.65:36331
I20260709 12:16:23.773231 11610 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.65:36331 every 8 connection(s)
I20260709 12:16:23.778435  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:23.785534 11615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.786350 11616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.788017 11618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.789521  4409 server_base.cc:1061] running on GCE node
I20260709 12:16:23.791401  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:23.791581  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:23.791746  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599383791728 us; error 0 us; skew 500 ppm
I20260709 12:16:23.792303  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:23.794286 11611 heartbeater.cc:344] Connected to a master server at 127.4.78.126:38583
I20260709 12:16:23.794623 11611 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:23.794956  4409 webserver.cc:533] Webserver started at http://127.4.78.66:33757/ using document root <none> and password file <none>
I20260709 12:16:23.795473  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:23.795420 11611 heartbeater.cc:507] Master 127.4.78.126:38583 requested a full tablet report, sending...
I20260709 12:16:23.795770  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:23.796044  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:23.797360  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/instance:
uuid: "b0f903ca23da45e594b2850337751f03"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-9t7s"
I20260709 12:16:23.797596 11484 ts_manager.cc:194] Registered new tserver with Master: ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:23.799482 11484 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42106
I20260709 12:16:23.802179  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:16:23.805658 11623 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.806444  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:16:23.806716  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-1-root
uuid: "b0f903ca23da45e594b2850337751f03"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-9t7s"
I20260709 12:16:23.806981  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:23.824631  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:23.825834  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:23.827208  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:23.829290  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:23.829489  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.829713  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:23.829876  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:16:23.868131  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.66:39117
I20260709 12:16:23.868230 11685 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.66:39117 every 8 connection(s)
I20260709 12:16:23.872932  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:23.880576 11689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.882416 11690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.883548  4409 server_base.cc:1061] running on GCE node
W20260709 12:16:23.884701 11692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.885267 11686 heartbeater.cc:344] Connected to a master server at 127.4.78.126:38583
I20260709 12:16:23.885614 11686 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:23.885669  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:23.885985  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:23.886153  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599383886137 us; error 0 us; skew 500 ppm
I20260709 12:16:23.886435 11686 heartbeater.cc:507] Master 127.4.78.126:38583 requested a full tablet report, sending...
I20260709 12:16:23.886796  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:23.888550 11484 ts_manager.cc:194] Registered new tserver with Master: b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:23.889554  4409 webserver.cc:533] Webserver started at http://127.4.78.67:43993/ using document root <none> and password file <none>
I20260709 12:16:23.890255  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:23.890383 11484 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42110
I20260709 12:16:23.890491  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:23.890924  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:23.892247  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/instance:
uuid: "264376c764c64dc78c4cef6031c15eef"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-9t7s"
I20260709 12:16:23.896433  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:16:23.899712 11697 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.900377  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 12:16:23.900631  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-2-root
uuid: "264376c764c64dc78c4cef6031c15eef"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-9t7s"
I20260709 12:16:23.900868  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:23.923954  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:23.925256  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:23.926831  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:23.929098  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:23.929302  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.929551  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:23.929697  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.968454  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.67:40145
I20260709 12:16:23.968537 11759 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.67:40145 every 8 connection(s)
I20260709 12:16:23.972988  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:23.979719 11763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.982563 11764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.985286 11766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.985772 11760 heartbeater.cc:344] Connected to a master server at 127.4.78.126:38583
I20260709 12:16:23.986121  4409 server_base.cc:1061] running on GCE node
I20260709 12:16:23.986238 11760 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:23.987249  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:16:23.987332 11760 heartbeater.cc:507] Master 127.4.78.126:38583 requested a full tablet report, sending...
W20260709 12:16:23.987576  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:23.987825  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599383987805 us; error 0 us; skew 500 ppm
I20260709 12:16:23.988531  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:23.989537 11484 ts_manager.cc:194] Registered new tserver with Master: 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:23.991050  4409 webserver.cc:533] Webserver started at http://127.4.78.68:41459/ using document root <none> and password file <none>
I20260709 12:16:23.991189 11484 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42126
I20260709 12:16:23.991601  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:23.991832  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:23.992079  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:23.993733  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-3-root/instance:
uuid: "cfe9bf206bb14951ba7615683809d178"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-9t7s"
I20260709 12:16:23.997934  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:24.001009 11771 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:24.001698  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:24.001999  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-3-root
uuid: "cfe9bf206bb14951ba7615683809d178"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-9t7s"
I20260709 12:16:24.002290  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:24.022298  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:24.023553  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:24.025144  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:24.027344  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:24.027544  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:24.027761  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:24.027913  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:24.065963  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.68:40845
I20260709 12:16:24.066048 11833 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.68:40845 every 8 connection(s)
I20260709 12:16:24.078833 11834 heartbeater.cc:344] Connected to a master server at 127.4.78.126:38583
I20260709 12:16:24.079190 11834 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:24.079921 11834 heartbeater.cc:507] Master 127.4.78.126:38583 requested a full tablet report, sending...
I20260709 12:16:24.081629 11484 ts_manager.cc:194] Registered new tserver with Master: cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:24.082382  4409 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013291219s
I20260709 12:16:24.082943 11484 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42134
I20260709 12:16:24.106400 11484 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42140:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:16:24.364293 11799 tablet_service.cc:1511] Processing CreateTablet for tablet 25e58426365f4050aa2b97643be55ad4 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:24.366786 11798 tablet_service.cc:1511] Processing CreateTablet for tablet 1e219590d128498d88773c090b1fc4f3 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:24.369174 11797 tablet_service.cc:1511] Processing CreateTablet for tablet c7c43c72411f483a8d001721079be3d1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:24.371338 11796 tablet_service.cc:1511] Processing CreateTablet for tablet 4155ea2d0cb34a1b9bd7f3d44b6285f0 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:24.372118 11799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e58426365f4050aa2b97643be55ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.372871 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e219590d128498d88773c090b1fc4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.373526 11797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c43c72411f483a8d001721079be3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.374244 11795 tablet_service.cc:1511] Processing CreateTablet for tablet 7a70076f56284eafba1df611decc3929 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:24.375716 11795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a70076f56284eafba1df611decc3929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.378980 11794 tablet_service.cc:1511] Processing CreateTablet for tablet c11a101e9d54454db77b4a2f2d9489e6 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:24.380477 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11a101e9d54454db77b4a2f2d9489e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.382099 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4155ea2d0cb34a1b9bd7f3d44b6285f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.382972 11793 tablet_service.cc:1511] Processing CreateTablet for tablet 841068979f35457ca7200408e6d522a9 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:24.384346 11793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841068979f35457ca7200408e6d522a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.387259 11792 tablet_service.cc:1511] Processing CreateTablet for tablet e0df0d2cb8774fe0b3479eeb8e30027d (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:24.387914 11576 tablet_service.cc:1511] Processing CreateTablet for tablet 25e58426365f4050aa2b97643be55ad4 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:24.388625 11792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0df0d2cb8774fe0b3479eeb8e30027d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.389284 11576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e58426365f4050aa2b97643be55ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.393159 11791 tablet_service.cc:1511] Processing CreateTablet for tablet 8968bb0a7df844fd868c906fb62847ff (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:24.394611 11791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8968bb0a7df844fd868c906fb62847ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.400300 11575 tablet_service.cc:1511] Processing CreateTablet for tablet f1b1feee36a2425db32953f79a0b0c0a (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:24.401322 11574 tablet_service.cc:1511] Processing CreateTablet for tablet 1e219590d128498d88773c090b1fc4f3 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:24.403707 11573 tablet_service.cc:1511] Processing CreateTablet for tablet a81f5cf331ca4fb7bc00211769a655b4 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:24.407001 11571 tablet_service.cc:1511] Processing CreateTablet for tablet 7a70076f56284eafba1df611decc3929 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:24.409538 11570 tablet_service.cc:1511] Processing CreateTablet for tablet 09f4699c530a4e4fb165983ca95e4a6b (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:24.412047 11569 tablet_service.cc:1511] Processing CreateTablet for tablet 841068979f35457ca7200408e6d522a9 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:24.414885 11567 tablet_service.cc:1511] Processing CreateTablet for tablet f6924fe8aeff4ed699be088221835654 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:24.416764 11568 tablet_service.cc:1511] Processing CreateTablet for tablet e0df0d2cb8774fe0b3479eeb8e30027d (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:24.417961 11790 tablet_service.cc:1511] Processing CreateTablet for tablet 225a49e8e4114f8baf86d7c29f4635d5 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:24.418195 11572 tablet_service.cc:1511] Processing CreateTablet for tablet 4155ea2d0cb34a1b9bd7f3d44b6285f0 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:24.419314 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225a49e8e4114f8baf86d7c29f4635d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.401739 11575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b1feee36a2425db32953f79a0b0c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.422103 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4155ea2d0cb34a1b9bd7f3d44b6285f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.426128 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81f5cf331ca4fb7bc00211769a655b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.428972 11569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841068979f35457ca7200408e6d522a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.430095 11568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0df0d2cb8774fe0b3479eeb8e30027d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.431866 11571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a70076f56284eafba1df611decc3929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.432902 11567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6924fe8aeff4ed699be088221835654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.434091 11574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e219590d128498d88773c090b1fc4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.433974 11651 tablet_service.cc:1511] Processing CreateTablet for tablet f1b1feee36a2425db32953f79a0b0c0a (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:24.435303 11570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f4699c530a4e4fb165983ca95e4a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.435416 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b1feee36a2425db32953f79a0b0c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.452934 11798 tablet_service.cc:1511] Processing CreateTablet for tablet c6ff7b5bd9f340839cbde90d6b7259c7 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:24.454308 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ff7b5bd9f340839cbde90d6b7259c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.457464 11650 tablet_service.cc:1511] Processing CreateTablet for tablet 1e219590d128498d88773c090b1fc4f3 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:24.458855 11650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e219590d128498d88773c090b1fc4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.463495 11794 tablet_service.cc:1511] Processing CreateTablet for tablet 98be08057b9a47a1abcefa3753fcaf70 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:24.464915 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98be08057b9a47a1abcefa3753fcaf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.501605 11725 tablet_service.cc:1511] Processing CreateTablet for tablet 25e58426365f4050aa2b97643be55ad4 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:24.503109 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e58426365f4050aa2b97643be55ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.503437 11851 tablet_bootstrap.cc:492] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:24.510618 11796 tablet_service.cc:1511] Processing CreateTablet for tablet a6b7ee7fe2c64c44901ea84bd330b073 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:24.511956 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b7ee7fe2c64c44901ea84bd330b073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.512984 11724 tablet_service.cc:1511] Processing CreateTablet for tablet f1b1feee36a2425db32953f79a0b0c0a (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:24.514295 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b1feee36a2425db32953f79a0b0c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.520059 11798 tablet_service.cc:1511] Processing CreateTablet for tablet 001b8afd665e4f66a4529aec50993495 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:24.521332 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001b8afd665e4f66a4529aec50993495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.523309 11723 tablet_service.cc:1511] Processing CreateTablet for tablet c7c43c72411f483a8d001721079be3d1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:24.524708 11723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c43c72411f483a8d001721079be3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.525923 11649 tablet_service.cc:1511] Processing CreateTablet for tablet c7c43c72411f483a8d001721079be3d1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:24.526706 11793 tablet_service.cc:1511] Processing CreateTablet for tablet e35e8ccf015d4658b6383cb7a76a1461 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:24.527267 11649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c43c72411f483a8d001721079be3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.528012 11793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35e8ccf015d4658b6383cb7a76a1461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.535624 11648 tablet_service.cc:1511] Processing CreateTablet for tablet a81f5cf331ca4fb7bc00211769a655b4 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:24.537329 11648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81f5cf331ca4fb7bc00211769a655b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.539006 11722 tablet_service.cc:1511] Processing CreateTablet for tablet a81f5cf331ca4fb7bc00211769a655b4 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:24.540349 11722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81f5cf331ca4fb7bc00211769a655b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.543388 11647 tablet_service.cc:1511] Processing CreateTablet for tablet 4155ea2d0cb34a1b9bd7f3d44b6285f0 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:24.544796 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4155ea2d0cb34a1b9bd7f3d44b6285f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.551846 11721 tablet_service.cc:1511] Processing CreateTablet for tablet 7a70076f56284eafba1df611decc3929 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:24.553288 11721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a70076f56284eafba1df611decc3929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.554306 11646 tablet_service.cc:1511] Processing CreateTablet for tablet c11a101e9d54454db77b4a2f2d9489e6 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:24.555671 11646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11a101e9d54454db77b4a2f2d9489e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.595970 11575 tablet_service.cc:1511] Processing CreateTablet for tablet 225a49e8e4114f8baf86d7c29f4635d5 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:24.597407 11575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225a49e8e4114f8baf86d7c29f4635d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:24.609787 11532 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:24.610469 11720 tablet_service.cc:1511] Processing CreateTablet for tablet c11a101e9d54454db77b4a2f2d9489e6 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:24.610941 11719 tablet_service.cc:1511] Processing CreateTablet for tablet 09f4699c530a4e4fb165983ca95e4a6b (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:24.611920 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11a101e9d54454db77b4a2f2d9489e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.613178 11718 tablet_service.cc:1511] Processing CreateTablet for tablet e0df0d2cb8774fe0b3479eeb8e30027d (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:24.614460 11718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0df0d2cb8774fe0b3479eeb8e30027d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.615335 11645 tablet_service.cc:1511] Processing CreateTablet for tablet 09f4699c530a4e4fb165983ca95e4a6b (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:24.616657 11645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f4699c530a4e4fb165983ca95e4a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.618860 11717 tablet_service.cc:1511] Processing CreateTablet for tablet 8968bb0a7df844fd868c906fb62847ff (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:24.620106 11717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8968bb0a7df844fd868c906fb62847ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.622903 11716 tablet_service.cc:1511] Processing CreateTablet for tablet f6924fe8aeff4ed699be088221835654 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:24.624190 11716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6924fe8aeff4ed699be088221835654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.624836 11573 tablet_service.cc:1511] Processing CreateTablet for tablet c6ff7b5bd9f340839cbde90d6b7259c7 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:24.626085 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ff7b5bd9f340839cbde90d6b7259c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.634500 11853 tablet_bootstrap.cc:492] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:24.635871 11569 tablet_service.cc:1511] Processing CreateTablet for tablet d12f3af68cd84f68b5137c6abe65e63e (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:24.635999 11719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f4699c530a4e4fb165983ca95e4a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.645092 11724 tablet_service.cc:1511] Processing CreateTablet for tablet c6ff7b5bd9f340839cbde90d6b7259c7 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:24.646808 11851 tablet_bootstrap.cc:654] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.647028 11792 tablet_service.cc:1511] Processing CreateTablet for tablet 195b741f1d144afab8c37ecc3be587b1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:24.648236 11792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195b741f1d144afab8c37ecc3be587b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.652558 11644 tablet_service.cc:1511] Processing CreateTablet for tablet 841068979f35457ca7200408e6d522a9 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:24.654629 11643 tablet_service.cc:1511] Processing CreateTablet for tablet 8968bb0a7df844fd868c906fb62847ff (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:24.656592 11642 tablet_service.cc:1511] Processing CreateTablet for tablet f6924fe8aeff4ed699be088221835654 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:24.660895 11644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841068979f35457ca7200408e6d522a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.662415 11568 tablet_service.cc:1511] Processing CreateTablet for tablet a6b7ee7fe2c64c44901ea84bd330b073 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:24.663663 11568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b7ee7fe2c64c44901ea84bd330b073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.668036 11574 tablet_service.cc:1511] Processing CreateTablet for tablet 001b8afd665e4f66a4529aec50993495 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:24.668768 11572 tablet_service.cc:1511] Processing CreateTablet for tablet a236cb878f1e49098e43b2733a84eb5c (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:24.669253 11574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001b8afd665e4f66a4529aec50993495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.674875 11722 tablet_service.cc:1511] Processing CreateTablet for tablet 98be08057b9a47a1abcefa3753fcaf70 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:24.676115 11722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98be08057b9a47a1abcefa3753fcaf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.676295 11569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12f3af68cd84f68b5137c6abe65e63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.678753 11572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a236cb878f1e49098e43b2733a84eb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.681069 11570 tablet_service.cc:1511] Processing CreateTablet for tablet 195b741f1d144afab8c37ecc3be587b1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:24.690503 11570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195b741f1d144afab8c37ecc3be587b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.694764 11790 tablet_service.cc:1511] Processing CreateTablet for tablet f145e4b384244aaaae76147c5ee135ec (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:24.685088 11853 tablet_bootstrap.cc:654] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.696098 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f145e4b384244aaaae76147c5ee135ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.687233 11651 tablet_service.cc:1511] Processing CreateTablet for tablet 225a49e8e4114f8baf86d7c29f4635d5 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:24.688459 11643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8968bb0a7df844fd868c906fb62847ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.698690 11791 tablet_service.cc:1511] Processing CreateTablet for tablet baf220366c63486c90e96d1db47de716 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:24.700011 11791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf220366c63486c90e96d1db47de716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.687141 11576 tablet_service.cc:1511] Processing CreateTablet for tablet bca6d1536f234395afd9bcbfe398e689 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:24.702325 11796 tablet_service.cc:1511] Processing CreateTablet for tablet 79d2242d216849e096e87b165c9d6778 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:24.703058 11576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca6d1536f234395afd9bcbfe398e689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.703663 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d2242d216849e096e87b165c9d6778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.682016 11571 tablet_service.cc:1511] Processing CreateTablet for tablet baf220366c63486c90e96d1db47de716 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:24.706183 11571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf220366c63486c90e96d1db47de716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.710134 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225a49e8e4114f8baf86d7c29f4635d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.713411 11650 tablet_service.cc:1511] Processing CreateTablet for tablet bca6d1536f234395afd9bcbfe398e689 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:24.714944 11650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca6d1536f234395afd9bcbfe398e689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.734824 11642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6924fe8aeff4ed699be088221835654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.744179 11854 tablet_bootstrap.cc:492] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:24.756990 11725 tablet_service.cc:1511] Processing CreateTablet for tablet d12f3af68cd84f68b5137c6abe65e63e (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:24.759526 11648 tablet_service.cc:1511] Processing CreateTablet for tablet a6b7ee7fe2c64c44901ea84bd330b073 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:24.786692 11648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b7ee7fe2c64c44901ea84bd330b073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.762148 11645 tablet_service.cc:1511] Processing CreateTablet for tablet d12f3af68cd84f68b5137c6abe65e63e (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:24.789063 11645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12f3af68cd84f68b5137c6abe65e63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.790782 11651 tablet_service.cc:1511] Processing CreateTablet for tablet 195b741f1d144afab8c37ecc3be587b1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:24.792106 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195b741f1d144afab8c37ecc3be587b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.793893 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ff7b5bd9f340839cbde90d6b7259c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.796345 11643 tablet_service.cc:1511] Processing CreateTablet for tablet 79d2242d216849e096e87b165c9d6778 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:24.767422 11723 tablet_service.cc:1511] Processing CreateTablet for tablet e35e8ccf015d4658b6383cb7a76a1461 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:24.767607 11795 tablet_service.cc:1511] Processing CreateTablet for tablet b748cd6fe5b3471e94399825d62e6646 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:24.771023 11716 tablet_service.cc:1511] Processing CreateTablet for tablet a236cb878f1e49098e43b2733a84eb5c (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:24.725620 11647 tablet_service.cc:1511] Processing CreateTablet for tablet 98be08057b9a47a1abcefa3753fcaf70 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:24.772462 11798 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec5984b3c05404884debeee7f5192a1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:24.775003 11644 tablet_service.cc:1511] Processing CreateTablet for tablet e35e8ccf015d4658b6383cb7a76a1461 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:24.776057 11717 tablet_service.cc:1511] Processing CreateTablet for tablet baf220366c63486c90e96d1db47de716 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:24.782397 11852 tablet_bootstrap.cc:492] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:24.797583 11567 tablet_service.cc:1511] Processing CreateTablet for tablet 79d2242d216849e096e87b165c9d6778 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:24.736178 11646 tablet_service.cc:1511] Processing CreateTablet for tablet f145e4b384244aaaae76147c5ee135ec (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:24.764844 11720 tablet_service.cc:1511] Processing CreateTablet for tablet 001b8afd665e4f66a4529aec50993495 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:24.801957 11611 heartbeater.cc:499] Master 127.4.78.126:38583 was elected leader, sending a full tablet report...
I20260709 12:16:24.826978 11571 tablet_service.cc:1511] Processing CreateTablet for tablet d70373b1ffec4647a2eb32b5cb550542 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:24.798156 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12f3af68cd84f68b5137c6abe65e63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.808851 11719 tablet_service.cc:1511] Processing CreateTablet for tablet bca6d1536f234395afd9bcbfe398e689 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:24.836624 11567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d2242d216849e096e87b165c9d6778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.822674 11795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b748cd6fe5b3471e94399825d62e6646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.837399 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec5984b3c05404884debeee7f5192a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.843782 11571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70373b1ffec4647a2eb32b5cb550542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.844782 11852 tablet_bootstrap.cc:654] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.831338 11721 tablet_service.cc:1511] Processing CreateTablet for tablet f145e4b384244aaaae76147c5ee135ec (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:24.836447 11716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a236cb878f1e49098e43b2733a84eb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.818571 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98be08057b9a47a1abcefa3753fcaf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.810402 11854 tablet_bootstrap.cc:654] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.847080 11717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf220366c63486c90e96d1db47de716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.789594 11649 tablet_service.cc:1511] Processing CreateTablet for tablet a236cb878f1e49098e43b2733a84eb5c (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:24.857283 11646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f145e4b384244aaaae76147c5ee135ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.858057 11649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a236cb878f1e49098e43b2733a84eb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.858589 11719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca6d1536f234395afd9bcbfe398e689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.872187 11643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d2242d216849e096e87b165c9d6778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.819072 11651 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec5984b3c05404884debeee7f5192a1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:24.880488 11723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35e8ccf015d4658b6383cb7a76a1461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.853217 11718 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec5984b3c05404884debeee7f5192a1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:24.890470 11853 tablet_bootstrap.cc:492] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:24.891032 11853 ts_tablet_manager.cc:1403] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.257s	user 0.019s	sys 0.018s
I20260709 12:16:24.872876 11722 tablet_service.cc:1511] Processing CreateTablet for tablet b748cd6fe5b3471e94399825d62e6646 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:24.892891 11686 heartbeater.cc:499] Master 127.4.78.126:38583 was elected leader, sending a full tablet report...
I20260709 12:16:24.896087 11721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f145e4b384244aaaae76147c5ee135ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.897102 11718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec5984b3c05404884debeee7f5192a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.891710 11644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35e8ccf015d4658b6383cb7a76a1461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.904341 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001b8afd665e4f66a4529aec50993495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.906544 11796 tablet_service.cc:1511] Processing CreateTablet for tablet a7852dc16ba7411fa9eadde150e3dcaa (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:24.908030 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7852dc16ba7411fa9eadde150e3dcaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.909902 11853 raft_consensus.cc:359] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:24.910667 11853 raft_consensus.cc:385] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.910977 11853 raft_consensus.cc:740] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.911756 11853 consensus_queue.cc:260] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:24.914067 11568 tablet_service.cc:1511] Processing CreateTablet for tablet a7852dc16ba7411fa9eadde150e3dcaa (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:24.915520 11568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7852dc16ba7411fa9eadde150e3dcaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.921195 11722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b748cd6fe5b3471e94399825d62e6646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.926312 11650 tablet_service.cc:1511] Processing CreateTablet for tablet d70373b1ffec4647a2eb32b5cb550542 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:24.927682 11851 tablet_bootstrap.cc:492] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:24.928211 11851 ts_tablet_manager.cc:1403] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.425s	user 0.018s	sys 0.000s
I20260709 12:16:24.929864 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec5984b3c05404884debeee7f5192a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.882659 11573 tablet_service.cc:1511] Processing CreateTablet for tablet b748cd6fe5b3471e94399825d62e6646 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:24.943354 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b748cd6fe5b3471e94399825d62e6646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.951820 11760 heartbeater.cc:499] Master 127.4.78.126:38583 was elected leader, sending a full tablet report...
I20260709 12:16:24.951820 11650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70373b1ffec4647a2eb32b5cb550542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:24.964423 11854 tablet_bootstrap.cc:492] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:24.965020 11854 ts_tablet_manager.cc:1403] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.221s	user 0.017s	sys 0.013s
I20260709 12:16:24.968047 11854 raft_consensus.cc:359] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:24.974728 11853 ts_tablet_manager.cc:1434] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.002s
I20260709 12:16:24.991668 11724 tablet_service.cc:1511] Processing CreateTablet for tablet d70373b1ffec4647a2eb32b5cb550542 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:25.018019 11854 raft_consensus.cc:385] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.018445 11854 raft_consensus.cc:740] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.018774 11853 tablet_bootstrap.cc:492] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:25.018718 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70373b1ffec4647a2eb32b5cb550542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.027695 11852 tablet_bootstrap.cc:492] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:25.028236 11852 ts_tablet_manager.cc:1403] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.246s	user 0.014s	sys 0.000s
I20260709 12:16:25.033741 11790 tablet_service.cc:1511] Processing CreateTablet for tablet da144a8884c1479980762ec9a874ec7f (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:25.035084 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da144a8884c1479980762ec9a874ec7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.036067 11852 raft_consensus.cc:359] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.036798 11852 raft_consensus.cc:385] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.037082 11852 raft_consensus.cc:740] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.999931 11851 raft_consensus.cc:359] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:25.008360 11569 tablet_service.cc:1511] Processing CreateTablet for tablet a0fdac8111fe4c49bccd7e22a650cccc (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:25.040784 11569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fdac8111fe4c49bccd7e22a650cccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.008482 11798 tablet_service.cc:1511] Processing CreateTablet for tablet a0fdac8111fe4c49bccd7e22a650cccc (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:25.042533 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fdac8111fe4c49bccd7e22a650cccc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:25.003371 11469 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 56712.3us
I20260709 12:16:25.049437 11649 tablet_service.cc:1511] Processing CreateTablet for tablet a7852dc16ba7411fa9eadde150e3dcaa (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:25.054082 11719 tablet_service.cc:1511] Processing CreateTablet for tablet a0fdac8111fe4c49bccd7e22a650cccc (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:25.055218 11719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fdac8111fe4c49bccd7e22a650cccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.057546 11649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7852dc16ba7411fa9eadde150e3dcaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.025617 11853 tablet_bootstrap.cc:654] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.052781 11723 tablet_service.cc:1511] Processing CreateTablet for tablet da144a8884c1479980762ec9a874ec7f (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:25.058565 11723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da144a8884c1479980762ec9a874ec7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.060849 11643 tablet_service.cc:1511] Processing CreateTablet for tablet da144a8884c1479980762ec9a874ec7f (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:25.062165 11643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da144a8884c1479980762ec9a874ec7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.053402 11852 consensus_queue.cc:260] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.071924 11851 raft_consensus.cc:385] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.072322 11851 raft_consensus.cc:740] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.073065 11851 consensus_queue.cc:260] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:25.019387 11854 consensus_queue.cc:260] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:25.080952 11573 tablet_service.cc:1511] Processing CreateTablet for tablet 869a40a36ae44ac9af963b7e09384543 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:25.080952 11717 tablet_service.cc:1511] Processing CreateTablet for tablet d95dddd4031d4b029df099f3324d5574 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:25.087971 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 869a40a36ae44ac9af963b7e09384543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.088178 11717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95dddd4031d4b029df099f3324d5574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.088636 11852 ts_tablet_manager.cc:1434] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.003s
I20260709 12:16:25.081283 11649 tablet_service.cc:1511] Processing CreateTablet for tablet d95dddd4031d4b029df099f3324d5574 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:25.090031 11649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95dddd4031d4b029df099f3324d5574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.092847 11858 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.077749 11790 tablet_service.cc:1511] Processing CreateTablet for tablet 869a40a36ae44ac9af963b7e09384543 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:25.093369 11858 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.094048 11644 tablet_service.cc:1511] Processing CreateTablet for tablet 869a40a36ae44ac9af963b7e09384543 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:25.095247 11644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 869a40a36ae44ac9af963b7e09384543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.095918 11858 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:25.096042 11852 tablet_bootstrap.cc:492] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:25.092905 11834 heartbeater.cc:499] Master 127.4.78.126:38583 was elected leader, sending a full tablet report...
I20260709 12:16:25.100188 11851 ts_tablet_manager.cc:1434] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.172s	user 0.009s	sys 0.010s
I20260709 12:16:25.078753 11576 tablet_service.cc:1511] Processing CreateTablet for tablet d95dddd4031d4b029df099f3324d5574 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:25.110514 11795 tablet_service.cc:1511] Processing CreateTablet for tablet 77633186a3bc4fbe82ee020cad674e30 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:25.117957 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 869a40a36ae44ac9af963b7e09384543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.118732 11795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77633186a3bc4fbe82ee020cad674e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.111100 11568 tablet_service.cc:1511] Processing CreateTablet for tablet 77633186a3bc4fbe82ee020cad674e30 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:25.123520 11651 tablet_service.cc:1511] Processing CreateTablet for tablet 896664897f42444796f0be51911c9ec7 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:25.124934 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896664897f42444796f0be51911c9ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.137840 11571 tablet_service.cc:1511] Processing CreateTablet for tablet 6a80694829ab40a8b9b84840d8c384ff (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:25.138788 11720 tablet_service.cc:1511] Processing CreateTablet for tablet 77633186a3bc4fbe82ee020cad674e30 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:25.139374 11571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a80694829ab40a8b9b84840d8c384ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.141328 11568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77633186a3bc4fbe82ee020cad674e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.142781 11798 tablet_service.cc:1511] Processing CreateTablet for tablet 896664897f42444796f0be51911c9ec7 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:25.143946 11576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95dddd4031d4b029df099f3324d5574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.144069 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896664897f42444796f0be51911c9ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.140027 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77633186a3bc4fbe82ee020cad674e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.134569 11852 tablet_bootstrap.cc:654] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.162277 11796 tablet_service.cc:1511] Processing CreateTablet for tablet cf073dc4ac2044dfadb5f017646c8101 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:25.162699 11860 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.166123 11851 tablet_bootstrap.cc:492] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:25.168584 11647 tablet_service.cc:1511] Processing CreateTablet for tablet 6a80694829ab40a8b9b84840d8c384ff (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:25.186017 11860 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.189152 11860 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:25.193910 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf073dc4ac2044dfadb5f017646c8101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.206826 11719 tablet_service.cc:1511] Processing CreateTablet for tablet 896664897f42444796f0be51911c9ec7 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:25.208470 11719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896664897f42444796f0be51911c9ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.210919 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a80694829ab40a8b9b84840d8c384ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.211957 11851 tablet_bootstrap.cc:654] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.211583 11571 tablet_service.cc:1511] Processing CreateTablet for tablet cf073dc4ac2044dfadb5f017646c8101 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:25.211635 11646 tablet_service.cc:1511] Processing CreateTablet for tablet cf073dc4ac2044dfadb5f017646c8101 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:25.213047 11571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf073dc4ac2044dfadb5f017646c8101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.213138 11646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf073dc4ac2044dfadb5f017646c8101. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:25.229346 11761 tablet.cc:2406] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:25.237401 11853 tablet_bootstrap.cc:492] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:25.238071 11853 ts_tablet_manager.cc:1403] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.220s	user 0.019s	sys 0.012s
I20260709 12:16:25.255097 11723 tablet_service.cc:1511] Processing CreateTablet for tablet 6a80694829ab40a8b9b84840d8c384ff (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:25.256548 11723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a80694829ab40a8b9b84840d8c384ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.259760 11722 tablet_service.cc:1511] Processing CreateTablet for tablet a633993d8d3341eeaddce5c93752db1e (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:25.241411 11853 raft_consensus.cc:359] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.261106 11853 raft_consensus.cc:385] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.262814 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:25.264906 11699 leader_election.cc:343] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.261521 11853 raft_consensus.cc:740] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.266753 11853 consensus_queue.cc:260] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.271757 11853 ts_tablet_manager.cc:1434] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:16:25.281697 11853 tablet_bootstrap.cc:492] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:25.261274 11722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a633993d8d3341eeaddce5c93752db1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.290980 11795 tablet_service.cc:1511] Processing CreateTablet for tablet a633993d8d3341eeaddce5c93752db1e (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:25.292577 11795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a633993d8d3341eeaddce5c93752db1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.292685 11573 tablet_service.cc:1511] Processing CreateTablet for tablet a633993d8d3341eeaddce5c93752db1e (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:25.294158 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a633993d8d3341eeaddce5c93752db1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.305076 11724 tablet_service.cc:1511] Processing CreateTablet for tablet d714468af62e4ab3bb4affae7ab03619 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:25.306490 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d714468af62e4ab3bb4affae7ab03619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.310838 11651 tablet_service.cc:1511] Processing CreateTablet for tablet d714468af62e4ab3bb4affae7ab03619 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:25.341972 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:25.343663 11701 leader_election.cc:343] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.344149 11701 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:25.345273 11858 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.346167 11852 tablet_bootstrap.cc:492] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:25.346310 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:25.346762 11852 ts_tablet_manager.cc:1403] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.251s	user 0.008s	sys 0.010s
W20260709 12:16:25.348260 11550 leader_election.cc:343] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.350025 11852 raft_consensus.cc:359] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:25.350776 11852 raft_consensus.cc:385] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.351056 11852 raft_consensus.cc:740] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.351805 11852 consensus_queue.cc:260] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:25.353981 11852 ts_tablet_manager.cc:1434] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 12:16:25.354980 11852 tablet_bootstrap.cc:492] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:25.356422 11790 tablet_service.cc:1511] Processing CreateTablet for tablet d714468af62e4ab3bb4affae7ab03619 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:25.362555 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d714468af62e4ab3bb4affae7ab03619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.346072 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d714468af62e4ab3bb4affae7ab03619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.361100 11852 tablet_bootstrap.cc:654] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.366549 11576 tablet_service.cc:1511] Processing CreateTablet for tablet 51181cd84fab48ffb41a532d72daf42d (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:25.369536 11576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51181cd84fab48ffb41a532d72daf42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.370747 11854 ts_tablet_manager.cc:1434] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.405s	user 0.005s	sys 0.008s
I20260709 12:16:25.368213 11647 tablet_service.cc:1511] Processing CreateTablet for tablet 51181cd84fab48ffb41a532d72daf42d (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:25.371845 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51181cd84fab48ffb41a532d72daf42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.371007 11851 tablet_bootstrap.cc:492] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:25.374167 11851 ts_tablet_manager.cc:1403] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.208s	user 0.008s	sys 0.016s
I20260709 12:16:25.375041 11853 tablet_bootstrap.cc:654] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.383430 11717 tablet_service.cc:1511] Processing CreateTablet for tablet 51181cd84fab48ffb41a532d72daf42d (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:25.383546 11795 tablet_service.cc:1511] Processing CreateTablet for tablet f5b9e8af33874d1da7a3fa1b4fc455f0 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:25.384987 11795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b9e8af33874d1da7a3fa1b4fc455f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.384989 11854 tablet_bootstrap.cc:492] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:25.384922 11717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51181cd84fab48ffb41a532d72daf42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.393476 11870 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.394053 11870 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:25.377837 11851 raft_consensus.cc:359] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:25.401898 11870 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:25.400517 11851 raft_consensus.cc:385] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.409371 11851 raft_consensus.cc:740] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.422274 11573 tablet_service.cc:1511] Processing CreateTablet for tablet f5b9e8af33874d1da7a3fa1b4fc455f0 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:25.426553 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b9e8af33874d1da7a3fa1b4fc455f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.427186 11644 tablet_service.cc:1511] Processing CreateTablet for tablet f5b9e8af33874d1da7a3fa1b4fc455f0 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:25.428678 11644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b9e8af33874d1da7a3fa1b4fc455f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.434597 11854 tablet_bootstrap.cc:654] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.435354 11723 tablet_service.cc:1511] Processing CreateTablet for tablet 60c076143e0f4e3cb04896d3f733461b (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:25.436637 11723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c076143e0f4e3cb04896d3f733461b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.422104 11851 consensus_queue.cc:260] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:25.447389 11571 tablet_service.cc:1511] Processing CreateTablet for tablet 60c076143e0f4e3cb04896d3f733461b (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:25.448783 11571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c076143e0f4e3cb04896d3f733461b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.449352 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:16:25.451256 11549 leader_election.cc:343] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.452222 11549 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:25.455792 11860 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.460232 11852 tablet_bootstrap.cc:492] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:25.471894 11852 ts_tablet_manager.cc:1403] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.004s
I20260709 12:16:25.473428 11796 tablet_service.cc:1511] Processing CreateTablet for tablet 60c076143e0f4e3cb04896d3f733461b (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:25.469928 11851 ts_tablet_manager.cc:1434] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.003s
I20260709 12:16:25.474857 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c076143e0f4e3cb04896d3f733461b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.478528 11851 tablet_bootstrap.cc:492] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:25.479221 11853 tablet_bootstrap.cc:492] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:25.485683 11853 ts_tablet_manager.cc:1403] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.204s	user 0.014s	sys 0.002s
I20260709 12:16:25.487011 11852 raft_consensus.cc:359] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.488188 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:25.488638 11853 raft_consensus.cc:359] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.489336 11853 raft_consensus.cc:385] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.489637 11853 raft_consensus.cc:740] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.490696 11860 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.490638 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:25.487749 11852 raft_consensus.cc:385] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.491333 11860 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:25.493875 11852 raft_consensus.cc:740] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.494534 11854 tablet_bootstrap.cc:492] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:25.495087 11854 ts_tablet_manager.cc:1403] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.003s
I20260709 12:16:25.495628 11860 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:16:25.489734 11627 leader_election.cc:343] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.497411 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:25.498199 11853 consensus_queue.cc:260] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.497691 11852 consensus_queue.cc:260] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:25.498976 11549 leader_election.cc:343] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.500438 11853 ts_tablet_manager.cc:1434] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:16:25.500833 11852 ts_tablet_manager.cc:1434] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:16:25.498741 11851 tablet_bootstrap.cc:654] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.501796 11647 tablet_service.cc:1511] Processing CreateTablet for tablet 3f44d8dd328e49b0b41e9345b6c2fb85 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:25.503830 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f44d8dd328e49b0b41e9345b6c2fb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.492547 11809 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:25.502704 11854 raft_consensus.cc:359] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.510135 11852 tablet_bootstrap.cc:492] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:25.511674 11854 raft_consensus.cc:385] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.517376 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:25.520359 11550 leader_election.cc:343] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.520717 11852 tablet_bootstrap.cc:654] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.520846 11550 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:25.522555 11860 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.510808 11573 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf30a4f63934c8fa1fb80a2aa7df9ee (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:25.523607 11854 raft_consensus.cc:740] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.524386 11722 tablet_service.cc:1511] Processing CreateTablet for tablet 3f44d8dd328e49b0b41e9345b6c2fb85 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:25.524523 11854 consensus_queue.cc:260] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.525786 11624 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:25.528586 11851 tablet_bootstrap.cc:492] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:25.528852 11870 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.530584 11720 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf30a4f63934c8fa1fb80a2aa7df9ee (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:25.531608 11851 ts_tablet_manager.cc:1403] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.003s
I20260709 12:16:25.531464 11870 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.532043 11870 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.532438 11854 ts_tablet_manager.cc:1434] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.004s
I20260709 12:16:25.533499 11854 tablet_bootstrap.cc:492] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:25.534435 11647 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf30a4f63934c8fa1fb80a2aa7df9ee (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:25.535604 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf30a4f63934c8fa1fb80a2aa7df9ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.536604 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf30a4f63934c8fa1fb80a2aa7df9ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.534761 11851 raft_consensus.cc:359] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:25.541002 11851 raft_consensus.cc:385] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.541352 11851 raft_consensus.cc:740] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.542289 11851 consensus_queue.cc:260] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:25.546166 11644 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac74a4093c34756a969a33ff35146ad (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:25.547480 11644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac74a4093c34756a969a33ff35146ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.549902 11576 tablet_service.cc:1511] Processing CreateTablet for tablet 63eff9adc00b4c7f8245454c066123ed (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:25.550431 11571 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac74a4093c34756a969a33ff35146ad (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:25.551317 11576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63eff9adc00b4c7f8245454c066123ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.551602 11724 tablet_service.cc:1511] Processing CreateTablet for tablet 63eff9adc00b4c7f8245454c066123ed (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:25.552189 11571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac74a4093c34756a969a33ff35146ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.553915 11651 tablet_service.cc:1511] Processing CreateTablet for tablet efb370bb0e99488f947f70704fee6e53 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:25.555256 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efb370bb0e99488f947f70704fee6e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.559039 11851 ts_tablet_manager.cc:1434] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:16:25.560148 11851 tablet_bootstrap.cc:492] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:25.569031 11719 tablet_service.cc:1511] Processing CreateTablet for tablet efb370bb0e99488f947f70704fee6e53 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:25.540791 11854 tablet_bootstrap.cc:654] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.570293 11861 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.570847 11861 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:25.617766 11858 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.618412 11858 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:25.630386 11532 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:25.630769 11853 tablet_bootstrap.cc:492] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:25.631342 11881 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.632085 11870 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:25.632242 11568 tablet_service.cc:1511] Processing CreateTablet for tablet 46a96b7da08f479dbbc7413cdacfa720 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:25.666056 11723 tablet_service.cc:1511] Processing CreateTablet for tablet 7004b9d11647433b94b3d6a7c3e247f6 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:25.666827 11568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a96b7da08f479dbbc7413cdacfa720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.669793 11854 tablet_bootstrap.cc:492] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:25.670423 11854 ts_tablet_manager.cc:1403] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.137s	user 0.020s	sys 0.017s
I20260709 12:16:25.673465 11854 raft_consensus.cc:359] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:25.674299 11854 raft_consensus.cc:385] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.674613 11854 raft_consensus.cc:740] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.675482 11854 consensus_queue.cc:260] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:25.633864 11720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf30a4f63934c8fa1fb80a2aa7df9ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.633666 11796 tablet_service.cc:1511] Processing CreateTablet for tablet 3f44d8dd328e49b0b41e9345b6c2fb85 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:25.634963 11790 tablet_service.cc:1511] Processing CreateTablet for tablet 63eff9adc00b4c7f8245454c066123ed (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:25.635313 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:25.678630 11586 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:25.635457 11795 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac74a4093c34756a969a33ff35146ad (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:25.637403 11798 tablet_service.cc:1511] Processing CreateTablet for tablet efb370bb0e99488f947f70704fee6e53 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:25.637920 11852 tablet_bootstrap.cc:492] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:25.680018 11852 ts_tablet_manager.cc:1403] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.170s	user 0.013s	sys 0.002s
I20260709 12:16:25.680450 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f44d8dd328e49b0b41e9345b6c2fb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.682595 11573 tablet_service.cc:1511] Processing CreateTablet for tablet 7004b9d11647433b94b3d6a7c3e247f6 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:25.683070 11852 raft_consensus.cc:359] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.683876 11852 raft_consensus.cc:385] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.684149 11852 raft_consensus.cc:740] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.646283 11861 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:25.647401 11851 tablet_bootstrap.cc:654] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.647545 11643 tablet_service.cc:1511] Processing CreateTablet for tablet 46a96b7da08f479dbbc7413cdacfa720 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:25.686043 11643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a96b7da08f479dbbc7413cdacfa720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.686475 11795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac74a4093c34756a969a33ff35146ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.687727 11647 tablet_service.cc:1511] Processing CreateTablet for tablet 9aacd4a8780042e792f4c4c8566c7649 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:25.684074 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7004b9d11647433b94b3d6a7c3e247f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.689013 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aacd4a8780042e792f4c4c8566c7649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.689492 11721 tablet_service.cc:1511] Processing CreateTablet for tablet 9aacd4a8780042e792f4c4c8566c7649 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:25.649603 11717 tablet_service.cc:1511] Processing CreateTablet for tablet 46a96b7da08f479dbbc7413cdacfa720 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:25.650532 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:25.655229 11858 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:25.694113 11858 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.688215 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efb370bb0e99488f947f70704fee6e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.694571 11858 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.658792 11576 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1489fa6b6f4aa59c527ec8a7f1c37b (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:25.660213 11651 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1489fa6b6f4aa59c527ec8a7f1c37b (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:25.697645 11576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1489fa6b6f4aa59c527ec8a7f1c37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.697645 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1489fa6b6f4aa59c527ec8a7f1c37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.697489 11569 tablet_service.cc:1511] Processing CreateTablet for tablet 13f2b34efd194430a04442a394ce05c1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:25.699024 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63eff9adc00b4c7f8245454c066123ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:25.701025 11698 leader_election.cc:343] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.702425 11858 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:25.703255 11569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f2b34efd194430a04442a394ce05c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.706580 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:25.665030 11881 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.710996 11661 raft_consensus.cc:2468] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:25.714074 11717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a96b7da08f479dbbc7413cdacfa720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.715512 11699 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:25.716395 11858 raft_consensus.cc:2804] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.716748 11858 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.716894 11870 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:25.717515 11858 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.717967 11852 consensus_queue.cc:260] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.730937 11852 ts_tablet_manager.cc:1434] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:16:25.728104 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63eff9adc00b4c7f8245454c066123ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.731384 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:25.749221 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:25.749922 11585 raft_consensus.cc:2468] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:25.751108 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:25.751772 11584 raft_consensus.cc:2468] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:25.752121 11852 tablet_bootstrap.cc:492] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:25.753836 11718 tablet_service.cc:1511] Processing CreateTablet for tablet 13f2b34efd194430a04442a394ce05c1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:25.755246 11627 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:25.756093 11870 raft_consensus.cc:2804] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.756450 11870 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.756793 11870 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.757719 11651 tablet_service.cc:1511] Processing CreateTablet for tablet 13f2b34efd194430a04442a394ce05c1 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:25.759500 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f2b34efd194430a04442a394ce05c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.761854 11881 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:16:25.765015 11627 leader_election.cc:343] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.771589 11870 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.772981 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:25.773921 11723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7004b9d11647433b94b3d6a7c3e247f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.774578 11718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f2b34efd194430a04442a394ce05c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.775225 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:25.775813 11586 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.777949 11861 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.778164 11701 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:25.779006 11852 tablet_bootstrap.cc:654] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.782056 11719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efb370bb0e99488f947f70704fee6e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.782511 11861 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:25.783318 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:25.784816 11861 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:25.785071 11870 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:25.790068 11721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aacd4a8780042e792f4c4c8566c7649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.798115 11722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f44d8dd328e49b0b41e9345b6c2fb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.804042 11885 raft_consensus.cc:2804] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.804944 11885 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.805356 11885 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.810034 11854 ts_tablet_manager.cc:1434] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.139s	user 0.012s	sys 0.000s
I20260709 12:16:25.811549 11854 tablet_bootstrap.cc:492] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:25.814723 11858 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.816095 11735 raft_consensus.cc:2393] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 1: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:25.817062 11885 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.818439 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:25.819307 11661 raft_consensus.cc:2393] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 1: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:25.820451 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:16:25.822075 11698 leader_election.cc:343] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.823747 11576 tablet_service.cc:1511] Processing CreateTablet for tablet bc6434e787264f388930e3ed1add578a (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:25.825117 11576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6434e787264f388930e3ed1add578a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.831936 11647 tablet_service.cc:1511] Processing CreateTablet for tablet bc6434e787264f388930e3ed1add578a (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:25.833256 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6434e787264f388930e3ed1add578a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.842864 11885 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:25.848635 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:25.850430 11775 leader_election.cc:343] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.816955 11858 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:25.861990 11725 tablet_service.cc:1511] Processing CreateTablet for tablet a54188b47043494b8e7d633bcfbcab11 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:25.863411 11725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a54188b47043494b8e7d633bcfbcab11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.867230 11586 raft_consensus.cc:2468] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:25.868551 11627 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:25.869426 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:25.869902 11851 tablet_bootstrap.cc:492] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:25.870074 11584 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.871547 11851 ts_tablet_manager.cc:1403] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.312s	user 0.018s	sys 0.023s
I20260709 12:16:25.874043 11886 raft_consensus.cc:2804] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.874572 11886 raft_consensus.cc:697] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:25.875365 11886 consensus_queue.cc:237] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.878068 11651 tablet_service.cc:1511] Processing CreateTablet for tablet 7195b55fe02f4056bfc2b0e22978a3ff (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:25.879194 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7195b55fe02f4056bfc2b0e22978a3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.887317 11569 tablet_service.cc:1511] Processing CreateTablet for tablet a54188b47043494b8e7d633bcfbcab11 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:25.889593 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:25.895731 11586 raft_consensus.cc:2393] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 1: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:25.898731 11701 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:25.900023 11858 raft_consensus.cc:2749] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.893990 11584 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:25.903247 11701 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:25.904697 11858 raft_consensus.cc:2804] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.904345 11576 tablet_service.cc:1511] Processing CreateTablet for tablet ee0cd617dac6426780fb32e90db31859 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:25.874668 11851 raft_consensus.cc:359] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:25.906038 11851 raft_consensus.cc:385] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.906236 11858 raft_consensus.cc:697] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:25.907822 11860 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.907387 11858 consensus_queue.cc:237] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.908322 11860 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:25.906363 11851 raft_consensus.cc:740] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.912312 11851 consensus_queue.cc:260] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:25.913162 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:25.910503 11860 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:25.905560 11853 tablet_bootstrap.cc:654] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.906226 11576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0cd617dac6426780fb32e90db31859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.912262 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:25.921615 11735 raft_consensus.cc:2468] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
W20260709 12:16:25.917243 11550 leader_election.cc:343] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.922840 11851 ts_tablet_manager.cc:1434] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:16:25.923415 11651 tablet_service.cc:1511] Processing CreateTablet for tablet ee0cd617dac6426780fb32e90db31859 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:25.926076 11550 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:25.926692 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0cd617dac6426780fb32e90db31859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.927181 11860 raft_consensus.cc:2804] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.927572 11860 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.927887 11860 raft_consensus.cc:3060] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.923878 11851 tablet_bootstrap.cc:492] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:25.924099 11854 tablet_bootstrap.cc:654] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.925750 11852 tablet_bootstrap.cc:492] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:25.932436 11852 ts_tablet_manager.cc:1403] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.183s	user 0.038s	sys 0.020s
I20260709 12:16:25.934513 11719 tablet_service.cc:1511] Processing CreateTablet for tablet 7195b55fe02f4056bfc2b0e22978a3ff (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:25.935521 11852 raft_consensus.cc:359] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:25.935866 11719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7195b55fe02f4056bfc2b0e22978a3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.936290 11852 raft_consensus.cc:385] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.936797 11724 tablet_service.cc:1511] Processing CreateTablet for tablet ee0cd617dac6426780fb32e90db31859 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:25.937831 11852 raft_consensus.cc:740] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.940107 11852 consensus_queue.cc:260] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:25.947902 11569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a54188b47043494b8e7d633bcfbcab11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.952353 11790 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1489fa6b6f4aa59c527ec8a7f1c37b (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:25.954528 11851 tablet_bootstrap.cc:654] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.957376 11483 catalog_manager.cc:5697] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.961404 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1489fa6b6f4aa59c527ec8a7f1c37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.951745 11724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0cd617dac6426780fb32e90db31859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.972008 11798 tablet_service.cc:1511] Processing CreateTablet for tablet 7004b9d11647433b94b3d6a7c3e247f6 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:25.973559 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7004b9d11647433b94b3d6a7c3e247f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.982285 11796 tablet_service.cc:1511] Processing CreateTablet for tablet 9aacd4a8780042e792f4c4c8566c7649 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:25.983672 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aacd4a8780042e792f4c4c8566c7649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.991683 11854 tablet_bootstrap.cc:492] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:25.992318 11854 ts_tablet_manager.cc:1403] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.181s	user 0.015s	sys 0.018s
I20260709 12:16:25.994306 11795 tablet_service.cc:1511] Processing CreateTablet for tablet bc6434e787264f388930e3ed1add578a (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:25.997210 11795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6434e787264f388930e3ed1add578a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:25.997586 11851 tablet_bootstrap.cc:492] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:25.998063 11851 ts_tablet_manager.cc:1403] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.007s
I20260709 12:16:26.000228 11851 raft_consensus.cc:359] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.000762 11851 raft_consensus.cc:385] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.996266 11860 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.001158 11851 raft_consensus.cc:740] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.991683 11853 tablet_bootstrap.cc:492] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:26.002326 11853 ts_tablet_manager.cc:1403] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.372s	user 0.017s	sys 0.006s
I20260709 12:16:26.002249 11851 consensus_queue.cc:260] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.003345 11860 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:26.005193 11851 ts_tablet_manager.cc:1434] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:16:26.006393 11851 tablet_bootstrap.cc:492] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:26.006278 11853 raft_consensus.cc:359] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.006740 11854 raft_consensus.cc:359] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.007450 11853 raft_consensus.cc:385] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.007783 11854 raft_consensus.cc:385] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.009227 11854 raft_consensus.cc:740] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.010792 11854 consensus_queue.cc:260] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.012450 11854 ts_tablet_manager.cc:1434] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:16:26.057114 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:26.058970 11735 raft_consensus.cc:3060] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.075964 11792 tablet_service.cc:1511] Processing CreateTablet for tablet 7195b55fe02f4056bfc2b0e22978a3ff (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:26.077921 11793 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4a55c602a24e9aa3bd55a9fef99c18 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:26.078866 11792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7195b55fe02f4056bfc2b0e22978a3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.007839 11853 raft_consensus.cc:740] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.081185 11794 tablet_service.cc:1511] Processing CreateTablet for tablet d3c499278cbd4f3094888a0d7373a5dc (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:26.085036 11793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4a55c602a24e9aa3bd55a9fef99c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.088343 11853 consensus_queue.cc:260] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.091506 11853 ts_tablet_manager.cc:1434] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.000s
I20260709 12:16:26.092021 11852 ts_tablet_manager.cc:1434] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.159s	user 0.014s	sys 0.022s
I20260709 12:16:26.092973 11794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c499278cbd4f3094888a0d7373a5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.093405 11853 tablet_bootstrap.cc:492] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:26.093976 11852 tablet_bootstrap.cc:492] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:26.096329 11851 tablet_bootstrap.cc:654] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.075964 11791 tablet_service.cc:1511] Processing CreateTablet for tablet a54188b47043494b8e7d633bcfbcab11 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:26.097854 11861 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.098414 11791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a54188b47043494b8e7d633bcfbcab11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.099313 11861 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.104882 11861 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:26.109537 11568 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4a55c602a24e9aa3bd55a9fef99c18 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:26.111688 11568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4a55c602a24e9aa3bd55a9fef99c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.113226 11852 tablet_bootstrap.cc:654] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.114318 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:26.114873 11853 tablet_bootstrap.cc:654] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.115588 11854 tablet_bootstrap.cc:492] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
W20260709 12:16:26.116330 11550 leader_election.cc:343] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.126390 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:26.127250 11809 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.130297 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:26.131001 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:26.131265 11661 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:26.132939 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:26.136762 11809 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
W20260709 12:16:26.138440 11773 leader_election.cc:343] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.139519 11773 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:26.140671 11735 raft_consensus.cc:2468] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:26.143581 11550 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:26.145079 11861 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.145560 11861 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.145952 11861 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.144923 11896 raft_consensus.cc:2804] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.146641 11896 raft_consensus.cc:697] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:26.147851 11896 consensus_queue.cc:237] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:26.154311 11773 leader_election.cc:343] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.155750 11651 tablet_service.cc:1511] Processing CreateTablet for tablet d3c499278cbd4f3094888a0d7373a5dc (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:26.157390 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:26.157349 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c499278cbd4f3094888a0d7373a5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.152314 11854 tablet_bootstrap.cc:654] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.158387 11624 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:26.166170 11886 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.166769 11886 raft_consensus.cc:697] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:26.167766 11886 consensus_queue.cc:237] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:16:26.170583 11773 leader_election.cc:343] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.173888 11573 tablet_service.cc:1511] Processing CreateTablet for tablet d3c499278cbd4f3094888a0d7373a5dc (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:26.174345 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:26.176144 11721 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4a55c602a24e9aa3bd55a9fef99c18 (DEFAULT_TABLE table=test-workload [id=7fc0074f127a4744b0029f24c0b6b8fe]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:26.178721 11735 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:26.179345 11721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4a55c602a24e9aa3bd55a9fef99c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.182976 11573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c499278cbd4f3094888a0d7373a5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:26.188668 11853 tablet_bootstrap.cc:492] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:26.184434 11773 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:26.189332 11853 ts_tablet_manager.cc:1403] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.003s
I20260709 12:16:26.199429 11484 catalog_manager.cc:5697] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.202858 11853 raft_consensus.cc:359] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.228621 11896 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.229306 11896 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.229704 11861 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.231688 11896 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:26.233186 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:26.235563 11584 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.233907 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:26.216564 11853 raft_consensus.cc:385] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.246919 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:26.251246 11809 raft_consensus.cc:2393] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 1: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:26.238956 11853 raft_consensus.cc:740] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.252985 11853 consensus_queue.cc:260] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.253803 11852 tablet_bootstrap.cc:492] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:26.254385 11852 ts_tablet_manager.cc:1403] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.161s	user 0.020s	sys 0.010s
I20260709 12:16:26.257239 11853 ts_tablet_manager.cc:1434] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.068s	user 0.002s	sys 0.007s
I20260709 12:16:26.257936 11659 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:26.261950 11861 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:26.266330 11861 raft_consensus.cc:2749] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.266410 11550 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:26.274602 11901 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.275182 11901 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:26.239203 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 69165.5us
I20260709 12:16:26.278774 11853 tablet_bootstrap.cc:492] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:26.257704 11852 raft_consensus.cc:359] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.290588 11852 raft_consensus.cc:385] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.290974 11852 raft_consensus.cc:740] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.292106 11852 consensus_queue.cc:260] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.292644 11584 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:26.298528 11896 raft_consensus.cc:2764] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:16:26.298666 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:26.298728 11901 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:26.299772 11586 raft_consensus.cc:2393] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 1: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:26.302455 11851 tablet_bootstrap.cc:492] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:26.303125 11851 ts_tablet_manager.cc:1403] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.297s	user 0.018s	sys 0.016s
I20260709 12:16:26.303611 11854 tablet_bootstrap.cc:492] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:26.304109 11854 ts_tablet_manager.cc:1403] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.189s	user 0.016s	sys 0.006s
I20260709 12:16:26.306622 11851 raft_consensus.cc:359] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.307430 11851 raft_consensus.cc:385] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.307704 11851 raft_consensus.cc:740] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.308337 11481 catalog_manager.cc:5697] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.308748 11851 consensus_queue.cc:260] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.311553 11851 ts_tablet_manager.cc:1434] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:26.312726 11851 tablet_bootstrap.cc:492] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:26.313735 11853 tablet_bootstrap.cc:654] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.314626 11854 raft_consensus.cc:359] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.315131 11775 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:26.316224 11901 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.316354 11852 ts_tablet_manager.cc:1434] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.002s
I20260709 12:16:26.316768 11901 raft_consensus.cc:697] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:26.315412 11854 raft_consensus.cc:385] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.317941 11854 raft_consensus.cc:740] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.318011 11901 consensus_queue.cc:237] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.319039 11852 tablet_bootstrap.cc:492] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:26.323318 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:26.323966 11659 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.328850 11853 tablet_bootstrap.cc:492] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:26.329217 11851 tablet_bootstrap.cc:654] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.329385 11853 ts_tablet_manager.cc:1403] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.009s
I20260709 12:16:26.331769 11659 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:26.332808 11853 raft_consensus.cc:359] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.334352 11773 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:26.335502 11861 raft_consensus.cc:2804] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.335896 11861 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.336200 11861 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.343326 11861 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.345400 11861 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:26.333565 11853 raft_consensus.cc:385] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.350080 11853 raft_consensus.cc:740] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.351083 11853 consensus_queue.cc:260] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.354753 11851 tablet_bootstrap.cc:492] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:26.355326 11851 ts_tablet_manager.cc:1403] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.043s	user 0.023s	sys 0.008s
I20260709 12:16:26.356947 11854 consensus_queue.cc:260] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.357999 11886 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.365734 11886 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.366204 11484 catalog_manager.cc:5697] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.367496 11854 ts_tablet_manager.cc:1434] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.000s
I20260709 12:16:26.368050 11886 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:26.354802 11853 ts_tablet_manager.cc:1434] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:16:26.368782 11854 tablet_bootstrap.cc:492] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:26.369554 11853 tablet_bootstrap.cc:492] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:26.359028 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:26.360167 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:26.371011 11734 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.375157 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:26.377737 11627 leader_election.cc:343] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.369599 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:16:26.383704 11625 leader_election.cc:343] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.384243 11625 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:26.385149 11886 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.394703 11854 tablet_bootstrap.cc:654] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.359464 11851 raft_consensus.cc:359] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.363440 11482 catalog_manager.cc:5697] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.365252 11852 tablet_bootstrap.cc:654] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.395362 11851 raft_consensus.cc:385] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.395808 11851 raft_consensus.cc:740] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.396667 11851 consensus_queue.cc:260] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.399302 11809 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.399243 11851 ts_tablet_manager.cc:1434] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:16:26.400960 11851 tablet_bootstrap.cc:492] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:26.403194 11870 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.403741 11870 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.403653 11886 consensus_queue.cc:1048] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:16:26.394703 11853 tablet_bootstrap.cc:654] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.414252 11870 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:26.414867 11870 consensus_queue.cc:1048] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.416297 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:26.416741 11851 tablet_bootstrap.cc:654] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.396615 11734 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:26.361358 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:26.419010 11659 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.422227 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:26.423074 11808 raft_consensus.cc:2393] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 1: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:26.426919 11853 tablet_bootstrap.cc:492] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:26.427129 11773 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:26.428522 11773 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:26.427495 11853 ts_tablet_manager.cc:1403] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.011s
I20260709 12:16:26.429935 11851 tablet_bootstrap.cc:492] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:26.434587 11851 ts_tablet_manager.cc:1403] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.003s
I20260709 12:16:26.437007 11852 tablet_bootstrap.cc:492] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:26.437011 11659 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:26.437350 11851 raft_consensus.cc:359] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.437798 11852 ts_tablet_manager.cc:1403] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.120s	user 0.022s	sys 0.009s
I20260709 12:16:26.438115 11851 raft_consensus.cc:385] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.438398 11851 raft_consensus.cc:740] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.439199 11624 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:26.433936 11901 raft_consensus.cc:2804] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.442619 11870 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.447891 11853 raft_consensus.cc:359] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.448762 11853 raft_consensus.cc:385] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.449054 11853 raft_consensus.cc:740] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.449522 11852 raft_consensus.cc:359] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.450615 11861 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.442117 11851 consensus_queue.cc:260] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.449900 11853 consensus_queue.cc:260] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.453009 11858 consensus_queue.cc:1048] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:26.453519 11852 raft_consensus.cc:385] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.458156 11852 raft_consensus.cc:740] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.466715 11854 tablet_bootstrap.cc:492] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:26.467337 11854 ts_tablet_manager.cc:1403] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.099s	user 0.026s	sys 0.019s
I20260709 12:16:26.471659 11858 consensus_queue.cc:1048] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:26.459671 11901 raft_consensus.cc:697] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:26.475344 11851 ts_tablet_manager.cc:1434] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.005s
I20260709 12:16:26.476678 11851 tablet_bootstrap.cc:492] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:26.487054 11854 raft_consensus.cc:359] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.492161 11854 raft_consensus.cc:385] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.492946 11854 raft_consensus.cc:740] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.472813 11852 consensus_queue.cc:260] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.499680 11854 consensus_queue.cc:260] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.505290 11854 ts_tablet_manager.cc:1434] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:16:26.502591 11901 consensus_queue.cc:237] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.506800 11853 ts_tablet_manager.cc:1434] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.007s
I20260709 12:16:26.508059 11853 tablet_bootstrap.cc:492] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:26.508824 11854 tablet_bootstrap.cc:492] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:26.510528 11851 tablet_bootstrap.cc:654] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.512518 11852 ts_tablet_manager.cc:1434] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 12:16:26.513742 11852 tablet_bootstrap.cc:492] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:26.524405 11853 tablet_bootstrap.cc:654] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.524621 11852 tablet_bootstrap.cc:654] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.520478 11854 tablet_bootstrap.cc:654] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.548930 11854 tablet_bootstrap.cc:492] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:26.549582 11854 ts_tablet_manager.cc:1403] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.011s
I20260709 12:16:26.553090 11854 raft_consensus.cc:359] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.553642 11851 tablet_bootstrap.cc:492] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:26.554764 11851 ts_tablet_manager.cc:1403] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.000s
I20260709 12:16:26.553959 11482 catalog_manager.cc:5697] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.554015 11854 raft_consensus.cc:385] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.555895 11854 raft_consensus.cc:740] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.556802 11854 consensus_queue.cc:260] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.559185 11854 ts_tablet_manager.cc:1434] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:26.562503 11853 tablet_bootstrap.cc:492] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:26.563048 11853 ts_tablet_manager.cc:1403] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.055s	user 0.003s	sys 0.012s
I20260709 12:16:26.565470 11854 tablet_bootstrap.cc:492] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:26.565853 11853 raft_consensus.cc:359] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.566525 11853 raft_consensus.cc:385] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.561537 11851 raft_consensus.cc:359] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.566812 11853 raft_consensus.cc:740] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.567579 11853 consensus_queue.cc:260] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.573094 11853 ts_tablet_manager.cc:1434] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:16:26.573105 11852 tablet_bootstrap.cc:492] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:26.573783 11852 ts_tablet_manager.cc:1403] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.004s
I20260709 12:16:26.574386 11853 tablet_bootstrap.cc:492] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:26.576514 11852 raft_consensus.cc:359] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.577196 11852 raft_consensus.cc:385] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.577458 11852 raft_consensus.cc:740] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.578136 11852 consensus_queue.cc:260] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.580523 11851 raft_consensus.cc:385] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.580906 11851 raft_consensus.cc:740] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.581043 11853 tablet_bootstrap.cc:654] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.583231 11852 ts_tablet_manager.cc:1434] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:16:26.584493 11852 tablet_bootstrap.cc:492] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:26.588567 11860 consensus_queue.cc:1048] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:26.591616 11852 tablet_bootstrap.cc:654] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.581852 11851 consensus_queue.cc:260] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.601248 11851 ts_tablet_manager.cc:1434] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 12:16:26.602725 11851 tablet_bootstrap.cc:492] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:26.605824 11854 tablet_bootstrap.cc:654] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.612696 11851 tablet_bootstrap.cc:654] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.614516 11860 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.615087 11860 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.616148 11901 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.616652 11901 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.617354 11860 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:26.621608 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:26.619844 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:16:26.624075 11549 leader_election.cc:343] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.620577 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:26.621452 11853 tablet_bootstrap.cc:492] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:26.621351 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:26.625707 11550 leader_election.cc:343] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.625955 11853 ts_tablet_manager.cc:1403] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.011s
I20260709 12:16:26.626169 11550 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:26.618750 11901 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:26.627241 11860 raft_consensus.cc:2749] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.628492 11853 raft_consensus.cc:359] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.629014 11853 raft_consensus.cc:385] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.629271 11853 raft_consensus.cc:740] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
W20260709 12:16:26.630029 11775 leader_election.cc:343] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:26.630828 11773 leader_election.cc:343] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.631244 11773 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:26.631949 11901 raft_consensus.cc:2749] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.632948 11659 raft_consensus.cc:3060] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.632681 11853 consensus_queue.cc:260] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.634927 11853 ts_tablet_manager.cc:1434] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:16:26.636053 11853 tablet_bootstrap.cc:492] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
W20260709 12:16:26.642938 11532 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:26.644131 11860 consensus_queue.cc:1048] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.643668 11853 tablet_bootstrap.cc:654] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.648056 11901 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.648561 11901 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.651871 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:26.652772 11586 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:26.652849 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:26.653680 11661 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:26.654974 11775 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:26.656011 11922 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.656420 11922 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.656737 11922 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.657126 11852 tablet_bootstrap.cc:492] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:26.657708 11852 ts_tablet_manager.cc:1403] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.016s
I20260709 12:16:26.654608 11933 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.658735 11933 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.662331 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:26.662942 11809 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:26.664328 11698 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:26.664578 11901 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:26.665529 11933 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:26.666162 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:26.666468 11933 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.666837 11933 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.667168 11933 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.670671 11858 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:26.670985 11699 leader_election.cc:343] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.671187 11858 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.673282 11858 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:26.674968 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:26.674880 11922 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:26.676879 11701 leader_election.cc:343] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.678539 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:26.681624 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:26.682341 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:26.683003 11661 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.682374 11586 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.687868 11933 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.690028 11933 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:26.691394 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:26.692050 11809 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:26.682404 11699 leader_election.cc:343] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.693226 11699 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:26.695369 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:16:26.699596 11699 leader_election.cc:343] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.700382 11809 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:26.701958 11698 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:26.703258 11858 raft_consensus.cc:2749] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.703953 11858 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.704398 11858 raft_consensus.cc:697] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:26.705225 11858 consensus_queue.cc:237] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.707360 11922 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:26.716811 11661 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:26.719043 11854 tablet_bootstrap.cc:492] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:26.719959 11854 ts_tablet_manager.cc:1403] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.000s
I20260709 12:16:26.721500 11853 tablet_bootstrap.cc:492] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:26.722247 11853 ts_tablet_manager.cc:1403] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.086s	user 0.021s	sys 0.028s
I20260709 12:16:26.723071 11854 raft_consensus.cc:359] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.721575 11852 raft_consensus.cc:359] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.724673 11773 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:26.725380 11852 raft_consensus.cc:385] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.709746 11851 tablet_bootstrap.cc:492] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:26.725062 11853 raft_consensus.cc:359] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.725802 11852 raft_consensus.cc:740] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.725307 11854 raft_consensus.cc:385] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.726408 11851 ts_tablet_manager.cc:1403] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.000s
I20260709 12:16:26.726388 11854 raft_consensus.cc:740] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.713430 11586 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:26.726724 11852 consensus_queue.cc:260] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.725848 11922 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.726155 11853 raft_consensus.cc:385] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.729655 11851 raft_consensus.cc:359] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.730360 11853 raft_consensus.cc:740] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.730593 11851 raft_consensus.cc:385] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.730942 11851 raft_consensus.cc:740] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.731101 11853 consensus_queue.cc:260] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.731658 11851 consensus_queue.cc:260] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.733458 11853 ts_tablet_manager.cc:1434] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:26.733825 11851 ts_tablet_manager.cc:1434] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:26.734855 11851 tablet_bootstrap.cc:492] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:26.734879 11853 tablet_bootstrap.cc:492] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:26.733539 11482 catalog_manager.cc:5697] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.737710 11852 ts_tablet_manager.cc:1434] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.080s	user 0.020s	sys 0.009s
I20260709 12:16:26.741514 11851 tablet_bootstrap.cc:654] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.741516 11853 tablet_bootstrap.cc:654] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.746613 11852 tablet_bootstrap.cc:492] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:26.753393 11853 tablet_bootstrap.cc:492] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:26.753412 11852 tablet_bootstrap.cc:654] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.754099 11853 ts_tablet_manager.cc:1403] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.002s
I20260709 12:16:26.755916 11922 raft_consensus.cc:697] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:26.756987 11853 raft_consensus.cc:359] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.768154 11853 raft_consensus.cc:385] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.768517 11853 raft_consensus.cc:740] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.769194 11853 consensus_queue.cc:260] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.757949 11854 consensus_queue.cc:260] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.757845 11858 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.769912 11852 tablet_bootstrap.cc:492] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:26.770478 11852 ts_tablet_manager.cc:1403] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.005s
I20260709 12:16:26.770138 11858 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.771085 11853 ts_tablet_manager.cc:1434] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.006s
I20260709 12:16:26.772192 11853 tablet_bootstrap.cc:492] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:26.776494 11854 ts_tablet_manager.cc:1434] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.056s	user 0.013s	sys 0.002s
I20260709 12:16:26.777632 11854 tablet_bootstrap.cc:492] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:26.780844 11853 tablet_bootstrap.cc:654] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.773646 11858 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:26.757042 11922 consensus_queue.cc:237] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.774468 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:26.782214 11586 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:26.773412 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:26.771461 11851 tablet_bootstrap.cc:492] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:26.784409 11851 ts_tablet_manager.cc:1403] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.006s
I20260709 12:16:26.776376 11584 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.773520 11852 raft_consensus.cc:359] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.784894 11852 raft_consensus.cc:385] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.783531 11701 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:16:26.790448 11698 leader_election.cc:343] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.791087 11851 raft_consensus.cc:359] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.791363 11914 consensus_queue.cc:1048] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:26.791818 11851 raft_consensus.cc:385] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.792096 11851 raft_consensus.cc:740] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.790686 11933 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.792819 11851 consensus_queue.cc:260] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.795275 11851 ts_tablet_manager.cc:1434] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:16:26.790308 11854 tablet_bootstrap.cc:654] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.796380 11851 tablet_bootstrap.cc:492] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:26.796868 11914 consensus_queue.cc:1048] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:26.801326 11933 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.801744 11933 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.803079 11851 tablet_bootstrap.cc:654] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.786607 11852 raft_consensus.cc:740] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.804807 11858 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.805311 11852 consensus_queue.cc:260] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.805332 11858 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.808525 11852 ts_tablet_manager.cc:1434] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 12:16:26.808970 11858 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:26.811316 11853 tablet_bootstrap.cc:492] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:26.811902 11853 ts_tablet_manager.cc:1403] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.005s
I20260709 12:16:26.809677 11482 catalog_manager.cc:5697] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.812687 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:16:26.814035 11698 leader_election.cc:343] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.811131 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:26.814311 11933 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.815858 11852 tablet_bootstrap.cc:492] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:26.817201 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:26.817411 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:26.814848 11853 raft_consensus.cc:359] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.818158 11586 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:26.818774 11698 leader_election.cc:343] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.818440 11853 raft_consensus.cc:385] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.824541 11853 raft_consensus.cc:740] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
W20260709 12:16:26.825693 11699 leader_election.cc:343] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.826220 11699 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:26.825896 11853 consensus_queue.cc:260] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.827793 11852 tablet_bootstrap.cc:654] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.832172 11942 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.832834 11942 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.835216 11942 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:26.837340 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:26.838143 11734 raft_consensus.cc:2468] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:26.837342 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:26.839636 11661 raft_consensus.cc:2468] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:26.843724 11858 raft_consensus.cc:2749] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.845131 11586 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:26.843694 11853 ts_tablet_manager.cc:1434] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:16:26.825297 11933 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:26.847940 11701 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:26.852542 11858 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.845029 11550 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:26.850978 11853 tablet_bootstrap.cc:492] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:26.853001 11858 raft_consensus.cc:697] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:26.852852 11922 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.858899 11858 consensus_queue.cc:237] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.860545 11922 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.863396 11922 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:26.860726 11942 raft_consensus.cc:2804] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.864152 11942 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.864508 11942 raft_consensus.cc:3060] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.867386 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:26.869505 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:16:26.872689 11773 leader_election.cc:343] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:26.873479 11773 leader_election.cc:343] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.873917 11773 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:26.874511 11922 raft_consensus.cc:2749] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.876955 11854 tablet_bootstrap.cc:492] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:26.877295 11852 tablet_bootstrap.cc:492] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:26.877446 11854 ts_tablet_manager.cc:1403] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.100s	user 0.018s	sys 0.022s
I20260709 12:16:26.870735 11933 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.880635 11852 ts_tablet_manager.cc:1403] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.000s
I20260709 12:16:26.880448 11933 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.884444 11922 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.883782 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:26.886025 11809 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:26.886912 11853 tablet_bootstrap.cc:654] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.887102 11698 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:26.888140 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:26.884995 11922 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.882700 11933 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:26.889866 11933 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.890267 11933 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.890641 11933 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.891216 11852 raft_consensus.cc:359] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.891877 11852 raft_consensus.cc:385] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.892145 11922 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:26.884953 11854 raft_consensus.cc:359] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.893222 11854 raft_consensus.cc:385] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:26.893447 11699 leader_election.cc:343] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.894650 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:26.893548 11854 raft_consensus.cc:740] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.879451 11942 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.895330 11901 consensus_queue.cc:1048] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.895839 11854 consensus_queue.cc:260] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.892141 11852 raft_consensus.cc:740] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.897939 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:26.897303 11942 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:26.898190 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:26.898711 11661 raft_consensus.cc:3060] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.898912 11734 raft_consensus.cc:3060] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.905669 11661 raft_consensus.cc:2468] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:26.906639 11851 tablet_bootstrap.cc:492] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:26.906947 11550 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:26.907938 11896 raft_consensus.cc:2804] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.907151 11851 ts_tablet_manager.cc:1403] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.017s
I20260709 12:16:26.908393 11896 raft_consensus.cc:697] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:26.909545 11896 consensus_queue.cc:237] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.899991 11586 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:26.911130 11851 raft_consensus.cc:359] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.911857 11851 raft_consensus.cc:385] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.912139 11851 raft_consensus.cc:740] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.911305 11775 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:26.913640 11901 raft_consensus.cc:2804] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.914036 11901 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.914083 11734 raft_consensus.cc:2468] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:26.914460 11901 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.916244 11851 consensus_queue.cc:260] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.917884 11851 ts_tablet_manager.cc:1434] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:26.898222 11852 consensus_queue.cc:260] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.919018 11851 tablet_bootstrap.cc:492] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:26.920198 11852 ts_tablet_manager.cc:1434] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:16:26.921342 11852 tablet_bootstrap.cc:492] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:26.926568 11851 tablet_bootstrap.cc:654] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.928773 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:26.929529 11733 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:26.930511 11933 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.937568 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:16:26.939033 11699 leader_election.cc:343] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.939675 11851 tablet_bootstrap.cc:492] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:26.940229 11851 ts_tablet_manager.cc:1403] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 12:16:26.940989 11854 ts_tablet_manager.cc:1434] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.001s
I20260709 12:16:26.942157 11854 tablet_bootstrap.cc:492] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:26.942003 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:26.942651 11808 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.943064 11851 raft_consensus.cc:359] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.943804 11851 raft_consensus.cc:385] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.944056 11851 raft_consensus.cc:740] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.931142 11483 catalog_manager.cc:5697] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.945003 11851 consensus_queue.cc:260] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.947528 11851 ts_tablet_manager.cc:1434] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:26.950554 11851 tablet_bootstrap.cc:492] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:26.952221 11861 consensus_queue.cc:1048] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.954967 11852 tablet_bootstrap.cc:654] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.959343 11808 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:26.960657 11698 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:26.950877 11933 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:26.961573 11858 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.962136 11858 raft_consensus.cc:697] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:26.963078 11858 consensus_queue.cc:237] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.937181 11901 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.967309 11901 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:26.964969 11851 tablet_bootstrap.cc:654] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.969038 11854 tablet_bootstrap.cc:654] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.968937 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:26.970047 11584 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.979728 11584 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:26.988514 11775 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:26.989336 11901 raft_consensus.cc:2804] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.990590 11901 raft_consensus.cc:697] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:26.990962 11852 tablet_bootstrap.cc:492] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:26.991497 11852 ts_tablet_manager.cc:1403] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.016s
I20260709 12:16:26.992178 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:26.992810 11734 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.993162 11853 tablet_bootstrap.cc:492] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:26.993412 11854 tablet_bootstrap.cc:492] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:26.993618 11853 ts_tablet_manager.cc:1403] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.143s	user 0.015s	sys 0.000s
I20260709 12:16:26.993909 11854 ts_tablet_manager.cc:1403] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.052s	user 0.005s	sys 0.009s
I20260709 12:16:26.994246 11852 raft_consensus.cc:359] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.994921 11852 raft_consensus.cc:385] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.995163 11852 raft_consensus.cc:740] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.995970 11852 consensus_queue.cc:260] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:26.996421 11853 raft_consensus.cc:359] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:26.996862 11854 raft_consensus.cc:359] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:26.997633 11854 raft_consensus.cc:385] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.997931 11854 raft_consensus.cc:740] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.998170 11852 ts_tablet_manager.cc:1434] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:26.999208 11852 tablet_bootstrap.cc:492] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:26.999532 11854 consensus_queue.cc:260] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.000058 11484 catalog_manager.cc:5697] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.002020 11854 ts_tablet_manager.cc:1434] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:27.003243 11854 tablet_bootstrap.cc:492] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:27.004204 11482 catalog_manager.cc:5697] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.005658 11852 tablet_bootstrap.cc:654] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.991415 11901 consensus_queue.cc:237] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:26.997047 11853 raft_consensus.cc:385] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.009613 11854 tablet_bootstrap.cc:654] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.012583 11853 raft_consensus.cc:740] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.018074 11914 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.018632 11914 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.019483 11853 consensus_queue.cc:260] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.020044 11861 consensus_queue.cc:1048] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.020704 11914 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:27.021917 11853 ts_tablet_manager.cc:1434] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:16:27.022470 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:27.023164 11853 tablet_bootstrap.cc:492] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:27.033409 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:27.023186 11584 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:27.040282 11627 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:27.041467 11914 raft_consensus.cc:2804] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.041888 11914 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.042219 11914 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.042747 11734 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
W20260709 12:16:27.051738 11624 leader_election.cc:343] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.052209 11896 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.052721 11896 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.055153 11896 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:27.056706 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:27.057399 11808 raft_consensus.cc:2468] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:27.058024 11914 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.059351 11549 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:27.060487 11942 raft_consensus.cc:2804] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.060850 11942 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.061161 11942 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.061434 11914 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:27.062391 11852 tablet_bootstrap.cc:492] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:27.062881 11852 ts_tablet_manager.cc:1403] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.008s
I20260709 12:16:27.063108 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:27.063679 11584 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.065874 11852 raft_consensus.cc:359] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.069696 11861 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.074394 11852 raft_consensus.cc:385] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.074489 11851 tablet_bootstrap.cc:492] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:27.074813 11852 raft_consensus.cc:740] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.066288 11901 consensus_queue.cc:1048] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:16:27.070058 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:27.075650 11852 consensus_queue.cc:260] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.069020 11854 tablet_bootstrap.cc:492] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:27.076807 11860 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.077119 11854 ts_tablet_manager.cc:1403] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.008s
I20260709 12:16:27.068614 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:27.078121 11852 ts_tablet_manager.cc:1434] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:16:27.078112 11734 raft_consensus.cc:2468] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
W20260709 12:16:27.077312 11624 leader_election.cc:343] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.074632 11861 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.080173 11854 raft_consensus.cc:359] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.080818 11854 raft_consensus.cc:385] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.081075 11854 raft_consensus.cc:740] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.081926 11853 tablet_bootstrap.cc:654] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.082368 11852 tablet_bootstrap.cc:492] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:27.082532 11861 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:27.084656 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:27.084779 11854 consensus_queue.cc:260] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.085850 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:27.086796 11773 leader_election.cc:343] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:27.087505 11775 leader_election.cc:343] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.087993 11854 ts_tablet_manager.cc:1434] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 12:16:27.087936 11775 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:27.088701 11852 tablet_bootstrap.cc:654] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.089111 11854 tablet_bootstrap.cc:492] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:27.089057 11901 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.089635 11901 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.091666 11901 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:27.092137 11901 raft_consensus.cc:2749] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.094141 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.094503 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:27.094873 11659 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:27.095211 11734 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:27.096310 11773 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:27.077291 11860 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.097260 11901 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.097656 11901 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.098037 11901 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.098963 11860 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:27.101794 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.076375 11483 catalog_manager.cc:5697] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:27.103482 11550 leader_election.cc:343] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.101720 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:27.104862 11734 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:27.106173 11550 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:27.107313 11860 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.107690 11860 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.108026 11860 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.110755 11584 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:27.112126 11627 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:27.110699 11854 tablet_bootstrap.cc:654] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.116919 11853 tablet_bootstrap.cc:492] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:27.117437 11853 ts_tablet_manager.cc:1403] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.008s
I20260709 12:16:27.120398 11853 raft_consensus.cc:359] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.121083 11853 raft_consensus.cc:385] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.121330 11853 raft_consensus.cc:740] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.114166 11942 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.122181 11851 ts_tablet_manager.cc:1403] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.172s	user 0.023s	sys 0.015s
I20260709 12:16:27.124917 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:27.125624 11734 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.129007 11860 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.130307 11942 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:27.124883 11914 raft_consensus.cc:2804] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.131410 11914 raft_consensus.cc:697] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:27.131695 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:27.132278 11808 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.132217 11914 consensus_queue.cc:237] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.141189 11661 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.143051 11852 tablet_bootstrap.cc:492] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:27.143389 11853 consensus_queue.cc:260] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.143680 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:27.144194 11852 ts_tablet_manager.cc:1403] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.062s	user 0.033s	sys 0.006s
W20260709 12:16:27.145184 11550 leader_election.cc:343] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.147145 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:27.147328 11852 raft_consensus.cc:359] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.147761 11735 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.148180 11852 raft_consensus.cc:385] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.148597 11852 raft_consensus.cc:740] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.149436 11852 consensus_queue.cc:260] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.150724 11808 raft_consensus.cc:2468] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:27.151473 11852 ts_tablet_manager.cc:1434] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:27.151985 11549 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:27.152482 11852 tablet_bootstrap.cc:492] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:27.155300 11896 raft_consensus.cc:2804] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.155841 11896 raft_consensus.cc:697] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:27.156643 11896 consensus_queue.cc:237] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.158505 11852 tablet_bootstrap.cc:654] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.163383 11735 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:27.165135 11550 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:27.166077 11942 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.168002 11901 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.170011 11860 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:27.170228 11851 raft_consensus.cc:359] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.170909 11851 raft_consensus.cc:385] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.171178 11851 raft_consensus.cc:740] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.171928 11851 consensus_queue.cc:260] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.177479 11858 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.178049 11858 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.179121 11922 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.179663 11922 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.145473 11853 ts_tablet_manager.cc:1434] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:16:27.180171 11858 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:27.181367 11853 tablet_bootstrap.cc:492] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:27.182015 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.182963 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:27.183755 11584 raft_consensus.cc:2393] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 1: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
W20260709 12:16:27.184372 11699 leader_election.cc:343] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.187098 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.187553 11942 raft_consensus.cc:697] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:27.188496 11942 consensus_queue.cc:237] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.189283 11773 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:27.190150 11858 consensus_queue.cc:1048] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.190418 11922 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:27.184731 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:27.191428 11861 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.191381 11886 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.192579 11886 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:27.192883 11701 leader_election.cc:343] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.193360 11701 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:27.194433 11933 raft_consensus.cc:2749] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.195029 11870 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.195497 11870 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.197458 11870 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:27.198876 11861 raft_consensus.cc:2749] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.199944 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:27.194651 11886 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:27.203491 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:27.204198 11809 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:27.208050 11624 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:27.210089 11853 tablet_bootstrap.cc:654] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.212090 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:16:27.213804 11624 leader_election.cc:343] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.214450 11734 raft_consensus.cc:2468] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:27.216365 11481 catalog_manager.cc:5697] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:27.221520 11922 consensus_queue.cc:1048] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.235870 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:27.236604 11661 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.239130 11858 consensus_queue.cc:1048] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.245059 11886 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:27.246642 11886 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:27.247141 11886 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:27.249277 11550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 83075.6us
I20260709 12:16:27.257649 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:27.262836 11627 leader_election.cc:343] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.263345 11627 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:27.265304 11914 raft_consensus.cc:2749] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.274122 11886 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.274312 11920 consensus_queue.cc:1048] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.276863 11660 raft_consensus.cc:1240] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:27.278498 11896 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.279076 11896 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.280936 11858 consensus_queue.cc:1059] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.282136 11933 raft_consensus.cc:3055] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:27.282516 11933 raft_consensus.cc:740] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:27.282588 11896 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:27.283316 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:27.283380 11933 consensus_queue.cc:260] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.177279 11851 ts_tablet_manager.cc:1434] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.001s
I20260709 12:16:27.284651 11933 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:27.285801 11549 leader_election.cc:343] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.287043 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:27.285179 11482 catalog_manager.cc:5697] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:27.288671 11550 leader_election.cc:343] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.289160 11550 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:27.289739 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:27.289899 11896 raft_consensus.cc:2749] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.291628 11734 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.288410 11482 catalog_manager.cc:5697] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.287092 11852 tablet_bootstrap.cc:492] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:27.296204 11852 ts_tablet_manager.cc:1403] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.144s	user 0.034s	sys 0.035s
I20260709 12:16:27.298383 11851 tablet_bootstrap.cc:492] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:27.288601 11901 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:27.302420 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:27.302639 11661 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:27.304510 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:27.305620 11773 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:27.306392 11886 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:27.310593 11901 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.311136 11901 raft_consensus.cc:697] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:27.311960 11901 consensus_queue.cc:237] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.320672 11734 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:27.321306 11854 tablet_bootstrap.cc:492] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:27.321054 11852 raft_consensus.cc:359] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.321820 11852 raft_consensus.cc:385] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.321822 11854 ts_tablet_manager.cc:1403] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.233s	user 0.023s	sys 0.022s
I20260709 12:16:27.322271 11852 raft_consensus.cc:740] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.323022 11852 consensus_queue.cc:260] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.324812 11854 raft_consensus.cc:359] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.325330 11852 ts_tablet_manager.cc:1434] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.002s
I20260709 12:16:27.326465 11852 tablet_bootstrap.cc:492] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:27.326897 11733 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:27.327221 11853 tablet_bootstrap.cc:492] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:27.328438 11853 ts_tablet_manager.cc:1403] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.147s	user 0.021s	sys 0.006s
I20260709 12:16:27.328994 11625 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:27.331279 11853 raft_consensus.cc:359] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.331832 11852 tablet_bootstrap.cc:654] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.332321 11886 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:27.332830 11886 raft_consensus.cc:697] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:27.333650 11886 consensus_queue.cc:237] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.325548 11854 raft_consensus.cc:385] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.337409 11854 raft_consensus.cc:740] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.327826 11851 tablet_bootstrap.cc:654] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.338063 11854 consensus_queue.cc:260] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.340078 11854 ts_tablet_manager.cc:1434] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:16:27.332043 11853 raft_consensus.cc:385] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.340585 11853 raft_consensus.cc:740] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.341671 11854 tablet_bootstrap.cc:492] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:27.341271 11853 consensus_queue.cc:260] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.343650 11853 ts_tablet_manager.cc:1434] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:16:27.347122 11853 tablet_bootstrap.cc:492] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:27.347615 11483 catalog_manager.cc:5697] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 1 to 2, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.362073 11851 tablet_bootstrap.cc:492] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:27.362138 11852 tablet_bootstrap.cc:492] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:27.362790 11851 ts_tablet_manager.cc:1403] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.005s
I20260709 12:16:27.362838 11852 ts_tablet_manager.cc:1403] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.012s
I20260709 12:16:27.365509 11851 raft_consensus.cc:359] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.365819 11852 raft_consensus.cc:359] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.366464 11852 raft_consensus.cc:385] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.366741 11852 raft_consensus.cc:740] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.367347 11852 consensus_queue.cc:260] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.366214 11851 raft_consensus.cc:385] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.375599 11851 raft_consensus.cc:740] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.376082 11854 tablet_bootstrap.cc:654] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.376458 11852 ts_tablet_manager.cc:1434] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:16:27.376693 11482 catalog_manager.cc:5697] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:27.377511 11852 tablet_bootstrap.cc:492] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:27.377897 11851 consensus_queue.cc:260] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.362948 11853 tablet_bootstrap.cc:654] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.380182 11851 ts_tablet_manager.cc:1434] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:16:27.381157 11851 tablet_bootstrap.cc:492] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:27.387459 11853 tablet_bootstrap.cc:492] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:27.387974 11809 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.390130 11852 tablet_bootstrap.cc:654] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.392256 11854 tablet_bootstrap.cc:492] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:27.392692 11854 ts_tablet_manager.cc:1403] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.001s
I20260709 12:16:27.394457 11896 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.394927 11896 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.395231 11854 raft_consensus.cc:359] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.387974 11853 ts_tablet_manager.cc:1403] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.005s
I20260709 12:16:27.398164 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:16:27.399560 11550 leader_election.cc:343] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.399469 11853 raft_consensus.cc:359] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.400226 11853 raft_consensus.cc:385] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.400462 11853 raft_consensus.cc:740] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.400800 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:27.401018 11853 consensus_queue.cc:260] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.401445 11808 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:27.402664 11549 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:27.403635 11976 raft_consensus.cc:2804] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.403976 11976 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.404325 11976 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.406872 11853 ts_tablet_manager.cc:1434] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:16:27.407011 11901 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.407516 11901 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.408849 11851 tablet_bootstrap.cc:654] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.411562 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:27.411922 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:27.412400 11853 tablet_bootstrap.cc:492] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:27.399544 11896 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:27.412612 11584 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:27.415035 11775 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:27.415884 11920 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:27.416267 11851 tablet_bootstrap.cc:492] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:27.416231 11920 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.416828 11920 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:27.412591 11858 consensus_queue.cc:1048] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:16:27.416586 11976 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.418955 11853 tablet_bootstrap.cc:654] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.419700 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
W20260709 12:16:27.421152 11550 leader_election.cc:343] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.412714 11901 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:27.425010 11920 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.427152 11851 ts_tablet_manager.cc:1403] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.004s
I20260709 12:16:27.427655 11914 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.428197 11914 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.434252 11933 consensus_queue.cc:1048] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.436318 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:27.438212 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:27.438236 11625 leader_election.cc:343] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.434376 11914 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:27.395843 11854 raft_consensus.cc:385] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.440331 11854 raft_consensus.cc:740] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.440547 11896 consensus_queue.cc:1048] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:27.441412 11699 consensus_peers.cc:597] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:27.442371 11627 leader_election.cc:343] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.442559 11809 raft_consensus.cc:1240] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:16:27.442852 11627 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:27.443938 11914 raft_consensus.cc:2749] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.444120 11858 consensus_queue.cc:1059] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.444967 11858 raft_consensus.cc:3055] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:27.445317 11858 raft_consensus.cc:740] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:27.446118 11858 consensus_queue.cc:260] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.441180 11854 consensus_queue.cc:260] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.447230 11858 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:27.448215 11852 tablet_bootstrap.cc:492] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:27.448781 11852 ts_tablet_manager.cc:1403] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.000s
I20260709 12:16:27.450289 11851 raft_consensus.cc:359] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.450608 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:27.453044 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:27.453395 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:27.453616 11851 raft_consensus.cc:385] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.453708 11808 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.454032 11851 raft_consensus.cc:740] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.455459 11851 consensus_queue.cc:260] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.457608 11851 ts_tablet_manager.cc:1434] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:16:27.458608 11851 tablet_bootstrap.cc:492] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:27.452802 11920 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:27.452033 11854 ts_tablet_manager.cc:1434] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:16:27.462656 11933 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.463341 11933 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.463944 11854 tablet_bootstrap.cc:492] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:27.463837 11976 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:27.465813 11808 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:27.466104 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:27.466828 11586 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:27.467034 11549 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:27.467548 11852 raft_consensus.cc:359] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.468003 11933 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:27.469290 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.470197 11852 raft_consensus.cc:385] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.470505 11852 raft_consensus.cc:740] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.470808 11853 tablet_bootstrap.cc:492] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
W20260709 12:16:27.470932 11699 leader_election.cc:343] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.471244 11852 consensus_queue.cc:260] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.472165 11701 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:27.473449 11854 tablet_bootstrap.cc:654] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.473807 11933 raft_consensus.cc:2804] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.471356 11853 ts_tablet_manager.cc:1403] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.022s
I20260709 12:16:27.476046 11852 ts_tablet_manager.cc:1434] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:16:27.476989 11852 tablet_bootstrap.cc:492] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:27.477583 11860 consensus_queue.cc:1048] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.474303 11896 raft_consensus.cc:2804] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.489832 11852 tablet_bootstrap.cc:654] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.474713 11933 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.494879 11853 raft_consensus.cc:359] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.496976 11853 raft_consensus.cc:385] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.497135 11733 raft_consensus.cc:2410] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:16:27.497426 11853 raft_consensus.cc:740] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.500453 11773 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:27.501327 11920 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:27.491540 11896 raft_consensus.cc:697] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:27.503728 11896 consensus_queue.cc:237] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.498956 11853 consensus_queue.cc:260] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.495579 11933 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.510794 11853 ts_tablet_manager.cc:1434] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.003s
I20260709 12:16:27.512001 11853 tablet_bootstrap.cc:492] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:27.513185 11851 tablet_bootstrap.cc:654] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.519174 11920 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.519707 11920 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.523455 11936 consensus_queue.cc:1048] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.523901 11920 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:27.523625 11933 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.523458 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.525094 11661 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:27.525897 11933 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:27.526320 11773 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:27.533372 11853 tablet_bootstrap.cc:654] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.534379 11920 raft_consensus.cc:2804] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.535244 11920 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.535662 11920 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.539500 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:27.540208 11586 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.535216 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:27.542152 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:27.542400 11584 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
W20260709 12:16:27.544132 11699 leader_election.cc:343] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.555939 11920 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.559082 11901 consensus_queue.cc:1048] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.563151 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:27.565913 11584 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.570302 11586 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:27.570488 11851 tablet_bootstrap.cc:492] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:27.571810 11854 tablet_bootstrap.cc:492] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:27.572309 11851 ts_tablet_manager.cc:1403] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.114s	user 0.017s	sys 0.014s
I20260709 12:16:27.572474 11854 ts_tablet_manager.cc:1403] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.024s
I20260709 12:16:27.581116 11701 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:27.580976 11914 consensus_queue.cc:1048] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:27.585952 11936 raft_consensus.cc:2804] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.586467 11936 raft_consensus.cc:697] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:27.587198 11854 raft_consensus.cc:359] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.588136 11854 raft_consensus.cc:385] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.588393 11854 raft_consensus.cc:740] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.596282 11942 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.596628 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:27.596836 11942 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.587294 11936 consensus_queue.cc:237] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.598959 11942 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:27.597249 11659 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.600414 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:27.600261 11482 catalog_manager.cc:5697] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:27.602102 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.603585 11901 consensus_queue.cc:1048] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:27.606369 11550 leader_election.cc:343] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:27.607075 11550 leader_election.cc:343] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.607470 11550 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:27.608866 11942 raft_consensus.cc:2749] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.607999 11854 consensus_queue.cc:260] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.614933 11852 tablet_bootstrap.cc:492] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:27.587827 11920 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:27.615694 11852 ts_tablet_manager.cc:1403] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.139s	user 0.025s	sys 0.010s
I20260709 12:16:27.619052 11851 raft_consensus.cc:359] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.619767 11851 raft_consensus.cc:385] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.620020 11851 raft_consensus.cc:740] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.620658 11851 consensus_queue.cc:260] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.617436 11659 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:27.622259 11773 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:27.623603 11854 ts_tablet_manager.cc:1434] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:16:27.622253 11942 consensus_queue.cc:1048] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:27.624887 11854 tablet_bootstrap.cc:492] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:27.625401 11853 tablet_bootstrap.cc:492] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:27.626046 11853 ts_tablet_manager.cc:1403] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.003s
I20260709 12:16:27.628826 11853 raft_consensus.cc:359] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.629534 11853 raft_consensus.cc:385] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.633174 11853 raft_consensus.cc:740] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.629093 11584 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:27.633800 11853 consensus_queue.cc:260] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.639853 11851 ts_tablet_manager.cc:1434] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.001s
I20260709 12:16:27.633774 11920 raft_consensus.cc:2804] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.644855 11852 raft_consensus.cc:359] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.645539 11933 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.646165 11933 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.645608 11852 raft_consensus.cc:385] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.647480 11852 raft_consensus.cc:740] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.648833 11853 ts_tablet_manager.cc:1434] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:16:27.648150 11920 raft_consensus.cc:697] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:27.650625 11853 tablet_bootstrap.cc:492] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:27.651460 11933 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:27.652616 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:27.653892 11808 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:27.652956 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.651190 11920 consensus_queue.cc:237] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.652293 11483 catalog_manager.cc:5697] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:27.659034 11699 leader_election.cc:343] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.659955 11851 tablet_bootstrap.cc:492] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:27.664827 11976 consensus_queue.cc:1048] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.666237 11698 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:27.667474 11933 raft_consensus.cc:2804] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.667923 11933 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.668023 11853 tablet_bootstrap.cc:654] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.668427 11933 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.675762 11854 tablet_bootstrap.cc:654] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:27.677359 12003 log.cc:927] Time spent T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.071s	user 0.001s	sys 0.003s
I20260709 12:16:27.678205 11852 consensus_queue.cc:260] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.684898 11852 ts_tablet_manager.cc:1434] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 12:16:27.691716 11851 tablet_bootstrap.cc:654] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.704543 11860 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.705204 11860 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.720111 11933 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.723356 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:27.724278 11854 tablet_bootstrap.cc:492] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:27.724807 11854 ts_tablet_manager.cc:1403] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.004s
W20260709 12:16:27.725347 11699 leader_election.cc:343] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.726204 11808 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:27.727452 11933 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:27.727766 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:27.728484 11807 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.735096 11860 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:27.737075 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.740986 11659 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:27.742367 11886 consensus_queue.cc:1048] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.743496 11550 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:27.744366 11896 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.744731 11896 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.745033 11896 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.747560 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:27.748205 11854 raft_consensus.cc:359] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.749195 11854 raft_consensus.cc:385] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.749441 11854 raft_consensus.cc:740] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.750056 11733 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:27.758275 11933 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.759213 11936 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.763437 11936 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.765729 11936 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:27.766901 11854 consensus_queue.cc:260] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.768671 11854 ts_tablet_manager.cc:1434] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:16:27.749963 11860 consensus_queue.cc:1048] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:16:27.769245 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:16:27.771278 11698 leader_election.cc:343] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.771267 11854 tablet_bootstrap.cc:492] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:27.772341 11733 raft_consensus.cc:1275] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:27.773288 11532 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:27.775563 11896 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.779260 11808 raft_consensus.cc:1275] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:27.762596 11852 tablet_bootstrap.cc:492] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:27.780817 11853 tablet_bootstrap.cc:492] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:27.781276 11853 ts_tablet_manager.cc:1403] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.025s
I20260709 12:16:27.781916 11886 consensus_queue.cc:1048] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:27.782228 11896 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:27.785250 11854 tablet_bootstrap.cc:654] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.783159 11886 consensus_queue.cc:1048] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:16:27.787701 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:27.788311 11735 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.792650 11852 tablet_bootstrap.cc:654] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.792768 11853 raft_consensus.cc:359] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.793426 11853 raft_consensus.cc:385] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.793644 11853 raft_consensus.cc:740] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.795969 11853 consensus_queue.cc:260] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.803349 11482 catalog_manager.cc:5697] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.809320 11886 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.814384 11853 ts_tablet_manager.cc:1434] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.004s
I20260709 12:16:27.805160 11807 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:27.799376 11933 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.820477 11858 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.812094 11886 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.829133 11853 tablet_bootstrap.cc:492] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:27.830331 11661 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.831176 11735 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:27.831698 11933 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:27.832522 11698 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:27.833242 11550 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:27.833279 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.834122 11660 raft_consensus.cc:2468] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:27.834944 11933 raft_consensus.cc:2804] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.822444 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:27.838065 11854 tablet_bootstrap.cc:492] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:27.838466 11854 ts_tablet_manager.cc:1403] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.004s
I20260709 12:16:27.834347 12013 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.835798 11858 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.839293 11659 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.844872 11699 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:27.847118 11886 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:27.861184 11936 raft_consensus.cc:2804] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.861594 11936 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.842084 11851 tablet_bootstrap.cc:492] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:27.862370 11851 ts_tablet_manager.cc:1403] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.203s	user 0.028s	sys 0.014s
I20260709 12:16:27.849002 11901 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.850134 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:27.840553 11933 raft_consensus.cc:697] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:27.859716 12013 raft_consensus.cc:697] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:27.860495 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:27.865592 11920 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.861946 11936 raft_consensus.cc:3060] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.868607 11920 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.872804 11933 consensus_queue.cc:237] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.873981 12013 consensus_queue.cc:237] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.881466 11851 raft_consensus.cc:359] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.882782 11851 raft_consensus.cc:385] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.886641 11851 raft_consensus.cc:740] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.884896 11920 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:27.867561 11808 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:27.892902 11851 consensus_queue.cc:260] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:27.905370 11851 ts_tablet_manager.cc:1434] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:16:27.897794 11922 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.908172 11851 tablet_bootstrap.cc:492] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:27.913489 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:27.913869 11853 tablet_bootstrap.cc:654] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.913689 11854 raft_consensus.cc:359] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.914376 11854 raft_consensus.cc:385] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.914650 11854 raft_consensus.cc:740] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.915283 11854 consensus_queue.cc:260] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.920261 11854 ts_tablet_manager.cc:1434] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.001s
I20260709 12:16:27.921317 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.927768 11936 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:27.907536 11922 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:27.936174 11852 tablet_bootstrap.cc:492] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:27.936735 11852 ts_tablet_manager.cc:1403] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.174s	user 0.020s	sys 0.016s
I20260709 12:16:27.938859 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:27.940178 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:27.935387 11775 leader_election.cc:343] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.941263 11936 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:27.931164 11860 consensus_queue.cc:1048] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:16:27.943684 11858 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:27.945601 11914 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.946146 11914 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.948282 11914 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:27.948951 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:27.949599 11735 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:27.950830 11625 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
W20260709 12:16:27.950958 11698 leader_election.cc:343] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.952008 12021 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.952308 12021 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.952551 12021 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.952943 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:27.953318 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:27.953510 11624 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:16:27.944171 11773 leader_election.cc:343] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.953984 11658 raft_consensus.cc:3060] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.957180 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:27.948997 11659 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:27.959407 11914 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.959546 11851 tablet_bootstrap.cc:654] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.962719 11482 catalog_manager.cc:5697] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:27.965987 11701 leader_election.cc:343] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.966071 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:27.966526 11701 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:27.967314 11922 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:27.967594 11858 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.968106 11854 tablet_bootstrap.cc:492] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:27.959617 12021 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:27.969143 11661 raft_consensus.cc:2393] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 1: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:27.973390 11699 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:27.974642 11858 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.966881 11773 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:27.976801 11922 raft_consensus.cc:2749] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.978484 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:27.982067 11854 tablet_bootstrap.cc:654] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.982362 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:16:27.974589 11775 leader_election.cc:343] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.983814 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:27.961962 11914 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.984809 11914 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.986478 11483 catalog_manager.cc:5697] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:27.985579 11627 leader_election.cc:343] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:27.988354 11920 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:27.989387 11701 leader_election.cc:343] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:27.990373 11701 leader_election.cc:343] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:27.993129 11550 consensus_peers.cc:597] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:27.997752 11860 consensus_queue.cc:1048] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.000120 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
W20260709 12:16:28.003082 11624 leader_election.cc:343] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:28.005256 11624 leader_election.cc:343] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.005976 11852 raft_consensus.cc:359] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.006657 11852 raft_consensus.cc:385] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.006927 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:28.006919 11852 raft_consensus.cc:740] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.014488 11914 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.016762 11914 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:28.018656 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:28.020015 11858 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.008845 12021 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:28.023113 11661 raft_consensus.cc:2393] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 1: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:28.024746 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:28.025346 11807 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.027073 11773 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:28.031807 11853 tablet_bootstrap.cc:492] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:28.032352 11853 ts_tablet_manager.cc:1403] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.203s	user 0.022s	sys 0.005s
I20260709 12:16:28.008420 11852 consensus_queue.cc:260] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.035414 11852 ts_tablet_manager.cc:1434] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.001s
I20260709 12:16:28.038071 11585 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.047276 11853 raft_consensus.cc:359] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.048182 11853 raft_consensus.cc:385] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.048461 11853 raft_consensus.cc:740] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.008162 11658 raft_consensus.cc:2468] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:28.049415 11853 consensus_queue.cc:260] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.050406 11699 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:28.052021 11853 ts_tablet_manager.cc:1434] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:16:28.052129 12025 raft_consensus.cc:2804] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.052994 12025 raft_consensus.cc:697] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:28.048516 11807 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:28.053893 11901 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.056945 11852 tablet_bootstrap.cc:492] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:28.058053 11853 tablet_bootstrap.cc:492] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:28.057062 11624 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:28.059971 11585 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:28.068290 11851 tablet_bootstrap.cc:492] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:28.061398 12025 consensus_queue.cc:237] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.062033 12021 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.062418 11858 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.062834 11734 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:28.070832 11851 ts_tablet_manager.cc:1403] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.163s	user 0.014s	sys 0.009s
I20260709 12:16:28.068390 11852 tablet_bootstrap.cc:654] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.070442 11854 tablet_bootstrap.cc:492] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:28.071818 11854 ts_tablet_manager.cc:1403] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.021s
I20260709 12:16:28.070222 12021 raft_consensus.cc:697] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:28.074453 12021 consensus_queue.cc:237] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.071112 11858 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.085649 11858 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:28.086736 11625 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:28.088295 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:28.090929 11914 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.095101 11914 raft_consensus.cc:697] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:28.095886 11914 consensus_queue.cc:237] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.098425 11854 raft_consensus.cc:359] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.099107 11854 raft_consensus.cc:385] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.099370 11854 raft_consensus.cc:740] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.099979 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:28.101166 11851 raft_consensus.cc:359] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:16:28.101706 11698 leader_election.cc:343] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.101802 11851 raft_consensus.cc:385] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.100001 11854 consensus_queue.cc:260] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.102927 11851 raft_consensus.cc:740] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.103610 11851 consensus_queue.cc:260] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.104761 11854 ts_tablet_manager.cc:1434] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
W20260709 12:16:28.105451 11699 leader_election.cc:343] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.106267 11853 tablet_bootstrap.cc:654] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.105718 11854 tablet_bootstrap.cc:492] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:28.106638 11484 catalog_manager.cc:5697] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.111522 11482 catalog_manager.cc:5697] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.114799 11851 ts_tablet_manager.cc:1434] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:16:28.105945 11699 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:28.122188 12025 consensus_queue.cc:1048] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:28.122990 11851 tablet_bootstrap.cc:492] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:28.122412 11936 raft_consensus.cc:2749] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:28.141933 11699 consensus_peers.cc:597] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.148626 11851 tablet_bootstrap.cc:654] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.153151 11854 tablet_bootstrap.cc:654] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.156924 11853 tablet_bootstrap.cc:492] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:28.156924 11852 tablet_bootstrap.cc:492] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:28.157618 11853 ts_tablet_manager.cc:1403] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.004s
I20260709 12:16:28.157631 11852 ts_tablet_manager.cc:1403] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.120s	user 0.035s	sys 0.023s
I20260709 12:16:28.160501 11852 raft_consensus.cc:359] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.161224 11852 raft_consensus.cc:385] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.161509 11852 raft_consensus.cc:740] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.162236 11852 consensus_queue.cc:260] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.164230 11852 ts_tablet_manager.cc:1434] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:28.160298 11481 catalog_manager.cc:5697] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.165231 11852 tablet_bootstrap.cc:492] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:28.165450 11853 raft_consensus.cc:359] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.166455 11853 raft_consensus.cc:385] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.166731 11853 raft_consensus.cc:740] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.170069 11851 tablet_bootstrap.cc:492] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:28.170562 11851 ts_tablet_manager.cc:1403] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.007s
I20260709 12:16:28.173218 11851 raft_consensus.cc:359] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.173832 11851 raft_consensus.cc:385] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.174090 11851 raft_consensus.cc:740] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.174010 11853 consensus_queue.cc:260] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.176326 11853 ts_tablet_manager.cc:1434] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 12:16:28.177239 11853 tablet_bootstrap.cc:492] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:28.179883 11854 tablet_bootstrap.cc:492] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:28.180521 11854 ts_tablet_manager.cc:1403] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.003s
I20260709 12:16:28.183224 11854 raft_consensus.cc:359] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.183899 11854 raft_consensus.cc:385] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.184157 11854 raft_consensus.cc:740] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.184880 11854 consensus_queue.cc:260] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.186800 11854 ts_tablet_manager.cc:1434] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:16:28.187717 11854 tablet_bootstrap.cc:492] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:28.180366 11851 consensus_queue.cc:260] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.190207 11851 ts_tablet_manager.cc:1434] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:16:28.179881 11852 tablet_bootstrap.cc:654] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.191431 11851 tablet_bootstrap.cc:492] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:28.193177 11854 tablet_bootstrap.cc:654] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.197140 11853 tablet_bootstrap.cc:654] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.199249 11920 consensus_queue.cc:1048] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.218585 11861 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.219165 11861 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.220463 11901 consensus_queue.cc:1048] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:28.221236 11861 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:28.221980 11853 tablet_bootstrap.cc:492] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:28.222441 11853 ts_tablet_manager.cc:1403] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.003s
I20260709 12:16:28.226446 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:28.226802 11851 tablet_bootstrap.cc:654] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.227336 11734 raft_consensus.cc:2393] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 1: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:28.227108 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:28.233196 11773 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:28.234112 11901 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.238894 11851 tablet_bootstrap.cc:492] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:28.247298 11851 ts_tablet_manager.cc:1403] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.006s
I20260709 12:16:28.252453 11851 raft_consensus.cc:359] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.254828 11851 raft_consensus.cc:385] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.255635 11851 raft_consensus.cc:740] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.257166 11851 consensus_queue.cc:260] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.259913 11851 ts_tablet_manager.cc:1434] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:16:28.262339 11851 tablet_bootstrap.cc:492] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:28.242025 12013 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.263926 12013 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.265681 12013 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:28.243238 11901 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.239334 11853 raft_consensus.cc:359] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.266580 11853 raft_consensus.cc:385] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.266928 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:28.266949 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:28.266940 11853 raft_consensus.cc:740] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.270292 11853 consensus_queue.cc:260] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.268450 11660 raft_consensus.cc:2393] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 1: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:28.273041 11914 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.273612 11914 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.275686 11851 tablet_bootstrap.cc:654] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.276089 11853 ts_tablet_manager.cc:1434] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260709 12:16:28.277146 11853 tablet_bootstrap.cc:492] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:28.278342 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:28.279023 11734 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:28.280119 11625 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:28.280956 12021 raft_consensus.cc:2804] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.281327 12021 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.281647 12021 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.283551 11550 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:28.284435 12013 raft_consensus.cc:3060] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.288476 11914 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:28.290313 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:28.296101 11807 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:28.296602 11942 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.303108 12013 raft_consensus.cc:2749] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.303493 11853 tablet_bootstrap.cc:654] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.311755 11852 tablet_bootstrap.cc:492] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:28.312167 11852 ts_tablet_manager.cc:1403] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.147s	user 0.020s	sys 0.020s
I20260709 12:16:28.289522 12021 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.314365 11852 raft_consensus.cc:359] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.314837 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:28.315593 11734 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.317975 11851 tablet_bootstrap.cc:492] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:28.318475 11851 ts_tablet_manager.cc:1403] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.005s
I20260709 12:16:28.319140 11854 tablet_bootstrap.cc:492] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:28.319620 11854 ts_tablet_manager.cc:1403] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.132s	user 0.026s	sys 0.047s
I20260709 12:16:28.321084 11851 raft_consensus.cc:359] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.321729 11851 raft_consensus.cc:385] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.322008 11851 raft_consensus.cc:740] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.322070 11854 raft_consensus.cc:359] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.322734 11854 raft_consensus.cc:385] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.322674 11851 consensus_queue.cc:260] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.323086 11854 raft_consensus.cc:740] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.323801 11854 consensus_queue.cc:260] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.325281 11853 tablet_bootstrap.cc:492] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:28.325742 11853 ts_tablet_manager.cc:1403] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.002s
I20260709 12:16:28.314918 11852 raft_consensus.cc:385] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.326313 11852 raft_consensus.cc:740] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.326980 11852 consensus_queue.cc:260] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.327296 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:28.327880 11807 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.329089 11852 ts_tablet_manager.cc:1434] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:16:28.329329 11853 raft_consensus.cc:359] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.330082 11853 raft_consensus.cc:385] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.330168 11852 tablet_bootstrap.cc:492] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:28.330389 11853 raft_consensus.cc:740] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.325851 11854 ts_tablet_manager.cc:1434] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:16:28.331120 11853 consensus_queue.cc:260] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.331965 11854 tablet_bootstrap.cc:492] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:28.333243 11853 ts_tablet_manager.cc:1434] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:16:28.334419 11853 tablet_bootstrap.cc:492] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:28.337312 11851 ts_tablet_manager.cc:1434] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.004s
I20260709 12:16:28.338289 11851 tablet_bootstrap.cc:492] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:28.339830 11853 tablet_bootstrap.cc:654] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.345434 11901 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.345973 11901 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.346470 11933 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.347079 11852 tablet_bootstrap.cc:654] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.346998 11933 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.349090 11933 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:28.349010 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:28.350163 11584 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:28.351958 11854 tablet_bootstrap.cc:654] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.351780 11775 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:28.352690 11861 raft_consensus.cc:2804] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.353050 11861 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.353353 11861 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.353978 11807 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:28.356739 11851 tablet_bootstrap.cc:654] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.357363 11852 tablet_bootstrap.cc:492] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:28.357837 11852 ts_tablet_manager.cc:1403] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:16:28.358237 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:16:28.359726 11698 leader_election.cc:343] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.363929 11861 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.364748 12021 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:28.365165 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:28.365430 11853 tablet_bootstrap.cc:492] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:28.380384 11853 ts_tablet_manager.cc:1403] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.006s
I20260709 12:16:28.382804 11853 raft_consensus.cc:359] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.383430 11853 raft_consensus.cc:385] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.383672 11853 raft_consensus.cc:740] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.384254 11853 consensus_queue.cc:260] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.385964 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:28.386605 11733 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.387619 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:28.367643 11734 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:28.369371 11860 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.370518 11854 tablet_bootstrap.cc:492] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:28.370643 11852 raft_consensus.cc:359] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.372798 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:28.374233 11624 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:28.374473 11901 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:28.388302 11584 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.389070 11854 ts_tablet_manager.cc:1403] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.000s
I20260709 12:16:28.388770 11861 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:28.398397 11733 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:28.400817 11584 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:28.388932 11852 raft_consensus.cc:385] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.404441 11852 raft_consensus.cc:740] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.403692 11773 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:28.404971 11854 raft_consensus.cc:359] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.405187 11852 consensus_queue.cc:260] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.393586 11853 ts_tablet_manager.cc:1434] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:16:28.406726 11861 raft_consensus.cc:2804] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.406977 11853 tablet_bootstrap.cc:492] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:28.407466 11861 raft_consensus.cc:697] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
W20260709 12:16:28.391283 11699 leader_election.cc:343] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.408231 11699 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
W20260709 12:16:28.410077 11699 consensus_peers.cc:597] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.410682 11933 raft_consensus.cc:2749] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.412165 11914 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.412631 11914 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.405691 11854 raft_consensus.cc:385] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.407642 11852 ts_tablet_manager.cc:1434] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:16:28.413363 11854 raft_consensus.cc:740] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.414175 11852 tablet_bootstrap.cc:492] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:28.414158 11854 consensus_queue.cc:260] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.414750 11914 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:28.390990 12021 raft_consensus.cc:2804] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.416678 11854 ts_tablet_manager.cc:1434] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:16:28.416617 12021 raft_consensus.cc:697] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:28.413062 11853 tablet_bootstrap.cc:654] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.417923 11854 tablet_bootstrap.cc:492] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:28.417570 12021 consensus_queue.cc:237] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.420456 11852 tablet_bootstrap.cc:654] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.423327 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:28.424166 11854 tablet_bootstrap.cc:654] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.431105 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:28.432543 11861 consensus_queue.cc:237] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.434365 11625 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:28.435853 12019 raft_consensus.cc:2749] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.445834 11851 tablet_bootstrap.cc:492] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:28.446487 11851 ts_tablet_manager.cc:1403] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.108s	user 0.019s	sys 0.023s
I20260709 12:16:28.449348 11851 raft_consensus.cc:359] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.450045 11851 raft_consensus.cc:385] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.450312 11851 raft_consensus.cc:740] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.450969 11851 consensus_queue.cc:260] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.452970 11851 ts_tablet_manager.cc:1434] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:28.452491 11482 catalog_manager.cc:5697] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.456851 11851 tablet_bootstrap.cc:492] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:28.463135 12019 consensus_queue.cc:1048] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.458773 11484 catalog_manager.cc:5697] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.463150 11851 tablet_bootstrap.cc:654] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.476871 12021 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.477406 12021 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.480432 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:28.481175 11807 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:28.480595 12021 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:28.484287 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:28.486277 11627 leader_election.cc:343] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.487212 11624 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:28.488039 12021 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.488499 12021 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.488885 12021 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.488795 11851 tablet_bootstrap.cc:492] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:28.489691 11851 ts_tablet_manager.cc:1403] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.004s
I20260709 12:16:28.490955 11933 consensus_queue.cc:1048] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.496940 12021 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.497027 11851 raft_consensus.cc:359] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.500113 11851 raft_consensus.cc:385] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.500386 11851 raft_consensus.cc:740] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.503813 11851 consensus_queue.cc:260] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.506937 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:28.507892 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:28.508353 11851 ts_tablet_manager.cc:1434] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:16:28.508517 11808 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.512550 11851 tablet_bootstrap.cc:492] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
W20260709 12:16:28.514781 11627 leader_election.cc:343] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.519515 12019 consensus_queue.cc:1048] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.521798 11808 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:28.524096 11624 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:28.524636 11901 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.525203 12019 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.525830 12019 raft_consensus.cc:697] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:28.526743 12019 consensus_queue.cc:237] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.530280 11733 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.531212 11851 tablet_bootstrap.cc:654] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.525240 11901 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.534849 11901 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:28.537101 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:28.538653 11773 leader_election.cc:343] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.541635 11914 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.542240 11914 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.544579 11914 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:28.549401 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:28.549752 12025 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.550340 12025 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.551098 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:28.552371 12025 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:28.554082 11625 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:28.556099 12018 raft_consensus.cc:2749] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.558867 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:28.561697 11699 leader_election.cc:343] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.563868 11482 catalog_manager.cc:5697] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.565284 11851 tablet_bootstrap.cc:492] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:28.574733 11851 ts_tablet_manager.cc:1403] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.002s
I20260709 12:16:28.565914 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:28.578087 11734 raft_consensus.cc:2468] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:28.567332 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:28.579854 11701 leader_election.cc:343] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.577421 11851 raft_consensus.cc:359] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.580344 11701 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:28.580626 11851 raft_consensus.cc:385] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.580930 11851 raft_consensus.cc:740] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.581598 11851 consensus_queue.cc:260] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.582831 11660 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.583269 11851 ts_tablet_manager.cc:1434] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:16:28.584429 11851 tablet_bootstrap.cc:492] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:28.586489 11936 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.588523 12021 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:28.589613 11773 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:28.591548 11922 raft_consensus.cc:2804] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.591939 11922 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.592272 11922 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.596740 11901 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.597375 11901 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.600904 11901 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:28.607443 11851 tablet_bootstrap.cc:654] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.619361 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:28.624187 11773 leader_election.cc:343] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.625996 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:16:28.627900 11773 leader_election.cc:343] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.628540 11773 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:28.629475 11901 raft_consensus.cc:2749] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.635847 11658 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.647468 12021 consensus_queue.cc:1048] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:28.648690 11922 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.654649 11922 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:28.656360 12025 consensus_queue.cc:1048] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:28.666779 11854 tablet_bootstrap.cc:492] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:28.667372 11854 ts_tablet_manager.cc:1403] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.250s	user 0.044s	sys 0.032s
I20260709 12:16:28.668275 11852 tablet_bootstrap.cc:492] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:28.668787 11852 ts_tablet_manager.cc:1403] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.255s	user 0.096s	sys 0.124s
I20260709 12:16:28.671299 11853 tablet_bootstrap.cc:492] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:28.671782 11853 ts_tablet_manager.cc:1403] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.265s	user 0.021s	sys 0.058s
I20260709 12:16:28.677877 11852 raft_consensus.cc:359] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.678644 11852 raft_consensus.cc:385] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.674465 11853 raft_consensus.cc:359] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.678951 11852 raft_consensus.cc:740] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.679347 11853 raft_consensus.cc:385] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.679445 11851 tablet_bootstrap.cc:492] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:28.679682 11853 raft_consensus.cc:740] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.679949 11851 ts_tablet_manager.cc:1403] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.014s
I20260709 12:16:28.679925 11852 consensus_queue.cc:260] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.678753 11854 raft_consensus.cc:359] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.681672 11854 raft_consensus.cc:385] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.681948 11854 raft_consensus.cc:740] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.682757 11852 ts_tablet_manager.cc:1434] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:16:28.682689 11854 consensus_queue.cc:260] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.683789 11852 tablet_bootstrap.cc:492] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:28.683470 11851 raft_consensus.cc:359] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.684175 11851 raft_consensus.cc:385] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.684464 11851 raft_consensus.cc:740] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.684824 11854 ts_tablet_manager.cc:1434] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:16:28.685070 11851 consensus_queue.cc:260] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.685778 11854 tablet_bootstrap.cc:492] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:28.687469 11851 ts_tablet_manager.cc:1434] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:28.688462 11851 tablet_bootstrap.cc:492] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:28.690117 11852 tablet_bootstrap.cc:654] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.691877 11854 tablet_bootstrap.cc:654] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.680392 11853 consensus_queue.cc:260] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.693841 11851 tablet_bootstrap.cc:654] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.695576 11853 ts_tablet_manager.cc:1434] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:16:28.696664 11853 tablet_bootstrap.cc:492] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:28.702699 11853 tablet_bootstrap.cc:654] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.715548 11852 tablet_bootstrap.cc:492] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:28.716524 11852 ts_tablet_manager.cc:1403] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.012s
I20260709 12:16:28.718231 12025 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.718652 11854 tablet_bootstrap.cc:492] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:28.719153 11854 ts_tablet_manager.cc:1403] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.001s
I20260709 12:16:28.718766 12025 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.719480 11851 tablet_bootstrap.cc:492] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:28.719846 11852 raft_consensus.cc:359] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.721527 11852 raft_consensus.cc:385] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.721741 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:28.720979 12025 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:28.722519 11807 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:28.720417 11851 ts_tablet_manager.cc:1403] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.008s
I20260709 12:16:28.723783 11698 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:28.724738 12025 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:28.725137 12025 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.725541 12025 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:28.725858 11851 raft_consensus.cc:359] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.726222 11854 raft_consensus.cc:359] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.726558 11851 raft_consensus.cc:385] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.723680 11853 tablet_bootstrap.cc:492] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:28.721904 11852 raft_consensus.cc:740] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.726946 11851 raft_consensus.cc:740] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.727006 12021 consensus_queue.cc:1048] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:28.727598 11853 ts_tablet_manager.cc:1403] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.001s
I20260709 12:16:28.727862 11851 consensus_queue.cc:260] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.730262 11851 ts_tablet_manager.cc:1434] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:28.730300 11853 raft_consensus.cc:359] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.731065 11853 raft_consensus.cc:385] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.731384 11851 tablet_bootstrap.cc:492] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:28.732136 11852 consensus_queue.cc:260] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:28.726164 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:28.733911 12025 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.734534 11852 ts_tablet_manager.cc:1434] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:16:28.735775 11852 tablet_bootstrap.cc:492] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:28.726886 11854 raft_consensus.cc:385] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.737874 11854 raft_consensus.cc:740] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.738137 11851 tablet_bootstrap.cc:654] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.742939 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:28.731335 11853 raft_consensus.cc:740] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.743518 11854 consensus_queue.cc:260] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.742940 11852 tablet_bootstrap.cc:654] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.745231 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:28.745878 11807 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:28.747699 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:28.748308 11734 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.753286 11807 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:28.755420 11936 consensus_queue.cc:1048] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.756218 11698 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:28.756562 11853 consensus_queue.cc:260] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.757114 11933 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:28.757563 11933 raft_consensus.cc:697] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:28.758514 11936 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.758371 11933 consensus_queue.cc:237] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.759006 11936 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.763334 11936 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:28.763576 11854 ts_tablet_manager.cc:1434] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 12:16:28.758378 12025 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:28.756242 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:28.764252 11922 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.766057 11922 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.768158 11922 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:16:28.758216 11773 leader_election.cc:343] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.771375 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:28.772013 11733 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:28.772886 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:28.774516 11585 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:28.776443 11775 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:28.777457 11922 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.777937 11922 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.778335 11922 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.781987 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:28.784250 11854 tablet_bootstrap.cc:492] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:28.786484 12013 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.787001 12013 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.788677 11853 ts_tablet_manager.cc:1434] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.001s
I20260709 12:16:28.789091 12013 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:28.789775 11853 tablet_bootstrap.cc:492] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:28.789867 11861 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.790380 11861 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.792398 11861 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:28.782719 11807 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:28.795089 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:28.795729 11808 raft_consensus.cc:2468] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:28.797351 11549 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:28.797997 11858 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.798414 12013 raft_consensus.cc:2804] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.798892 12013 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.798527 11858 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.799337 11922 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.800735 11858 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:28.802615 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:28.803242 11586 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.803359 11583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:28.805632 11698 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:28.799232 12013 raft_consensus.cc:3060] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.808288 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:28.809394 11660 raft_consensus.cc:2468] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:28.811506 11860 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.811913 11852 tablet_bootstrap.cc:492] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:28.811960 11860 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.812543 11852 ts_tablet_manager.cc:1403] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.010s
I20260709 12:16:28.813896 11922 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:28.814263 11860 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:28.815117 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:28.815387 11852 raft_consensus.cc:359] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.816114 11852 raft_consensus.cc:385] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.819308 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:28.816418 11852 raft_consensus.cc:740] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.823243 11852 consensus_queue.cc:260] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:16:28.827654 11699 leader_election.cc:343] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.828297 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:28.828603 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:28.829551 11806 raft_consensus.cc:2393] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 1: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:28.830965 11549 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:28.832294 11858 raft_consensus.cc:2804] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.832734 11858 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.832754 11860 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.838487 11942 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.839092 11942 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.841203 11942 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:28.833093 11858 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.842922 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:28.831064 11852 ts_tablet_manager.cc:1434] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.005s
I20260709 12:16:28.847536 11661 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.847990 11852 tablet_bootstrap.cc:492] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:28.851233 11860 raft_consensus.cc:2749] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:28.815869 11808 raft_consensus.cc:2468] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:28.843417 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:28.864275 11854 tablet_bootstrap.cc:654] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.874042 11698 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:28.880570 11852 tablet_bootstrap.cc:654] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.865795 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:28.866650 11733 raft_consensus.cc:2468] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:28.871793 11734 raft_consensus.cc:2468] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
W20260709 12:16:28.883400 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 78057us
I20260709 12:16:28.890046 12025 raft_consensus.cc:2804] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:28.899394 11586 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:28.910348 12025 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.910903 12025 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.911403 11775 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:28.912292 11922 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.912744 11922 raft_consensus.cc:697] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:28.913332 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:28.916016 11734 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:28.905046 11701 leader_election.cc:343] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:28.910480 11853 tablet_bootstrap.cc:654] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.893985 12013 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:28.935030 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:28.934923 12025 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.935798 11808 raft_consensus.cc:3060] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.937202 12025 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:28.913554 11922 consensus_queue.cc:237] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.895717 11858 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:28.962406 11851 tablet_bootstrap.cc:492] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:28.964460 11851 ts_tablet_manager.cc:1403] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.233s	user 0.030s	sys 0.026s
W20260709 12:16:28.965435 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 64784.9us
I20260709 12:16:28.978811 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:28.979566 11657 raft_consensus.cc:2468] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:28.969244 11585 raft_consensus.cc:2393] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 1: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:28.979473 11851 raft_consensus.cc:359] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.984683 11851 raft_consensus.cc:385] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.985044 11851 raft_consensus.cc:740] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.974294 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:28.988008 11851 consensus_queue.cc:260] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:28.984550 12013 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:28.999272 11852 tablet_bootstrap.cc:492] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:28.999701 11852 ts_tablet_manager.cc:1403] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.152s	user 0.014s	sys 0.001s
I20260709 12:16:29.000852 11851 ts_tablet_manager.cc:1434] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.005s
I20260709 12:16:29.003993 11858 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:28.989980 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:29.000569 12025 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.995751 11586 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.011935 11854 tablet_bootstrap.cc:492] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:29.012482 11854 ts_tablet_manager.cc:1403] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.228s	user 0.020s	sys 0.022s
I20260709 12:16:29.011437 12025 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.019615 11851 tablet_bootstrap.cc:492] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:29.009207 11807 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.023715 12025 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:29.025300 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:29.027171 11482 catalog_manager.cc:5697] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.029428 11808 raft_consensus.cc:2468] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:29.030745 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:29.031873 11585 raft_consensus.cc:2468] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:29.032315 11853 tablet_bootstrap.cc:492] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:29.034574 11853 ts_tablet_manager.cc:1403] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.245s	user 0.018s	sys 0.018s
I20260709 12:16:29.036479 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:29.036856 11699 leader_election.cc:343] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.041528 11854 raft_consensus.cc:359] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:29.042071 11699 leader_election.cc:343] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.042541 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:29.042889 11549 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:29.043922 12084 raft_consensus.cc:2804] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.044276 11854 raft_consensus.cc:385] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.044423 12084 raft_consensus.cc:697] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:29.044618 11854 raft_consensus.cc:740] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.045306 12084 consensus_queue.cc:237] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.042304 12019 consensus_queue.cc:1048] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:16:29.046587 11920 consensus_queue.cc:1048] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.049484 11809 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.052376 11853 raft_consensus.cc:359] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.053131 11853 raft_consensus.cc:385] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.053400 11853 raft_consensus.cc:740] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.053752 11901 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.045230 11854 consensus_queue.cc:260] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.054069 11853 consensus_queue.cc:260] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.055763 11854 ts_tablet_manager.cc:1434] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 12:16:29.056025 11853 ts_tablet_manager.cc:1434] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 12:16:29.055708 11773 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:29.056856 11854 tablet_bootstrap.cc:492] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:29.057842 11851 tablet_bootstrap.cc:654] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.059063 11701 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:29.060390 12019 consensus_queue.cc:1048] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.061091 11586 raft_consensus.cc:2468] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:29.058013 11852 raft_consensus.cc:359] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.056984 11853 tablet_bootstrap.cc:492] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:29.062294 11852 raft_consensus.cc:385] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.063292 11852 raft_consensus.cc:740] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.068135 11852 consensus_queue.cc:260] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:16:29.017031 11550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 52237.2us
I20260709 12:16:29.072649 11852 ts_tablet_manager.cc:1434] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 12:16:29.062287 11936 raft_consensus.cc:2804] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.069582 11861 raft_consensus.cc:2804] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.078827 11936 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.086119 11936 raft_consensus.cc:3060] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.062251 11701 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:29.091228 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:29.091923 11657 raft_consensus.cc:3060] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.070029 11901 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:29.102741 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 57827.2us
I20260709 12:16:29.086544 11860 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:29.106431 12025 raft_consensus.cc:2804] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.113163 12025 raft_consensus.cc:697] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:29.114029 12025 consensus_queue.cc:237] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.119011 11901 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:29.111649 11860 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.122222 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:29.123909 11775 leader_election.cc:343] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.124409 11860 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:29.124969 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:29.125702 11808 raft_consensus.cc:2368] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3.
I20260709 12:16:29.126979 11549 leader_election.cc:400] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3.
I20260709 12:16:29.127287 11549 leader_election.cc:403] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:29.127925 11860 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:29.128052 12018 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.128543 12018 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.135191 11860 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3.
W20260709 12:16:29.135756 11532 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:29.136792 11550 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:29.140476 11852 tablet_bootstrap.cc:492] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:29.138577 11861 raft_consensus.cc:697] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:29.138943 11920 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.140120 12091 raft_consensus.cc:2764] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:16:29.167117 12092 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.171579 11809 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:29.172698 11773 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:29.172945 11698 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:29.163267 11807 raft_consensus.cc:2468] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:29.174052 12025 raft_consensus.cc:2804] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.167672 12092 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.178316 11922 raft_consensus.cc:2764] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:16:29.179028 12092 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:29.179579 12025 raft_consensus.cc:697] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:29.180470 12025 consensus_queue.cc:237] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:29.182735 11657 raft_consensus.cc:2468] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:29.179582 12018 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:29.177047 11861 consensus_queue.cc:237] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:29.160624 11920 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.189721 11851 tablet_bootstrap.cc:492] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:29.166699 11734 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:29.190291 11851 ts_tablet_manager.cc:1403] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.182s	user 0.013s	sys 0.006s
I20260709 12:16:29.195484 11853 tablet_bootstrap.cc:654] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.195720 11854 tablet_bootstrap.cc:654] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.201998 11852 tablet_bootstrap.cc:654] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.203244 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:29.206290 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:29.211503 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:29.214123 11936 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.218106 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:29.220674 11860 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.222695 12019 consensus_queue.cc:1048] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:16:29.220489 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:29.219815 11809 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:29.232452 11922 consensus_queue.cc:1048] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:16:29.236299 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:29.237073 11586 raft_consensus.cc:3060] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.236411 11920 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:16:29.240871 11773 leader_election.cc:343] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.242820 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:29.243428 11584 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:29.228408 11860 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.247542 11860 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:16:29.246398 11624 leader_election.cc:343] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.248994 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:29.248742 11775 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:29.250139 11901 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.250536 11901 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.250849 11901 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.250782 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:16:29.251415 11773 leader_election.cc:343] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.251919 11773 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:29.254590 11922 raft_consensus.cc:2749] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:29.260948 12019 consensus_queue.cc:1048] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.255354 11549 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:29.266347 11860 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.266182 11851 raft_consensus.cc:359] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.266765 11860 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.267073 11851 raft_consensus.cc:385] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.267504 11851 raft_consensus.cc:740] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.267684 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:29.268342 11851 consensus_queue.cc:260] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:29.269866 11550 leader_election.cc:343] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.267127 11860 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:29.270871 11550 leader_election.cc:343] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.271797 11851 ts_tablet_manager.cc:1434] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.080s	user 0.004s	sys 0.003s
I20260709 12:16:29.273468 11851 tablet_bootstrap.cc:492] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:29.283144 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:29.278484 11936 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:16:29.298488 11699 leader_election.cc:343] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:29.303330 11627 leader_election.cc:343] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.303948 11627 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:29.304999 12104 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:29.308969 11901 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.310137 11586 raft_consensus.cc:2468] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:29.283201 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:29.315478 11852 tablet_bootstrap.cc:492] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:29.315940 11852 ts_tablet_manager.cc:1403] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.217s	user 0.016s	sys 0.004s
I20260709 12:16:29.320390 11701 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:29.321583 11936 raft_consensus.cc:2804] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.322080 11936 raft_consensus.cc:697] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:29.322865 11936 consensus_queue.cc:237] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.317368 11735 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:29.325843 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:29.326525 11901 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:29.329196 11550 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:29.330380 12092 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.332902 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:29.330777 12092 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.335435 12092 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:29.338394 11773 leader_election.cc:343] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.346730 11851 tablet_bootstrap.cc:654] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.347666 11853 tablet_bootstrap.cc:492] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:29.348110 11853 ts_tablet_manager.cc:1403] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.291s	user 0.023s	sys 0.011s
I20260709 12:16:29.350586 11853 raft_consensus.cc:359] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.351227 11853 raft_consensus.cc:385] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.351480 11853 raft_consensus.cc:740] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.352165 11853 consensus_queue.cc:260] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.355860 11807 raft_consensus.cc:1275] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:29.357378 12025 consensus_queue.cc:1048] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.358485 11860 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.360198 11586 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 1: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:29.360746 11860 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:29.361999 11775 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:29.363603 11922 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:29.365037 11852 raft_consensus.cc:359] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.367518 11852 raft_consensus.cc:385] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.367796 11852 raft_consensus.cc:740] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.368458 11852 consensus_queue.cc:260] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.368999 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:29.369863 11806 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 1: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:29.370599 11852 ts_tablet_manager.cc:1434] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.002s
I20260709 12:16:29.371657 11852 tablet_bootstrap.cc:492] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:29.375417 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:29.376075 11735 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.376884 11586 raft_consensus.cc:1275] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:29.377441 11853 ts_tablet_manager.cc:1434] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:16:29.378743 11933 consensus_queue.cc:1048] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.383224 11735 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:29.389065 11853 tablet_bootstrap.cc:492] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:29.389520 11550 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:29.386037 11854 tablet_bootstrap.cc:492] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:29.391287 11854 ts_tablet_manager.cc:1403] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.335s	user 0.024s	sys 0.030s
I20260709 12:16:29.390723 11483 catalog_manager.cc:5697] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.394583 11854 raft_consensus.cc:359] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.395328 11854 raft_consensus.cc:385] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.395637 11854 raft_consensus.cc:740] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.395632 11853 tablet_bootstrap.cc:654] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.396437 11854 consensus_queue.cc:260] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.375367 12092 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.400221 11860 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.402118 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:29.401028 11860 raft_consensus.cc:697] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
W20260709 12:16:29.403414 11550 leader_election.cc:343] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.404744 11851 tablet_bootstrap.cc:492] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:29.404767 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:29.405403 11851 ts_tablet_manager.cc:1403] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.002s
I20260709 12:16:29.405514 11735 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.404796 11860 consensus_queue.cc:237] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.408685 11851 raft_consensus.cc:359] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.409417 11851 raft_consensus.cc:385] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.409680 11851 raft_consensus.cc:740] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.410403 11851 consensus_queue.cc:260] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.413684 11735 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:29.414278 12092 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:29.414400 11854 ts_tablet_manager.cc:1434] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:16:29.416149 11550 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:29.417198 12087 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.417716 12087 raft_consensus.cc:697] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:29.416109 11851 ts_tablet_manager.cc:1434] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:16:29.418635 12087 consensus_queue.cc:237] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.419400 11851 tablet_bootstrap.cc:492] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:29.417428 11854 tablet_bootstrap.cc:492] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:29.443298 12091 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.443951 12091 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.448657 11851 tablet_bootstrap.cc:654] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.452915 12091 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:29.455492 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:29.458775 11851 tablet_bootstrap.cc:492] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:29.459352 11851 ts_tablet_manager.cc:1403] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.040s	user 0.004s	sys 0.011s
I20260709 12:16:29.462260 11851 raft_consensus.cc:359] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:29.462997 11851 raft_consensus.cc:385] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.463263 11851 raft_consensus.cc:740] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
W20260709 12:16:29.463337 11550 leader_election.cc:343] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.464051 11851 consensus_queue.cc:260] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:29.471236 11853 tablet_bootstrap.cc:492] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:29.471494 11852 tablet_bootstrap.cc:654] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.471834 11853 ts_tablet_manager.cc:1403] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.083s	user 0.034s	sys 0.024s
I20260709 12:16:29.475683 11851 ts_tablet_manager.cc:1434] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:16:29.476760 11851 tablet_bootstrap.cc:492] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:29.476812 11901 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.477408 11901 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.479573 11901 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:29.480154 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:29.480806 11806 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:29.481499 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:29.482152 11549 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
W20260709 12:16:29.482924 11775 leader_election.cc:343] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.483270 12084 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.483677 12084 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.484006 12084 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.488108 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:29.489811 11851 tablet_bootstrap.cc:654] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.490065 11922 consensus_queue.cc:1048] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:29.493100 11854 tablet_bootstrap.cc:654] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.493619 11922 consensus_queue.cc:1048] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.489858 11657 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:29.497526 11853 raft_consensus.cc:359] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:29.498975 11853 raft_consensus.cc:385] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.497448 11773 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:29.500048 11901 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.500450 11901 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.500771 11901 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.499284 11853 raft_consensus.cc:740] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.502175 11853 consensus_queue.cc:260] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:29.505919 11853 ts_tablet_manager.cc:1434] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:16:29.506750 12021 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.506922 11853 tablet_bootstrap.cc:492] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:29.507277 12021 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.511085 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:29.513006 12021 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:29.517001 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:29.517868 11586 raft_consensus.cc:2393] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 1: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:29.519068 11627 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:29.520188 12021 raft_consensus.cc:3060] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.523011 11853 tablet_bootstrap.cc:654] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.522747 12084 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.529253 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:29.529896 11807 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.532142 12084 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:29.535416 11853 tablet_bootstrap.cc:492] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:29.535835 11851 tablet_bootstrap.cc:492] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:29.535929 11853 ts_tablet_manager.cc:1403] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 12:16:29.536365 11851 ts_tablet_manager.cc:1403] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.021s
I20260709 12:16:29.537374 11807 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:29.538384 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:29.538777 11549 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:29.539203 11922 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.539775 12084 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.539701 11922 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.540617 12084 raft_consensus.cc:697] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:29.541457 12084 consensus_queue.cc:237] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.541750 11922 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:29.541963 11852 tablet_bootstrap.cc:492] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:29.545261 11852 ts_tablet_manager.cc:1403] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.174s	user 0.009s	sys 0.002s
I20260709 12:16:29.546260 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:29.538843 11853 raft_consensus.cc:359] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.548105 11852 raft_consensus.cc:359] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.548630 11853 raft_consensus.cc:385] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.519064 11854 tablet_bootstrap.cc:492] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:29.548992 11853 raft_consensus.cc:740] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.549597 11854 ts_tablet_manager.cc:1403] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.132s	user 0.011s	sys 0.000s
I20260709 12:16:29.550027 11853 consensus_queue.cc:260] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.550927 11735 raft_consensus.cc:2468] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:29.549188 12021 raft_consensus.cc:2749] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:29.543061 11550 leader_election.cc:343] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.553694 11773 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:29.554601 11920 raft_consensus.cc:2804] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.554971 11920 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.555299 11920 raft_consensus.cc:3060] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.556031 11853 ts_tablet_manager.cc:1434] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:16:29.543889 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:29.558466 11481 catalog_manager.cc:5697] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:29.543715 11901 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.560175 11481 catalog_manager.cc:5697] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.563010 11481 catalog_manager.cc:5697] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.548946 11851 raft_consensus.cc:359] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.568876 11851 raft_consensus.cc:385] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.569190 11851 raft_consensus.cc:740] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.569875 11851 consensus_queue.cc:260] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.572009 11851 ts_tablet_manager.cc:1434] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 12:16:29.581146 11860 consensus_queue.cc:1048] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.583315 11853 tablet_bootstrap.cc:492] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:29.584007 11854 raft_consensus.cc:359] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.584703 11854 raft_consensus.cc:385] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.584928 11901 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:29.590276 11853 tablet_bootstrap.cc:654] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.593719 11852 raft_consensus.cc:385] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.594161 11852 raft_consensus.cc:740] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.594930 11852 consensus_queue.cc:260] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.594223 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:29.596122 11661 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.597314 11852 ts_tablet_manager.cc:1434] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:16:29.584944 11854 raft_consensus.cc:740] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.601805 11854 consensus_queue.cc:260] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.601567 11484 catalog_manager.cc:5697] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:29.606581 11775 leader_election.cc:343] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.616744 12091 consensus_queue.cc:1048] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.624646 11583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:29.625419 11484 catalog_manager.cc:5697] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.625425 11583 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.636296 11661 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:29.615221 11920 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.637682 11773 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:29.638562 11922 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.639035 11920 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:29.639011 11922 raft_consensus.cc:697] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:29.640384 11922 consensus_queue.cc:237] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.642634 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:29.643324 11735 raft_consensus.cc:3060] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.646582 11851 tablet_bootstrap.cc:492] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:29.652834 11854 ts_tablet_manager.cc:1434] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.103s	user 0.005s	sys 0.000s
I20260709 12:16:29.657400 11852 tablet_bootstrap.cc:492] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:29.659263 11735 raft_consensus.cc:2468] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:29.662434 11854 tablet_bootstrap.cc:492] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:29.667490 11851 tablet_bootstrap.cc:654] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.680130 11861 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.680727 11861 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.681550 11582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:29.672402 11583 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:29.676497 11853 tablet_bootstrap.cc:492] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:29.677803 11852 tablet_bootstrap.cc:654] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.682825 11861 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:29.682950 11853 ts_tablet_manager.cc:1403] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.100s	user 0.029s	sys 0.041s
W20260709 12:16:29.683934 11775 leader_election.cc:343] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.686691 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:29.687245 11858 consensus_queue.cc:1048] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.689821 11482 catalog_manager.cc:5697] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:29.691524 11853 raft_consensus.cc:359] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.692188 11853 raft_consensus.cc:385] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.692436 11853 raft_consensus.cc:740] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.693065 11853 consensus_queue.cc:260] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.698678 11853 ts_tablet_manager.cc:1434] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:16:29.699064 11854 tablet_bootstrap.cc:654] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.706421 11853 tablet_bootstrap.cc:492] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:29.714768 11853 tablet_bootstrap.cc:654] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.717016 11773 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:16:29.718504 11773 leader_election.cc:343] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.721652 11920 raft_consensus.cc:2804] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.722538 11920 raft_consensus.cc:697] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:29.723994 11920 consensus_queue.cc:237] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.725868 11483 catalog_manager.cc:5697] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:29.727996 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 44091us
I20260709 12:16:29.730278 11582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:29.727828 11483 catalog_manager.cc:5697] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.732914 11858 consensus_queue.cc:1048] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:29.741542 11775 leader_election.cc:343] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.748773 11775 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:29.751668 11922 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:29.757563 11936 consensus_queue.cc:1048] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.759691 11851 tablet_bootstrap.cc:492] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:29.760192 11851 ts_tablet_manager.cc:1403] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.000s
I20260709 12:16:29.763307 11851 raft_consensus.cc:359] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.742987 11853 tablet_bootstrap.cc:492] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:29.745450 11858 consensus_queue.cc:1048] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.764783 11853 ts_tablet_manager.cc:1403] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.007s
I20260709 12:16:29.746855 11852 tablet_bootstrap.cc:492] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:29.747670 11920 consensus_queue.cc:1048] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.764127 11851 raft_consensus.cc:385] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.769011 11853 raft_consensus.cc:359] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.769397 11854 tablet_bootstrap.cc:492] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:29.779830 11854 ts_tablet_manager.cc:1403] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.126s	user 0.024s	sys 0.017s
I20260709 12:16:29.779906 12021 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.780508 12021 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.769328 11852 ts_tablet_manager.cc:1403] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.171s	user 0.012s	sys 0.000s
I20260709 12:16:29.771556 12025 consensus_queue.cc:1048] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:16:29.783771 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:29.784430 11734 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:29.784768 11582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:29.784564 11854 raft_consensus.cc:359] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:29.785337 11854 raft_consensus.cc:385] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.785851 11625 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
W20260709 12:16:29.786469 11627 leader_election.cc:343] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.786233 11854 raft_consensus.cc:740] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.786731 11852 raft_consensus.cc:359] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.787397 11852 raft_consensus.cc:385] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.773928 11851 raft_consensus.cc:740] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.787690 11854 consensus_queue.cc:260] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:29.787603 12104 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.788946 12104 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.788698 11851 consensus_queue.cc:260] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.789330 12104 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.787268 12021 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:29.790277 11854 ts_tablet_manager.cc:1434] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:16:29.791111 11851 ts_tablet_manager.cc:1434] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 12:16:29.791299 11854 tablet_bootstrap.cc:492] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:29.787768 11852 raft_consensus.cc:740] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.804694 11852 consensus_queue.cc:260] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.791849 11853 raft_consensus.cc:385] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.805995 11853 raft_consensus.cc:740] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
W20260709 12:16:29.802521 11699 consensus_peers.cc:597] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.792001 11851 tablet_bootstrap.cc:492] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
W20260709 12:16:29.807945 11550 consensus_peers.cc:597] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.806728 11852 ts_tablet_manager.cc:1434] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:16:29.809226 11852 tablet_bootstrap.cc:492] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:29.810263 11853 consensus_queue.cc:260] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.810948 11657 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.821255 11853 ts_tablet_manager.cc:1434] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.002s
I20260709 12:16:29.823176 12091 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.811836 11854 tablet_bootstrap.cc:654] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.826128 11853 tablet_bootstrap.cc:492] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:29.826611 12084 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.827292 11861 consensus_queue.cc:1048] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.833846 11861 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.834309 11861 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.836615 12091 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.837116 12091 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.837348 11582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:29.838881 11775 leader_election.cc:343] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.839464 11861 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:29.839699 12091 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:29.841213 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:29.841854 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:29.842502 11734 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:29.843743 11550 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:29.844576 12091 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.844977 12091 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.845293 12091 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.847517 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:29.848248 11734 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:29.849583 11773 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:29.850440 11861 raft_consensus.cc:2804] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.850883 11861 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.851285 11861 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.852975 11922 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.853533 11922 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:29.855662 11922 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:29.818957 11482 catalog_manager.cc:5697] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.857451 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:29.858680 11734 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:29.860579 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:29.863422 11861 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:29.816391 11852 tablet_bootstrap.cc:654] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.819039 11851 tablet_bootstrap.cc:654] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.816061 12104 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:29.867707 11658 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 1: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:29.868757 11583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:29.857918 11482 catalog_manager.cc:5697] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.870465 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:29.871076 11734 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.873919 12104 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:29.877068 11851 tablet_bootstrap.cc:492] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:29.883759 11851 ts_tablet_manager.cc:1403] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.092s	user 0.003s	sys 0.007s
I20260709 12:16:29.888372 11851 raft_consensus.cc:359] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.883232 11853 tablet_bootstrap.cc:654] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.885483 11861 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:29.889587 11582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:16:29.891094 11775 leader_election.cc:343] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:29.863607 11773 leader_election.cc:343] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.901501 11773 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:29.902545 11861 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.903007 11861 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.903307 11861 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.910750 11861 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:29.889650 11851 raft_consensus.cc:385] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.911962 11851 raft_consensus.cc:740] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.913067 11861 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:29.916324 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:29.916152 11851 consensus_queue.cc:260] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:29.918295 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:29.927043 11733 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.928423 11851 ts_tablet_manager.cc:1434] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.002s
I20260709 12:16:29.929389 11851 tablet_bootstrap.cc:492] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:29.924217 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:29.937062 11851 tablet_bootstrap.cc:654] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.943075 11733 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:29.926613 11735 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.946799 11773 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:29.950449 11851 tablet_bootstrap.cc:492] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:29.952099 11851 ts_tablet_manager.cc:1403] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.005s
I20260709 12:16:29.954631 11861 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.955281 11861 raft_consensus.cc:697] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:29.956176 11861 consensus_queue.cc:237] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.001302 11852 tablet_bootstrap.cc:492] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:30.001909 11852 ts_tablet_manager.cc:1403] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.193s	user 0.018s	sys 0.000s
I20260709 12:16:30.003931 12084 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:30.004547 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 57862.1us
I20260709 12:16:30.006330 11851 raft_consensus.cc:359] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.007082 11854 tablet_bootstrap.cc:492] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:30.007786 11854 ts_tablet_manager.cc:1403] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.217s	user 0.046s	sys 0.078s
I20260709 12:16:30.009204 11852 raft_consensus.cc:359] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.009996 11852 raft_consensus.cc:385] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.010284 11852 raft_consensus.cc:740] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.007158 11851 raft_consensus.cc:385] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.010505 11854 raft_consensus.cc:359] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.011097 11851 raft_consensus.cc:740] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.011914 11851 consensus_queue.cc:260] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.012895 11852 consensus_queue.cc:260] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.014043 11854 raft_consensus.cc:385] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.014367 11854 raft_consensus.cc:740] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.015375 11852 ts_tablet_manager.cc:1434] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:16:30.015008 11854 consensus_queue.cc:260] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.017308 11854 ts_tablet_manager.cc:1434] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:16:30.018141 11852 tablet_bootstrap.cc:492] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:30.019649 11853 tablet_bootstrap.cc:492] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:30.019711 11851 ts_tablet_manager.cc:1434] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.010s
I20260709 12:16:30.020377 11853 ts_tablet_manager.cc:1403] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.198s	user 0.034s	sys 0.029s
I20260709 12:16:30.021860 11734 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:30.023141 11853 raft_consensus.cc:359] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.049916 11853 raft_consensus.cc:385] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.050243 11853 raft_consensus.cc:740] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.050871 11853 consensus_queue.cc:260] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.051544 11852 tablet_bootstrap.cc:654] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.052848 11853 ts_tablet_manager.cc:1434] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.032s	user 0.023s	sys 0.000s
W20260709 12:16:30.023237 11773 leader_election.cc:343] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.021010 11851 tablet_bootstrap.cc:492] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:30.068313 11735 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:30.053745 11853 tablet_bootstrap.cc:492] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:30.075776 11853 tablet_bootstrap.cc:654] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.077613 11773 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:30.078437 12094 raft_consensus.cc:2804] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:30.078972 12094 raft_consensus.cc:697] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:30.079818 12094 consensus_queue.cc:237] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.069108 11484 catalog_manager.cc:5697] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:30.084986 11851 tablet_bootstrap.cc:654] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.087268 11858 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.087814 11858 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.090030 11858 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:29.950776 12091 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.047379 11625 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
W20260709 12:16:30.091986 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 44706.9us
I20260709 12:16:30.092110 11582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:30.022997 11860 consensus_queue.cc:1048] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.092087 12104 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:30.094732 12104 raft_consensus.cc:697] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:30.095616 12104 consensus_queue.cc:237] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.048161 12084 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.049520 11854 tablet_bootstrap.cc:492] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:30.097872 11583 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 1: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:30.099167 12106 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.100109 12106 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.097311 12084 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.103292 12091 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:30.103720 11852 tablet_bootstrap.cc:492] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:30.104038 12084 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:30.104287 11852 ts_tablet_manager.cc:1403] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.027s
W20260709 12:16:30.105036 11701 leader_election.cc:343] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.107055 11852 raft_consensus.cc:359] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.107828 11852 raft_consensus.cc:385] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.108083 11852 raft_consensus.cc:740] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.108119 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:30.109009 11583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:30.108877 11852 consensus_queue.cc:260] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.109014 11854 tablet_bootstrap.cc:654] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:30.110464 11775 leader_election.cc:343] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:30.099031 11550 consensus_peers.cc:597] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:30.111373 11852 ts_tablet_manager.cc:1434] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:16:30.095984 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:30.116164 11852 tablet_bootstrap.cc:492] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
W20260709 12:16:30.116895 11699 leader_election.cc:343] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.117461 11699 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:30.119318 11936 raft_consensus.cc:2749] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.123867 11853 tablet_bootstrap.cc:492] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:30.124436 11853 ts_tablet_manager.cc:1403] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.002s
I20260709 12:16:30.127065 11853 raft_consensus.cc:359] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.127723 11853 raft_consensus.cc:385] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.127967 11853 raft_consensus.cc:740] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.128700 11853 consensus_queue.cc:260] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.134321 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:30.134717 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.134939 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:30.135510 11731 raft_consensus.cc:2393] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 1: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:30.135234 11733 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 1: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:30.136368 12106 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:30.140686 11550 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:30.141970 11550 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:30.142638 11482 catalog_manager.cc:5697] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.145200 11852 tablet_bootstrap.cc:654] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.149724 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.148245 12092 raft_consensus.cc:3060] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:30.154942 11773 leader_election.cc:343] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.170183 11773 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:30.173511 11853 ts_tablet_manager.cc:1434] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 12:16:30.148098 12091 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.175045 12110 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.181515 11851 tablet_bootstrap.cc:492] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:30.182178 11851 ts_tablet_manager.cc:1403] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.161s	user 0.028s	sys 0.013s
I20260709 12:16:30.184038 11920 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.184635 11920 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.186800 11920 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:30.187353 11920 consensus_queue.cc:1048] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.188275 11851 raft_consensus.cc:359] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.189146 11851 raft_consensus.cc:385] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.174192 12094 raft_consensus.cc:2749] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.191247 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.189525 11851 raft_consensus.cc:740] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
W20260709 12:16:30.199517 11773 leader_election.cc:343] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.194391 11851 consensus_queue.cc:260] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.203358 11853 tablet_bootstrap.cc:492] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:30.209928 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:30.189165 12110 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:16:30.224066 12161 log.cc:927] Time spent T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:16:30.227783 11851 ts_tablet_manager.cc:1434] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.003s
I20260709 12:16:30.228389 11482 catalog_manager.cc:5697] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.237980 11851 tablet_bootstrap.cc:492] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:30.225661 12110 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:30.251556 11858 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.252110 11858 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.255203 11920 consensus_queue.cc:1048] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:30.255321 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:30.261549 11701 leader_election.cc:343] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.262322 12092 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:30.237635 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 46033.2us
I20260709 12:16:30.266405 12106 consensus_queue.cc:1048] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.268257 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.269524 11661 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:30.270320 11773 leader_election.cc:343] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.270823 11773 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:16:30.271508 12159 log.cc:927] Time spent T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:16:30.272037 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:30.273785 12094 raft_consensus.cc:2749] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.276183 11854 tablet_bootstrap.cc:492] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:30.276701 11854 ts_tablet_manager.cc:1403] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.227s	user 0.016s	sys 0.028s
I20260709 12:16:30.255177 11858 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:30.282004 11851 tablet_bootstrap.cc:654] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.289654 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:30.291890 11854 raft_consensus.cc:359] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.292598 11854 raft_consensus.cc:385] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.292876 11854 raft_consensus.cc:740] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.293815 11854 consensus_queue.cc:260] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:30.295169 11699 leader_election.cc:343] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.295667 11699 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:30.296198 11854 ts_tablet_manager.cc:1434] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:16:30.297375 11854 tablet_bootstrap.cc:492] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:30.301092 11853 tablet_bootstrap.cc:654] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.301833 11858 raft_consensus.cc:2749] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.304486 11624 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:30.308915 12106 consensus_queue.cc:1048] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.332084 11854 tablet_bootstrap.cc:654] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.351109 11852 tablet_bootstrap.cc:492] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:30.351709 11852 ts_tablet_manager.cc:1403] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.236s	user 0.023s	sys 0.007s
I20260709 12:16:30.358235 11860 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.358780 11860 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.359798 11852 raft_consensus.cc:359] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.360477 11852 raft_consensus.cc:385] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.360720 11852 raft_consensus.cc:740] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.360785 11860 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:30.361397 11852 consensus_queue.cc:260] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.363524 11852 ts_tablet_manager.cc:1434] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:16:30.366889 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:30.367290 11851 tablet_bootstrap.cc:492] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:30.367815 11851 ts_tablet_manager.cc:1403] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.013s
I20260709 12:16:30.368443 12110 raft_consensus.cc:2749] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.370954 11852 tablet_bootstrap.cc:492] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:30.381039 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.381857 11732 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:30.386425 11852 tablet_bootstrap.cc:654] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.390129 11550 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:16:30.391122 11550 leader_election.cc:343] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.391583 12092 raft_consensus.cc:2804] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:30.392055 12092 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.392387 12092 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.404528 11851 raft_consensus.cc:359] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.406454 11851 raft_consensus.cc:385] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.406761 11851 raft_consensus.cc:740] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.407392 11851 consensus_queue.cc:260] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.409924 11851 ts_tablet_manager.cc:1434] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.002s
I20260709 12:16:30.410871 11851 tablet_bootstrap.cc:492] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:30.413735 11901 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.414301 11901 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.416283 11901 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:30.417860 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:30.420320 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:30.420964 11851 tablet_bootstrap.cc:654] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:30.421963 11775 leader_election.cc:343] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:30.423097 11773 leader_election.cc:343] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.423517 11773 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:30.424208 11901 raft_consensus.cc:2749] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.432222 12094 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.432747 12094 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:16:30.434567 11532 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:30.434911 12094 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:30.439404 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.439601 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:30.440131 11735 raft_consensus.cc:2468] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
W20260709 12:16:30.441246 11773 leader_election.cc:343] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.441943 11773 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:30.442929 11920 raft_consensus.cc:2804] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:30.443269 11920 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.443572 11920 raft_consensus.cc:3060] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.448551 11853 tablet_bootstrap.cc:492] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:30.449081 11853 ts_tablet_manager.cc:1403] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.252s	user 0.010s	sys 0.000s
I20260709 12:16:30.434725 12092 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.451045 11854 tablet_bootstrap.cc:492] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:30.450891 11920 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.451731 11854 ts_tablet_manager.cc:1403] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.000s
I20260709 12:16:30.453460 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:30.453660 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:30.454483 11854 raft_consensus.cc:359] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:30.454962 11550 leader_election.cc:343] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:30.455286 11773 leader_election.cc:343] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.455209 11854 raft_consensus.cc:385] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.453502 11853 raft_consensus.cc:359] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.455814 11854 raft_consensus.cc:740] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.456127 11853 raft_consensus.cc:385] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.456439 11853 raft_consensus.cc:740] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.456853 11854 consensus_queue.cc:260] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.457957 12092 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:30.458397 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:30.459031 11735 raft_consensus.cc:3060] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.459468 11854 ts_tablet_manager.cc:1434] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:30.460520 11854 tablet_bootstrap.cc:492] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:30.460875 11852 tablet_bootstrap.cc:492] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:30.461323 11852 ts_tablet_manager.cc:1403] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.003s
I20260709 12:16:30.463255 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:30.463842 11732 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.464946 11851 tablet_bootstrap.cc:492] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:30.465905 11851 ts_tablet_manager.cc:1403] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.003s
I20260709 12:16:30.458755 11853 consensus_queue.cc:260] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.465284 11920 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:30.467727 11853 ts_tablet_manager.cc:1434] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 12:16:30.466049 11854 tablet_bootstrap.cc:654] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.463966 11852 raft_consensus.cc:359] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.468750 11852 raft_consensus.cc:385] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.469048 11852 raft_consensus.cc:740] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.469798 11852 consensus_queue.cc:260] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.470579 11851 raft_consensus.cc:359] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.471310 11851 raft_consensus.cc:385] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.471609 11851 raft_consensus.cc:740] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.471835 11852 ts_tablet_manager.cc:1434] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:16:30.472373 11851 consensus_queue.cc:260] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.474288 11735 raft_consensus.cc:2468] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:30.474926 11851 ts_tablet_manager.cc:1434] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:16:30.475519 11773 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:30.476281 11920 raft_consensus.cc:2804] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:30.476778 11920 raft_consensus.cc:697] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:30.477535 11920 consensus_queue.cc:237] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.478127 11732 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:30.475952 11851 tablet_bootstrap.cc:492] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:30.481894 11854 tablet_bootstrap.cc:492] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:30.482393 11854 ts_tablet_manager.cc:1403] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 12:16:30.485302 11854 raft_consensus.cc:359] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.485953 11854 raft_consensus.cc:385] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.486225 11854 raft_consensus.cc:740] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.486802 11854 consensus_queue.cc:260] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.488771 11854 ts_tablet_manager.cc:1434] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:30.489715 11854 tablet_bootstrap.cc:492] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:30.491137 11851 tablet_bootstrap.cc:654] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:30.491282 11773 consensus_peers.cc:597] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:30.498494 11853 tablet_bootstrap.cc:492] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:30.502436 12092 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.503007 12092 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.486723 11550 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:30.505807 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:30.506448 11807 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:30.507738 11549 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:30.507993 12084 raft_consensus.cc:2804] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:30.508560 12084 raft_consensus.cc:697] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:30.509428 12087 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:30.509472 12084 consensus_queue.cc:237] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.510361 12087 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.510789 12087 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.517993 11852 tablet_bootstrap.cc:492] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:30.518193 12087 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.521232 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:30.521809 11807 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.524866 11853 tablet_bootstrap.cc:654] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.528232 12104 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.528849 11807 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:30.530081 11549 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:30.531032 11860 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:30.531495 11860 raft_consensus.cc:697] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:30.533030 12092 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:30.532335 11484 catalog_manager.cc:5697] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:30.528816 12104 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.536638 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.537484 11852 tablet_bootstrap.cc:654] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.538419 12104 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:30.539348 11901 consensus_queue.cc:1048] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.542936 12087 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:30.545645 11854 tablet_bootstrap.cc:654] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.532421 11860 consensus_queue.cc:237] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.553000 11852 tablet_bootstrap.cc:492] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:30.553479 11852 ts_tablet_manager.cc:1403] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 12:16:30.555604 11582 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.564352 11920 consensus_queue.cc:1048] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.567965 11854 tablet_bootstrap.cc:492] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:30.568565 11854 ts_tablet_manager.cc:1403] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.001s
I20260709 12:16:30.571336 11854 raft_consensus.cc:359] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.571970 11854 raft_consensus.cc:385] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.572218 11854 raft_consensus.cc:740] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.572628 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:30.573590 11854 consensus_queue.cc:260] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.575841 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:30.577123 11854 ts_tablet_manager.cc:1434] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:30.578238 11854 tablet_bootstrap.cc:492] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:30.579489 11657 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.583981 11854 tablet_bootstrap.cc:654] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:30.589967 11550 leader_election.cc:343] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.591976 11920 consensus_queue.cc:1048] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.595047 11582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:30.604558 11853 tablet_bootstrap.cc:492] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:30.605291 11853 ts_tablet_manager.cc:1403] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.000s
W20260709 12:16:30.606231 11550 leader_election.cc:343] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.609036 11852 raft_consensus.cc:359] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.614442 11852 raft_consensus.cc:385] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.614754 11852 raft_consensus.cc:740] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.615384 11852 consensus_queue.cc:260] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.610428 11853 raft_consensus.cc:359] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.616194 11853 raft_consensus.cc:385] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.616240 11854 tablet_bootstrap.cc:492] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:30.616587 11853 raft_consensus.cc:740] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.616868 11854 ts_tablet_manager.cc:1403] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.009s
I20260709 12:16:30.617519 11853 consensus_queue.cc:260] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.620508 11852 ts_tablet_manager.cc:1434] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 12:16:30.621889 11627 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:30.622426 11854 raft_consensus.cc:359] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.622920 11852 tablet_bootstrap.cc:492] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:30.624852 12165 raft_consensus.cc:2749] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.623240 11854 raft_consensus.cc:385] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.625568 11854 raft_consensus.cc:740] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.626487 11854 consensus_queue.cc:260] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.626746 11853 ts_tablet_manager.cc:1434] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 12:16:30.631839 11854 ts_tablet_manager.cc:1434] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:16:30.632823 11854 tablet_bootstrap.cc:492] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:30.633246 11920 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.635064 11920 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.636938 11920 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:30.633087 11852 tablet_bootstrap.cc:654] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.640864 11854 tablet_bootstrap.cc:654] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.641772 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.643397 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:30.644050 11773 leader_election.cc:343] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.643692 11484 catalog_manager.cc:5697] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:30.646605 11775 leader_election.cc:343] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.647042 11775 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:30.647737 11861 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.664674 11853 tablet_bootstrap.cc:492] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:30.667750 11851 tablet_bootstrap.cc:492] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:30.668256 12110 consensus_queue.cc:1048] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.668286 11851 ts_tablet_manager.cc:1403] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.193s	user 0.018s	sys 0.020s
I20260709 12:16:30.673633 11483 catalog_manager.cc:5697] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.682592 11936 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.686595 11936 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.688657 11936 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:30.690928 11582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:30.692893 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:30.693179 11701 leader_election.cc:343] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.698827 11853 tablet_bootstrap.cc:654] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.699550 11854 tablet_bootstrap.cc:492] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:30.700080 11854 ts_tablet_manager.cc:1403] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.003s
I20260709 12:16:30.703173 11851 raft_consensus.cc:359] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.703892 11851 raft_consensus.cc:385] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.704152 11851 raft_consensus.cc:740] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.704353 11852 tablet_bootstrap.cc:492] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:30.704924 11852 ts_tablet_manager.cc:1403] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.015s
I20260709 12:16:30.705181 11851 consensus_queue.cc:260] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:16:30.707929 11699 leader_election.cc:343] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.708061 12104 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:30.708622 12104 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.708956 11920 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.709458 11920 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.712363 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:30.712818 11920 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:16:30.714627 11775 leader_election.cc:343] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.715039 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:30.715309 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:30.715176 12104 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:30.717829 11627 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:30.717846 12104 consensus_queue.cc:1048] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:30.718925 12165 raft_consensus.cc:2749] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.708384 11699 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:30.719624 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:30.720842 11858 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:30.720865 11773 leader_election.cc:343] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.722074 11773 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:30.721848 11852 raft_consensus.cc:359] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.722674 11852 raft_consensus.cc:385] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.722954 11852 raft_consensus.cc:740] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.723786 11852 consensus_queue.cc:260] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.724978 11920 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.727222 12165 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.727810 12165 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.733531 11851 ts_tablet_manager.cc:1434] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:16:30.776816 12104 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.778326 12104 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.782229 11657 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:30.835225 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 114385us
I20260709 12:16:30.837776 12165 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:30.838400 11854 raft_consensus.cc:359] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.839216 11854 raft_consensus.cc:385] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.839524 11854 raft_consensus.cc:740] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.840235 11854 consensus_queue.cc:260] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:30.840905 11851 tablet_bootstrap.cc:492] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:30.842321 11854 ts_tablet_manager.cc:1434] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.142s	user 0.016s	sys 0.039s
I20260709 12:16:30.845134 12104 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:30.848243 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:30.849028 11851 tablet_bootstrap.cc:654] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.859510 11852 ts_tablet_manager.cc:1434] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.154s	user 0.013s	sys 0.012s
W20260709 12:16:30.850248 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 142345us
W20260709 12:16:30.849184 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 131452us
I20260709 12:16:30.877594 12091 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.878161 12091 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.879491 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.869601 11853 tablet_bootstrap.cc:492] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:30.883939 11853 ts_tablet_manager.cc:1403] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.224s	user 0.013s	sys 0.008s
I20260709 12:16:30.888695 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.880213 12091 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:30.901504 11625 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:30.903556 11853 raft_consensus.cc:359] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.904284 11853 raft_consensus.cc:385] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.904551 11853 raft_consensus.cc:740] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.904889 12110 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.905167 11853 consensus_queue.cc:260] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.906761 11853 ts_tablet_manager.cc:1434] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:16:30.906792 11854 tablet_bootstrap.cc:492] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:30.907922 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:30.908564 11807 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:30.909801 11549 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:30.910493 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.911103 11734 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:30.910625 12091 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:30.882994 11735 raft_consensus.cc:2393] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 1: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:30.915233 11853 tablet_bootstrap.cc:492] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:30.928436 11920 consensus_queue.cc:1048] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:30.913978 12091 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.931628 12091 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.918154 11852 tablet_bootstrap.cc:492] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:30.938789 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:30.942179 11853 tablet_bootstrap.cc:654] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.942714 12104 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.943259 12104 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:30.945178 11854 tablet_bootstrap.cc:654] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.945415 12104 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:30.947085 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:30.960343 11659 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.961333 11852 tablet_bootstrap.cc:654] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.956848 12025 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.962224 12025 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:30.964370 12025 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:30.972244 11920 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.972772 11920 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:30.974809 11920 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:30.986588 11658 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.987563 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:30.990574 11582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:30.992188 11775 leader_election.cc:343] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:30.993040 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:30.989777 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:30.998188 11585 raft_consensus.cc:2468] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:30.965950 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:31.001717 11699 leader_election.cc:343] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:31.006688 11773 leader_election.cc:343] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.007212 11773 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:31.007869 11851 tablet_bootstrap.cc:492] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:31.008416 11920 raft_consensus.cc:2749] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.976035 11807 raft_consensus.cc:2393] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 1: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:31.008497 11851 ts_tablet_manager.cc:1403] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.168s	user 0.037s	sys 0.061s
I20260709 12:16:31.020282 11860 consensus_queue.cc:1048] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.020475 11701 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:31.025499 12025 raft_consensus.cc:2804] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:31.026067 12025 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.027760 12025 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.029888 12181 consensus_queue.cc:1048] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.034366 11851 raft_consensus.cc:359] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.035110 11851 raft_consensus.cc:385] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.035364 11851 raft_consensus.cc:740] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.036186 11851 consensus_queue.cc:260] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.038661 11851 ts_tablet_manager.cc:1434] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260709 12:16:31.039681 11851 tablet_bootstrap.cc:492] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:31.046329 12104 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.046891 12104 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:31.048959 12104 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:31.052608 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:31.053402 11807 raft_consensus.cc:2468] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:31.054692 11624 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:31.055568 12104 raft_consensus.cc:2804] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:31.055995 12104 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.056361 12104 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.064234 12104 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:31.067243 11627 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:30.967629 12091 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:31.082224 11851 tablet_bootstrap.cc:654] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.078868 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:16:31.109055 11625 leader_election.cc:343] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.117501 11658 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:31.123068 11773 consensus_peers.cc:597] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:31.124337 12025 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:31.126791 12091 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:31.127266 11627 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:31.128654 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:31.129247 11734 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.137326 11854 tablet_bootstrap.cc:492] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:31.138099 11854 ts_tablet_manager.cc:1403] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.232s	user 0.009s	sys 0.007s
I20260709 12:16:31.142467 11852 tablet_bootstrap.cc:492] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:31.142976 11852 ts_tablet_manager.cc:1403] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.259s	user 0.027s	sys 0.077s
I20260709 12:16:31.159281 12084 consensus_queue.cc:1048] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:16:31.164004 11853 tablet_bootstrap.cc:492] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:31.164567 11853 ts_tablet_manager.cc:1403] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.257s	user 0.031s	sys 0.015s
I20260709 12:16:31.157521 12164 raft_consensus.cc:2749] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:31.167752 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:31.168419 11807 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.187716 11734 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:31.201289 11550 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:31.200493 12110 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:31.224949 11852 raft_consensus.cc:359] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.225780 11852 raft_consensus.cc:385] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.226258 11852 raft_consensus.cc:740] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.226980 11852 consensus_queue.cc:260] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.208811 11860 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.205291 12091 consensus_queue.cc:1048] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:16:31.246562 11852 ts_tablet_manager.cc:1434] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.103s	user 0.004s	sys 0.004s
I20260709 12:16:31.259191 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:31.266822 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:31.287899 11860 raft_consensus.cc:697] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:31.288866 11806 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.321565 11854 raft_consensus.cc:359] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:31.326571 11853 raft_consensus.cc:359] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:31.330101 11853 raft_consensus.cc:385] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.327551 11854 raft_consensus.cc:385] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.331832 11854 raft_consensus.cc:740] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.332338 11854 consensus_queue.cc:260] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:31.334465 11854 ts_tablet_manager.cc:1434] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.196s	user 0.007s	sys 0.000s
I20260709 12:16:31.330379 11853 raft_consensus.cc:740] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.339237 11853 consensus_queue.cc:260] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:31.343724 11853 ts_tablet_manager.cc:1434] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.179s	user 0.008s	sys 0.002s
I20260709 12:16:31.348323 11807 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:31.363196 12025 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:31.325946 11860 consensus_queue.cc:237] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:31.371635 11806 raft_consensus.cc:2468] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:31.375795 11858 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.376325 11858 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:31.378271 11858 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:31.380119 11854 tablet_bootstrap.cc:492] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:31.371905 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:31.380668 11852 tablet_bootstrap.cc:492] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:31.380970 11586 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.390934 11851 tablet_bootstrap.cc:492] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:31.391498 11851 ts_tablet_manager.cc:1403] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.352s	user 0.027s	sys 0.015s
I20260709 12:16:31.393157 11854 tablet_bootstrap.cc:654] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.396697 11586 raft_consensus.cc:2468] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
W20260709 12:16:31.371665 12202 log.cc:927] Time spent T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:16:31.398656 12104 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:16:31.386204 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 82022.7us
I20260709 12:16:31.421835 11851 raft_consensus.cc:359] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:31.425148 11851 raft_consensus.cc:385] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.425578 11851 raft_consensus.cc:740] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
W20260709 12:16:31.425628 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 54799.1us
I20260709 12:16:31.430044 11853 tablet_bootstrap.cc:492] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
W20260709 12:16:31.456113 11625 leader_election.cc:343] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.464023 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:31.466416 11583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:31.469367 11852 tablet_bootstrap.cc:654] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.439213 11851 consensus_queue.cc:260] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:16:31.479753 11699 leader_election.cc:343] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.480602 11624 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:31.483034 12216 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.483547 12216 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.485087 11854 tablet_bootstrap.cc:492] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:31.485558 11854 ts_tablet_manager.cc:1403] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.106s	user 0.039s	sys 0.020s
I20260709 12:16:31.489130 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:31.494411 11806 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:31.494903 12209 raft_consensus.cc:2804] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.495435 12209 raft_consensus.cc:697] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:31.496229 12209 consensus_queue.cc:237] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:31.493383 11701 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:31.522394 11854 raft_consensus.cc:359] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.523223 11854 raft_consensus.cc:385] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.523640 11854 raft_consensus.cc:740] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.487772 12207 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.537485 12207 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.539613 12207 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:31.540508 11698 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:31.540921 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:31.541594 11807 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:31.541647 11854 consensus_queue.cc:260] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.543035 11936 raft_consensus.cc:2804] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.543130 11549 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:31.485642 12216 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:31.548928 11851 ts_tablet_manager.cc:1434] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.157s	user 0.006s	sys 0.003s
I20260709 12:16:31.566870 11851 tablet_bootstrap.cc:492] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:31.556718 11853 tablet_bootstrap.cc:654] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:31.558025 11701 leader_election.cc:343] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.561991 11858 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:31.576005 11858 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.576457 11858 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.576434 11854 ts_tablet_manager.cc:1434] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 12:16:31.608268 11851 tablet_bootstrap.cc:654] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.608884 11854 tablet_bootstrap.cc:492] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
W20260709 12:16:31.563246 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 106258us
I20260709 12:16:31.611218 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:31.625270 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 49356.1us
I20260709 12:16:31.620180 11936 raft_consensus.cc:697] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:31.634497 12225 raft_consensus.cc:2804] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:31.634972 12225 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.635294 12225 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.627535 11655 raft_consensus.cc:3060] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.646579 11854 tablet_bootstrap.cc:654] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.650964 11858 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:16:31.622664 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 129688us
I20260709 12:16:31.661749 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:31.662518 11661 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
W20260709 12:16:31.664477 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 122720us
W20260709 12:16:31.667948 11773 leader_election.cc:343] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.668386 11484 catalog_manager.cc:5697] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:31.676466 11858 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:31.680145 11852 tablet_bootstrap.cc:492] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:31.680694 11852 ts_tablet_manager.cc:1403] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.300s	user 0.027s	sys 0.034s
I20260709 12:16:31.685364 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:31.686201 11807 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.700862 11582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:31.701325 12225 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.703750 12225 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:31.705655 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:31.706411 11657 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.719254 11852 raft_consensus.cc:359] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.720203 11852 raft_consensus.cc:385] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.720486 11852 raft_consensus.cc:740] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.721150 11852 consensus_queue.cc:260] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.722196 11807 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:31.731070 11853 tablet_bootstrap.cc:492] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:31.731628 11853 ts_tablet_manager.cc:1403] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.329s	user 0.019s	sys 0.004s
I20260709 12:16:31.731863 11698 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:31.732136 11936 consensus_queue.cc:237] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:31.745427 11851 tablet_bootstrap.cc:492] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:31.745975 11851 ts_tablet_manager.cc:1403] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.179s	user 0.021s	sys 0.002s
W20260709 12:16:31.750520 11532 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:31.753861 12240 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.754437 12240 raft_consensus.cc:697] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:31.755254 12240 consensus_queue.cc:237] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:31.761442 11853 raft_consensus.cc:359] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:31.762200 11853 raft_consensus.cc:385] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.762447 11853 raft_consensus.cc:740] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.763010 11853 consensus_queue.cc:260] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:16:31.764070 11775 leader_election.cc:343] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.764546 11775 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:31.766408 12216 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:31.771193 11854 tablet_bootstrap.cc:492] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:31.771662 11854 ts_tablet_manager.cc:1403] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.010s
I20260709 12:16:31.772099 11851 raft_consensus.cc:359] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:31.772836 11851 raft_consensus.cc:385] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.773089 11851 raft_consensus.cc:740] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.774385 11854 raft_consensus.cc:359] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:31.775077 11854 raft_consensus.cc:385] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.775326 11854 raft_consensus.cc:740] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.775905 11854 consensus_queue.cc:260] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:31.776917 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:31.778282 11854 ts_tablet_manager.cc:1434] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:16:31.779351 11854 tablet_bootstrap.cc:492] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:31.781955 12091 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.782456 12091 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.782397 11852 ts_tablet_manager.cc:1434] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.101s	user 0.004s	sys 0.004s
I20260709 12:16:31.787883 12091 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:31.789258 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:31.790654 11805 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:31.791971 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:31.792589 11807 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.793176 11549 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:31.794090 12091 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:31.794451 12091 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.794795 12091 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.790292 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:31.802013 11852 tablet_bootstrap.cc:492] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
W20260709 12:16:31.802420 11550 leader_election.cc:343] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.807468 11657 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:31.773692 11851 consensus_queue.cc:260] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:31.809054 11854 tablet_bootstrap.cc:654] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.809206 11550 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:31.810662 11860 raft_consensus.cc:2804] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.811113 11860 raft_consensus.cc:697] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:31.811829 11860 consensus_queue.cc:237] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.816156 11807 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
W20260709 12:16:31.818693 11701 leader_election.cc:343] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.819799 11853 ts_tablet_manager.cc:1434] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.004s
I20260709 12:16:31.823884 11851 ts_tablet_manager.cc:1434] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 12:16:31.825115 11851 tablet_bootstrap.cc:492] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:31.825366 11854 tablet_bootstrap.cc:492] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:31.825987 11854 ts_tablet_manager.cc:1403] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.007s
I20260709 12:16:31.823225 12091 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.828979 12091 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:31.830885 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:31.833343 11853 tablet_bootstrap.cc:492] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:31.837596 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:31.838272 11807 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.840345 11481 catalog_manager.cc:5697] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:31.842996 12091 consensus_queue.cc:1048] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:31.846312 11807 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:31.856604 11549 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:31.857489 11860 consensus_queue.cc:1048] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:31.858860 11860 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.859323 11860 raft_consensus.cc:697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:31.862732 11851 tablet_bootstrap.cc:654] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.864516 11854 raft_consensus.cc:359] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.865224 11854 raft_consensus.cc:385] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.865468 11854 raft_consensus.cc:740] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.860116 11860 consensus_queue.cc:237] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.869071 11854 consensus_queue.cc:260] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.874730 11854 ts_tablet_manager.cc:1434] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:16:31.875808 11854 tablet_bootstrap.cc:492] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:31.876103 11654 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.880306 11852 tablet_bootstrap.cc:654] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.881558 11854 tablet_bootstrap.cc:654] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.903445 11851 tablet_bootstrap.cc:492] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:31.904121 11851 ts_tablet_manager.cc:1403] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.012s
I20260709 12:16:31.905479 12233 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.906284 12205 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.906765 12205 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:31.906024 12233 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:31.910970 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:31.912140 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:31.912526 11773 leader_election.cc:343] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.912952 11586 raft_consensus.cc:2393] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 1: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:31.913300 12233 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:31.914915 12205 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:31.915182 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:16:31.917101 11773 leader_election.cc:343] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.917518 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:31.918582 12233 raft_consensus.cc:2749] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:31.918919 11853 tablet_bootstrap.cc:654] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.919209 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:31.922849 11625 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:31.924546 11482 catalog_manager.cc:5697] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.907372 11851 raft_consensus.cc:359] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.935073 11851 raft_consensus.cc:385] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.935403 11851 raft_consensus.cc:740] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.944281 11851 consensus_queue.cc:260] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:31.947767 11851 ts_tablet_manager.cc:1434] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:16:31.936105 12205 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.924652 11654 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:31.951335 11936 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.966480 11936 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:31.967480 12222 consensus_queue.cc:1048] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:31.968757 11936 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:31.969720 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:31.971432 11701 leader_election.cc:343] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:31.950629 11851 tablet_bootstrap.cc:492] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178: Bootstrap starting.
I20260709 12:16:31.999924 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:16:32.019272 11698 leader_election.cc:343] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.019733 11698 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:32.023617 12205 raft_consensus.cc:2749] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.023978 11936 raft_consensus.cc:2749] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.028055 11851 tablet_bootstrap.cc:654] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.034905 11852 tablet_bootstrap.cc:492] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:32.035492 11852 ts_tablet_manager.cc:1403] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.234s	user 0.040s	sys 0.017s
I20260709 12:16:32.037144 11484 catalog_manager.cc:5697] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:32.038964 11484 catalog_manager.cc:5697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:32.041853 11853 tablet_bootstrap.cc:492] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:32.042358 11853 ts_tablet_manager.cc:1403] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.212s	user 0.008s	sys 0.035s
I20260709 12:16:32.047752 11854 tablet_bootstrap.cc:492] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:32.048254 11854 ts_tablet_manager.cc:1403] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.173s	user 0.020s	sys 0.007s
I20260709 12:16:32.052086 11854 raft_consensus.cc:359] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.052867 11854 raft_consensus.cc:385] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.053223 11854 raft_consensus.cc:740] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.054054 11854 consensus_queue.cc:260] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.056522 11854 ts_tablet_manager.cc:1434] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:32.057600 11854 tablet_bootstrap.cc:492] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:32.064116 11853 raft_consensus.cc:359] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.064805 11853 raft_consensus.cc:385] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.065076 11853 raft_consensus.cc:740] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.066241 11854 tablet_bootstrap.cc:654] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.070521 11481 catalog_manager.cc:5697] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:32.067742 11852 raft_consensus.cc:359] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.082273 11852 raft_consensus.cc:385] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.082648 11852 raft_consensus.cc:740] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.083446 11853 consensus_queue.cc:260] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.084354 11852 consensus_queue.cc:260] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.087132 11853 ts_tablet_manager.cc:1434] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
I20260709 12:16:32.093609 11853 tablet_bootstrap.cc:492] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:32.094143 11732 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.088841 11852 ts_tablet_manager.cc:1434] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:16:32.095256 11852 tablet_bootstrap.cc:492] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:32.110189 11936 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.110793 11936 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.113019 11936 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:32.114871 11852 tablet_bootstrap.cc:654] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.116110 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:32.115826 11853 tablet_bootstrap.cc:654] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.116789 11584 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:32.118835 11701 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:32.119102 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:32.130571 12237 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.130987 12237 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.131305 12237 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.131803 11853 tablet_bootstrap.cc:492] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:32.132349 11853 ts_tablet_manager.cc:1403] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.004s
I20260709 12:16:32.132570 11851 tablet_bootstrap.cc:492] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178: No bootstrap required, opened a new log
I20260709 12:16:32.133149 11851 ts_tablet_manager.cc:1403] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178: Time spent bootstrapping tablet: real 0.184s	user 0.010s	sys 0.005s
I20260709 12:16:32.135193 11853 raft_consensus.cc:359] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:16:32.135545 11699 leader_election.cc:343] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.136101 11851 raft_consensus.cc:359] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:32.139700 11852 tablet_bootstrap.cc:492] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:32.139837 11851 raft_consensus.cc:385] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.140350 11851 raft_consensus.cc:740] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.140412 11852 ts_tablet_manager.cc:1403] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 12:16:32.141276 11851 consensus_queue.cc:260] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:32.143424 11852 raft_consensus.cc:359] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:32.144380 11852 raft_consensus.cc:385] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.144693 11852 raft_consensus.cc:740] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.146065 11851 ts_tablet_manager.cc:1434] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 12:16:32.145975 11852 consensus_queue.cc:260] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:32.152910 11852 ts_tablet_manager.cc:1434] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:16:32.153970 11852 tablet_bootstrap.cc:492] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:32.157856 11853 raft_consensus.cc:385] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.158242 11853 raft_consensus.cc:740] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.158967 11853 consensus_queue.cc:260] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.160591 11853 ts_tablet_manager.cc:1434] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.000s
I20260709 12:16:32.161563 11853 tablet_bootstrap.cc:492] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:32.163255 12240 consensus_queue.cc:1048] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:32.167742 11853 tablet_bootstrap.cc:654] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.183043 12216 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.183728 12216 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:32.187242 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:32.187911 11584 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:32.190516 11775 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:32.191439 12218 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.191803 12218 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.192106 12218 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.206635 12216 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:32.208256 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:32.210791 11773 leader_election.cc:343] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.141402 12237 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.216194 12165 consensus_queue.cc:1048] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:32.217212 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:32.217887 11585 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.220979 12181 consensus_queue.cc:1048] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:32.230877 12025 consensus_queue.cc:1048] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:32.239886 11701 consensus_peers.cc:597] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:32.246562 11852 tablet_bootstrap.cc:654] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.254338 12207 consensus_queue.cc:1048] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:32.257052 11585 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:32.257946 12237 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:32.279173 11701 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:32.280014 12237 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.260555 12218 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:32.261281 12233 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.280682 12237 raft_consensus.cc:697] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:32.280730 12233 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.281991 12237 consensus_queue.cc:237] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.283011 12233 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:32.291858 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:32.292562 11655 raft_consensus.cc:2468] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:32.300226 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:32.305130 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:32.305840 11734 raft_consensus.cc:2468] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:32.308910 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:32.309624 11586 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.310519 12218 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:32.316403 11852 tablet_bootstrap.cc:492] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:32.317040 11852 ts_tablet_manager.cc:1403] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.163s	user 0.010s	sys 0.000s
I20260709 12:16:32.317342 11586 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:32.318902 11775 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:32.319963 11852 raft_consensus.cc:359] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.320472 12218 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.321703 12218 raft_consensus.cc:697] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:32.320753 11852 raft_consensus.cc:385] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.322366 11852 raft_consensus.cc:740] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.323449 11854 tablet_bootstrap.cc:492] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:32.323210 11852 consensus_queue.cc:260] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.323961 11854 ts_tablet_manager.cc:1403] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.267s	user 0.057s	sys 0.073s
I20260709 12:16:32.324357 12218 consensus_queue.cc:237] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:32.325467 11852 ts_tablet_manager.cc:1434] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:16:32.326737 11854 raft_consensus.cc:359] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.327402 11854 raft_consensus.cc:385] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.327659 11854 raft_consensus.cc:740] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.328297 11854 consensus_queue.cc:260] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.330708 11854 ts_tablet_manager.cc:1434] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:16:32.331627 11854 tablet_bootstrap.cc:492] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:32.335813 11860 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.336287 11860 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.338124 11860 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:32.339713 11852 tablet_bootstrap.cc:492] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:32.340557 12025 consensus_queue.cc:1048] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:32.344709 11854 tablet_bootstrap.cc:654] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.345273 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:32.346006 11734 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:32.349242 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:32.350121 11654 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:32.353461 11550 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:32.354497 11860 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.354923 11860 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.355216 11860 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.366119 11852 tablet_bootstrap.cc:654] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:32.367406 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 60639.4us
I20260709 12:16:32.369521 11854 tablet_bootstrap.cc:492] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:32.370105 11854 ts_tablet_manager.cc:1403] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.005s
I20260709 12:16:32.372699 11854 raft_consensus.cc:359] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:32.373363 11854 raft_consensus.cc:385] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.373620 11854 raft_consensus.cc:740] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.374274 11854 consensus_queue.cc:260] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:32.376235 11854 ts_tablet_manager.cc:1434] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:16:32.377209 11854 tablet_bootstrap.cc:492] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:32.378649 11860 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.383610 11773 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:32.385733 11860 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:32.409080 11860 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:32.387388 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:32.410713 11654 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.390606 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:32.416457 11730 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.391963 11854 tablet_bootstrap.cc:654] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.395488 11852 tablet_bootstrap.cc:492] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:32.425035 11852 ts_tablet_manager.cc:1403] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.002s
I20260709 12:16:32.428066 11852 raft_consensus.cc:359] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:32.429181 11852 raft_consensus.cc:385] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.429458 11852 raft_consensus.cc:740] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.430115 11852 consensus_queue.cc:260] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:32.437034 11654 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:32.439321 11852 ts_tablet_manager.cc:1434] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:16:32.449616 11852 tablet_bootstrap.cc:492] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:32.466317 11852 tablet_bootstrap.cc:654] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.468082 11854 tablet_bootstrap.cc:492] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:32.468770 11854 ts_tablet_manager.cc:1403] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.002s
I20260709 12:16:32.472430 11854 raft_consensus.cc:359] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.473198 11854 raft_consensus.cc:385] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.473479 11854 raft_consensus.cc:740] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
W20260709 12:16:32.369431 11699 leader_election.cc:343] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:32.474315 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 104912us
I20260709 12:16:32.482857 11852 tablet_bootstrap.cc:492] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:32.483475 11852 ts_tablet_manager.cc:1403] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.004s
I20260709 12:16:32.486006 11852 raft_consensus.cc:359] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.486686 11852 raft_consensus.cc:385] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.486967 11852 raft_consensus.cc:740] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.487681 11852 consensus_queue.cc:260] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.490221 11852 ts_tablet_manager.cc:1434] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:16:32.493031 11852 tablet_bootstrap.cc:492] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:32.496165 12218 raft_consensus.cc:2804] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.496588 12218 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.496966 12218 raft_consensus.cc:3060] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.499239 11852 tablet_bootstrap.cc:654] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.509835 11730 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:32.511320 11550 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:32.512137 11860 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.512789 11860 raft_consensus.cc:697] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:32.506834 12218 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.514230 11860 consensus_queue.cc:237] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.516570 12218 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:32.540807 11852 tablet_bootstrap.cc:492] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:32.541509 11852 ts_tablet_manager.cc:1403] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.000s
W20260709 12:16:32.556752 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 173211us
I20260709 12:16:32.560994 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:32.561652 11658 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.564024 11852 raft_consensus.cc:359] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:32.564986 11852 raft_consensus.cc:385] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.565251 11852 raft_consensus.cc:740] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.565922 11852 consensus_queue.cc:260] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:32.567443 11852 ts_tablet_manager.cc:1434] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:16:32.568380 11852 tablet_bootstrap.cc:492] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:32.572067 11658 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:32.579531 11852 tablet_bootstrap.cc:654] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.603168 11852 tablet_bootstrap.cc:492] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:32.610106 11852 ts_tablet_manager.cc:1403] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.010s
I20260709 12:16:32.612865 11852 raft_consensus.cc:359] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:32.632290 12218 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.632861 12218 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:32.634939 12218 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:32.634702 12181 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:32.638612 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:32.639261 11735 raft_consensus.cc:3060] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.639447 11585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:32.641443 11775 leader_election.cc:343] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.645403 11854 consensus_queue.cc:260] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.646631 11735 raft_consensus.cc:2468] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:32.613554 11852 raft_consensus.cc:385] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.659876 11852 raft_consensus.cc:740] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.660534 11852 consensus_queue.cc:260] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:32.661621 11481 catalog_manager.cc:5697] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:32.662498 11852 ts_tablet_manager.cc:1434] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:16:32.663599 11852 tablet_bootstrap.cc:492] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:32.648144 11854 ts_tablet_manager.cc:1434] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.179s	user 0.007s	sys 0.000s
I20260709 12:16:32.665504 11854 tablet_bootstrap.cc:492] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:32.641659 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:32.670066 11659 raft_consensus.cc:3060] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.670524 11852 tablet_bootstrap.cc:654] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.689464 11854 tablet_bootstrap.cc:654] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.708597 11854 tablet_bootstrap.cc:492] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:32.709370 11854 ts_tablet_manager.cc:1403] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.004s
W20260709 12:16:32.710479 11853 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.149s	sys 0.221s
W20260709 12:16:32.710834 11853 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.149s	sys 0.221s
I20260709 12:16:32.712051 11659 raft_consensus.cc:2468] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
W20260709 12:16:32.714075 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 57298.9us
I20260709 12:16:32.714037 11482 catalog_manager.cc:5697] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:32.718293 11853 tablet_bootstrap.cc:492] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:32.718808 11853 ts_tablet_manager.cc:1403] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.557s	user 0.160s	sys 0.221s
I20260709 12:16:32.721302 11853 raft_consensus.cc:359] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.721966 11853 raft_consensus.cc:385] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.722218 11853 raft_consensus.cc:740] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.722859 11853 consensus_queue.cc:260] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.724921 11853 ts_tablet_manager.cc:1434] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:32.725858 11853 tablet_bootstrap.cc:492] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:32.734939 11773 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:32.735951 12218 raft_consensus.cc:2804] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.736469 12218 raft_consensus.cc:697] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:32.737293 12218 consensus_queue.cc:237] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.737579 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:32.738523 11730 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:32.740430 11853 tablet_bootstrap.cc:654] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.756273 11773 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:32.756951 11854 raft_consensus.cc:359] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.763811 12025 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.765408 12025 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.767336 12025 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:32.767939 11854 raft_consensus.cc:385] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.771719 11854 raft_consensus.cc:740] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.773152 11854 consensus_queue.cc:260] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.774143 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:32.768492 11655 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.794240 11854 ts_tablet_manager.cc:1434] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.084s	user 0.004s	sys 0.002s
I20260709 12:16:32.796262 12233 raft_consensus.cc:2804] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.799929 11852 tablet_bootstrap.cc:492] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: No bootstrap required, opened a new log
I20260709 12:16:32.803524 11852 ts_tablet_manager.cc:1403] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.140s	user 0.030s	sys 0.036s
W20260709 12:16:32.805649 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 49476.4us
W20260709 12:16:32.806264 11699 leader_election.cc:343] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.808274 11854 tablet_bootstrap.cc:492] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:32.801074 12233 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.809867 12233 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.814599 12207 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.846055 12207 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:32.848274 12207 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:32.850590 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:32.832135 12233 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:32.831533 11854 tablet_bootstrap.cc:654] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:32.852180 11550 leader_election.cc:343] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.861250 11860 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:32.817678 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 93255us
I20260709 12:16:32.861733 11860 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:32.863651 12217 consensus_queue.cc:1048] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:16:32.865916 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:32.873195 11806 raft_consensus.cc:2468] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:32.873422 12233 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:32.873804 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:32.867206 11936 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:16:32.869870 11860 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:32.870996 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:32.875403 11549 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:32.877486 11482 catalog_manager.cc:5697] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:32.878165 11860 raft_consensus.cc:2804] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:32.878497 11532 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:32.878660 11860 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.879388 11860 raft_consensus.cc:3060] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.866149 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:32.882345 11584 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 0.
I20260709 12:16:32.885509 11584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:32.869167 11852 raft_consensus.cc:359] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:32.889283 11852 raft_consensus.cc:385] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.889530 11852 raft_consensus.cc:740] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.891258 11853 tablet_bootstrap.cc:492] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:32.891777 11853 ts_tablet_manager.cc:1403] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.028s
I20260709 12:16:32.900146 11853 raft_consensus.cc:359] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.906155 11853 raft_consensus.cc:385] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.906468 11853 raft_consensus.cc:740] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.907146 11853 consensus_queue.cc:260] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:32.914160 11701 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:32.914353 12240 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:32.916561 11936 raft_consensus.cc:2804] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.916975 11936 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.917311 11936 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.918439 11586 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.923061 11854 tablet_bootstrap.cc:492] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:32.923622 11854 ts_tablet_manager.cc:1403] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.126s	user 0.008s	sys 0.012s
I20260709 12:16:32.925290 11549 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:32.933530 11852 consensus_queue.cc:260] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:32.939047 11853 ts_tablet_manager.cc:1434] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.002s
I20260709 12:16:32.940297 11854 raft_consensus.cc:359] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.944816 11854 raft_consensus.cc:385] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.945128 11854 raft_consensus.cc:740] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.943779 11852 ts_tablet_manager.cc:1434] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.000s
I20260709 12:16:32.945847 11854 consensus_queue.cc:260] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.946800 11860 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:32.951062 11854 ts_tablet_manager.cc:1434] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:16:32.938427 11584 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.961628 11853 tablet_bootstrap.cc:492] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef: Bootstrap starting.
I20260709 12:16:32.965041 11854 tablet_bootstrap.cc:492] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03: Bootstrap starting.
I20260709 12:16:32.963631 12225 consensus_queue.cc:1048] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:16:32.983060 11936 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:32.991539 11936 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:32.992626 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:32.993388 11655 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:32.996894 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 135005us
I20260709 12:16:33.000954 11854 tablet_bootstrap.cc:654] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.005157 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:33.005863 11734 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.010278 11853 tablet_bootstrap.cc:654] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.016197 11734 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:33.019912 11860 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:16:33.021679 11549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 58750.5us
I20260709 12:16:33.033968 11773 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:33.027653 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:33.033897 12216 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.039880 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:33.042209 12218 raft_consensus.cc:2804] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.048887 11582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:33.104416 11481 catalog_manager.cc:5697] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:33.053664 11808 raft_consensus.cc:3060] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.133646 11584 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:33.041987 12233 consensus_queue.cc:1048] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.059s
I20260709 12:16:33.137866 11582 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.094455 12284 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.054112 12216 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:33.112005 12218 raft_consensus.cc:697] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:33.190763 12181 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:33.213147 12291 log.cc:927] Time spent T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:16:33.220923 11853 tablet_bootstrap.cc:492] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef: No bootstrap required, opened a new log
I20260709 12:16:33.221531 11853 ts_tablet_manager.cc:1403] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef: Time spent bootstrapping tablet: real 0.262s	user 0.010s	sys 0.006s
I20260709 12:16:33.227440 11861 consensus_queue.cc:1048] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:33.240947 11854 tablet_bootstrap.cc:492] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03: No bootstrap required, opened a new log
I20260709 12:16:33.215330 12181 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:33.241469 11854 ts_tablet_manager.cc:1403] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03: Time spent bootstrapping tablet: real 0.277s	user 0.056s	sys 0.058s
W20260709 12:16:33.242287 12296 log.cc:927] Time spent T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:16:33.242853 12181 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:16:33.238992 11550 leader_election.cc:343] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.220755 12298 consensus_queue.cc:1048] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 12:16:33.261642 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 47373.3us
W20260709 12:16:33.252946 12297 log.cc:927] Time spent T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:16:33.227007 12218 consensus_queue.cc:237] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:33.273167 11853 raft_consensus.cc:359] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:33.259045 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:33.274257 11853 raft_consensus.cc:385] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.276265 11853 raft_consensus.cc:740] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Initialized, Role: FOLLOWER
W20260709 12:16:33.278997 12300 log.cc:927] Time spent T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:16:33.279487 12309 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.279899 11808 raft_consensus.cc:2468] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:33.279999 12309 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:33.284595 11549 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:33.292254 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:33.281651 11582 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:33.300643 11655 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:33.288120 12298 raft_consensus.cc:2804] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.290831 11853 consensus_queue.cc:260] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:33.327320 11699 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:33.328948 11920 consensus_queue.cc:1048] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.330392 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:33.331106 11735 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:33.339470 11853 ts_tablet_manager.cc:1434] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 12:16:33.322844 11732 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
I20260709 12:16:33.323894 12298 raft_consensus.cc:697] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
W20260709 12:16:33.453392 11550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 131599us
I20260709 12:16:33.337170 11625 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:33.334018 12216 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:16:33.592196 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 255122us
I20260709 12:16:33.597994 11854 raft_consensus.cc:359] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:33.598730 11854 raft_consensus.cc:385] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.599016 11854 raft_consensus.cc:740] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.599674 11854 consensus_queue.cc:260] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:33.590775 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 252213us
I20260709 12:16:33.593936 12306 raft_consensus.cc:2804] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.609258 12313 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.648768 12313 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.657610 11854 ts_tablet_manager.cc:1434] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03: Time spent starting tablet: real 0.416s	user 0.015s	sys 0.015s
I20260709 12:16:33.654224 12313 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.700459 12306 raft_consensus.cc:697] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
W20260709 12:16:33.721769 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 117095us
I20260709 12:16:33.738885 11586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:33.739665 11586 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
W20260709 12:16:33.721936 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 105856us
I20260709 12:16:33.649925 12298 consensus_queue.cc:237] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:33.732841 12306 consensus_queue.cc:237] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:33.775517 12309 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:33.778419 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:33.779066 11807 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 0.
W20260709 12:16:33.786283 12318 log.cc:927] Time spent T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:16:33.796727 12339 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.797266 12339 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:33.799371 12339 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:33.835830 12313 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:16:33.835866 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 236955us
I20260709 12:16:33.843519 12313 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:16:33.867393 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 101645us
I20260709 12:16:33.871308 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:33.872022 11735 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 0.
I20260709 12:16:33.877699 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:33.878420 11805 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 0.
I20260709 12:16:33.886353 12326 consensus_queue.cc:1048] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.887945 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:33.888805 12326 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.889225 12326 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.889528 12326 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.900249 12326 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:33.906387 12326 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:33.907632 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:33.912830 11735 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.918037 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:33.888670 11550 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:33.927314 11775 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:33.932021 12317 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.932441 12317 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.932793 12317 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.939443 12313 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.940013 12313 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:33.942288 12313 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:33.932724 11484 catalog_manager.cc:5697] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.947957 12342 consensus_queue.cc:1048] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:33.951134 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:33.952109 11808 raft_consensus.cc:2393] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 1: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:33.943037 12327 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.953889 12327 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.954242 12327 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.961476 11735 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:33.964280 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:33.965220 11805 raft_consensus.cc:2393] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 1: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:33.959304 11483 catalog_manager.cc:5697] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:33.974802 11549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 73599.5us
I20260709 12:16:33.979893 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:33.980805 11656 raft_consensus.cc:2393] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 1: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:33.983764 11625 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:34.015059 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:34.019044 12317 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:34.020265 11583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:34.021853 12341 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:34.022393 12341 raft_consensus.cc:697] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:34.023226 12341 consensus_queue.cc:237] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:34.047789 12317 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:33.987156 12327 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:34.050144 12327 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:34.054481 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:34.055413 11730 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:34.066769 11550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 62938.3us
I20260709 12:16:34.075762 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:34.078147 11583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:34.079082 11583 raft_consensus.cc:2393] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 1: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:34.095678 11627 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:34.098702 12325 raft_consensus.cc:3060] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:34.104226 11532 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:34.118628 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:34.119513 11808 raft_consensus.cc:2393] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 1: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:34.136494 12325 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.159653 11549 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:34.180667 12327 raft_consensus.cc:2749] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.201726 11481 catalog_manager.cc:5697] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 0 to 1, leader changed from <none> to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 1 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:34.189635 12025 consensus_queue.cc:1048] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:34.204226 11730 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:34.250926 11773 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:34.252434 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:34.257055 12216 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:34.258075 12340 raft_consensus.cc:2749] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.257601 12216 raft_consensus.cc:697] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:34.259583 12216 consensus_queue.cc:237] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:34.270159 12328 consensus_queue.cc:1048] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:34.289177 12332 consensus_queue.cc:1048] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:34.311547 11483 catalog_manager.cc:5697] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:34.335450 11481 catalog_manager.cc:5697] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 1 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:34.344274 12353 consensus_queue.cc:1048] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.454288 12325 consensus_queue.cc:1048] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.485246 12324 consensus_queue.cc:1048] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.650199 12305 consensus_queue.cc:1048] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.663223 12305 consensus_queue.cc:1048] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:34.668483  4409 tablet_server.cc:179] TabletServer@127.4.78.65:0 shutting down...
W20260709 12:16:34.686141 11627 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:16:34.720072 11775 consensus_peers.cc:597] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.721086 11701 consensus_peers.cc:597] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.722667 11627 consensus_peers.cc:597] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.723300 11775 consensus_peers.cc:597] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.724913 11701 consensus_peers.cc:597] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.728057 11701 consensus_peers.cc:597] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.728359  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:34.729326  4409 tablet_replica.cc:333] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.729991  4409 raft_consensus.cc:2243] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.730400  4409 raft_consensus.cc:2272] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.732563  4409 tablet_replica.cc:333] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.733122  4409 raft_consensus.cc:2243] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.733486  4409 raft_consensus.cc:2272] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.735767  4409 tablet_replica.cc:333] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.736377  4409 raft_consensus.cc:2243] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.737007  4409 raft_consensus.cc:2272] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.739282  4409 tablet_replica.cc:333] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.739825  4409 raft_consensus.cc:2243] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.740159  4409 raft_consensus.cc:2272] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.742249  4409 tablet_replica.cc:333] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.743039  4409 raft_consensus.cc:2243] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.744025  4409 raft_consensus.cc:2272] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.745987  4409 tablet_replica.cc:333] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.746511  4409 raft_consensus.cc:2243] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.746856  4409 raft_consensus.cc:2272] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.748493  4409 tablet_replica.cc:333] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.749123  4409 raft_consensus.cc:2243] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.749773  4409 raft_consensus.cc:2272] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.751967  4409 tablet_replica.cc:333] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.752807  4409 raft_consensus.cc:2243] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.753716  4409 raft_consensus.cc:2272] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.756114  4409 tablet_replica.cc:333] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.756865  4409 raft_consensus.cc:2243] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.757359  4409 raft_consensus.cc:2272] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:34.757504 11775 consensus_peers.cc:597] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.759614  4409 tablet_replica.cc:333] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.760512  4409 raft_consensus.cc:2243] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:16:34.760785 11775 consensus_peers.cc:597] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.761171 11701 consensus_peers.cc:597] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.761435  4409 raft_consensus.cc:2272] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.763307  4409 tablet_replica.cc:333] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.763818  4409 raft_consensus.cc:2243] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.764144  4409 raft_consensus.cc:2272] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.765964  4409 tablet_replica.cc:333] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.766675  4409 raft_consensus.cc:2243] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.767096  4409 raft_consensus.cc:2272] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.769289  4409 tablet_replica.cc:333] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.770107  4409 raft_consensus.cc:2243] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:16:34.770150 11701 consensus_peers.cc:597] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.771031  4409 raft_consensus.cc:2272] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.773342  4409 tablet_replica.cc:333] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.774206  4409 raft_consensus.cc:2243] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.774713  4409 raft_consensus.cc:2272] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:34.776832 11775 consensus_peers.cc:597] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.777412  4409 tablet_replica.cc:333] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.778285  4409 raft_consensus.cc:2243] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.779181  4409 raft_consensus.cc:2272] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.781054  4409 tablet_replica.cc:333] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.781584  4409 raft_consensus.cc:2243] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.781986  4409 raft_consensus.cc:2272] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.783613  4409 tablet_replica.cc:333] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.784168  4409 raft_consensus.cc:2243] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.784925  4409 raft_consensus.cc:2272] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.786849  4409 tablet_replica.cc:333] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.787376  4409 raft_consensus.cc:2243] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.788046  4409 raft_consensus.cc:2272] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.789770  4409 tablet_replica.cc:333] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.790287  4409 raft_consensus.cc:2243] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.790935  4409 raft_consensus.cc:2272] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.792616  4409 tablet_replica.cc:333] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.793104  4409 raft_consensus.cc:2243] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.793457  4409 raft_consensus.cc:2272] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.795059  4409 tablet_replica.cc:333] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.795544  4409 raft_consensus.cc:2243] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.795990  4409 raft_consensus.cc:2272] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.797963  4409 tablet_replica.cc:333] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.798629  4409 raft_consensus.cc:2243] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.799022  4409 raft_consensus.cc:2272] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.800717  4409 tablet_replica.cc:333] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.801318  4409 raft_consensus.cc:2243] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.801684  4409 raft_consensus.cc:2272] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.803347  4409 tablet_replica.cc:333] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.803933  4409 raft_consensus.cc:2243] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.804306  4409 raft_consensus.cc:2272] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.805984  4409 tablet_replica.cc:333] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.806465  4409 raft_consensus.cc:2243] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.806833  4409 raft_consensus.cc:2272] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.808444  4409 tablet_replica.cc:333] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.808945  4409 raft_consensus.cc:2243] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.809302  4409 raft_consensus.cc:2272] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.810882  4409 tablet_replica.cc:333] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.811383  4409 raft_consensus.cc:2243] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.811853  4409 raft_consensus.cc:2272] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.813891  4409 tablet_replica.cc:333] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.814543  4409 raft_consensus.cc:2243] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.815201  4409 raft_consensus.cc:2272] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.816758  4409 tablet_replica.cc:333] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.817215  4409 raft_consensus.cc:2243] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.817616  4409 raft_consensus.cc:2272] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.819209  4409 tablet_replica.cc:333] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.819669  4409 raft_consensus.cc:2243] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.820293  4409 raft_consensus.cc:2272] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.821939  4409 tablet_replica.cc:333] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.822384  4409 raft_consensus.cc:2243] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.822993  4409 raft_consensus.cc:2272] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.824512  4409 tablet_replica.cc:333] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.825129  4409 raft_consensus.cc:2243] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.825482  4409 raft_consensus.cc:2272] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.827608  4409 tablet_replica.cc:333] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.828238  4409 raft_consensus.cc:2243] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.829025  4409 raft_consensus.cc:2272] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.831247  4409 tablet_replica.cc:333] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.831743  4409 raft_consensus.cc:2243] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.832463  4409 raft_consensus.cc:2272] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:34.832942 11701 consensus_peers.cc:597] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.834334  4409 tablet_replica.cc:333] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.835141  4409 raft_consensus.cc:2243] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.835561  4409 raft_consensus.cc:2272] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.837572  4409 tablet_replica.cc:333] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.838090  4409 raft_consensus.cc:2243] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.838420  4409 raft_consensus.cc:2272] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.840067  4409 tablet_replica.cc:333] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.840539  4409 raft_consensus.cc:2243] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.841172  4409 raft_consensus.cc:2272] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.842829  4409 tablet_replica.cc:333] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.843438  4409 raft_consensus.cc:2243] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.843807  4409 raft_consensus.cc:2272] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.845607  4409 tablet_replica.cc:333] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.846127  4409 raft_consensus.cc:2243] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.846879  4409 raft_consensus.cc:2272] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.849246  4409 tablet_replica.cc:333] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.850041  4409 raft_consensus.cc:2243] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.850589  4409 raft_consensus.cc:2272] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.853392  4409 tablet_replica.cc:333] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.854099  4409 raft_consensus.cc:2243] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.854592  4409 raft_consensus.cc:2272] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:34.855002 11627 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.856621  4409 tablet_replica.cc:333] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.857146  4409 raft_consensus.cc:2243] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:34.857852  4409 raft_consensus.cc:2272] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.859735  4409 tablet_replica.cc:333] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.860164  4409 raft_consensus.cc:2243] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.860494  4409 raft_consensus.cc:2272] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.862043  4409 tablet_replica.cc:333] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.862588  4409 raft_consensus.cc:2243] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.863029  4409 raft_consensus.cc:2272] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.864722  4409 tablet_replica.cc:333] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: stopping tablet replica
I20260709 12:16:34.865120  4409 raft_consensus.cc:2243] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.865468  4409 raft_consensus.cc:2272] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:34.870910 11775 consensus_peers.cc:597] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.886322 11627 consensus_peers.cc:597] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.887814 11775 consensus_peers.cc:597] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.934624  4409 tablet_server.cc:196] TabletServer@127.4.78.65:0 shutdown complete.
W20260709 12:16:34.939002 11627 consensus_peers.cc:597] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.944705 11627 consensus_peers.cc:597] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.956300 11775 consensus_peers.cc:597] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.978718 11775 consensus_peers.cc:597] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:34.999136 11775 consensus_peers.cc:597] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:35.003566  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:35.008050 11701 consensus_peers.cc:597] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:35.010810 12377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:35.010777 12378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:35.020450 12380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:35.023013 11775 consensus_peers.cc:597] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:35.023118  4409 server_base.cc:1061] running on GCE node
I20260709 12:16:35.026612  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:35.026917  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:35.027150  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599395027134 us; error 0 us; skew 500 ppm
I20260709 12:16:35.027745  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:35.030391  4409 webserver.cc:533] Webserver started at http://127.4.78.65:42943/ using document root <none> and password file <none>
I20260709 12:16:35.030861  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:35.031014  4409 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:16:35.034731  4409 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:16:35.043633 12385 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:35.044413  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:16:35.044709  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-0-root
uuid: "ce38e95b93a640c1a7b16f37868b30fc"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-9t7s"
I20260709 12:16:35.045018  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599105096696-4409-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:35.058029  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:35.059482  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:35.061218  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:35.066599 12392 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:16:35.088724 11775 consensus_peers.cc:597] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:35.096037 11701 consensus_peers.cc:597] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:35.131157 11701 consensus_peers.cc:597] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:35.219022 11701 consensus_peers.cc:597] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:35.224666 11627 consensus_peers.cc:597] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:35.323890  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:16:35.324258  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.259s	user 0.004s	sys 0.004s
I20260709 12:16:35.324589  4409 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:16:35.329332 12392 tablet_bootstrap.cc:492] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.339939 12392 tablet_bootstrap.cc:492] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.340584 12392 tablet_bootstrap.cc:492] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.341058 12392 ts_tablet_manager.cc:1403] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:16:35.342875 12392 raft_consensus.cc:359] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.343463 12392 raft_consensus.cc:740] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.344075 12392 consensus_queue.cc:260] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.346406 12392 ts_tablet_manager.cc:1434] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:16:35.347281 12392 tablet_bootstrap.cc:492] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.358426 12392 tablet_bootstrap.cc:492] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.359488 12392 tablet_bootstrap.cc:492] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.360105 12392 ts_tablet_manager.cc:1403] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:16:35.362229 12392 raft_consensus.cc:359] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.362833 12392 raft_consensus.cc:740] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.363428 12392 consensus_queue.cc:260] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.365162 12392 ts_tablet_manager.cc:1434] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:16:35.365912 12392 tablet_bootstrap.cc:492] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.377743 12392 tablet_bootstrap.cc:492] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.378525 12392 tablet_bootstrap.cc:492] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.379083 12392 ts_tablet_manager.cc:1403] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:16:35.381273 12392 raft_consensus.cc:359] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.381964 12392 raft_consensus.cc:740] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.382608 12392 consensus_queue.cc:260] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.384436 12392 ts_tablet_manager.cc:1434] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:35.385143 12392 tablet_bootstrap.cc:492] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.410324 12392 tablet_bootstrap.cc:492] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.411084 12392 tablet_bootstrap.cc:492] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.411628 12392 ts_tablet_manager.cc:1403] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 12:16:35.413321 12392 raft_consensus.cc:359] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.413865 12392 raft_consensus.cc:740] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.414678 12392 consensus_queue.cc:260] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.416491 12392 ts_tablet_manager.cc:1434] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:35.417208 12392 tablet_bootstrap.cc:492] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.448680 12392 tablet_bootstrap.cc:492] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.449469 12392 tablet_bootstrap.cc:492] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.450027 12392 ts_tablet_manager.cc:1403] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.003s
I20260709 12:16:35.451838 12392 raft_consensus.cc:359] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.452333 12392 raft_consensus.cc:740] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.452880 12392 consensus_queue.cc:260] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.454275 12392 ts_tablet_manager.cc:1434] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:35.454856 12392 tablet_bootstrap.cc:492] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.476161 12392 tablet_bootstrap.cc:492] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.479166 12392 tablet_bootstrap.cc:492] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.479902 12392 ts_tablet_manager.cc:1403] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 12:16:35.483649 12392 raft_consensus.cc:359] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.485011 12392 raft_consensus.cc:740] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.485714 12392 consensus_queue.cc:260] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.487725 12392 ts_tablet_manager.cc:1434] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:16:35.488499 12392 tablet_bootstrap.cc:492] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.507478 12392 tablet_bootstrap.cc:492] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.508358 12392 tablet_bootstrap.cc:492] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.509001 12392 ts_tablet_manager.cc:1403] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 12:16:35.511407 12392 raft_consensus.cc:359] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.512076 12392 raft_consensus.cc:740] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.512703 12392 consensus_queue.cc:260] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.514168 12392 ts_tablet_manager.cc:1434] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:35.514775 12392 tablet_bootstrap.cc:492] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.525305 12392 tablet_bootstrap.cc:492] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.526221 12392 tablet_bootstrap.cc:492] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.526748 12392 ts_tablet_manager.cc:1403] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:16:35.529018 12392 raft_consensus.cc:359] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.529706 12392 raft_consensus.cc:740] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.530435 12392 consensus_queue.cc:260] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.532284 12392 ts_tablet_manager.cc:1434] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:35.533090 12392 tablet_bootstrap.cc:492] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.544866 12392 tablet_bootstrap.cc:492] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.545635 12392 tablet_bootstrap.cc:492] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.546216 12392 ts_tablet_manager.cc:1403] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 12:16:35.548049 12392 raft_consensus.cc:359] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.548449  4409 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:16:35.548668 12392 raft_consensus.cc:740] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.548935  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.224s	user 0.216s	sys 0.000s
I20260709 12:16:35.549474 12392 consensus_queue.cc:260] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.551517 12392 ts_tablet_manager.cc:1434] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:35.552338 12392 tablet_bootstrap.cc:492] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.567119 12392 tablet_bootstrap.cc:492] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.568033 12392 tablet_bootstrap.cc:492] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.568846 12392 ts_tablet_manager.cc:1403] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 12:16:35.570787 12392 raft_consensus.cc:359] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.571450 12392 raft_consensus.cc:740] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.572247 12392 consensus_queue.cc:260] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.574462 12392 ts_tablet_manager.cc:1434] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:16:35.575260 12392 tablet_bootstrap.cc:492] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.594539 12392 tablet_bootstrap.cc:492] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.595481 12392 tablet_bootstrap.cc:492] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.596151 12392 ts_tablet_manager.cc:1403] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:16:35.598798 12392 raft_consensus.cc:359] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.599457 12392 raft_consensus.cc:740] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.600136 12392 consensus_queue.cc:260] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.602046 12392 ts_tablet_manager.cc:1434] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:16:35.602870 12392 tablet_bootstrap.cc:492] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.621876 12392 tablet_bootstrap.cc:492] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.622807 12392 tablet_bootstrap.cc:492] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.623453 12392 ts_tablet_manager.cc:1403] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:16:35.625875 12392 raft_consensus.cc:359] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.626484 12392 raft_consensus.cc:740] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.627269 12392 consensus_queue.cc:260] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.629387 12392 ts_tablet_manager.cc:1434] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:35.630213 12392 tablet_bootstrap.cc:492] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.643141 12392 tablet_bootstrap.cc:492] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.644047 12392 tablet_bootstrap.cc:492] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.644717 12392 ts_tablet_manager.cc:1403] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:16:35.647053 12392 raft_consensus.cc:359] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.647828 12392 raft_consensus.cc:740] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.648659 12392 consensus_queue.cc:260] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.651026 12392 ts_tablet_manager.cc:1434] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:16:35.651923 12392 tablet_bootstrap.cc:492] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.656293  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.65:36331
I20260709 12:16:35.656406 12463 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.65:36331 every 8 connection(s)
I20260709 12:16:35.668974 12392 tablet_bootstrap.cc:492] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.669984 12392 tablet_bootstrap.cc:492] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.670665 12392 ts_tablet_manager.cc:1403] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 12:16:35.673274 12392 raft_consensus.cc:359] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.673959 12392 raft_consensus.cc:740] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.674871 12392 consensus_queue.cc:260] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.676167 12392 ts_tablet_manager.cc:1434] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:16:35.676939 12392 tablet_bootstrap.cc:492] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.702589 12392 tablet_bootstrap.cc:492] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.703293 12392 tablet_bootstrap.cc:492] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.703864 12392 ts_tablet_manager.cc:1403] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.019s
I20260709 12:16:35.706094 12392 raft_consensus.cc:359] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.706792 12392 raft_consensus.cc:740] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.707659 12392 consensus_queue.cc:260] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.708690 12464 heartbeater.cc:344] Connected to a master server at 127.4.78.126:38583
I20260709 12:16:35.709131 12464 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:35.709515 12392 ts_tablet_manager.cc:1434] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:16:35.710062 12464 heartbeater.cc:507] Master 127.4.78.126:38583 requested a full tablet report, sending...
I20260709 12:16:35.710392 12392 tablet_bootstrap.cc:492] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.732667 11484 ts_manager.cc:194] Re-registered known tserver with Master: ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:35.735234 12392 tablet_bootstrap.cc:492] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.736310 12392 tablet_bootstrap.cc:492] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.736987 12392 ts_tablet_manager.cc:1403] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.008s
I20260709 12:16:35.738373 11936 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.738886 11936 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.739532 12392 raft_consensus.cc:359] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.740123 12392 raft_consensus.cc:740] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.740700 12392 consensus_queue.cc:260] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.741791 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:35.742949 12392 ts_tablet_manager.cc:1434] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:35.743203 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.743849 12392 tablet_bootstrap.cc:492] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
W20260709 12:16:35.744731 11701 leader_election.cc:343] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.745180 11701 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:35.745958 12025 raft_consensus.cc:2749] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:35.740644 11936 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:35.757194 12392 tablet_bootstrap.cc:492] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.758296 12392 tablet_bootstrap.cc:492] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.758981 12392 ts_tablet_manager.cc:1403] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:16:35.761541 12392 raft_consensus.cc:359] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.762240 12392 raft_consensus.cc:740] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.762830 12392 consensus_queue.cc:260] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.764384 12392 ts_tablet_manager.cc:1434] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:16:35.765149 12392 tablet_bootstrap.cc:492] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.779762 12392 tablet_bootstrap.cc:492] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.780742 12392 tablet_bootstrap.cc:492] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.781435 12392 ts_tablet_manager.cc:1403] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:16:35.784251 12392 raft_consensus.cc:359] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.785017 12392 raft_consensus.cc:740] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.786012 12392 consensus_queue.cc:260] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.787151 12324 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.787722 12324 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.788031 11936 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.788174 12392 ts_tablet_manager.cc:1434] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:35.788555 11936 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.789144 12392 tablet_bootstrap.cc:492] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.789961 12324 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:35.791021 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.791685 12437 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:35.791581 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.793256 11701 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:35.794049 12328 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:35.794423 12328 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.794756 12328 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:35.794154 11627 leader_election.cc:343] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.796813 11484 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33118
I20260709 12:16:35.801540 12464 heartbeater.cc:499] Master 127.4.78.126:38583 was elected leader, sending a full tablet report...
I20260709 12:16:35.802441 12328 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.803548 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:35.805246 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:35.805842 12438 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.806784 11625 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:35.808459 12341 raft_consensus.cc:2749] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:35.809739 11936 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.811228 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:35.814651 12328 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.816133 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:35.817189 12392 tablet_bootstrap.cc:492] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.818207 12392 tablet_bootstrap.cc:492] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.818917 12392 ts_tablet_manager.cc:1403] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.008s
I20260709 12:16:35.821194 12438 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:35.821456 12392 raft_consensus.cc:359] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.822227 12392 raft_consensus.cc:740] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.822577 11701 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:35.822981 12392 consensus_queue.cc:260] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.823383 11936 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:35.823845 11936 raft_consensus.cc:697] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:35.824568 11936 consensus_queue.cc:237] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.825031 12392 ts_tablet_manager.cc:1434] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:35.825433 12025 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.825876 12392 tablet_bootstrap.cc:492] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.825899 12025 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.828392 12025 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.829919 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:35.831832 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.832623 12437 raft_consensus.cc:2468] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:35.833829 11701 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:35.834647 12025 raft_consensus.cc:2804] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:35.835031 12025 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.835418 12025 raft_consensus.cc:3060] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.840324 12398 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.841586 12341 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.842136 12341 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.844151 12341 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:35.845642 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.846431 12436 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:35.847501 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:35.851529 12025 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.853883 12305 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.872048 12305 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.872377 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:35.873014 12437 raft_consensus.cc:3060] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.876269 12025 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.879055 12305 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.855243 11627 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:35.860276 12341 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.868664 11936 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.876473 12340 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.880914 12340 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.881430 12325 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:35.881886 12325 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.882256 12325 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.882982 12340 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.871294 11481 catalog_manager.cc:5697] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:35.884274 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:35.885089 11936 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.886252 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:35.886389 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:35.840903 12398 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.880726 12341 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.891495 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.892249 12436 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:35.893115 11660 raft_consensus.cc:2468] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:35.893476 11701 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:35.893682 12398 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.894863 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.895105 12025 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:35.895522 12436 raft_consensus.cc:2468] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:35.897701 11627 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:35.893374 12341 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:35.898522 12324 raft_consensus.cc:2804] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:35.898904 12324 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.899247 12324 raft_consensus.cc:3060] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.901906 11936 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.895505 12025 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.902745 12025 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.903316 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:35.904345 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:35.904491 11773 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:35.905015 11806 raft_consensus.cc:2468] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:35.905964 12233 raft_consensus.cc:2804] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:35.906386 12233 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.906778 12233 raft_consensus.cc:3060] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.907984 11936 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.908216 12325 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.910048 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.910696 12436 raft_consensus.cc:2468] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:35.911315 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:35.911453 11936 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.912648 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:35.913226 12436 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.913959 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.914125 11936 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.914592 12438 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:35.915122 12392 tablet_bootstrap.cc:492] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.915773 11701 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:35.919088 12233 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.920334 12328 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:35.920792 12328 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.921180 12328 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.919608 12025 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.922585 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:35.922842 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.923362 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:35.923491 12438 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:35.924825 12325 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:35.926437 12025 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.922639 12233 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.927027 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:35.927111 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:35.927393 12437 raft_consensus.cc:2468] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:35.927801 12438 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.928535 11701 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:35.928853 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.930182 11775 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:35.930722 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:35.930938 12398 raft_consensus.cc:2804] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:35.931370 12398 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.931877 12398 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.916097 12392 tablet_bootstrap.cc:492] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:35.933954 12392 ts_tablet_manager.cc:1403] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.108s	user 0.035s	sys 0.020s
I20260709 12:16:35.931308 12435 raft_consensus.cc:3060] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.908689 12324 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.934605 12025 raft_consensus.cc:2804] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:35.936225 11661 raft_consensus.cc:2393] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 2: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
W20260709 12:16:35.938602 11775 leader_election.cc:343] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:35.939070 11775 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:35.939517 12025 raft_consensus.cc:697] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:35.936379 12392 raft_consensus.cc:359] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.941417 12392 raft_consensus.cc:740] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.941358 12025 consensus_queue.cc:237] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.937640 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:35.941871 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:35.949566 12398 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.946761 12480 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.952214 12436 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:35.956925 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:35.952919 12480 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.953811 12233 raft_consensus.cc:2749] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:35.939561 12438 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:35.955425 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:35.959748 11806 raft_consensus.cc:2393] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 2: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:35.959677 11660 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.959092 11627 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:35.962258 11624 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:35.961300 12480 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:35.963104 12480 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:35.963533 12480 raft_consensus.cc:697] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:35.963864 11701 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:35.964318 12341 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.964583 11936 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:35.942422 12392 consensus_queue.cc:260] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.965088 11936 raft_consensus.cc:697] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:35.966024 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:35.967813 12325 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:35.968788 12341 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:35.964372 12480 consensus_queue.cc:237] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.971055 12392 ts_tablet_manager.cc:1434] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.004s
I20260709 12:16:35.951802 12398 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.972004 12392 tablet_bootstrap.cc:492] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:35.945611 12435 raft_consensus.cc:2468] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:35.952508 12324 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:35.960331 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:35.973433 12434 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.970975 12341 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:35.978650 12328 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.981407 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:35.982051 12435 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.982673 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.984123 12398 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.965869 11936 consensus_queue.cc:237] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:35.984674 12398 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:35.987334 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:35.987542 12398 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:35.989068 12437 raft_consensus.cc:2393] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 2: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:35.983572 11775 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:35.991154 12328 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:35.991068 11660 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:35.996037 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:35.996824 12437 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:35.997038 12398 raft_consensus.cc:2804] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:35.997809 12398 raft_consensus.cc:697] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:35.998013 11775 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:35.998466 12435 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:35.998878 12233 raft_consensus.cc:2804] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:35.999226 12233 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:35.999519 12233 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.999821 11701 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:36.000890 12476 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.001348 12476 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.003499 12476 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:36.004532 12398 consensus_queue.cc:237] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.005458 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.006266 12436 raft_consensus.cc:2393] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 2: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:36.006623 12233 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.000589 12328 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.009228 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:36.008261 12328 raft_consensus.cc:697] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:36.011068 12233 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.010931 12328 consensus_queue.cc:237] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.012967 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:36.014886 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.015908 12436 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:36.018298 11627 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.027673 11627 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:36.023826 12025 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.029066 12025 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.029925 12324 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:36.023094 12233 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.030663 12324 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:36.030545 12233 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.031069 12324 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.031458 12324 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.031492 11481 catalog_manager.cc:5697] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.035444 11484 catalog_manager.cc:5697] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 2 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.024673 12434 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:36.039352 11775 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:36.041975 12340 raft_consensus.cc:2804] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.042759 12233 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:36.043910 12025 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:36.044428 12025 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.044831 12025 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.047222 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.047406 12324 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.047338 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.047926 12436 raft_consensus.cc:2468] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:36.049114 11701 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:36.049506 12324 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.050002 12476 raft_consensus.cc:2804] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:36.050144 12324 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.050495 12476 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.050927 12476 raft_consensus.cc:3060] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:36.052001 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 89826.9us
I20260709 12:16:36.053965 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:36.054574 11808 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:36.055055 12324 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.056450 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:36.057055 11807 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.057386 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:36.057940 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:36.058595 12434 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.059974 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:36.060328 12025 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.061318 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:36.061966 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.061606 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:36.062819 11805 raft_consensus.cc:2393] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 2: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:36.063347 12340 raft_consensus.cc:697] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:36.063514 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.062682 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:36.064250 12340 consensus_queue.cc:237] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.062649 12435 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:36.066004 11627 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:36.067314 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:36.068328 12485 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:36.068974 12485 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.069312 12485 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.069330 11699 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.072431 11807 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
W20260709 12:16:36.049160 11775 leader_election.cc:343] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.075294 11773 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.076054 12492 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:36.075493 12025 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.091477 12025 raft_consensus.cc:2749] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:36.013622 12437 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.103684 12485 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.104769 12476 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.057065 12324 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.105649 11481 catalog_manager.cc:5697] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 2 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.111706 12434 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:36.107674 12485 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.115726 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:36.116328 12434 raft_consensus.cc:3060] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.117100 11627 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:36.117321 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:36.117969 12435 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.118683 12476 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:36.120177 12492 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.121294 12492 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.121870 12325 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.122364 12325 raft_consensus.cc:697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:36.123373 12492 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.123159 12325 consensus_queue.cc:237] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.124758 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:36.126019 11775 leader_election.cc:343] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.126662 12435 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:36.127921 12324 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.128057 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:36.128412 12324 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.128808 11627 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:36.124778 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:36.129594 12341 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.130082 12341 raft_consensus.cc:697] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:36.130872 11773 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.132082 12324 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:36.133167 11654 raft_consensus.cc:3060] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.134181 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:36.133674 12492 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:36.137142 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.133394 12341 consensus_queue.cc:237] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.142096 12325 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.142699 12325 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.145637 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.146378 12325 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:36.146595 12436 raft_consensus.cc:2393] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 2: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:36.135439 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:36.135077 11733 raft_consensus.cc:2393] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 2: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:36.148658 11481 catalog_manager.cc:5697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.136046 11698 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:36.151083 12494 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.153604 12392 tablet_bootstrap.cc:492] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:36.154711 12392 tablet_bootstrap.cc:492] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:36.155367 12392 ts_tablet_manager.cc:1403] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.184s	user 0.022s	sys 0.023s
I20260709 12:16:36.156958 11625 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.158694 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:36.160158 11625 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.162220 12325 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.162392 11654 raft_consensus.cc:2468] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:36.166141 12392 raft_consensus.cc:359] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.167297 12392 raft_consensus.cc:740] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.163875 12341 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:36.170382 12434 raft_consensus.cc:2468] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:36.167985 12392 consensus_queue.cc:260] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.177012 12392 ts_tablet_manager.cc:1434] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:16:36.179435 12437 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:36.180629 11775 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:36.181411 12392 tablet_bootstrap.cc:492] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:36.181734 12492 raft_consensus.cc:2804] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.182283 12492 raft_consensus.cc:697] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:36.183168 12492 consensus_queue.cc:237] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.183183 12494 raft_consensus.cc:2749] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:36.233978 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 70579us
I20260709 12:16:36.238118 11699 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:36.249696 11936 raft_consensus.cc:2804] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.250540 11936 raft_consensus.cc:697] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:36.252115 11936 consensus_queue.cc:237] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.268779 12325 raft_consensus.cc:2749] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:36.268971 12233 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.267254 12025 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.286998 12325 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.300612 12398 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.301582 12398 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.303421 12485 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.304464 12485 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.304842 12398 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.311084 12398 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.311643 12325 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.311893 12398 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.299912 12025 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.318717 12494 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.319491 12494 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.324906 12494 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.306253 12233 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.328159 12484 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.329082 12484 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.330459 12325 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.331796 12496 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.332613 12496 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.334108 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.334786 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.332247 12484 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:16:36.338228 11775 leader_election.cc:343] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:36.339021 11775 leader_election.cc:343] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.341274 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.343530 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.344436 12431 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:36.346140 11701 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:36.348073 12025 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:36.344300 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.349681 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:36.350473 11807 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:36.345984 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.354046 12025 raft_consensus.cc:2804] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:36.354426 12025 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.319490 12398 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:16:36.355455 11701 leader_election.cc:343] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.354763 12025 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.356750 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:36.357404 11733 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:36.335223 12496 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.362849 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:36.360500 12484 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.365185 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:36.370651 11730 raft_consensus.cc:2468] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:36.368322 12484 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.357234 11698 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.365933 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:36.376109 11808 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:36.381538 11936 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:36.382885 11936 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.383275 11936 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.385187 11661 raft_consensus.cc:3060] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.376763 12484 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:36.387723 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:36.387715 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.391263 12436 raft_consensus.cc:2393] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 2: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:36.393159 12436 raft_consensus.cc:1275] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.388469 12233 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:36.388494 12485 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:36.397423 12328 consensus_queue.cc:1048] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:36.388983 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:36.404462 11808 raft_consensus.cc:2468] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:36.390331 11660 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:36.407049 11484 catalog_manager.cc:5697] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 2 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.383339 12503 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.415305 12503 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:16:36.424472 12504 log.cc:927] Time spent T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:16:36.428855 11661 raft_consensus.cc:1275] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.439205 11484 catalog_manager.cc:5697] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.441318 11484 catalog_manager.cc:5697] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.442972 11484 catalog_manager.cc:5697] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.447858 12432 raft_consensus.cc:1275] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.451565 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.451205 11481 catalog_manager.cc:5697] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.452701 12438 raft_consensus.cc:2393] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 2: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:36.455366 12506 consensus_queue.cc:1048] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:36.458108 12503 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.467644 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.468649 12436 raft_consensus.cc:2393] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 2: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:36.468750 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.472129 12025 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.469672 12430 raft_consensus.cc:2393] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 2: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:36.490366 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:36.493934 12025 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:16:36.494812 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 45336.5us
I20260709 12:16:36.502498 11808 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:36.501943 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:36.504427 12438 raft_consensus.cc:1275] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.508297 11773 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.510304 11936 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.514969 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:36.524613 11773 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.525790 12479 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:36.526167 12479 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.526510 12479 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.527408 12340 raft_consensus.cc:2804] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:36.527810 12340 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.528126 12340 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.531286 11936 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.534543 12430 raft_consensus.cc:1275] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.538506 12305 consensus_queue.cc:1048] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:36.539280 12436 raft_consensus.cc:1275] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.526513 11624 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:16:36.541814 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 105151us
I20260709 12:16:36.544165 12505 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:36.544631 12505 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.545001 12505 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:36.548817 11627 leader_election.cc:343] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.548708 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:36.555475 11698 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:36.556489 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:36.556677 12512 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:36.557260 12512 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.557562 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:16:36.558295 12507 log.cc:927] Time spent T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:16:36.559911 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 105484us
W20260709 12:16:36.560513 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 50638.2us
I20260709 12:16:36.557643 12512 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.577524 11936 consensus_queue.cc:1048] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:36.580387 11627 leader_election.cc:343] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.583164 12480 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:36.588001 12340 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.595597 11625 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.596624 12480 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.597066 11625 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.597944 12484 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:36.602327 12340 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.604933 11624 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:36.602749 12479 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.616397 12479 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.616964 12480 raft_consensus.cc:2749] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:36.617141 11805 raft_consensus.cc:2393] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 2: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
W20260709 12:16:36.623504 11701 leader_election.cc:343] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.625959 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:36.628588 11936 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:36.627810 11775 leader_election.cc:343] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.635182 12438 raft_consensus.cc:1275] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.635318 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:36.638502 12392 tablet_bootstrap.cc:492] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:16:36.639933 11701 leader_election.cc:343] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.641055 12437 raft_consensus.cc:1275] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.642104 12512 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.642671 12392 tablet_bootstrap.cc:492] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:36.638391 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:36.640079 11481 catalog_manager.cc:5697] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.644011 12434 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.640618 11701 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:36.647913 11624 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.648528 11936 raft_consensus.cc:2749] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:36.649966 12480 raft_consensus.cc:2804] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:36.653950 12025 consensus_queue.cc:1048] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.648671 12484 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.656669 12505 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.656023 12480 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:36.657099 11733 raft_consensus.cc:1275] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.665290 12480 raft_consensus.cc:3060] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.660722 12437 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.653589 12496 consensus_queue.cc:1048] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:16:36.663645 12435 raft_consensus.cc:1275] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.666839 12325 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:36.668771 12514 consensus_queue.cc:1048] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.668874 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:36.669600 11805 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.647003 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:36.676939 12325 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:16:36.680572 11775 leader_election.cc:343] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.678576 12392 ts_tablet_manager.cc:1403] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.497s	user 0.025s	sys 0.010s
I20260709 12:16:36.659772 12512 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.693969 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:36.694706 11660 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.695336 11654 raft_consensus.cc:1275] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.703421 11661 raft_consensus.cc:1275] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.714030 11661 raft_consensus.cc:1275] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.723286 11936 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.727458 11936 consensus_queue.cc:1048] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.728325 12505 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.730772 11806 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.738721 12392 raft_consensus.cc:359] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.739542 12392 raft_consensus.cc:740] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.745254 11805 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:36.755904 11660 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:36.760048 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:36.766466 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:36.769150 11808 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.772712 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:36.773451 11729 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:36.775188 11627 leader_election.cc:343] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.776469 12484 raft_consensus.cc:2749] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:36.777637 12480 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.779150 11698 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:36.780207 11936 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.780673 11936 raft_consensus.cc:697] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:36.740195 12392 consensus_queue.cc:260] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:36.781486 11936 consensus_queue.cc:237] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.782963 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:36.783468 12392 ts_tablet_manager.cc:1434] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.092s	user 0.000s	sys 0.005s
I20260709 12:16:36.783792 11730 raft_consensus.cc:2393] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 2: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:36.784749 12392 tablet_bootstrap.cc:492] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
W20260709 12:16:36.786441 11701 leader_election.cc:343] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.801996 11729 raft_consensus.cc:2468] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:36.804595 12025 consensus_queue.cc:1048] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.807617 11699 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:36.812458 12476 raft_consensus.cc:2804] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.816866 12476 raft_consensus.cc:697] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:36.818691 12476 consensus_queue.cc:237] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:36.819404 12324 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:36.828330 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:16:36.829998 11627 leader_election.cc:343] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:36.797927 12480 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:36.793824 12434 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:36.840538 11773 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.854602 12429 raft_consensus.cc:1275] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.856705 12502 consensus_queue.cc:1048] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:16:36.908593 11806 raft_consensus.cc:1275] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.910006 12479 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:36.920387 11773 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.929492 11773 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:36.938102 12233 raft_consensus.cc:2804] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.942849 11658 raft_consensus.cc:1275] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:36.988122 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 60359.1us
I20260709 12:16:36.988734 12233 raft_consensus.cc:697] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:36.989794 12233 consensus_queue.cc:237] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:36.969599 12514 raft_consensus.cc:2749] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:37.002018 11658 raft_consensus.cc:1275] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:37.085880 12525 log.cc:927] Time spent T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:16:37.123946 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:37.124193 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:37.124763 11808 raft_consensus.cc:3060] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:37.124764 11805 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:37.138401 11730 raft_consensus.cc:1275] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:37.138865 12529 log.cc:927] Time spent T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:16:37.142204 12432 raft_consensus.cc:1275] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.155435 12324 consensus_queue.cc:1048] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.182860 12517 consensus_queue.cc:1048] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:16:37.199105 12515 consensus_queue.cc:1048] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:16:37.205022 11805 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
W20260709 12:16:37.211475 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 76469us
I20260709 12:16:37.228596 11808 raft_consensus.cc:2468] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
W20260709 12:16:37.239078 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 95939.3us
I20260709 12:16:37.244858 11661 raft_consensus.cc:1275] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.248713 12392 tablet_bootstrap.cc:492] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:16:37.258843 11627 consensus_peers.cc:597] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:37.273322 11701 consensus_peers.cc:597] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:37.274533 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 52421.7us
I20260709 12:16:37.278551 12392 tablet_bootstrap.cc:492] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.279397 12392 ts_tablet_manager.cc:1403] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.495s	user 0.018s	sys 0.006s
I20260709 12:16:37.281633 11484 catalog_manager.cc:5697] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:37.288058 11653 raft_consensus.cc:1275] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.285857 11624 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:37.291203 11809 raft_consensus.cc:1275] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.292001 12492 consensus_queue.cc:1048] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:16:37.292794 12553 consensus_queue.cc:1048] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.282049 12392 raft_consensus.cc:359] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:37.296545 12392 raft_consensus.cc:740] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
W20260709 12:16:37.299268 11701 consensus_peers.cc:597] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:37.299127 12392 consensus_queue.cc:260] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:37.301047 12392 ts_tablet_manager.cc:1434] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:16:37.302089 12392 tablet_bootstrap.cc:492] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:37.315066 11624 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:37.318756 12544 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:16:37.315066 12480 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:37.322558 12480 raft_consensus.cc:697] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:37.323418 12480 consensus_queue.cc:237] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:37.316308 11627 consensus_peers.cc:597] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:37.327577 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 56992.7us
I20260709 12:16:37.343590 12549 raft_consensus.cc:2804] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:37.344224 12549 raft_consensus.cc:697] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:37.349416 12544 consensus_queue.cc:1048] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:37.352690 12494 consensus_queue.cc:1048] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.345237 12549 consensus_queue.cc:237] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:37.445497 11627 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:37.456880 12559 log.cc:927] Time spent T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:16:37.459889 12437 raft_consensus.cc:1275] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:37.466228 11701 consensus_peers.cc:597] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:37.516669 12025 consensus_queue.cc:1048] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:37.529546 11701 consensus_peers.cc:597] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:37.581118 11701 consensus_peers.cc:597] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:37.583340 11775 consensus_peers.cc:597] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:37.587383 11775 consensus_peers.cc:597] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:37.588126 11775 consensus_peers.cc:597] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:37.588776 11775 consensus_peers.cc:597] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:37.592149 12392 tablet_bootstrap.cc:492] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.593166 12392 tablet_bootstrap.cc:492] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.596355 12392 ts_tablet_manager.cc:1403] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.295s	user 0.026s	sys 0.009s
I20260709 12:16:37.600754 12392 raft_consensus.cc:359] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:37.601433 12392 raft_consensus.cc:740] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.603191 12392 consensus_queue.cc:260] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:37.605773 11729 raft_consensus.cc:1275] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:37.608283 11627 consensus_peers.cc:597] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:37.605783 12392 ts_tablet_manager.cc:1434] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:16:37.616253 12541 consensus_queue.cc:1048] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.617424 12392 tablet_bootstrap.cc:492] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
W20260709 12:16:37.618338 11775 consensus_peers.cc:597] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:37.626067 11775 consensus_peers.cc:597] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:37.654124 11483 catalog_manager.cc:5697] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 2 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:37.656093 12392 tablet_bootstrap.cc:492] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.657025 12392 tablet_bootstrap.cc:492] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.657668 12392 ts_tablet_manager.cc:1403] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.006s
I20260709 12:16:37.661588 12392 raft_consensus.cc:359] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:37.662274 12392 raft_consensus.cc:740] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.663034 12392 consensus_queue.cc:260] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:37.665133 12392 ts_tablet_manager.cc:1434] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:16:37.666009 12392 tablet_bootstrap.cc:492] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
W20260709 12:16:37.683400 11701 consensus_peers.cc:597] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:37.687192 11701 consensus_peers.cc:597] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:37.692304 12392 tablet_bootstrap.cc:492] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.693354 12392 tablet_bootstrap.cc:492] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.694105 12392 ts_tablet_manager.cc:1403] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 12:16:37.696210 12392 raft_consensus.cc:359] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:37.696727 12392 raft_consensus.cc:740] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.697477 12392 consensus_queue.cc:260] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:37.698513 11481 catalog_manager.cc:5697] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } }
I20260709 12:16:37.699704 12392 ts_tablet_manager.cc:1434] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:37.700647 12392 tablet_bootstrap.cc:492] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:37.715914 12392 tablet_bootstrap.cc:492] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.716799 12392 tablet_bootstrap.cc:492] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.717463 12392 ts_tablet_manager.cc:1403] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:16:37.719919 12392 raft_consensus.cc:359] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:37.720628 12392 raft_consensus.cc:740] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.721272 12392 consensus_queue.cc:260] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:37.723308 12392 ts_tablet_manager.cc:1434] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:37.724211 12392 tablet_bootstrap.cc:492] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:37.726367 11484 catalog_manager.cc:5697] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:37.729000 11484 catalog_manager.cc:5697] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 1 to 2, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:37.739954 12392 tablet_bootstrap.cc:492] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.740898 12392 tablet_bootstrap.cc:492] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.741427 12392 ts_tablet_manager.cc:1403] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:16:37.743835 12392 raft_consensus.cc:359] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:37.744478 12392 raft_consensus.cc:740] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.745076 12392 consensus_queue.cc:260] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:37.746794 12392 ts_tablet_manager.cc:1434] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:37.747594 12392 tablet_bootstrap.cc:492] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:37.794075 12431 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:37.794267 12392 tablet_bootstrap.cc:492] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.799785 12392 tablet_bootstrap.cc:492] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.800598 12392 ts_tablet_manager.cc:1403] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.053s	user 0.025s	sys 0.008s
I20260709 12:16:37.803361 12392 raft_consensus.cc:359] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:37.803937 12431 raft_consensus.cc:1275] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.804131 12392 raft_consensus.cc:740] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.805173 12392 consensus_queue.cc:260] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:37.808058 12392 ts_tablet_manager.cc:1434] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:37.808961 12392 tablet_bootstrap.cc:492] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:37.810770 12535 consensus_queue.cc:1048] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.844552 12392 tablet_bootstrap.cc:492] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.845607 12392 tablet_bootstrap.cc:492] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.846323 12392 ts_tablet_manager.cc:1403] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.038s	user 0.029s	sys 0.004s
I20260709 12:16:37.846769 11806 raft_consensus.cc:1275] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.848634 12480 consensus_queue.cc:1048] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.849128 12392 raft_consensus.cc:359] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:37.849884 12392 raft_consensus.cc:740] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.850600 12392 consensus_queue.cc:260] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:37.857247 12392 ts_tablet_manager.cc:1434] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:16:37.858209 12392 tablet_bootstrap.cc:492] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:37.878178 12392 tablet_bootstrap.cc:492] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.879145 12392 tablet_bootstrap.cc:492] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.879827 12392 ts_tablet_manager.cc:1403] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 12:16:37.882243 12392 raft_consensus.cc:359] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:37.882910 12392 raft_consensus.cc:740] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.883531 12392 consensus_queue.cc:260] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:37.884552 11775 consensus_peers.cc:597] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:37.885566 12392 ts_tablet_manager.cc:1434] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:37.886776 12392 tablet_bootstrap.cc:492] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:37.889930 12432 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:37.909580 12392 tablet_bootstrap.cc:492] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.910457 12392 tablet_bootstrap.cc:492] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.911152 12392 ts_tablet_manager.cc:1403] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 12:16:37.913520 12392 raft_consensus.cc:359] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:37.914177 12392 raft_consensus.cc:740] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.914803 12392 consensus_queue.cc:260] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:37.916168 12392 ts_tablet_manager.cc:1434] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:16:37.916972 12392 tablet_bootstrap.cc:492] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:37.931202 12392 tablet_bootstrap.cc:492] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.932063 12392 tablet_bootstrap.cc:492] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.932600 12392 ts_tablet_manager.cc:1403] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:16:37.934449 12392 raft_consensus.cc:359] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:37.934624 11806 raft_consensus.cc:1275] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.934984 12392 raft_consensus.cc:740] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.935724 12392 consensus_queue.cc:260] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:37.937654 12392 ts_tablet_manager.cc:1434] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:16:37.937561 12480 consensus_queue.cc:1048] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:37.941883 12392 tablet_bootstrap.cc:492] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:37.971459 12431 raft_consensus.cc:3060] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:37.972369 12392 tablet_bootstrap.cc:492] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.973309 12392 tablet_bootstrap.cc:492] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:37.973958 12392 ts_tablet_manager.cc:1403] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.014s
I20260709 12:16:37.976593 12392 raft_consensus.cc:359] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:37.977237 12392 raft_consensus.cc:740] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.978255 12392 consensus_queue.cc:260] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:37.981200 12431 raft_consensus.cc:1275] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.985497 12392 ts_tablet_manager.cc:1434] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 12:16:37.986567 12392 tablet_bootstrap.cc:492] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:37.986370 12549 consensus_queue.cc:1048] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.010205 12392 tablet_bootstrap.cc:492] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.010890 12392 tablet_bootstrap.cc:492] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:38.011456 12392 ts_tablet_manager.cc:1403] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.005s
I20260709 12:16:38.013258 12392 raft_consensus.cc:359] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:38.013720 12392 raft_consensus.cc:740] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:38.014245 12392 consensus_queue.cc:260] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:38.015616 12392 ts_tablet_manager.cc:1434] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:16:38.016474 12392 tablet_bootstrap.cc:492] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:38.028149 12392 tablet_bootstrap.cc:492] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.028811 12392 tablet_bootstrap.cc:492] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:38.029299 12392 ts_tablet_manager.cc:1403] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:16:38.030998 12392 raft_consensus.cc:359] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:38.031461 12392 raft_consensus.cc:740] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:38.032016 12392 consensus_queue.cc:260] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:38.034119 12392 ts_tablet_manager.cc:1434] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:16:38.035210 12392 tablet_bootstrap.cc:492] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:38.056730 12392 tablet_bootstrap.cc:492] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.057617 12392 tablet_bootstrap.cc:492] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:38.058290 12392 ts_tablet_manager.cc:1403] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 12:16:38.060451 12392 raft_consensus.cc:359] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:38.060899 12392 raft_consensus.cc:740] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:38.061360 12392 consensus_queue.cc:260] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:38.063119 12392 ts_tablet_manager.cc:1434] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:38.064126 12392 tablet_bootstrap.cc:492] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:38.085316 12392 tablet_bootstrap.cc:492] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.086477 12392 tablet_bootstrap.cc:492] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:38.087214 12392 ts_tablet_manager.cc:1403] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:16:38.089740 12392 raft_consensus.cc:359] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:38.090515 12392 raft_consensus.cc:740] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:38.091377 12392 consensus_queue.cc:260] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:38.093423 12392 ts_tablet_manager.cc:1434] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 12:16:38.094813 12392 tablet_bootstrap.cc:492] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:38.108906 12392 tablet_bootstrap.cc:492] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.109910 12392 tablet_bootstrap.cc:492] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:38.110579 12392 ts_tablet_manager.cc:1403] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:16:38.112736 12392 raft_consensus.cc:359] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:38.113293 12392 raft_consensus.cc:740] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:38.113873 12392 consensus_queue.cc:260] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:38.115873 12392 ts_tablet_manager.cc:1434] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:38.117005 12392 tablet_bootstrap.cc:492] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:38.136456 12392 tablet_bootstrap.cc:492] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.137387 12392 tablet_bootstrap.cc:492] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:38.137989 12392 ts_tablet_manager.cc:1403] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.004s
I20260709 12:16:38.139683 12392 raft_consensus.cc:359] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:38.140350 12392 raft_consensus.cc:740] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:38.140964 12392 consensus_queue.cc:260] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:38.143121 12392 ts_tablet_manager.cc:1434] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:38.143916 12392 tablet_bootstrap.cc:492] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:38.157843 12392 tablet_bootstrap.cc:492] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.158594 12392 tablet_bootstrap.cc:492] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:38.159204 12392 ts_tablet_manager.cc:1403] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:16:38.161379 12392 raft_consensus.cc:359] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:38.162037 12392 raft_consensus.cc:740] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:38.162629 12392 consensus_queue.cc:260] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:38.165788 12392 ts_tablet_manager.cc:1434] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:38.166703 12392 tablet_bootstrap.cc:492] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:38.179768 12392 tablet_bootstrap.cc:492] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.180608 12392 tablet_bootstrap.cc:492] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:38.181233 12392 ts_tablet_manager.cc:1403] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:16:38.183269 12392 raft_consensus.cc:359] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:38.183744 12392 raft_consensus.cc:740] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:38.184314 12392 consensus_queue.cc:260] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:38.186373 12392 ts_tablet_manager.cc:1434] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:16:38.187520 12392 tablet_bootstrap.cc:492] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:38.200780 12392 tablet_bootstrap.cc:492] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.202050 12392 tablet_bootstrap.cc:492] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:38.202688 12392 ts_tablet_manager.cc:1403] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.008s
I20260709 12:16:38.205090 12392 raft_consensus.cc:359] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:38.205804 12392 raft_consensus.cc:740] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:38.206413 12392 consensus_queue.cc:260] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:38.208192 12392 ts_tablet_manager.cc:1434] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:16:38.209045 12392 tablet_bootstrap.cc:492] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:38.226261 12392 tablet_bootstrap.cc:492] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.229491 12392 tablet_bootstrap.cc:492] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:38.230250 12392 ts_tablet_manager.cc:1403] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 12:16:38.232626 12392 raft_consensus.cc:359] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:38.233218 12392 raft_consensus.cc:740] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:38.233786 12392 consensus_queue.cc:260] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:38.235785 12392 ts_tablet_manager.cc:1434] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:38.236483 12392 tablet_bootstrap.cc:492] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap starting.
I20260709 12:16:38.251050 12392 tablet_bootstrap.cc:492] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.251755 12392 tablet_bootstrap.cc:492] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Bootstrap complete.
I20260709 12:16:38.252350 12392 ts_tablet_manager.cc:1403] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:16:38.255686 12392 raft_consensus.cc:359] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:38.256508 12392 raft_consensus.cc:740] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Initialized, Role: FOLLOWER
I20260709 12:16:38.257125 12392 consensus_queue.cc:260] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:38.258849 12392 ts_tablet_manager.cc:1434] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:38.387547 12431 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.584019 11936 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.584594 11936 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:38.586495 11936 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:38.587750 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:38.588054 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:38.588693 11806 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:38.589972 11698 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:38.590466 12434 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:38.590771 11936 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:38.591223 11936 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:38.591570 11936 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.597240 11936 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:38.598626 11936 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:38.599243 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:38.599416 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:38.599731 11806 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.599929 12434 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.605909 12434 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:38.607887 11701 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:38.609640 12508 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:38.610873 12508 raft_consensus.cc:697] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:38.611721 11806 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:38.614797 12508 consensus_queue.cc:237] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:38.625656 11482 catalog_manager.cc:5697] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 3, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:39.094133 11804 raft_consensus.cc:1275] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:39.095459 12508 consensus_queue.cc:1048] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:39.108109 12432 raft_consensus.cc:1275] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:39.109772 11936 consensus_queue.cc:1048] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.661612  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:45.711745 11729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:16:45.712327 11729 raft_consensus.cc:606] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:45.724272 11806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:51054
I20260709 12:16:45.724756 11806 raft_consensus.cc:606] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:45.726866 11729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:16:45.727260 11729 raft_consensus.cc:606] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:45.729487 11729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:16:45.730031 11729 raft_consensus.cc:606] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:45.740914 11657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:34102
I20260709 12:16:45.741482 11657 raft_consensus.cc:606] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:45.744000 11729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:16:45.744387 11729 raft_consensus.cc:606] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:16:45.746516 11729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6924fe8aeff4ed699be088221835654"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:16:45.746984 11729 raft_consensus.cc:606] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:45.748169  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:16:45.750723  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:45.751639  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:45.806296 12628 raft_consensus.cc:993] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:16:45.806881 12628 raft_consensus.cc:1081] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Signalling peer b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:16:45.808562 12625 raft_consensus.cc:993] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:45.808972 12625 raft_consensus.cc:1081] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:45.810535 12431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:16:45.811097 12431 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.811399 12431 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.815070 11657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:16:45.815657 11657 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.816004 11657 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.818907 12431 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:45.825594 11657 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:45.826925 12431 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:45.827646 11657 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:45.828725 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:45.828943 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:45.829639 11806 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.829720 11729 raft_consensus.cc:3055] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:45.830179 11729 raft_consensus.cc:740] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:45.830938 11729 consensus_queue.cc:260] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:45.832119 11729 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.836460 11806 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:45.837716 11624 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:45.838464 12626 raft_consensus.cc:2804] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:45.838939 12626 raft_consensus.cc:697] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:45.839633 12626 consensus_queue.cc:237] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:45.839504 11729 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:45.852150 11483 catalog_manager.cc:5697] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 1 to 2, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.864281 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:45.865031 11729 raft_consensus.cc:3055] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:45.865343 11729 raft_consensus.cc:740] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:45.866101 11729 consensus_queue.cc:260] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:45.867041 11729 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.869294 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:45.869902 11657 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.876255 11657 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:45.877182 11729 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:45.877521 12387 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:45.879269 12643 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:45.880430 12643 raft_consensus.cc:697] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:45.881209 12643 consensus_queue.cc:237] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:45.891556 11483 catalog_manager.cc:5697] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 2, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 2 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.904729 12638 raft_consensus.cc:993] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:45.905143 12626 raft_consensus.cc:1081] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:45.906432 12431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57346
I20260709 12:16:45.906838 12431 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.907133 12431 raft_consensus.cc:3060] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.912772 12431 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:45.915230 12431 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:45.915822 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:45.916435 11661 raft_consensus.cc:3055] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:45.916709 11661 raft_consensus.cc:740] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:45.917389 11661 consensus_queue.cc:260] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:45.918404 11661 raft_consensus.cc:3060] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.924031 11661 raft_consensus.cc:2468] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:45.925359 12387 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:45.925796 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:45.926311 12643 raft_consensus.cc:2804] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:45.926401 11807 raft_consensus.cc:3060] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.926986 12643 raft_consensus.cc:697] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:45.929298 12628 raft_consensus.cc:993] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:45.929148 12643 consensus_queue.cc:237] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:45.929723 12512 raft_consensus.cc:1081] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:45.931357 12434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:16:45.931836 12434 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.932183 12434 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.935063 11807 raft_consensus.cc:2468] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:45.938265 12434 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:45.940677 12434 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:45.940968 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:45.941183 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:45.941613 11729 raft_consensus.cc:3055] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:45.941820 11807 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.941910 11729 raft_consensus.cc:740] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:45.942803 11729 consensus_queue.cc:260] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:45.943966 11729 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.944772 11483 catalog_manager.cc:5697] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 2 to 3, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 3 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.946508 11807 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:45.947510 12386 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:45.948338 12643 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:45.948801 12643 raft_consensus.cc:697] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:45.949589 12643 consensus_queue.cc:237] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:45.950094 11729 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:45.958861 11483 catalog_manager.cc:5697] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 2 to 3, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 3 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.032908 12627 raft_consensus.cc:993] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:46.033419 12634 raft_consensus.cc:1081] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:46.034840 12431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57354
I20260709 12:16:46.035269 12431 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:46.035524 12431 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:46.040300 12431 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:46.041971 12431 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:46.042596 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:46.042917 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:46.043282 11807 raft_consensus.cc:3055] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:46.043512 11661 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:46.043637 11807 raft_consensus.cc:740] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:46.044435 11807 consensus_queue.cc:260] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:46.045676 11807 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:46.050275 11661 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:46.051651 12387 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:46.052038 11807 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:46.052452 12643 raft_consensus.cc:2804] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:46.052951 12643 raft_consensus.cc:697] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:46.053668 12643 consensus_queue.cc:237] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:46.062682 11483 catalog_manager.cc:5697] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 2 to 3, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 3 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:46.076388 12625 raft_consensus.cc:993] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:46.076874 12512 raft_consensus.cc:1081] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:46.078445 12434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6924fe8aeff4ed699be088221835654"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:16:46.078889 12434 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:46.079162 12434 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:46.083776 12434 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:46.085289 12434 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:46.086290 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:46.086179 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:46.086984 11729 raft_consensus.cc:3055] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:46.087031 11661 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:46.087291 11729 raft_consensus.cc:740] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:46.088047 11729 consensus_queue.cc:260] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:46.088946 11729 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:46.091768 11661 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:46.092789 12387 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:46.093556 12643 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:46.093636 11729 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:46.094017 12643 raft_consensus.cc:697] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:46.094913 12643 consensus_queue.cc:237] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:46.103775 11483 catalog_manager.cc:5697] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 2 to 3, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 3 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:46.182032 12625 raft_consensus.cc:993] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:46.182490 12512 raft_consensus.cc:1081] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:46.183979 12434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:16:46.184580 12434 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:46.184989 12434 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.189949 12434 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:46.191584 12434 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:46.192631 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:46.192952 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:46.193337 11807 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.193516 11729 raft_consensus.cc:3055] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:46.193893 11729 raft_consensus.cc:740] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:46.194676 11729 consensus_queue.cc:260] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:46.195919 11729 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.200311 11807 raft_consensus.cc:2468] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:46.201351 12386 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:46.202095 12643 raft_consensus.cc:2804] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:46.202339 11729 raft_consensus.cc:2468] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:46.202490 12643 raft_consensus.cc:697] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:46.203420 12643 consensus_queue.cc:237] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:46.220145 11483 catalog_manager.cc:5697] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 2, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 2 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.336215 11729 raft_consensus.cc:1275] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.346215 11804 raft_consensus.cc:1275] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.354712 11804 raft_consensus.cc:1275] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.357142 12643 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:46.357487 12644 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:46.362696 12626 consensus_queue.cc:1048] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:46.374801 11661 raft_consensus.cc:1275] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.379971 12643 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:46.550513 11656 raft_consensus.cc:1275] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.557169 12670 consensus_queue.cc:1048] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:46.575223 11729 raft_consensus.cc:1275] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.586813 11654 raft_consensus.cc:1275] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.588585 11804 raft_consensus.cc:1275] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.588371 12670 consensus_queue.cc:1048] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:46.591082 11809 raft_consensus.cc:1275] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.600858 12643 consensus_queue.cc:1048] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:16:46.630956 11732 raft_consensus.cc:1275] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.597114 12670 consensus_queue.cc:1048] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:16:46.656339 12643 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:46.664445 11661 raft_consensus.cc:1275] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.669373 12669 consensus_queue.cc:1048] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:46.685377 12670 consensus_queue.cc:1048] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:46.703001 11729 raft_consensus.cc:1275] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.714234 11729 raft_consensus.cc:1275] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.729539 12670 consensus_queue.cc:1048] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:46.733649 12658 consensus_queue.cc:1048] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:46.756920 11804 raft_consensus.cc:1275] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.760476 12658 consensus_queue.cc:1048] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:46.803077  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:46.856758 11804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:51054
I20260709 12:16:46.857545 11804 raft_consensus.cc:606] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:46.862231 11729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:16:46.862838 11729 raft_consensus.cc:606] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:46.865912 11804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
mode: GRACEFUL
new_leader_uuid: "264376c764c64dc78c4cef6031c15eef"
 from {username='slave'} at 127.0.0.1:51054
I20260709 12:16:46.866453 11804 raft_consensus.cc:606] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Received request to transfer leadership to TS 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:46.871392 11654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:34102
I20260709 12:16:46.872020 11654 raft_consensus.cc:606] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:46.874672 11804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:51054
I20260709 12:16:46.875164 11804 raft_consensus.cc:606] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:16:46.876084  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:46.877380  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:46.878371  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:46.903728 12627 raft_consensus.cc:993] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178: : Instructing follower b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:16:46.904717 12652 raft_consensus.cc:1081] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Signalling peer b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:16:46.906767 11654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:60060
I20260709 12:16:46.907748 11654 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:46.908195 11654 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.915158 11654 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:46.917091 11654 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:46.918229 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:46.918891 11729 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.926834 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:46.930038 11804 raft_consensus.cc:3055] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:46.930351 11804 raft_consensus.cc:740] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:46.931344 11804 consensus_queue.cc:260] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:46.932713 11804 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.937458 11729 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:46.939091 11625 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:46.939733 11804 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:46.940022 12669 raft_consensus.cc:2804] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:46.940582 12669 raft_consensus.cc:697] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:46.941502 12669 consensus_queue.cc:237] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:46.952124 11483 catalog_manager.cc:5697] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 1 to 2, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.003634 12661 raft_consensus.cc:993] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:47.004151 12666 raft_consensus.cc:1081] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:47.005795 12434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:16:47.006229 12434 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.006482 12434 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.013264 12434 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:47.014724 12434 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:47.015587 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:47.015618 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:47.016214 11729 raft_consensus.cc:3055] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:47.016302 11804 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.016645 11729 raft_consensus.cc:740] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:47.017455 11729 consensus_queue.cc:260] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:47.018705 11729 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.022773 11804 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:47.024199 12386 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:47.024758 11729 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:47.025035 12670 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:47.025578 12670 raft_consensus.cc:697] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:47.026558 12670 consensus_queue.cc:237] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:47.035074 11483 catalog_manager.cc:5697] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 2, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 2 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.270759 12652 raft_consensus.cc:993] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178: : Instructing follower 264376c764c64dc78c4cef6031c15eef to start an election
I20260709 12:16:47.271186 12627 raft_consensus.cc:1081] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Signalling peer 264376c764c64dc78c4cef6031c15eef to start an election
I20260709 12:16:47.272560 11730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
 from {username='slave'} at 127.0.0.1:59520
I20260709 12:16:47.272965 11730 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.273211 11730 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.278550 11730 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:47.281352 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:47.281526 11730 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:47.281674 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:47.281991 11654 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.282303 11804 raft_consensus.cc:3055] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:47.282647 11804 raft_consensus.cc:740] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:47.283296 11804 consensus_queue.cc:260] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:47.284091 11804 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.286900 11654 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:47.287968 11699 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:47.288548 12661 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:47.288698 11804 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:47.288923 12661 raft_consensus.cc:697] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:47.290019 12661 consensus_queue.cc:237] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:47.298859 11483 catalog_manager.cc:5697] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 2, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.301239 12665 raft_consensus.cc:993] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:47.301819 12665 raft_consensus.cc:1081] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:47.303359 12431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57346
I20260709 12:16:47.303761 12431 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.304093 12431 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.310226 12431 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:47.311676 12431 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:47.312602 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:47.312922 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:47.313207 11654 raft_consensus.cc:3055] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:47.313530 11804 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.313548 11654 raft_consensus.cc:740] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:47.315820 11654 consensus_queue.cc:260] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:47.317108 11654 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.320221 11804 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:47.321256 12386 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:47.322077 12662 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:47.322535 12662 raft_consensus.cc:697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:47.323395 12662 consensus_queue.cc:237] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:47.322471 11654 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:47.333727 11483 catalog_manager.cc:5697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 2 to 3, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 3 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.372146 12652 raft_consensus.cc:993] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:47.372707 12652 raft_consensus.cc:1081] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:47.374250 12434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57354
I20260709 12:16:47.374670 12434 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.374931 12434 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.379673 12434 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:47.381064 12434 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:47.381737 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:47.381955 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:47.382438 11730 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.382449 11804 raft_consensus.cc:3055] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:47.382925 11804 raft_consensus.cc:740] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:47.383679 11804 consensus_queue.cc:260] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:47.384954 11804 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.389147 11730 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:47.390545 12387 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:47.391264 11804 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:47.391326 12662 raft_consensus.cc:2804] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:47.391939 12662 raft_consensus.cc:697] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:47.392834 12662 consensus_queue.cc:237] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:47.403319 11483 catalog_manager.cc:5697] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 2, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 2 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.428668 11730 raft_consensus.cc:1275] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.429695 12662 consensus_queue.cc:1048] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.435148 11804 raft_consensus.cc:1275] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.436851 12670 consensus_queue.cc:1048] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.492419 11804 raft_consensus.cc:1275] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.493455 12669 consensus_queue.cc:1048] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.498005 11730 raft_consensus.cc:1275] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.499593 12669 consensus_queue.cc:1048] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.794577 11806 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.795768 12704 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.806231 11654 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.808671 12704 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.832909 11806 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:47.834764 12658 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.843182 11654 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:47.844491 12662 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.877033 11804 raft_consensus.cc:1275] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.878234 12670 consensus_queue.cc:1048] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.887787 11729 raft_consensus.cc:1275] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.889793 12711 consensus_queue.cc:1048] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:47.917042  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:47.973146 11654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
mode: GRACEFUL
new_leader_uuid: "264376c764c64dc78c4cef6031c15eef"
 from {username='slave'} at 127.0.0.1:34102
I20260709 12:16:47.973646 11654 raft_consensus.cc:606] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Received request to transfer leadership to TS 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:47.976547 11729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:16:47.977191 11729 raft_consensus.cc:606] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:47.980031 11804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baf220366c63486c90e96d1db47de716"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:51054
I20260709 12:16:47.980605 11804 raft_consensus.cc:606] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:47.983783 11804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:51054
I20260709 12:16:47.984316 11804 raft_consensus.cc:606] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:47.986845 11804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:51054
I20260709 12:16:47.987368 11804 raft_consensus.cc:606] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:47.988597  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:47.990617  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:47.991432  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:48.086108 12638 raft_consensus.cc:993] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03: : Instructing follower 264376c764c64dc78c4cef6031c15eef to start an election
I20260709 12:16:48.086550 12665 raft_consensus.cc:1081] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Signalling peer 264376c764c64dc78c4cef6031c15eef to start an election
I20260709 12:16:48.087849 11729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
 from {username='slave'} at 127.0.0.1:59512
I20260709 12:16:48.088285 11729 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.088510 11729 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.095005 11729 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:48.096362 11729 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:48.097035 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:48.097438 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:48.097537 11654 raft_consensus.cc:3055] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:48.097958 11654 raft_consensus.cc:740] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:48.098001 11804 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.098912 11654 consensus_queue.cc:260] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:48.101167 12652 raft_consensus.cc:993] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:48.103824 11804 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:48.100937 11654 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.106863 12705 raft_consensus.cc:1081] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:48.107503 11698 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:48.108356 12661 raft_consensus.cc:2804] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.108565 12431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "baf220366c63486c90e96d1db47de716"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57354
I20260709 12:16:48.109157 12431 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.108781 12661 raft_consensus.cc:697] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:48.109510 12431 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.110320 12661 consensus_queue.cc:237] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:48.113286 11654 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:48.116981 12431 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:48.119737 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:48.119951 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:48.120319 11729 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.120575 11804 raft_consensus.cc:3055] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:48.120908 11804 raft_consensus.cc:740] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:48.121599 11804 consensus_queue.cc:260] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:48.122609 11804 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.122301 11483 catalog_manager.cc:5697] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 2, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.127513 11729 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:48.128854 12387 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:48.129721 12711 raft_consensus.cc:2804] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.130204 12711 raft_consensus.cc:697] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:48.130996 12711 consensus_queue.cc:237] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:48.123313 12431 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:48.132931 11804 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:48.143338 11484 catalog_manager.cc:5697] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 2, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 2 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:48.360778 12652 raft_consensus.cc:993] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:48.361177 12705 raft_consensus.cc:1081] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:48.362318 12431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57354
I20260709 12:16:48.362728 12431 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.362973 12431 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.367194 12431 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:48.368577 12431 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:48.369146 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:48.369470 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:48.369798 11729 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.370043 11804 raft_consensus.cc:3055] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:48.370332 11804 raft_consensus.cc:740] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:48.370970 11804 consensus_queue.cc:260] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:48.371958 11804 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.376149 11729 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:48.377166 12387 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:48.378118 12711 raft_consensus.cc:2804] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.378613 12711 raft_consensus.cc:697] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:48.378064 11804 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:48.379441 12711 consensus_queue.cc:237] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:48.380733 12652 raft_consensus.cc:993] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:48.381181 12652 raft_consensus.cc:1081] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:48.382637 12431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57354
I20260709 12:16:48.383185 12431 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.385248 12431 raft_consensus.cc:3060] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:48.390530 11484 catalog_manager.cc:5697] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 2, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 2 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:48.392187 12431 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:48.394784 12431 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:48.395305 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:48.395920 11806 raft_consensus.cc:3055] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:48.396219 11806 raft_consensus.cc:740] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:48.396564 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:48.398386 11654 raft_consensus.cc:3060] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:48.396948 11806 consensus_queue.cc:260] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:48.399873 11806 raft_consensus.cc:3060] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:48.409332 11806 raft_consensus.cc:2468] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:48.410465 12386 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:48.411325 12711 raft_consensus.cc:2804] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:48.411823 12711 raft_consensus.cc:697] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:48.412066 11654 raft_consensus.cc:2468] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:48.412657 12711 consensus_queue.cc:237] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:48.423403 11484 catalog_manager.cc:5697] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 2 to 3, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 3 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.453014 12666 raft_consensus.cc:993] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:48.453672 12704 raft_consensus.cc:1081] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:48.457355 12431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:16:48.457875 12431 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.458223 12431 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:48.463018 12431 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:48.464565 12431 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:48.465427 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:48.465876 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:48.466068 11729 raft_consensus.cc:3055] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:48.466456 11729 raft_consensus.cc:740] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:48.466463 11804 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:48.467177 11729 consensus_queue.cc:260] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:48.468330 11729 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:48.472775 11804 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:16:48.474239 12386 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:48.474243 11729 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:16:48.475144 12711 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:48.475585 12711 raft_consensus.cc:697] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:48.476346 12711 consensus_queue.cc:237] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:48.485292 11484 catalog_manager.cc:5697] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 3 to 4, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 4 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:48.590094 11654 raft_consensus.cc:1275] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.593065 12704 consensus_queue.cc:1048] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.609964 11804 raft_consensus.cc:1275] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.612197 12666 consensus_queue.cc:1048] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.683158 11729 raft_consensus.cc:1275] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.684295 12711 consensus_queue.cc:1048] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.694047 11806 raft_consensus.cc:1275] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.696692 12711 consensus_queue.cc:1048] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.776654 11806 raft_consensus.cc:1275] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.778765 12658 consensus_queue.cc:1048] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.791554 11729 raft_consensus.cc:1275] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.792912 12658 consensus_queue.cc:1048] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.809243 11806 raft_consensus.cc:1275] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:48.810461 12658 consensus_queue.cc:1048] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:48.824965 11654 raft_consensus.cc:1275] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:48.826233 12711 consensus_queue.cc:1048] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:49.018414 11804 raft_consensus.cc:1275] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:49.019678 12662 consensus_queue.cc:1048] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:49.029906 11732 raft_consensus.cc:1275] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:49.033280 12711 consensus_queue.cc:1048] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:49.036183  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.105245 11729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:16:49.105942 11729 raft_consensus.cc:606] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:16:49.107180  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:16:49.107582 12661 raft_consensus.cc:993] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:16:49.108184 12666 raft_consensus.cc:1081] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Signalling peer b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:16:49.109122  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:49.110212 11661 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:16:49.110886 11661 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:49.111009  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.111506 11661 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:49.116730 11661 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:49.118247 11661 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:49.119001 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:49.119334 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:49.119638 11729 raft_consensus.cc:3055] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:49.119964 11806 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:49.119990 11729 raft_consensus.cc:740] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:49.120882 11729 consensus_queue.cc:260] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:49.122042 11729 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:49.126296 11806 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:16:49.128664 11729 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:16:49.128710 11624 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:49.129928 12665 raft_consensus.cc:2804] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:49.130362 12665 raft_consensus.cc:697] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:49.130960 12665 consensus_queue.cc:237] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:49.142000 11483 catalog_manager.cc:5697] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 2 to 3, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 3 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:49.655331 11729 raft_consensus.cc:1275] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:49.657037 12724 consensus_queue.cc:1048] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:16:50.337111 11774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.000s	sys 0.009s
W20260709 12:16:51.066761 11627 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.001s	sys 0.005s
W20260709 12:16:51.067236 11627 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.002s	sys 0.005s
I20260709 12:16:51.079679 12751 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:51.080351 12751 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:51.081583 12753 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:51.082760 12751 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:51.083648 12753 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:51.090291 12753 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:51.095551 12751 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:51.096035 12751 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:51.097995 12751 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:51.098959 12751 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:51.100098 12751 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:51.102236 12751 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:51.099472 12755 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:51.103049 12755 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:51.105779 12755 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:16:51.690258 11774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.338s	user 0.025s	sys 0.111s
W20260709 12:16:51.690879 11774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.339s	user 0.025s	sys 0.111s
W20260709 12:16:51.731484 11698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.001s	sys 0.001s
W20260709 12:16:51.732311 11698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.002s	sys 0.001s
W20260709 12:16:51.764405 12389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.413s	user 0.010s	sys 0.007s
W20260709 12:16:51.765091 12389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.415s	user 0.011s	sys 0.007s
W20260709 12:16:51.784888 11773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.624s	user 0.012s	sys 0.007s
W20260709 12:16:51.785590 11773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.770s	user 0.013s	sys 0.007s
I20260709 12:16:51.834067 12759 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:51.834896 12759 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:51.855057 12759 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:51.864094 12760 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:51.871959 12761 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:51.957944 12764 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:51.958593 12763 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:51.965783 12766 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:51.976763 12771 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:51.958871 11729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59512 (request call id 359) took 2299 ms. Trace:
W20260709 12:16:51.985327 12386 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.024s	user 0.007s	sys 0.017s
W20260709 12:16:51.986490 12386 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.026s	user 0.007s	sys 0.017s
I20260709 12:16:51.978902 12759 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:51.978188 12763 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:51.980260 12761 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:51.996759 12769 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:51.997545 12763 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:51.990564 12759 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:51.997308 12769 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:51.998123 12763 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:51.998243 12761 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:51.980383 12764 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:51.998641 12763 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.000424 12764 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.000710 12763 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:51.981722 12766 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.002759 12759 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.004134 12766 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:51.980868 11729 rpcz_store.cc:276] 0709 12:16:49.659306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:49.659442 (+   136us) service_pool.cc:224] Handling call
0709 12:16:49.660097 (+   655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:49.660874 (+   777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:49.660909 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:51.674093 (+2013184us) log.cc:844] Serialized 26 byte log entry
0709 12:16:51.934069 (+259976us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:51.934114 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:51.958565 (+ 24451us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:51.958615 (+    50us) raft_consensus.cc:1685] finished
0709 12:16:51.958626 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:51.958778 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2669,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":69539,"thread_start_us":259532,"threads_started":1,"wal-append.queue_time_us":258063}
I20260709 12:16:52.006913 12767 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:51.982066 12760 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.028919 12769 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.029608 12760 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.016168 12766 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:51.984339 12771 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.016448 12658 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.017338 12762 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.007535 12767 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.043573 12777 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.044222 12777 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.045387 12781 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.045624 12768 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.045997 12781 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.046145 12768 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:52.047313 12387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.043s	user 0.074s	sys 0.175s
W20260709 12:16:52.048003 12387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.044s	user 0.074s	sys 0.175s
I20260709 12:16:52.048139 12781 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.054682 12761 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.055073 12658 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.055202 12761 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.057346 12783 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.037638 12766 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.057915 12783 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.058748 12771 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.059264 12767 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.059406 12766 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.057482 12761 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.049502 12762 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.061538 12777 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.062155 12762 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.059899 12772 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.063019 12772 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.065001 12772 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.057302 12658 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.044279 12770 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.066586 12770 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:16:52.068332 11756 debug-util.cc:398] Leaking SignalData structure 0x7b0800224e20 after lost signal to thread 4412
I20260709 12:16:52.068586 12770 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.082765 12769 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.083029 12730 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.083520 12769 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.084432 12772 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.085045 12772 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.086088 12769 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.086995 12772 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.087364 12730 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.089288 12772 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.089797 12772 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.090710 12777 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.091259 12777 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.091706 12772 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.092024 12781 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.092547 12781 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.094030 12730 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.087050 12778 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.094354 12772 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.095026 12778 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.095496 12772 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.099720 12772 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.101131 12772 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.101838 12778 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.102433 12778 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.102988 12778 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.104489 12777 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.105037 12778 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.048118 12768 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.060070 12783 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.114228 12770 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.099933 12779 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.114763 12761 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.102435 12772 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.125000 12658 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.128427 12766 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.145463 12767 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.145627 12769 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.146118 12767 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.146308 12769 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.147070 12773 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.147609 12773 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.148283 12767 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.148846 12767 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.149286 12767 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.150384 12781 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.151005 12766 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.151463 12765 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.151196 12767 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.151970 12765 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.141183 12658 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.153200 12766 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.154099 12765 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.154685 12658 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.154911 12774 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.155426 12774 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.132035 12771 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.159842 12771 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.130630 12770 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.148527 12769 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.158819 12794 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.162824 12768 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.159101 12795 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.137024 12761 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.161407 12772 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.163568 12795 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.166599 12662 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.167158 12761 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.163466 12768 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:52.168303 11772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.207s	user 0.098s	sys 0.181s
I20260709 12:16:52.168543 12795 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.165118 12770 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.165402 12766 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.169996 12768 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:16:52.169857 11772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.209s	user 0.098s	sys 0.183s
I20260709 12:16:52.169793 12766 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.177788 12766 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.178961 12776 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:16:52.172096 11775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.311s	user 0.053s	sys 0.134s
I20260709 12:16:52.179523 12776 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:52.180230 12388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.843s	user 0.016s	sys 0.011s
W20260709 12:16:52.181188 11775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.320s	user 0.054s	sys 0.134s
W20260709 12:16:52.181479 11756 debug-util.cc:398] Leaking SignalData structure 0x7b08000db440 after lost signal to thread 11518
I20260709 12:16:52.173781 12774 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.174003 12780 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.182195 12774 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.182281 12780 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.182739 12774 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.184791 12780 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.163233 12794 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:16:52.185904 12388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.987s	user 0.017s	sys 0.011s
I20260709 12:16:52.186122 12776 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.130553 12779 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.161968 12771 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.186602 12774 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.166169 12658 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.167135 12662 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.198639 12789 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.199364 12789 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.200614 12662 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.201543 12794 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.187305 12658 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:52.211295 11756 debug-util.cc:398] Leaking SignalData structure 0x7b08000bd200 after lost signal to thread 11685
I20260709 12:16:52.203608 12763 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.204515 12764 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.212003 12771 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.210552 12794 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.212568 12793 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.222856 12793 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.223727 12662 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.224287 12662 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.225059 12793 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.209031 12796 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.226372 12662 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.201727 12789 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.207536 12770 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.212903 12791 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.227483 12770 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.227914 12791 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.212805 12798 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.229717 12781 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.226094 12796 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.229929 12770 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.230401 12781 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.232776 12796 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.230280 12798 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.234781 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.212924 12765 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.212531 12759 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.202014 12787 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.204267 12769 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.203691 12779 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.236831 12759 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.237097 12787 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.207795 12785 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.214257 12761 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.221474 12766 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.204386 12730 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.214133 12786 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.206457 12658 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.215690 12772 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.239502 12787 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.238741 12761 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.240289 12787 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.237150 12769 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.240746 12787 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.237011 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.241559 12761 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.242216 12769 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.239513 12786 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.221475 12764 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.242827 12787 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.236116 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.244246 12786 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.239743 12766 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:52.221410 11756 debug-util.cc:398] Leaking SignalData structure 0x7b08001b06a0 after lost signal to thread 11759
I20260709 12:16:52.236588 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.221912 12771 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.245429 12772 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.222308 12794 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.244496 12764 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.248028 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.245271 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.261065 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:52.245193 11756 debug-util.cc:398] Leaking SignalData structure 0x7b080037eea0 after lost signal to thread 11772
I20260709 12:16:52.262333 11654 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:52.239418 12730 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.235450 11658 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:52.242779 12769 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.221352 12763 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.248274 11657 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:52.211455 12797 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.209285 12768 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.207041 12773 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.209054 12790 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.235337 12798 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.247356 12771 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.279567 12801 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.280419 12794 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.280198 12801 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.281486 12763 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.282071 12763 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.282505 12801 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.283105 12801 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.283560 12801 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.271299 12786 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.284389 12786 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.247363 12772 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.284775 12768 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.280505 12766 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.272986 12769 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.286010 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.286468 12786 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.286720 12429 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:52.287074  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:52.238523 12785 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.287272 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.283795 12730 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.289002 12785 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.289471 12785 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.308359 12802 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.291872 12797 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.308861 12802 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.308856 12803 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.310086 12803 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.310858 12797 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.310985 12802 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.293350 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.273577 12789 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.312176 12803 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.312618 12789 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.314673 12789 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.309460 12730 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.315608 12730 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.316617 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.317269 12428 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:52.295421 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.318092 12430 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:52.296245 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.297106 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.319550 12437 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:52.297263 12781 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.308804 12785 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.320637 12790 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.322038 12785 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.298872 12759 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.299494 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:52.322899 11756 debug-util.cc:398] Leaking SignalData structure 0x7b0800043f00 after lost signal to thread 11833
I20260709 12:16:52.300698 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.277870 12761 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.236112 12765 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.314549 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.326143 12765 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.326258 12790 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.317577 12730 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.324304 12761 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.327689 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.328388 11807 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:52.301412 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.302201 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.302682 12768 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.296505 12801 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.305428 12769 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.247968 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.305909 11701 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:52.330551 12436 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:52.331152 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.331749 11806 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:52.331808 12765 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.332293 12765 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.332667 12765 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.307018 12791 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.332918 11701 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:52.333796 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.306142 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.307761 12764 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.335376 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.336000 12436 raft_consensus.cc:2468] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:52.333873 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.262723 12762 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.336903 11809 raft_consensus.cc:2468] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:52.282534 12763 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.338989 12789 raft_consensus.cc:2804] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.339406 12789 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.329782 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.340109 11807 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:52.334674 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.341007 11732 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:16:52.335230 12764 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.341603 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.308182 12787 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.342207 11729 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:52.337054 12762 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.343859 12764 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.344779 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.342139 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.342327 12787 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.341513 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.346391 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.346565 11660 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:52.347251 11732 raft_consensus.cc:2410] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:52.347365 12787 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.347791 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.336197 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.347707 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.342392 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.349411 11804 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:52.349722 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.341173 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.344667 12762 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.354430 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.354899 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.328610 12761 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.355520 11805 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:52.353678 11735 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:52.356642 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.356863 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:16:52.323289 11756 debug-util.cc:398] Leaking SignalData structure 0x7b0800127440 after lost signal to thread 11834
I20260709 12:16:52.357550 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.358104 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.339695 12763 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.349083 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.359158 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:52.358623 11756 debug-util.cc:398] Leaking SignalData structure 0x7b080016f600 after lost signal to thread 12463
I20260709 12:16:52.359016 11701 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:16:52.360102 11756 debug-util.cc:398] Leaking SignalData structure 0x7b08001f39c0 after lost signal to thread 12464
I20260709 12:16:52.358700 11805 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:52.361068 12762 raft_consensus.cc:2804] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.361429 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.359489 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.362955 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.363426 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.364989 11809 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:52.362187 11805 raft_consensus.cc:2468] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:52.366156 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.366333 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.366958 11733 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:52.359655 12429 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:52.368028 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.368468 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.369094 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.369705 11733 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:52.339748 12789 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.372291 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.373642 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.373353 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.374392 11803 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:52.374330 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.375475 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.369853 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.376173 11660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:34102
I20260709 12:16:52.376715 11660 raft_consensus.cc:606] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.377290 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.378449  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:16:52.379844 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.380251  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:52.381064  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:52.381150 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.361485 12762 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.382005 12762 raft_consensus.cc:3060] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.382521 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.363967 12763 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.384004 12763 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.385332 11701 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:52.386116 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.387717 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.387228 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.389102 11803 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:52.390062 11698 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.390957 12767 raft_consensus.cc:2804] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.391364 12767 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.391799 12767 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.392452 11698 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.388553 12785 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.388370 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.393069 12785 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.393579 12799 raft_consensus.cc:2804] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:52.394274 12799 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.394742 12799 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:52.381938 12432 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:52.395828 11698 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.386603 12763 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.394151 12785 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.396960 12797 raft_consensus.cc:2804] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.397385 12791 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.397965 12791 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.397370 12797 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.398712 12797 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.399998 12791 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.406082 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.407497 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.407745 11800 raft_consensus.cc:1275] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:52.408087 11698 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.409395 12798 raft_consensus.cc:2804] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.409730 12798 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.410118 12798 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.405855 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.410248 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.414459 12797 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.418529 11698 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.419991 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.422601 12767 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.422914 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.423861 12773 raft_consensus.cc:2804] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.424278 12773 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.424518 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.425282 11806 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:52.425825 11698 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.424907 12798 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.416834 12789 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.424669 12773 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.428715 12804 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.426863 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.430115 12793 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:52.430773 12760 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.431202 12770 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.433185 12793 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.433876 12793 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:52.433355 12760 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.434374 11803 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.435801 12760 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.436390 12760 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.436854 12760 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.429435 12798 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.433430 12770 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.439272 12770 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.437160 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:52.440078 12436 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.441430 12760 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.441921 12804 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.442128 12785 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.444092 12804 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.445029 12785 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.447956 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:52.448555 12434 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.448786 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.449942 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.450060 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.451088 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.451654 11809 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:52.416957 12797 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.452674 12806 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.453193 12806 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.454221 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.454912 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.455654 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.455996 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.458803 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.459481 12799 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.447413 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.460212 12806 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.460743 12429 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:52.461835 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.461803 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.462502 11701 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:52.464941 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.465077 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.466042 12806 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.466463 12806 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.466826 12806 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.466912 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.468700 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.468947 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.470533 12765 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.472719 12765 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.473699 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.474133 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:52.474099 12434 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:52.475543 12437 raft_consensus.cc:1240] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:52.473544 12806 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.475541 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.478552 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.431191 12789 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.479812 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.477191 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.478735 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.481079 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:52.481969 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.482117 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.476559 11803 raft_consensus.cc:2468] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:52.483893 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.484788 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.485244 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.484055 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.424723 12767 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.392637 12762 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.486910 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.487203 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.487751 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.476197 12793 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.488662 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.489266 11660 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:52.490406 11803 raft_consensus.cc:1240] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:52.488344 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.496752 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.477849 12806 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.498255 11732 raft_consensus.cc:1240] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:52.498670 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.499696 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.500053 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.500166 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.500644 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.495803 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.501554 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.502079 11735 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:52.502771 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.500296 11660 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:52.503396 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.500761 11729 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:52.503882 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.504347 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.505052 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.500314 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.506235 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.504155 11733 raft_consensus.cc:2393] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 2: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:52.507581 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.508104 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.508723 11731 raft_consensus.cc:2468] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:52.508941 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.509625 11728 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:52.510694 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.511524 11727 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 4: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:52.511725 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.512425 11729 raft_consensus.cc:2393] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:52.512857 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.516745 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.505368 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.519513 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.519533 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.519651 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.492475 11701 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:52.462419 12799 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.522854 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.524781 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.525415 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.526587 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.526973 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.527264 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.527596 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.520555 11654 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:52.528714 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.526495 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.529464 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.529978 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.543422 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.543659 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.543979 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.529282 12793 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.548655 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.549393 12386 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.550220 12791 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.550622 12791 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.550989 12791 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.530086 12806 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:52.531071 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.521211 11773 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.556139 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.556680 12806 raft_consensus.cc:697] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:52.557042 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.491701 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.535292 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.536377 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.529333 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.557629 12806 consensus_queue.cc:237] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.542302 12779 consensus_queue.cc:1048] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:52.542438 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.561957 12801 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.562350 12801 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.554364 12386 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.554586 11732 raft_consensus.cc:1240] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:52.541450 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:52.564601 11773 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.562716 12801 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.555272 11624 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.565809 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.566975 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.568039 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.568794 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.569370 12787 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:52.569792 12787 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.570030 12779 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.570447 12779 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.568794 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:52.571857 12779 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.573046 11773 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.573935 12805 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.569816 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.575256 12787 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:52.580021 12805 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.580623 12805 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:52.535763 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 104041us
I20260709 12:16:52.564929 12762 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.582947 11698 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.535854 12773 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.582820 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:52.584520 11775 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:52.585410 12773 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.586057 12730 raft_consensus.cc:2804] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.586517 12730 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.586921 12730 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.588292 12787 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.575543 12436 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:52.589453 12434 raft_consensus.cc:1240] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:52.590085 11698 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.591182 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.591305 12763 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.591514 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:52.591753 12763 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.592185 12763 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.592177 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.589452 12762 raft_consensus.cc:2804] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.593061 12762 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.593447 12762 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.594754 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.595732 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.596073 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.598666 11730 raft_consensus.cc:1240] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:52.599330 11698 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.599911 11775 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:52.600005 11698 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.600661 11701 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:52.600867 12770 raft_consensus.cc:2749] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.601158 11727 raft_consensus.cc:1240] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:52.601620 12808 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.602074 12808 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.602443 12808 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.602891 12793 raft_consensus.cc:2804] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:52.603659 12793 raft_consensus.cc:697] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:52.604636 12793 consensus_queue.cc:237] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.607781 11775 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:52.599417 11773 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.611958 11698 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.612547 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.614099 11627 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.614307 11773 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.614991 11775 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.615435 11698 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.616734 12387 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.616792 11698 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.615476 12764 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.579627 12801 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.618444 11627 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.620172 11698 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.618782 12387 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:52.625438 12387 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.627171 11627 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.614758 12769 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.623044 12759 raft_consensus.cc:2804] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.633281 12387 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.618124 12799 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.628438 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.622290 12794 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:52.635785 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.636909 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:52.623514 12789 raft_consensus.cc:2749] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:52.637662 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.639844 11627 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.638334 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.618055 12790 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:52.622213 12767 raft_consensus.cc:2749] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:52.624557 12786 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.605495 12791 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.642375 11806 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:52.638585 12658 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.646294 12658 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.646665 12658 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.639921 12780 raft_consensus.cc:2804] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.639274 12799 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.633953 12769 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.648320 12799 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.623382 12764 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:52.643123 12387 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:52.628894 12768 raft_consensus.cc:2749] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:52.626042 12766 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.642892 12790 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.650180 12766 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.642526 12796 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.650658 12766 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.650296 12790 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:52.651129 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.649972 12764 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.654451 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.643471 12786 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.638998 12759 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.655349 12759 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.656213 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.657714 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.659263 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.650774 12769 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.645545 12802 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.662034 12786 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.647925 12780 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:52.662909 12780 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.666484 11806 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:52.666752 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.669543 11698 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.671305 11698 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.642567 12776 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.677677 12387 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.690479 11627 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.632337 12773 raft_consensus.cc:2804] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:52.684041 11698 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.672334 12761 raft_consensus.cc:2804] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:52.700104 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.700551 12761 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:52.700970 12761 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.701443 12791 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.693647 12766 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.697440 12387 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.699075 11728 raft_consensus.cc:1240] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:52.693981 12768 consensus_queue.cc:1059] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:16:52.641115 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.672636 12789 raft_consensus.cc:2749] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.706786 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.709077 11698 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:52.694062 12662 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.675997 12797 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:52.718291 12434 raft_consensus.cc:1240] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:52.719393 12766 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.720213 12730 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.661690 12808 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.723501 12763 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.724308 12808 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.725103 12767 raft_consensus.cc:2804] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:52.710762 12770 raft_consensus.cc:2749] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:52.722380 12730 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.708176 12771 raft_consensus.cc:2749] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.730348 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.727249 11806 raft_consensus.cc:1240] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:52.687929 12779 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.725669 12795 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:52.725611 12763 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.737301 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.694111 12790 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.738554 12765 consensus_queue.cc:1059] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:52.739470 12790 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.739651 12765 raft_consensus.cc:3055] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:52.740175 12765 raft_consensus.cc:740] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:52.735829 12767 raft_consensus.cc:697] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:52.736289 11698 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.741039 12765 consensus_queue.cc:260] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.742928 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.743693 12765 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.727336 12773 raft_consensus.cc:697] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:52.745142 12387 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.741417 12767 consensus_queue.cc:237] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.745941 12773 consensus_queue.cc:237] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.746410 12801 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:52.742040 12785 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.741825 12807 raft_consensus.cc:2804] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.747303 12807 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:52.747807 12799 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.748939 12764 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.747697 12807 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.750464 12774 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.749445 12759 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.751951 12387 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.756929 12762 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.760813 12774 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.761649 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.771611 12786 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.762007 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.773015 12791 consensus_queue.cc:1059] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:52.773296 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.769274 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.769580 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.763785 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.774528 11730 raft_consensus.cc:1240] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:52.782722 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.782796 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.783895 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.784770 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.775688 12387 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:52.769906 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.764988 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.827370 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.830071 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.831653 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.785647 12771 raft_consensus.cc:3055] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:52.832134 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.832883 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.828547 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.833436 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.827790 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.834510 12658 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.835016 12774 raft_consensus.cc:2749] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:52.830189 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 63324.4us
I20260709 12:16:52.836102 11625 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.826680 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.828190 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.837538 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:16:52.836318 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 60699.7us
I20260709 12:16:52.832609 12771 raft_consensus.cc:740] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:52.838368 12759 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.838598 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.838687 12771 consensus_queue.cc:260] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.839129 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.839811 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.839932 12771 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:52.829599 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.828263 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.757118 12805 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.843123 12775 raft_consensus.cc:3055] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:52.843519 12775 raft_consensus.cc:740] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:52.843148 12805 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.836670 12658 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.845136 11657 raft_consensus.cc:1240] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:52.844830 12775 consensus_queue.cc:260] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.832350 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.847430 12794 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:52.847710 12767 consensus_queue.cc:1059] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:52.847929 12796 consensus_queue.cc:1059] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:52.848975 12794 raft_consensus.cc:3055] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:52.849318 12794 raft_consensus.cc:740] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:52.847546 11625 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.850539 12785 raft_consensus.cc:3055] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:52.850144 12794 consensus_queue.cc:260] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.850936 12785 raft_consensus.cc:740] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:52.851258 11625 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.851606 12794 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.850025 12799 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.851840 12796 raft_consensus.cc:2749] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:52.853245 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 70882.2us
I20260709 12:16:52.793744 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:16:52.788089 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 78023us
I20260709 12:16:52.792214 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:52.855757 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:52.856437 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.854990 12387 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.790592 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.844755 12779 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:52.851679 12785 consensus_queue.cc:260] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:52.860494 12785 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.861810 11625 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.862663 12775 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.862963 11625 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.863729 12795 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:52.864384 12795 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.864996 12795 raft_consensus.cc:2749] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.866166 11625 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.866999 12796 raft_consensus.cc:2749] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.867413 11730 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 2: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:52.763451 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.868489 12807 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:52.767483 12769 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.870276 12805 raft_consensus.cc:2749] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:52.871572 12786 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.868139 11625 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.873663 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:16:52.874296 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 262146us
I20260709 12:16:52.857528 11734 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:52.875355 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.871754 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:52.891873 11775 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.896981 11775 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.888314 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.857102 11627 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.905978 12759 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:52.906782 12759 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:52.907105 11775 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.881085 11625 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.753732 12780 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:52.765869 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:52.766119 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.763638 11727 raft_consensus.cc:1240] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:52.765419 11731 raft_consensus.cc:1240] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:52.947646 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 324876us
I20260709 12:16:52.954468 11699 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.913112 11775 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.913945 11735 raft_consensus.cc:1240] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:52.916947 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
W20260709 12:16:52.927600 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 46592.4us
I20260709 12:16:52.765588 12762 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.912531 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.757150 12787 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:16:52.912046 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:52.768967 12764 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.971132 11661 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:52.931770 11701 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.969830 11734 raft_consensus.cc:1240] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:52.907851 12779 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.905587 12794 raft_consensus.cc:2749] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.889034 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.888211 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.970139 11773 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:52.976593 11773 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.976634 11625 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.977072 12788 consensus_queue.cc:1059] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:52.774492 12761 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:52.937083 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:52.929857 12795 raft_consensus.cc:2749] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:52.875385 12807 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.944852 12769 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:52.928503 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.928088 12759 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.930271 12796 raft_consensus.cc:993] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
W20260709 12:16:52.972162 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 59116.1us
W20260709 12:16:52.972690 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:52.970348 12785 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:52.977327 12784 consensus_queue.cc:1059] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:16:52.979698 11773 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:52.974805 12808 raft_consensus.cc:2749] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:53.005496 12781 raft_consensus.cc:1081] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:16:53.007737 12787 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.007938 12780 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.991360 12779 raft_consensus.cc:2749] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.011988 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:52.980187 11699 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.014568 11699 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.014948 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:53.015957 12767 raft_consensus.cc:2749] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.016153 11699 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.017167 12767 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.017581 12808 raft_consensus.cc:2749] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:52.981438 11701 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:52.972477 12790 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:52.985204 11730 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:53.019650 12785 raft_consensus.cc:2749] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:52.982005 12814 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:53.019284 12429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57346
I20260709 12:16:53.021701 12814 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:53.019683 12761 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:53.022137 12794 raft_consensus.cc:3055] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:53.022660 12790 consensus_queue.cc:1059] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:53.015869 12768 raft_consensus.cc:3055] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:53.023429 12768 raft_consensus.cc:740] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:53.023707 12790 raft_consensus.cc:3055] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:53.024088 12790 raft_consensus.cc:740] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:53.022893 12794 raft_consensus.cc:740] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:53.024408 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:53.024859 12790 consensus_queue.cc:260] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:53.025219 12794 consensus_queue.cc:260] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:53.025625 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:53.022684 12429 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:53.031347 12431 raft_consensus.cc:1240] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.031508 12429 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.022218 12814 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.026324 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:53.026234 12790 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.033849 12794 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.039309 12814 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:53.039682 12429 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:53.017751 11699 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.027661 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:53.041213 12773 raft_consensus.cc:2749] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:53.029678 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:53.022367 11773 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:53.042220 12814 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:52.983588 11625 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.042848 11773 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:16:53.043586 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 60065.2us
I20260709 12:16:53.044154 11625 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.024276 12768 consensus_queue.cc:260] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:53.028311 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:53.045141 12775 raft_consensus.cc:2749] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.046017 11806 raft_consensus.cc:1240] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:53.046507 12768 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.044229 12769 raft_consensus.cc:2804] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:53.047468 12769 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:53.044574 11773 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:53.044708 12759 raft_consensus.cc:2804] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:52.978785 12764 raft_consensus.cc:2749] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:53.047896 12769 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.048448 12814 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:53.048815 11773 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:53.049000 12814 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:53.049549 12814 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.049695 12764 raft_consensus.cc:2749] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.050276 11773 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.050454 12775 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:53.051347 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:53.052021 12803 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.052148 11773 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:53.052431 12803 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:53.052798 12803 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.053251 11773 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.057147 12814 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:53.041668 11699 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.058035 12815 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.058437 12815 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:53.058751 12815 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.059206 12814 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:53.059358 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:53.060385 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:53.060684 11803 raft_consensus.cc:1240] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:53.060765 11802 raft_consensus.cc:1240] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:53.061112 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:53.062371 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:53.063964 11803 raft_consensus.cc:1240] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:53.064884 12808 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.064944 11699 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.065824 12808 raft_consensus.cc:2749] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.066144 12771 consensus_queue.cc:1059] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:53.067162 12786 raft_consensus.cc:3055] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:53.068583 12786 raft_consensus.cc:740] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:53.069253 12786 consensus_queue.cc:260] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:53.070132 12386 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.070426 12786 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:53.072007 12813 raft_consensus.cc:2749] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:53.073545 12771 consensus_queue.cc:1059] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:53.074599 12813 raft_consensus.cc:3055] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:53.074934 12813 raft_consensus.cc:740] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:53.067113 11699 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.075680 12813 consensus_queue.cc:260] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:53.076243 12759 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:53.077044 12759 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.077248 12814 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:53.077610 12773 raft_consensus.cc:2749] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:53.078764 12761 consensus_queue.cc:1059] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:53.079646 12658 raft_consensus.cc:3055] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:53.079977 12658 raft_consensus.cc:740] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:53.051882 12764 raft_consensus.cc:2804] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:53.080659 12764 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:53.080785 12658 consensus_queue.cc:260] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:53.081951 12658 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.082307 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:53.075081 11773 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.081972 12813 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.084056 12787 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:53.086541 12437 raft_consensus.cc:1275] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:53.086982 11624 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.083798 12803 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:53.088542 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:53.088773 12775 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:53.088472 11624 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.088735 12764 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.088809 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:53.090500 11624 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.090816 12790 consensus_queue.cc:1059] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:53.091178 12784 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.091995 12787 raft_consensus.cc:3055] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:53.092396 12787 raft_consensus.cc:740] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:53.093169 12787 consensus_queue.cc:260] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:53.091858 12784 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.094534 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:53.095393 11653 raft_consensus.cc:2393] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:53.095158 12815 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:53.097376 12815 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:53.089438 12773 consensus_queue.cc:1048] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:16:53.098244 12787 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.100054 12803 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:53.102404 12434 raft_consensus.cc:1240] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:53.103932 12784 consensus_queue.cc:1059] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:53.104854 12784 raft_consensus.cc:3055] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:53.105207 12784 raft_consensus.cc:740] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:53.106091 12784 consensus_queue.cc:260] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:53.104966 11730 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:53.107015 12784 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.110769 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:53.111168 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:53.112241 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:53.112600 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:53.112900 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:53.116465 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:53.117162 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:53.120251 11661 raft_consensus.cc:1240] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.123409 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:53.128489 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:53.131377 11800 raft_consensus.cc:1240] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:53.129606 11806 raft_consensus.cc:1240] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:16:53.133163 12386 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.137845 11808 raft_consensus.cc:1240] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.139119 11805 raft_consensus.cc:1240] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:53.140208 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:53.143071 11807 raft_consensus.cc:1240] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.143539 12764 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:53.144045 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:53.077044 11699 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.146481 11809 raft_consensus.cc:2393] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
W20260709 12:16:53.147675 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 70703.9us
I20260709 12:16:53.133325 12759 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:53.148437 12808 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:53.149503 12436 raft_consensus.cc:1240] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.149953 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:53.149492 12429 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:53.150520 11661 raft_consensus.cc:3055] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:53.150940 11661 raft_consensus.cc:740] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:53.152431 12761 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.154758 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:53.156044 12759 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:53.157047 11661 consensus_queue.cc:260] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:53.158285 11773 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.159511 11804 raft_consensus.cc:1240] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.160017 11773 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:53.161011 12815 raft_consensus.cc:2749] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:53.161283 12787 raft_consensus.cc:2749] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.162518 11773 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.163190 12790 raft_consensus.cc:2749] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.165480 11773 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.167160 12790 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:53.153290 12386 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.153685 11809 raft_consensus.cc:1275] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:53.168469 11773 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.169919 12759 raft_consensus.cc:2749] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:53.170604 12658 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:53.171185 11773 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.172101 12759 raft_consensus.cc:2749] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.173045 12386 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:53.173929 12761 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.174985 12430 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:53.175246 12761 consensus_queue.cc:1059] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:53.176307 12658 raft_consensus.cc:3055] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:53.176644 12658 raft_consensus.cc:740] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:53.176949 11803 raft_consensus.cc:1240] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.177436 12658 consensus_queue.cc:260] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:53.177920 11773 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:53.178615 12658 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:53.178999 11773 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.179689 12787 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:53.180135 12787 raft_consensus.cc:697] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:53.180418 12759 raft_consensus.cc:2749] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:53.180963 12787 consensus_queue.cc:237] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:53.182360 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:53.183197 11803 raft_consensus.cc:2393] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 2: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:53.184780 12790 consensus_queue.cc:1059] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:53.185775 12790 raft_consensus.cc:3055] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:53.186110 12790 raft_consensus.cc:740] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:53.186470 11773 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:53.187326 12815 raft_consensus.cc:2749] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:53.186854 12790 consensus_queue.cc:260] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:53.187602 12769 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:53.187987 11773 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:53.188771 12803 raft_consensus.cc:2749] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:53.188271 12790 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.192785 12814 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:16:53.498953 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:53.500639  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:53.189692 12769 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:53.843369 12764 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:16:53.845811 12818 log.cc:927] Time spent T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 12:16:53.846412 12790 consensus_meta.cc:287] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.000s
I20260709 12:16:54.326368 12437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57338 (request call id 532) took 1226 ms. Trace:
I20260709 12:16:54.327032 12437 rpcz_store.cc:276] 0709 12:16:53.099540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.099695 (+   155us) service_pool.cc:224] Handling call
0709 12:16:53.100045 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:53.100429 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:53.100464 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:53.100945 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:16:53.158738 (+ 57793us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:53.160654 (+  1916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:53.160829 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:54.326011 (+1165182us) raft_consensus.cc:1685] finished
0709 12:16:54.326041 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:54.326255 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1203,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":1872,"thread_start_us":44553,"threads_started":1,"wal-append.queue_time_us":530840}
W20260709 12:16:54.758463 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:54.758927 11625 connection.cc:256] RPC call timeout handler was delayed by -1.035591777000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 12:16:54.759348 11625 connection.cc:256] RPC call timeout handler was delayed by -1.0154879720000736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
I20260709 12:16:54.760901 12768 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:54.761503 12768 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:54.763564 12768 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:54.764032 12768 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:54.764472 12768 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:16:53.607538 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.760283 12794 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:54.768045 12794 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:54.765992 12796 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.770932 12796 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:54.773200 12796 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:54.776137 12768 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:54.770133 12794 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:16:54.802438 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:54.758728 11775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.990937 12794 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:54.991652 12794 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:54.994040 12794 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.058969 12794 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:55.059732 12794 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.061916 12794 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:16:55.073619 11625 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.67:40145 timed out after 1.597s (SENT) [suppressed 55 similar messages]
I20260709 12:16:55.133713 11699 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:55.135613 11699 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:55.151932 12820 raft_consensus.cc:2749] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.152738 12820 raft_consensus.cc:2749] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:16:55.125536 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:55.163470 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 1.97367e+06us
I20260709 12:16:55.163446 12794 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.165220 12794 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.167415 12794 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.167820 12815 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.167960 12759 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.168394 12815 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.169201 12769 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.169713 12769 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:16:55.170063 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 96487.6us
I20260709 12:16:55.170486 12815 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.171005 12815 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.171397 12815 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.171703 12769 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.171937 12823 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.172153 12824 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.173002 12824 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.175068 12824 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.175592 12823 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.169834 12794 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:55.172423 12787 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.171639 12819 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.177130 12787 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.177284 12819 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.179158 12787 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.179385 12819 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.169724 12796 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:55.180069 12796 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.176666 12794 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.173460 12815 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.168455 12759 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.182698 12794 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.183389 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:55.183722 12759 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.182216 12796 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.184296 11730 raft_consensus.cc:1240] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:55.172231 12769 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.184736 12796 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:55.184787 11727 raft_consensus.cc:2393] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 2: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:55.185791 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:55.186165 12796 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.186661 11734 raft_consensus.cc:2393] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:55.187014 11730 raft_consensus.cc:1240] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:55.188177 12796 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.188383 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:55.188716 12796 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.189257 11727 raft_consensus.cc:2393] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:55.189193 12796 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.185513 12769 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.198297 12769 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.200182 12796 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.199903 11484 catalog_manager.cc:5697] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 2 to 3, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 3 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:55.203078 12814 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.203680 12814 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.181967 12823 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.205896 12763 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.206475 11730 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:55.206416 12763 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.208477 12763 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.208937 12763 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.209362 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.209321 12763 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.210454 11730 raft_consensus.cc:2393] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:55.211486 12763 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.205718 12814 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.213065 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.214039 12814 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:55.214568 12814 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.191093 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:55.191918 12815 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.192318 12787 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.192427 12759 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.192962 12764 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.193866 12803 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.194360 12828 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.190420 12820 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.221657 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:16:55.228772 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 1.72353e+06us
W20260709 12:16:55.220592 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 85057.7us
W20260709 12:16:55.285842 12434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57354 (request call id 487) took 1842 ms (client timeout 1730 ms). Trace:
I20260709 12:16:55.225993 12769 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.290017 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.293047 11730 raft_consensus.cc:2393] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:55.276696 12819 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.224961 12763 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:55.276877 12823 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.229774 12827 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:55.288249 12434 rpcz_store.cc:269] 0709 12:16:53.434648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.434780 (+   132us) service_pool.cc:224] Handling call
0709 12:16:55.221497 (+1786717us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b5800004598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:16:55.276738 (+ 55241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308480}
I20260709 12:16:55.290095 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.278474 12822 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.282574 12824 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.298761 12827 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.298766 11727 raft_consensus.cc:2393] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:55.300679 12800 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.297894 12763 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.301265 12800 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.279866 12815 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:55.297422 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.291342 12786 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.279798 12820 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.279728 12787 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.280169 12803 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.296769 12658 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.294739 12776 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.283066 12759 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.318801 12796 consensus_queue.cc:1059] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:16:55.296495 12819 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.279619 12828 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.299068 12823 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.321198 12763 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.321682 12658 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.322275 12820 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.321655 12827 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.289915 12826 consensus_queue.cc:1059] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:16:55.283245 12764 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.325992 12776 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.296270 12769 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.300175 12824 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.304641 12790 consensus_queue.cc:1059] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:16:55.314942 12786 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.310624 12822 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.319177 12794 consensus_queue.cc:1059] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:16:55.321655 12800 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.322849 12814 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.352067 12800 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:55.355082 12796 consensus_queue.cc:1243] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer 264376c764c64dc78c4cef6031c15eef log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:16:55.354863 12800 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.335410 12819 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.335427 12658 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.336726 12787 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.343765 12824 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:16:55.346043 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:55.330617 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 90162.1us
I20260709 12:16:55.359414 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.359968 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.360597 12658 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.361106 12658 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.353209 12834 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.362105 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.362598 12834 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.363263 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.363793 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.318197 12835 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.364841 12658 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.372174 12825 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.351279 12763 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.337370 12764 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.342103 12803 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.339028 12776 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.338357 12429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57354 (request call id 488) took 1903 ms. Trace:
I20260709 12:16:55.356516 12838 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.347910 12786 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.384975 12835 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:55.340504 12430 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57354 (request call id 484) took 2259 ms (client timeout 2172 ms). Trace:
W20260709 12:16:55.400331 12430 rpcz_store.cc:269] 0709 12:16:53.081471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.082062 (+   591us) service_pool.cc:224] Handling call
0709 12:16:55.340219 (+2258157us) spinlock_profiling.cc:243] Waited 83.2 ms on lock 0x7b540000c3d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:16:55.340380 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191373184}
I20260709 12:16:55.340773 12769 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.349261 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:55.393695 12763 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.401731 11726 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.387575 12825 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.403671 12763 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.404052 12825 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.327337 12829 consensus_queue.cc:1059] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:16:55.404659 12759 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.345547 12815 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.345947 12771 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.381927 12787 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.387003 12814 raft_consensus.cc:3055] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.399529 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:16:55.437083 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 75381.1us
I20260709 12:16:55.349903 12822 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.407900 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.438663 12839 consensus_queue.cc:1059] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:55.384225 12658 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.439890 12658 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.430158 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.442061 12431 raft_consensus.cc:2393] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:55.430719 12814 raft_consensus.cc:740] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:55.432546 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.443305 12814 consensus_queue.cc:260] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.444576 12814 raft_consensus.cc:3060] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.400166 12823 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:16:55.429826 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 45012us
I20260709 12:16:55.407143 12776 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.397399 12790 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.447232 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.453600 12434 raft_consensus.cc:2410] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:55.431008 12771 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.454425 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.454977 12434 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:55.455390 12771 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.455972 12771 consensus_queue.cc:1059] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:55.401923 12835 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.456954 12434 raft_consensus.cc:1240] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:55.458139 12835 raft_consensus.cc:3055] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:55.458452 12835 raft_consensus.cc:740] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:55.459125 12835 consensus_queue.cc:260] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.459925 12835 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.401374 12828 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.409150 12833 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:55.436213 12786 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.467299 11735 raft_consensus.cc:1240] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:55.447435 12800 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.446542 12844 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.468747 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.469713 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.471669 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.472260 11735 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:16:55.470554 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:55.472522 11775 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:55.474877 11733 raft_consensus.cc:2393] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:55.474949 11730 raft_consensus.cc:1240] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:55.467782 12828 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:55.463649 12823 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.436713 12787 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.483413 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.474246 12820 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.478047 12828 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.484990 12820 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.486573 12828 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.463845 12776 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.486932 12834 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.478760 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.488076 11800 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:55.488593 12776 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.480715 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.490187 12851 raft_consensus.cc:3055] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.490600 12851 raft_consensus.cc:740] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:55.491362 12826 raft_consensus.cc:3055] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.409265 12838 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.491750 12826 raft_consensus.cc:740] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:55.491978 12850 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:55.492486 12850 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.492765 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.493391 12435 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:16:55.489109 11726 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:55.494329 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.463001 12825 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:16:55.494899 12435 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:55.474412 12844 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.495857 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.496788 12435 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:55.479339 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.478047 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.499313 11808 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:16:55.499420 12386 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:55.494592 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:55.501899 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.503708 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.504444 11735 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:55.468427 12833 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.506512 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.506770 11809 raft_consensus.cc:1240] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:55.494607 11728 raft_consensus.cc:1240] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:55.507792 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.508497 12843 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:55.491412 12851 consensus_queue.cc:260] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.509011 12843 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.479573 12823 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.529327 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.571786 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.623164 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.525907 11806 raft_consensus.cc:2393] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 2: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
W20260709 12:16:55.622306 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.396574 12429 rpcz_store.cc:276] 0709 12:16:53.434933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.451777 (+ 16844us) service_pool.cc:224] Handling call
0709 12:16:53.606224 (+154447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:53.612201 (+  5977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:53.613812 (+  1611us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:53.616327 (+  2515us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:53.629861 (+ 13534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:53.633536 (+  3675us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:55.338263 (+1704727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:55.509989 12829 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:55.513346 12852 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.479489 11803 raft_consensus.cc:1240] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:55.478729 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.476655 12848 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.494567 12850 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.478310 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.479041 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.641001 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.642141 11652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
mode: GRACEFUL
new_leader_uuid: "264376c764c64dc78c4cef6031c15eef"
 from {username='slave'} at 127.0.0.1:34102
I20260709 12:16:55.512252 12838 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.629344 12829 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.645746 12819 consensus_queue.cc:1059] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:55.646473 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.647221 11809 raft_consensus.cc:2468] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:55.479081 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.478976 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.624637 11808 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:55.514883 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.512892 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.535406 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.637001 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.637149 12851 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.665416 12823 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.665993 12857 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.666364 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.666503 12857 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.666968 11809 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:55.668640 12857 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.521464 12842 consensus_queue.cc:1059] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 12:16:55.670589 12842 raft_consensus.cc:3055] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.670931 12842 raft_consensus.cc:740] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:55.671700 12842 consensus_queue.cc:260] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.673102 12842 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.676353 12796 raft_consensus.cc:3055] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:55.676759 12796 raft_consensus.cc:740] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:55.639142 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.679505 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.680569 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.681195 11735 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:16:55.642437 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.489128 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.637332 12843 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.637503 12848 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.687274 11800 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:55.687431 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.649896 11801 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:55.548703 12826 consensus_queue.cc:260] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.497663 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.691377 12428 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:55.691810 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.692591 12435 raft_consensus.cc:2393] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:55.508250 12813 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:55.693084 12813 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.693473 12813 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.695117 11661 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.695489 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.692286 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.701532 12838 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:55.702203 12838 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.704137 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.704452 12838 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.705026 12838 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:55.705684 12853 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.705440 12838 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.706228 12853 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.707405 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.708163 12838 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.708336 12853 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.709581 12835 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.688414 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.710444 12436 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:55.653455 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.710908 12838 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:55.711489 12838 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.711721 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.712342 11733 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:16:55.713224 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.487041 12820 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.713608 12856 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:55.509197 11654 raft_consensus.cc:3055] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:55.714186 11654 raft_consensus.cc:740] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:55.714706 12838 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.515560 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.658006 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.717533 11701 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:55.651338 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.661157 12832 raft_consensus.cc:3055] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.718420 12853 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:55.718608 12832 raft_consensus.cc:740] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:55.708657 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.718633 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.719684 12832 consensus_queue.cc:260] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.720214 11732 raft_consensus.cc:2393] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:55.720952 12832 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.721267 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.722380 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.718890 12853 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.723433 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.663166 11802 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:16:55.724943 12853 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.660034 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.682622 11625 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:55.631698 12852 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.683209 12784 consensus_queue.cc:1059] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:55.724711 11732 raft_consensus.cc:1240] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:55.726711 12784 raft_consensus.cc:2804] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:55.727087 12784 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.727396 12852 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.677531 12796 consensus_queue.cc:260] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.687784 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.688845 12848 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.685992 12658 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.648342 12829 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.497603 12844 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:16:55.608508 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 104932us
I20260709 12:16:55.729082 11775 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:55.725962 11806 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:16:55.730136 11775 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:55.714951 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.731047 12435 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:55.731731 11775 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:55.732201 11701 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:55.732441 12831 raft_consensus.cc:2749] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:55.732944 12848 raft_consensus.cc:2804] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:55.733088 12831 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:55.733340 12848 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.733512 12831 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.733775 12848 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.734489 12847 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:55.715024 11654 consensus_queue.cc:260] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.710216 12835 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.717118 12854 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.735805 12854 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.736977 12835 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.737612 12831 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.738019 12854 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.738862 12431 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
W20260709 12:16:55.726029 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 43493.9us
I20260709 12:16:55.742074 11625 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:55.742794 12851 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:55.743151 12851 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.734890 12847 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.743920 12847 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:55.743492 12851 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.746119 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.746770 12430 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:55.727427 12784 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:55.714205 12856 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.715085 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:55.464409 12790 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.735277 11654 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:55.753423 11733 raft_consensus.cc:2393] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:55.727648 12828 raft_consensus.cc:3055] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:55.638325 12437 raft_consensus.cc:2468] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:55.753975 12828 raft_consensus.cc:740] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:55.754623 12790 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.754976 11701 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:55.469815 12786 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.755703 12820 raft_consensus.cc:2804] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:55.756073 12820 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.754848 12828 consensus_queue.cc:260] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.756619 12820 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.757259 12828 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.735304 11775 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:55.759316 11775 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:55.759750 11654 raft_consensus.cc:1275] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:55.760124 11775 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:16:55.760537 12840 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:16:55.760947 11652 raft_consensus.cc:606] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Received request to transfer leadership to TS 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:55.761343 11652 raft_consensus.cc:614] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:55.762555 12759 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:55.762835 11775 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:55.763764 12815 raft_consensus.cc:2749] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:55.764401 11775 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:55.479537 12763 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:55.765377 12790 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.763088 12769 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:55.765827 12763 raft_consensus.cc:697] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:55.767421 12763 consensus_queue.cc:237] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.769290 12786 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.766201 12815 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:55.770117 12815 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.770478 12815 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.771646 12856 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:55.774391 12759 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.774873 12759 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.775611 12771 raft_consensus.cc:3055] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:55.776015 12771 raft_consensus.cc:740] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:55.777159 12432 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:55.743513 11625 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:55.720110 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.789736 11731 raft_consensus.cc:2393] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:55.753541 11805 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:55.798171 12847 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.800266 12847 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.765194 11775 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:55.766059 12769 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:55.801234 11775 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:55.801472 12769 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.782979 12848 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.783797 12851 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:55.790704 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 47235.6us
I20260709 12:16:55.810710 11625 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:55.811504 11625 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:55.811565 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.690335 11803 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:55.802235 12386 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:55.814826 12840 raft_consensus.cc:2749] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:55.815110 12386 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.815788 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.816442 11802 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:55.817497 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.818085 12431 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:55.818825 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:55.819171 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.819329 12431 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:55.819499 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.819839 12786 consensus_queue.cc:1059] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:55.820122 11660 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:55.820353 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.820837 12786 raft_consensus.cc:3055] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:55.821059 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.821677 11657 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:55.822127 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.822938 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:55.823945 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.824261 12786 raft_consensus.cc:740] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:55.824551 12828 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:55.824986 12828 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:55.825371 12828 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:55.825555 12786 consensus_queue.cc:260] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.826848 12786 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:55.828545 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.829444 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.829977 12430 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:16:55.471139 12794 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.830622 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.831351 11732 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 2: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:55.831103 12794 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.831761 11733 raft_consensus.cc:1240] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:55.832089 11659 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:55.832113 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.832649 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:55.833681 12790 raft_consensus.cc:2749] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:55.834475 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.821321 11483 catalog_manager.cc:5697] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 3 to 4, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.835366 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.835525 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.835996 11654 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:55.836238 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.836563 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.802700 12814 raft_consensus.cc:2804] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:55.837296 12814 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.837658 12814 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.839202 11659 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:55.835826 11483 catalog_manager.cc:5697] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 3, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:55.776805 12771 consensus_queue.cc:260] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.841388 11483 catalog_manager.cc:5697] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 3, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.842285 12771 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.843041 11483 catalog_manager.cc:5697] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 2, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.845264 11773 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:55.803637 12437 raft_consensus.cc:1275] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:55.757205 12813 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.769747 12787 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.807799 11661 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:55.812160 11806 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:16:55.812400 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.813297 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.813534 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.813599 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.813939 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:55.836663 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:16:55.845230 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 340164us
I20260709 12:16:55.802443 12429 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:55.833302 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.858548 11657 raft_consensus.cc:2376] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2. Re-sending same reply.
I20260709 12:16:55.837679 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.833218 11733 raft_consensus.cc:2376] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3. Re-sending same reply.
I20260709 12:16:55.829326 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.850136 12431 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:16:55.847070 12386 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:55.864987 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.865418 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.865618 11660 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:55.812747 11625 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:55.807438 12768 raft_consensus.cc:2749] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:55.856246 11661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34104 (request call id 87) took 2701 ms (client timeout 1785 ms). Trace:
I20260709 12:16:55.856778 12387 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:55.859126 11773 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:55.861897 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.805507 12784 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:55.789970 12820 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:55.833263 12794 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:16:55.909619 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 44425.5us
I20260709 12:16:55.866541 12386 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:16:55.912505 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 47779.9us
W20260709 12:16:55.911573 11661 rpcz_store.cc:269] 0709 12:16:53.149547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.149702 (+   155us) service_pool.cc:224] Handling call
0709 12:16:55.694911 (+2545209us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b5800151dd0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9a70aa 00007f44fda29447 00007f44fda41fe7 00007f44fda437de 00007f44fda4f27c 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c
0709 12:16:55.850657 (+155746us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350391552}
I20260709 12:16:55.855485 12847 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:55.914117 12386 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:16:55.912554 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 55865.8us
I20260709 12:16:55.912108 11624 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
W20260709 12:16:55.916281 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 103626us
I20260709 12:16:55.917016 11625 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:55.915462 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.918179 11625 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:16:55.918637 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 59596.7us
I20260709 12:16:55.919325 11625 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:55.913245 11701 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:55.860159 12823 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.920624 12386 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:55.864796 12856 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:55.860585 12787 raft_consensus.cc:2749] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:55.868876 12829 consensus_queue.cc:1059] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:16:55.928644 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:55.929258 11734 raft_consensus.cc:2376] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2. Re-sending same reply.
I20260709 12:16:55.929569 12831 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.931432 12848 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.932111 12831 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.923069 12843 raft_consensus.cc:2749] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.914202 12839 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.945354 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.946107 12438 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:16:55.869545 12658 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:55.947227 12658 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.947592 12658 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:55.920445 12857 raft_consensus.cc:2749] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:55.949460 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.949920 12848 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:55.950732 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.951823 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.952739 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.940021 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:55.954012 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.954360 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.955443 12826 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.956231 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:55.909694 11728 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:16:55.930217 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.958595 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.940595 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.959342 11653 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:16:55.959457 12847 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.939008 12796 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.941103 12814 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.916162 12853 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.862716 12819 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.865861 11800 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:55.934139 12859 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:55.952549 12769 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:55.958729 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.996542 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.942852 11773 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:16:56.185722 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 242936us
I20260709 12:16:56.179358 12843 raft_consensus.cc:2749] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.958844 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:55.916476 12800 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.189576 12800 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.189972 12800 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.970676 11729 raft_consensus.cc:1240] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:56.177472 12853 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:55.943243 12813 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.181543 11731 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:55.911298 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:55.868867 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:55.979518 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 55886.9us
I20260709 12:16:56.195096 11624 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:56.196235 11624 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:56.193135 11658 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:56.199532 12856 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.200040 12856 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.202512 12850 consensus_queue.cc:1059] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:56.186317 12658 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.203645 12850 raft_consensus.cc:2749] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.204267 12850 raft_consensus.cc:2804] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.204630 12850 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.204952 12850 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.205051 12658 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.206444 12843 raft_consensus.cc:3055] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:56.206836 12843 raft_consensus.cc:740] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:56.206738 12768 raft_consensus.cc:3055] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:56.207355 12768 raft_consensus.cc:740] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:56.207712 12843 consensus_queue.cc:260] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.208179 12768 consensus_queue.cc:260] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.208959 12843 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.209879 12768 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.211669 11484 catalog_manager.cc:5697] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 2 to 3, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 3 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:55.994295 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 73737us
I20260709 12:16:55.920673 12794 raft_consensus.cc:2749] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:55.999753 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 82997.3us
I20260709 12:16:55.959882 12847 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.218333 12386 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:56.219157 12658 raft_consensus.cc:2804] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.219584 12658 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:56.219937 12658 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.197263 11624 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:55.922222 12828 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:56.222914 11624 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:55.959789 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:56.223996 11624 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:55.932945 12841 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.225075 12841 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:56.225934 12840 raft_consensus.cc:2804] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.226361 12840 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:56.226745 12840 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.227092 12841 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:55.934398 12851 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:56.227914 12851 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.228549 12851 raft_consensus.cc:2749] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.014916 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:56.229285 11734 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:16:55.937227 12833 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:55.932714 12759 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:55.996176 12819 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:56.219264 12386 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:56.230806 12386 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:56.231393 12819 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:16:56.027354 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 164304us
I20260709 12:16:56.232002 12387 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:56.232391 12386 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:56.233124 12387 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:56.234076 12864 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:56.234450 11775 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:56.234649 11726 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:56.236451 12786 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.236985 12786 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:55.962074 12823 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.025903 12858 raft_consensus.cc:2749] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.935508 12846 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:56.044549 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.237023 12776 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.234489 12864 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.239256 12864 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:56.236662 12838 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.240108 12838 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.237511 12786 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.240517 12838 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.242035  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:16:56.243788  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:56.244566  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:56.236634 12787 raft_consensus.cc:2804] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.239367 12823 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:56.223869 12828 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:56.246423 12819 consensus_queue.cc:1048] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:56.246345 12787 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.238528 12776 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.247887 12787 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.246266 12840 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:56.019466 12859 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.997350 12839 raft_consensus.cc:2749] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.247607 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.001425 12771 raft_consensus.cc:2764] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:16:56.086683 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 137188us
I20260709 12:16:56.250324 12840 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:56.250623 11701 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:56.250653 12436 raft_consensus.cc:2393] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 2: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:56.248320 12850 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:56.252241 12819 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:56.252619 12819 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:56.252961 12819 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.045957 12437 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:56.238045 12846 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:16:56.253268 12850 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:56.253702 12846 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.249184 12859 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.256573 12813 raft_consensus.cc:2804] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.257531 12813 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.257929 12813 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.258149 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.258773 12435 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.251127 12776 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.238020 11775 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:56.262781 11775 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:56.263594 11775 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:56.264568 12834 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:56.264528 12859 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.177942 12814 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.273636 12800 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.265358 12833 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:56.227988 12658 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.274758 12833 raft_consensus.cc:697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:56.275368 12846 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.275780 12800 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.276364 12658 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:56.277396 12846 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:56.277930 11773 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:56.278537 12831 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.279481 12859 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:56.275655 12833 consensus_queue.cc:237] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.284009 12787 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:16:56.176110 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:56.288532 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.288846 12819 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.176537 12784 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:56.179497 11808 raft_consensus.cc:2393] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
W20260709 12:16:56.180001 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:56.180608 11699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.300242 12435 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:56.182585 12820 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:56.183704 12769 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:56.303247 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.303334 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.304059 12430 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.304383 12429 raft_consensus.cc:2393] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 2: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:56.305856 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.306748 12429 raft_consensus.cc:2393] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:56.308476 12429 raft_consensus.cc:1275] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:55.924427 12803 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:56.311546 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.303247 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:56.313081 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.313645 12430 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
W20260709 12:16:56.176810 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 257522us
I20260709 12:16:56.188548 12764 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.231412 12759 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.265244 12834 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.265581 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.319389 12834 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:56.265641 12825 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.266713 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.320822 11807 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.270576 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:56.270879 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:56.265072 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.250337 12387 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:56.272431 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:56.273192 12813 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.284009 12864 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.328406 11625 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:56.329471 12784 raft_consensus.cc:2749] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:56.285828 12786 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.287047 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.330160 12429 raft_consensus.cc:2393] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 4: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:56.330421 11801 raft_consensus.cc:2468] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:56.287536 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.178592 12815 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.332787 11698 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:56.291666 11701 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:56.293139 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.225598 11624 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:16:56.335680 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 110146us
I20260709 12:16:56.293951 12787 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:56.238585 12856 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.305603 12776 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.350713 11625 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:56.323367 12764 raft_consensus.cc:697] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:56.295130 11806 raft_consensus.cc:1275] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.357476 11734 raft_consensus.cc:1217] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:16:56.296521 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.297646 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.298094 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:16:56.302551 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:56.366124 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.366073 11809 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:56.334417 12428 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.367241 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:55.996438 11733 raft_consensus.cc:2368] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3.
I20260709 12:16:55.868944 12852 consensus_queue.cc:1059] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 12:16:56.371752 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:56.371969 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.373034 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.373194 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.321718 12432 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:56.374030 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.320001 11800 raft_consensus.cc:2393] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 2: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
W20260709 12:16:56.325192 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 74921.6us
I20260709 12:16:56.326052 11775 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:16:56.378700 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 52761.8us
I20260709 12:16:56.379673 12387 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:56.380460 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.380678 12387 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:56.380975 11809 raft_consensus.cc:2368] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4.
I20260709 12:16:56.327495 11726 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.324786 12434 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:56.331568 12786 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.323137 12825 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.358688 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.331719 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.343415 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.343596 12820 raft_consensus.cc:2804] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.392484 12820 raft_consensus.cc:697] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:56.392139 11483 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42126 (request call id 159) took 1101 ms. Trace:
I20260709 12:16:56.345408 12815 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.385370 12825 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.393466 12820 consensus_queue.cc:237] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.346136 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.346846 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.339252 12784 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.347344 12859 raft_consensus.cc:2804] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.395722 12859 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.396070 11655 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:56.396154 12859 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.343338 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.356561 11807 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:16:56.314916 12838 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.329692 12864 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:56.358009 11734 raft_consensus.cc:1240] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:16:56.326845 12437 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:56.329694 12813 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:56.360073 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:56.404731 11732 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.362016 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:56.362701 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:56.367775 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.370877 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.368955 11806 raft_consensus.cc:2393] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:56.355353 12856 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:56.373775 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:56.374372 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.374883 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:56.413082 11656 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:56.375342 11698 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:56.373978 11653 raft_consensus.cc:2368] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4.
I20260709 12:16:56.397075 11657 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:56.393033 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.599539 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.600530 11657 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:56.376257 11660 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.414247 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:56.339459 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 47874.1us
I20260709 12:16:56.603595 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.542209 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.601722 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:16:56.531617 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 107787us
I20260709 12:16:56.420111 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.570547 11699 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:56.611377 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.612773 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.613111 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.614745 11653 raft_consensus.cc:2410] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:56.605670 11701 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:56.575225 11726 raft_consensus.cc:1275] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.178126 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:56.490073 11731 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.618243 11727 raft_consensus.cc:2376] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2. Re-sending same reply.
I20260709 12:16:56.488184 11732 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:16:56.486213 11775 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:56.618220 11701 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:56.621657 12853 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:16:56.622179 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 135957us
I20260709 12:16:56.622349 11701 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:56.622610 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.623055 12832 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.622421 12853 raft_consensus.cc:697] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:56.623852 12833 raft_consensus.cc:2749] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:56.624790 12386 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:56.409360 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.625420 12853 consensus_queue.cc:237] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:16:56.626502 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 250998us
I20260709 12:16:56.626852 12827 raft_consensus.cc:2804] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.627398 12827 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.627803 12827 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.628463 12824 raft_consensus.cc:2764] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:16:56.399515 11801 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.375510 11805 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:56.402820 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.632180 11807 raft_consensus.cc:2393] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:56.625995 11653 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:56.632771 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.407016 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.320824 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.400503 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.385313 12387 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
W20260709 12:16:56.418386 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.499416 12428 raft_consensus.cc:2468] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:56.381151 12432 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.375376 12438 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 5: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:56.409024 12764 consensus_queue.cc:237] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:56.408538 12776 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.395668 12784 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:56.381644 12787 raft_consensus.cc:2804] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:16:56.587877 12460 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa620 after lost signal to thread 4412
I20260709 12:16:56.359051 12768 consensus_queue.cc:1059] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:16:56.326711 12769 consensus_queue.cc:1048] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:56.386969 12819 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:56.496758 12825 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.382055 12835 raft_consensus.cc:2764] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:16:56.492806 12838 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.397691 12844 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.294541 12847 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.411996 12848 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.409893 12865 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.367488 12823 consensus_queue.cc:1048] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:16:56.394102 11483 rpcz_store.cc:276] 0709 12:16:55.290991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.291109 (+   118us) service_pool.cc:224] Handling call
0709 12:16:56.392048 (+1100939us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:55.991287 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:55.991924 (+   637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:55.991960 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:16:55.991978 (+    18us) tablet.cc:662] Decoding operations
0709 12:16:55.992631 (+   653us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:55.992710 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:55.992738 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:16:55.993153 (+   415us) tablet.cc:701] Row locks acquired
0709 12:16:55.993171 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:16:56.216228 (+223057us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b2c00058028. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fc344a11 00007f44fc353a0a 00007f44fc353693 00007f44fc353631 00007f44fda86902 00007f44fda866dd 00007f4501481243 00007f4501480d58 00007f45014859f1 00007f45014859a9 00007f4501485939
0709 12:16:56.216295 (+    67us) write_op.cc:270] Start()
0709 12:16:56.216540 (+   245us) write_op.cc:276] Timestamp: P: 1783599415995485 usec, L: 0
0709 12:16:56.216567 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:16:56.217217 (+   650us) log.cc:844] Serialized 1681 byte log entry
0709 12:16:56.280844 (+ 63627us) op_driver.cc:464] REPLICATION: finished
0709 12:16:56.371905 (+ 91061us) write_op.cc:301] APPLY: starting
0709 12:16:56.371990 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:56.372126 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:56.372143 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:56.372632 (+   489us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:56.372794 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:16:56.372838 (+    44us) write_op.cc:312] APPLY: finished
0709 12:16:56.373055 (+   217us) log.cc:844] Serialized 40 byte log entry
0709 12:16:56.373213 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:56.373304 (+    91us) write_op.cc:454] Released schema lock
0709 12:16:56.373344 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":85212,"apply.run_cpu_time_us":1852,"apply.run_wall_time_us":10693,"num_ops":4,"prepare.queue_time_us":66748,"prepare.run_cpu_time_us":14657,"prepare.run_wall_time_us":226236,"replication_time_us":64122,"spinlock_wait_cycles":5011840,"thread_start_us":136107,"threads_started":2}]]}
I20260709 12:16:56.409998 12834 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.358893 12850 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.411442 12796 consensus_queue.cc:1059] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:16:56.705835 12850 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.706405 12850 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:56.706781 12460 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6d80 after lost signal to thread 11518
I20260709 12:16:56.610136 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.416368 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.616640 12841 consensus_queue.cc:1048] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:56.710296 11803 raft_consensus.cc:2368] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6.
I20260709 12:16:56.709729 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.712881 11660 raft_consensus.cc:2393] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:56.714062 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.715063 11660 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:56.716081 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.716909 11660 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:56.718242 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.719875 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.368687 11802 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:56.731479 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.732757 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.700894 12844 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:56.630514 12813 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:56.733814 12844 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.634963 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.633230 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.633173 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.623607 12832 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.650245 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.654419 11698 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:56.639921 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.635028 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.623677 11701 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:56.633683 11805 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.627914 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.694089 12787 raft_consensus.cc:697] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:56.659803 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.693862 12768 raft_consensus.cc:3055] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:56.495522 12859 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.628572 11655 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.722095 12848 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.748039 12859 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:56.749627 12848 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:56.723240 12784 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.724867 11659 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
W20260709 12:16:56.726104 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 49058.5us
I20260709 12:16:56.726238 12865 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:16:56.711290 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.727496 11658 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:56.754829 11657 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.733208 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.735301 11625 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:56.738794 11653 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.738907 11807 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.739253 11806 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.745713 12787 consensus_queue.cc:237] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:56.746807 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 118706us
I20260709 12:16:56.743206 11802 raft_consensus.cc:2368] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4.
I20260709 12:16:56.743422 12768 raft_consensus.cc:740] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:56.716367 12834 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:56.751252 11800 raft_consensus.cc:2393] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 4: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:56.751575 12813 raft_consensus.cc:697] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:56.739836 12832 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.727245 12432 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:56.755292 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.743688 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.760532 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.754416 12865 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.761500 12840 raft_consensus.cc:3055] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:56.765093 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:56.767483 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:16:56.769707 11699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.771390 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:16:56.766325 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 142863us
I20260709 12:16:56.773725 12813 consensus_queue.cc:237] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.774634 11652 raft_consensus.cc:2393] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:56.774981 11808 raft_consensus.cc:2393] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 2: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:56.775048 11654 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:56.775655 11698 leader_election.cc:400] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4.
I20260709 12:16:56.771562 12840 raft_consensus.cc:740] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
W20260709 12:16:56.778293 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 43896.2us
I20260709 12:16:56.779877 11809 raft_consensus.cc:2368] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:56.784677 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.785450 11803 raft_consensus.cc:2393] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:56.786713 12796 raft_consensus.cc:2804] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:56.773895 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.788713 11698 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:56.776602 12768 consensus_queue.cc:260] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:56.791754 12825 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.792119 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.792961 11803 raft_consensus.cc:1240] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:56.793282 12460 debug-util.cc:398] Leaking SignalData structure 0x7b08000948e0 after lost signal to thread 11685
I20260709 12:16:56.794222 12768 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.792492 12823 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:56.792492 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.786772 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.797652 12437 raft_consensus.cc:2393] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 6: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:56.799336 11800 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:56.801417 11800 raft_consensus.cc:1275] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:56.785321 12838 raft_consensus.cc:2764] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:16:56.787393 12796 raft_consensus.cc:697] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:56.803145 12796 consensus_queue.cc:237] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:56.810083 12859 raft_consensus.cc:2804] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.810668 12859 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.811048 12859 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.816072 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.817059 12428 raft_consensus.cc:2368] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6.
I20260709 12:16:56.818070 12769 consensus_queue.cc:1048] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:16:56.822337 12847 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.824548 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.824703 12840 consensus_queue.cc:260] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:56.825326 12438 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.828392 11656 raft_consensus.cc:1275] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.830883 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:56.842761 11726 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:56.833719 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:56.846123 11808 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:56.834478 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 449095us
I20260709 12:16:56.833547 12848 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.850514 12848 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.850836 11698 leader_election.cc:400] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6.
W20260709 12:16:56.851989 12460 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff7e0 after lost signal to thread 11759
I20260709 12:16:56.793195 11802 raft_consensus.cc:2393] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:56.850883 12848 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.856086 11802 raft_consensus.cc:1240] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:56.860635 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:56.862705 12768 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:56.863384 12768 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.865682 12852 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:56.866365 12852 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.867980 12843 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:56.868618 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:56.868556 12843 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.869660 12437 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:56.840833 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:56.873397 11809 raft_consensus.cc:2468] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:56.841825 12840 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.842129 11658 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.870834 12432 raft_consensus.cc:1240] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:56.871212 12843 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:56.817384 11731 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:16:56.885632 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:56.885999 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:56.887562 11625 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:56.889004 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.889367 12843 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.890527 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.891723 11654 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.839741 12827 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:56.905282 11657 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:56.910004 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:56.911221 11806 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:16:56.916435 11657 raft_consensus.cc:1240] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:56.915959 11807 raft_consensus.cc:2468] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:16:56.930265 12432 raft_consensus.cc:2393] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 4: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:56.920626 12768 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:16:56.934391 12460 debug-util.cc:398] Leaking SignalData structure 0x7b080014f060 after lost signal to thread 11833
W20260709 12:16:56.935964 12460 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5f60 after lost signal to thread 12463
I20260709 12:16:56.920804 12850 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:56.937004 12844 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:16:56.938921 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.927291 12870 raft_consensus.cc:2749] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:56.923470 12838 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:56.942641 12838 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.945044 12838 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:56.946053 11660 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 3: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:56.939230 12850 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:56.911068 11653 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
W20260709 12:16:56.950182 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 99565.9us
I20260709 12:16:56.951844 11808 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:56.951931 11727 raft_consensus.cc:1240] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:56.949998 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.954744 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.918550 12438 raft_consensus.cc:2468] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:56.948167 11701 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:56.957662 11658 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:16:56.957890 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.964922 11698 leader_election.cc:400] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4.
I20260709 12:16:56.963639 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.978744 11660 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.978775 11654 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:16:56.970688 12838 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
W20260709 12:16:56.986778 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.958215 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.970276 12852 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:56.957787 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:56.967195 12844 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:16:56.992760 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.971364 11801 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:16:56.971858 11805 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:56.972972 12784 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:56.969427 12832 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:56.960453 12865 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:56.990074 12843 raft_consensus.cc:697] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
W20260709 12:16:57.005704 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 81250.3us
W20260709 12:16:57.006224 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 79497.5us
I20260709 12:16:56.996691 12870 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:57.011262 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:57.012058 11808 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:57.002630 12827 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:57.012795 11657 raft_consensus.cc:1240] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:57.014058 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:57.015805 11803 raft_consensus.cc:1240] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:16:57.013437 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:57.002607 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:57.018031 11656 raft_consensus.cc:2393] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:57.025148 11699 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.029987 11701 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:57.005252 12838 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:16:57.035446 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 70756.6us
I20260709 12:16:57.033317 11775 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:57.041209 11624 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.041441 11655 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
W20260709 12:16:57.042335 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 65498.8us
I20260709 12:16:57.043533 11624 leader_election.cc:400] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:57.033511 11726 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:16:57.043840 11624 leader_election.cc:403] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:57.044834 12889 raft_consensus.cc:2749] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.045576 12889 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:57.045863 11661 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:57.046623 12784 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:57.054479 12832 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:57.058175 12843 consensus_queue.cc:237] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:57.059222 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:57.060115 12438 raft_consensus.cc:2393] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:57.062461 12865 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:57.040000 12870 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:57.069831 12870 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:57.070183 12859 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.072361 12859 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:57.072810 12387 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
W20260709 12:16:57.073117 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 54809.7us
I20260709 12:16:57.074555 12787 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:57.075066 12787 raft_consensus.cc:697] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:57.075173 12838 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:57.076109 12787 consensus_queue.cc:237] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:57.078081 12386 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:16:57.079121 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 54135.7us
I20260709 12:16:57.079802 12436 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:57.083243 12844 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.085069 12387 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.070199 12870 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:57.090193 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 65635.7us
I20260709 12:16:57.091806 11698 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:57.092769 12823 consensus_queue.cc:1059] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.092923 12819 consensus_queue.cc:1048] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:57.093276 11698 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.093660 12820 raft_consensus.cc:2804] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:57.076000 12834 consensus_queue.cc:1059] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:16:57.094873 12834 raft_consensus.cc:3055] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.091744 12853 raft_consensus.cc:2804] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.095219 12834 raft_consensus.cc:740] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:57.096171 12823 raft_consensus.cc:3055] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.096056 12834 consensus_queue.cc:260] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:57.096565 12823 raft_consensus.cc:740] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.097254 12834 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.094125 12820 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.097965 12820 raft_consensus.cc:3060] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.097739 11484 catalog_manager.cc:5697] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.097980 12824 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:16:57.095438 12853 raft_consensus.cc:697] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.106621 12853 consensus_queue.cc:237] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:57.108144 12776 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.108487 12386 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:57.098325 11701 leader_election.cc:400] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6.
I20260709 12:16:57.109915 11701 leader_election.cc:403] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:16:57.099828 11660 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
W20260709 12:16:57.135353 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 142339us
I20260709 12:16:57.139508 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:57.140782 11804 raft_consensus.cc:2468] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:57.136191 12865 raft_consensus.cc:2804] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.099123 12848 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:57.157167 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 63976us
I20260709 12:16:57.097422 12823 consensus_queue.cc:260] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.099028 12819 consensus_queue.cc:1059] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:16:57.141238 12838 raft_consensus.cc:2804] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:57.155210 12859 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.151993 12832 raft_consensus.cc:2749] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6.
W20260709 12:16:57.166040 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 68279.4us
I20260709 12:16:57.155021 12865 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
W20260709 12:16:57.167979 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 83067.3us
I20260709 12:16:57.146567 12769 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:16:57.172684 11654 raft_consensus.cc:1240] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:57.168088 12436 raft_consensus.cc:1240] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.173681 11701 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:57.168475 12838 raft_consensus.cc:697] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:57.170516 12865 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.184115 12776 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.177842 12387 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.190857 12813 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.193349 12387 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.194335 12813 raft_consensus.cc:2749] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.195003 12387 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.195811 12813 raft_consensus.cc:2749] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.196381 12387 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.197252 12813 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.198050 12848 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:57.174189 12859 raft_consensus.cc:3055] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:57.199005 12859 raft_consensus.cc:740] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.187412 12870 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.180576 12820 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:57.175912 12823 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.200337 12859 consensus_queue.cc:260] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.203333 12832 consensus_queue.cc:1059] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:16:57.206460 12859 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.186740 12838 consensus_queue.cc:237] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:57.189075 12897 raft_consensus.cc:2804] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:57.189814 11701 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:57.211494 11773 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:57.203375 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:57.219098 12387 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.228250 12832 raft_consensus.cc:2804] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:57.228823 12832 raft_consensus.cc:697] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.217180 12897 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.229740 12832 consensus_queue.cc:237] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:57.235430 11803 raft_consensus.cc:1240] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:16:57.230355 12820 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:57.231547 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:57.237927 11805 raft_consensus.cc:1240] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:57.238147 11808 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:57.238600 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:57.232578 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:57.230588 12897 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.239753 11809 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.239861 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:57.240527 12432 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.239195 11806 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.244055 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:57.244812 12428 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.251001 11806 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:57.253111 12432 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:57.255218 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:57.255501 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:57.255995 11661 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.256181 12434 raft_consensus.cc:3060] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.258383 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:57.259109 11654 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:16:57.261901 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:57.264014 12434 raft_consensus.cc:2468] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:57.264706 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:57.265609 11658 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 3: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:57.265507 12769 raft_consensus.cc:2764] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:16:57.265900 12870 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:57.266628 11801 raft_consensus.cc:2368] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6.
W20260709 12:16:57.266885 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 104125us
I20260709 12:16:57.268278 12386 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:57.267856 11773 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:57.277474 11654 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:57.284900 12432 raft_consensus.cc:1240] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:57.226300 12827 raft_consensus.cc:3055] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:57.294166 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:57.295843 12834 consensus_queue.cc:1059] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.296912 12834 raft_consensus.cc:3055] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.297302 12834 raft_consensus.cc:740] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:57.267935 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:57.307461 11804 raft_consensus.cc:3060] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.290843 12813 raft_consensus.cc:2764] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:16:57.248346 12865 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:57.293833 12827 raft_consensus.cc:740] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.321913 11661 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:57.309360 12429 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.314226 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:57.351213 12856 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:16:57.352092 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 88440.9us
W20260709 12:16:57.357192 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 147322us
I20260709 12:16:57.361577 11809 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
W20260709 12:16:57.367524 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 60018.9us
W20260709 12:16:57.369221 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 101494us
I20260709 12:16:57.368661 11701 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:57.356778 12438 raft_consensus.cc:1240] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:57.363402 11652 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.362867 12769 raft_consensus.cc:2764] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:16:57.377499 12387 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.379673 11701 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:57.381881 12909 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.382529 12909 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.386238 12909 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:57.386870 12909 raft_consensus.cc:2804] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:57.387264 12909 raft_consensus.cc:697] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
W20260709 12:16:57.374055 12904 log.cc:927] Time spent T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:16:57.388901 12909 consensus_queue.cc:237] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:57.383333 12824 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:57.390899 12824 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:57.336544 12834 consensus_queue.cc:260] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:57.371485 12827 consensus_queue.cc:260] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:57.403414 12832 raft_consensus.cc:2804] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:57.413621 12870 consensus_queue.cc:1059] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:57.414583 12870 consensus_queue.cc:1243] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Peer ce38e95b93a640c1a7b16f37868b30fc log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:57.415423 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:57.416287 11730 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
W20260709 12:16:57.417023 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 46334.2us
I20260709 12:16:57.418243 12834 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.384093 12848 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.419456 12848 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.426817 12387 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.421545 12848 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:57.434178 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:57.426033 12824 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:57.437140 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:57.437359 12865 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:57.437904 11730 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:57.439194 12387 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.440619 12387 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.442147 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:57.442816 11658 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:57.444469 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:57.444748 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:57.445063 11809 raft_consensus.cc:3060] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.445986 11801 raft_consensus.cc:1275] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:57.411172 12832 raft_consensus.cc:697] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.449024 11699 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:57.441521 11698 leader_election.cc:400] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6.
W20260709 12:16:57.449900 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 54187.7us
I20260709 12:16:57.452363 11808 raft_consensus.cc:1240] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.452389 12838 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:57.454102 11804 raft_consensus.cc:2468] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:57.457937 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:57.459410 11806 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:16:57.463284 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:57.462960 11809 raft_consensus.cc:2468] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:57.435117 12813 raft_consensus.cc:2749] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.452286 12429 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:57.466796 12865 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.446708 12437 raft_consensus.cc:1240] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:57.452775 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:57.468199 11803 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:57.468451 12897 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:57.468894 11654 raft_consensus.cc:1240] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.468824 11657 raft_consensus.cc:2393] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:57.471565 12387 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.471839 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.472998 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:57.473620 11658 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
W20260709 12:16:57.481642 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:57.482120 11699 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:57.466699 12436 raft_consensus.cc:1275] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:57.486322 12819 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:57.487349 11807 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:16:57.488476 12386 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:57.489838 11698 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:57.491466 12819 raft_consensus.cc:697] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.491943 12841 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:57.492470 12916 consensus_queue.cc:1059] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:57.493172 12820 raft_consensus.cc:2804] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:57.493604 12853 consensus_queue.cc:1048] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.495719 12824 raft_consensus.cc:3055] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:57.496088 12824 raft_consensus.cc:740] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.489279 11699 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:57.496658 12820 raft_consensus.cc:697] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.494236 12915 consensus_queue.cc:1059] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:57.496985 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:57.497411 12910 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:57.486188 12832 consensus_queue.cc:237] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:57.497829 12910 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.498324 12910 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.498708 12428 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:57.498564 12820 consensus_queue.cc:237] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.496505 12841 raft_consensus.cc:697] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.497639 12915 raft_consensus.cc:3055] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.499756 12915 raft_consensus.cc:740] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.500147 12841 consensus_queue.cc:237] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.500607 12915 consensus_queue.cc:260] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.502476 12387 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.503228 12838 raft_consensus.cc:2749] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.503924 12838 raft_consensus.cc:2804] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.504411 12838 raft_consensus.cc:697] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:57.505138 12387 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.505990 12865 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.506750 12865 raft_consensus.cc:2749] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.497793 12819 consensus_queue.cc:237] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:57.508069 12897 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:57.499224 12776 raft_consensus.cc:2764] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:16:57.509087 11652 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
W20260709 12:16:57.489228 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 108582us
I20260709 12:16:57.496879 12824 consensus_queue.cc:260] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:57.511902 11773 leader_election.cc:400] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Vote denied by peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117) with higher term. Message: Invalid argument: T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4.
I20260709 12:16:57.512593 11773 leader_election.cc:403] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:16:57.510370 12915 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.519964 12859 consensus_queue.cc:1059] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:57.522169 11699 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:57.523114 12897 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:57.523653 12897 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.524047 12897 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.524626 11730 raft_consensus.cc:1275] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:57.526943 12843 consensus_queue.cc:1048] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:57.531364 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:57.532259 11807 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:57.533568 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 49100us
I20260709 12:16:57.542310 11701 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.552274 11807 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:57.554355 11698 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:57.532109 12910 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.505367 12838 consensus_queue.cc:237] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:57.562215 11701 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:16:57.563927 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 58887.1us
I20260709 12:16:57.546315 12834 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117) with higher term. Message: Invalid argument: T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4.
I20260709 12:16:57.563400 12823 raft_consensus.cc:2804] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:57.572698 12912 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.557555 12853 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:57.573395 12387 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.574717 12856 raft_consensus.cc:2749] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.576674 12387 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.577626 12856 raft_consensus.cc:2804] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.578164 12856 raft_consensus.cc:697] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:57.579095 12856 consensus_queue.cc:237] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:16:57.582052 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 70511.9us
I20260709 12:16:57.583065 12787 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:57.583277 11773 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:57.584609 12787 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:16:57.588541 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:57.584627 11773 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.601652 12824 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.603206 12853 raft_consensus.cc:697] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.604291 12853 consensus_queue.cc:237] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:57.608636 12438 raft_consensus.cc:1275] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:57.596930 12823 raft_consensus.cc:697] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.614497 12834 consensus_queue.cc:1048] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.615216 12823 consensus_queue.cc:237] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:57.628860 11661 raft_consensus.cc:1275] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.630288 12387 leader_election.cc:400] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3.
I20260709 12:16:57.630705 12387 leader_election.cc:403] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:57.601953 12787 raft_consensus.cc:2749] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.638028 12865 raft_consensus.cc:2749] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3.
W20260709 12:16:57.662487 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 77969.8us
W20260709 12:16:57.663574 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 100280us
I20260709 12:16:57.635030 12824 consensus_queue.cc:1048] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:16:57.671484 12841 consensus_queue.cc:1059] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:57.673458 12910 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:57.678920 11726 raft_consensus.cc:1275] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:57.679586 12912 raft_consensus.cc:2749] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:57.680787 12841 raft_consensus.cc:3055] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:57.681182 12841 raft_consensus.cc:740] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.682255 12841 consensus_queue.cc:260] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:57.683674 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:57.684299 11809 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.685909 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:57.687767 11652 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.691979 12827 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.687096 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:16:57.693773 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 93736.7us
I20260709 12:16:57.694183 12428 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.694602 11773 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:57.696348 11773 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:57.697201 12787 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.697975 12787 raft_consensus.cc:2749] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:57.683597 12841 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.704064 12840 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:57.683413 12897 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.719695 11773 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.665589 12819 consensus_queue.cc:1048] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
W20260709 12:16:57.748880 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:57.704480 11652 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:57.750511 12387 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.755904 12430 raft_consensus.cc:1275] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.754073 12769 raft_consensus.cc:2749] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:57.770047 11699 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:57.773231 11809 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:16:57.776022 12929 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:57.776891 12929 raft_consensus.cc:697] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.781239 12897 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:57.778267 12929 consensus_queue.cc:237] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.786689 12915 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:57.787225 12915 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.789901 12843 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.790170 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:16:57.790550 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 92815.4us
I20260709 12:16:57.791870 12915 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:57.792315 12843 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:57.792364 12823 consensus_queue.cc:1048] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:57.794524 12843 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:57.792160 12856 raft_consensus.cc:2749] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:57.796986 12428 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:57.792115 11773 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:16:57.791666 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 44030.9us
I20260709 12:16:57.800472 12387 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.801424 12856 raft_consensus.cc:2749] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:57.801705 12776 consensus_queue.cc:1059] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:57.802706 12856 raft_consensus.cc:3055] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:57.803082 12856 raft_consensus.cc:740] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:57.803932 12856 consensus_queue.cc:260] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:57.804975 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:57.805135 12856 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.803097 12387 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.807811 12838 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:57.808734 12428 raft_consensus.cc:1240] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.811118 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:57.811674 11809 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.817317 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.818104 12437 raft_consensus.cc:2368] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:57.818405 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.819072 12432 raft_consensus.cc:2368] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4.
I20260709 12:16:57.819505 12787 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.820544 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.822652 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.822821 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.824012 12429 raft_consensus.cc:1240] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 4. Ops: []
I20260709 12:16:57.833732 12787 raft_consensus.cc:2749] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.825706 11699 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.834503 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.835109 11773 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:57.836318 12819 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.837086 12819 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:57.837575 12819 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:57.838279 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.825775 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.817198 12823 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:57.830539 12431 raft_consensus.cc:1240] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.831249 11804 raft_consensus.cc:1275] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:57.832754 12853 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.856877 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.841782 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:57.845207 11809 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:57.824393 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.858187 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.858471 12432 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:57.859156 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:57.859342 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.859944 11652 raft_consensus.cc:2393] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 2: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:57.860407 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.861191 12432 raft_consensus.cc:2368] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:57.861296 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:57.862084 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:57.863142 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:57.863541 12827 consensus_queue.cc:1048] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:57.864176 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.864858 12432 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:57.855969 12435 raft_consensus.cc:1240] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 3. Ops: []
I20260709 12:16:57.866531 11698 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:16:57.849025 11484 catalog_manager.cc:5697] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 3, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.852766 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:57.853731 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:57.855198 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:57.855839 12823 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.856714 12853 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:57.840662 12819 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:57.847322 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:57.871937 11661 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.869146 11484 catalog_manager.cc:5697] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 3, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.872876 12387 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.850888 12787 raft_consensus.cc:2749] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.873715 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:57.870275 12827 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:57.874963 12853 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:57.875141 12827 raft_consensus.cc:697] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:16:57.876106 12827 consensus_queue.cc:237] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.878433 12840 consensus_queue.cc:1059] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.879376 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:57.879586 12840 raft_consensus.cc:3055] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.879927 12840 raft_consensus.cc:740] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:57.880096 12431 raft_consensus.cc:2368] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:57.879407 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:16:57.880867 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.881183 11652 raft_consensus.cc:2393] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 2: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:16:57.878744 11627 leader_election.cc:400] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4.
I20260709 12:16:57.882019 11627 leader_election.cc:403] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:57.883118 11627 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:57.883252 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.865526 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:57.884451 12432 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:16:57.873152 11484 catalog_manager.cc:5697] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 3 to 4, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:57.887141 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 52158.4us
I20260709 12:16:57.889530 11484 catalog_manager.cc:5697] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 2, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.871025 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.894474 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.894392 11726 raft_consensus.cc:1240] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:57.896234 12431 raft_consensus.cc:2368] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
W20260709 12:16:57.894860 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:57.897630 11701 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.899920 11661 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:57.901677 11484 catalog_manager.cc:5697] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 4, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.919220 11484 catalog_manager.cc:5697] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 4, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.921540 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:57.921265 11484 catalog_manager.cc:5697] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.922169 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:57.923403 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:57.924382 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.925405 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.926493 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.895699 12823 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:57.887727 12843 raft_consensus.cc:2749] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4.
I20260709 12:16:57.895710 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.927865 12432 raft_consensus.cc:2368] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:57.919602 12841 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.894748 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:16:57.931545 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 58733.3us
I20260709 12:16:57.927636 11484 catalog_manager.cc:5697] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 4, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.917476 12838 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.935606 11806 raft_consensus.cc:3055] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:57.936163 11806 raft_consensus.cc:740] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:57.902004 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.935072 12387 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.936975 12431 raft_consensus.cc:1275] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:57.941838 11727 raft_consensus.cc:1275] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:57.941814 12840 consensus_queue.cc:260] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:57.942482 12870 consensus_queue.cc:1048] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:57.943096 12840 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.943578 11806 consensus_queue.cc:260] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:57.944476 11806 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.944676 11809 raft_consensus.cc:1275] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:57.941722 12856 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.938184 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:57.946159 12843 raft_consensus.cc:2749] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.948336 12856 consensus_queue.cc:1048] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:57.951489 12428 raft_consensus.cc:1275] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:57.956084 11699 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:57.962249 11807 raft_consensus.cc:1275] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:57.965750 11699 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:57.970109 11730 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
W20260709 12:16:57.971421 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:57.972383 11806 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:16:57.978143 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 95124.5us
I20260709 12:16:57.974295 12832 raft_consensus.cc:2749] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.974159 12915 raft_consensus.cc:2749] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.987490 12832 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:57.992751 11773 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:57.986346 12435 raft_consensus.cc:2393] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 4: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:16:57.965584 12870 consensus_queue.cc:1048] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:16:58.000660 12437 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:16:58.001776 12438 raft_consensus.cc:1275] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:57.964432 12897 consensus_queue.cc:1048] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 12:16:58.006665 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.017910 11806 raft_consensus.cc:1275] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:16:58.020732 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 85734.3us
W20260709 12:16:58.001010 12939 log.cc:927] Time spent T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:16:58.029711 12387 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:58.022374 12834 raft_consensus.cc:2764] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 12:16:58.039232 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 63896.8us
I20260709 12:16:58.042037 12838 raft_consensus.cc:2749] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:58.049420 12387 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:58.037648 12865 consensus_queue.cc:1059] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:16:58.037732 12823 consensus_queue.cc:1048] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
W20260709 12:16:58.059965 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.063313 12438 raft_consensus.cc:1275] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.057312 12776 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:58.071014 11658 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:16:58.099102 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.118101 11806 raft_consensus.cc:1275] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.119383 12387 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
W20260709 12:16:58.122148 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 46638.7us
W20260709 12:16:58.126701 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.068373 12899 consensus_queue.cc:1048] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:16:58.148108 11773 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:16:58.195346 11806 raft_consensus.cc:1275] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.198264 12865 consensus_queue.cc:1048] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.199962 12847 raft_consensus.cc:2749] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:58.128049 12897 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
W20260709 12:16:58.185511 12940 log.cc:927] Time spent T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.178s	user 0.004s	sys 0.003s
I20260709 12:16:58.201972 12856 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:16:58.232511 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 115389us
I20260709 12:16:58.127972 12922 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
W20260709 12:16:58.262768 11775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:58.269341 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 150039us
I20260709 12:16:58.271816 12387 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:58.273918 12865 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.211575 12870 consensus_queue.cc:1048] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:16:58.207417 12897 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:16:58.292974 12946 log.cc:927] Time spent T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.076s	user 0.006s	sys 0.005s
W20260709 12:16:58.299024 12950 log.cc:927] Time spent T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:16:58.322257 12387 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
W20260709 12:16:58.327426 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 58681.7us
I20260709 12:16:58.337235 12434 raft_consensus.cc:1275] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.287943 12438 raft_consensus.cc:1275] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:16:58.340129 12943 log.cc:927] Time spent T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.275s	user 0.007s	sys 0.000s
I20260709 12:16:58.340723 12430 raft_consensus.cc:1240] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.341549 11658 raft_consensus.cc:1275] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:16:58.331996 12945 log.cc:927] Time spent T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:16:58.343228 12942 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:58.343760 12942 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:58.345003 12952 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.321501 12838 raft_consensus.cc:3055] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:58.354139 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:58.354820 11730 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:58.363140 11657 raft_consensus.cc:1275] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:58.365011 11658 raft_consensus.cc:1275] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:58.370968 11661 raft_consensus.cc:1275] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.373178 12437 raft_consensus.cc:1275] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:16:58.374161 12947 log.cc:927] Time spent T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.135s	user 0.011s	sys 0.002s
I20260709 12:16:58.374634 12915 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:58.376785 12897 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:58.366392 11625 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:58.380976 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.354671 12838 raft_consensus.cc:740] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:58.383695 12838 consensus_queue.cc:260] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:58.385077 12838 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:58.398363 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 76182.5us
W20260709 12:16:58.399513 12951 log.cc:927] Time spent T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:16:58.399684 12897 consensus_queue.cc:1048] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.400722 12932 consensus_queue.cc:1048] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.378535 12942 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:58.408074 12387 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:16:58.409168 11660 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.411788 11661 raft_consensus.cc:1275] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.395721 12915 consensus_queue.cc:1048] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:16:58.417425 11659 raft_consensus.cc:1275] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:58.395505 12916 consensus_queue.cc:1048] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 12:16:58.433637 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 47037.4us
I20260709 12:16:58.417900 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:16:58.436636 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:58.437251 11657 raft_consensus.cc:2468] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:16:58.445261 11660 raft_consensus.cc:1275] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.449309 12944 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:58.412252 12952 consensus_queue.cc:1048] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:16:58.478341 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 72240.1us
I20260709 12:16:58.449776 12944 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:58.446739 12840 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:58.485662 12944 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.478063 12769 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.492054 12856 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:58.492055 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 84042.5us
I20260709 12:16:58.495499 11773 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:16:58.493160 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 91941us
I20260709 12:16:58.503057 11730 raft_consensus.cc:1275] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.487211 12840 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:16:58.507541 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:58.511759 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.498040 12769 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:58.506177 12916 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:58.531673 12859 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:58.532342 12859 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:58.500479 12856 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:58.534112 12834 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.534356 12859 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:58.534638 12834 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:58.535177 12859 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:58.518430 11773 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:58.535728 12859 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:58.536980 12834 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:58.519289 12759 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:58.519893 12953 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:58.528024 11808 raft_consensus.cc:1275] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:58.529122 12952 consensus_queue.cc:1048] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:58.515440 12965 consensus_queue.cc:1048] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:16:58.531584 12916 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:58.517369 11627 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:58.538316 11773 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:58.551625 11804 raft_consensus.cc:1275] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:58.532796 12942 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.537912 12859 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:58.537632 12834 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:58.534757 12856 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:58.554157 12759 raft_consensus.cc:697] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
W20260709 12:16:58.558595 12967 log.cc:927] Time spent T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:16:58.558156 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:58.571487 12759 consensus_queue.cc:237] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:58.572466 12970 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:58.556931 12953 raft_consensus.cc:697] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:16:58.585801 11805 raft_consensus.cc:1275] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:16:58.587949 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 185625us
I20260709 12:16:58.588240 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.589811 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.591675 11730 raft_consensus.cc:1275] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:58.592458 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.604635 12764 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:58.605314 12764 raft_consensus.cc:697] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 4 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:58.560407 12942 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:58.613150 12820 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:58.614193 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:58.592183 12429 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:16:58.593365 12823 consensus_queue.cc:1048] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:16:58.605947 12962 consensus_queue.cc:1048] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:16:58.636974 12981 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:58.612706 11726 raft_consensus.cc:1240] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:58.586928 12970 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:58.600162 12819 consensus_queue.cc:1048] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:16:58.648648 12971 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:58.649289 12971 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:58.650066 11661 raft_consensus.cc:1275] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.649973 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:58.651290 12981 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.651436 12971 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:16:58.652724 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 154745us
I20260709 12:16:58.667544 11658 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:16:58.668179 12978 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:58.668757 12978 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:58.669803 12944 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:58.633773 12975 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:16:58.681656 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 63195.6us
I20260709 12:16:58.682832 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:58.648999 11655 raft_consensus.cc:1275] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.667930 12942 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:58.654330 12981 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:58.680581 12865 consensus_queue.cc:1048] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:16:58.693243 12975 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:58.695106 12981 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:58.695545 12944 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:58.696105 12916 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:58.696614 12978 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:16:58.697033 12976 log.cc:927] Time spent T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:16:58.699084 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:58.700067 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.643980 12824 consensus_queue.cc:1048] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:16:58.699693 11732 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
W20260709 12:16:58.721961 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 204644us
I20260709 12:16:58.713822 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:58.722949 11661 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:16:58.725065 12387 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:16:58.667892 12969 consensus_queue.cc:1059] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 12:16:58.728667 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:16:58.729256 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.731596 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.732481 11699 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:16:58.668298 12970 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:58.690452 11653 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:58.736042 11806 raft_consensus.cc:1240] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.670219 12764 consensus_queue.cc:237] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:58.738091 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:58.738890 11801 raft_consensus.cc:2368] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:58.738917 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.691732 11656 raft_consensus.cc:1217] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:16:58.742715 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:58.744624 11807 raft_consensus.cc:2376] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2. Re-sending same reply.
I20260709 12:16:58.701105 12841 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.701830 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:58.695592 12975 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:58.730455 12865 raft_consensus.cc:2804] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:58.701164 12899 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:58.720505 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:58.697959 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:16:58.726630 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:58.702442 12965 consensus_queue.cc:1048] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:16:58.742425 12769 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:58.744874 12915 raft_consensus.cc:2804] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:58.741881 11803 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:16:58.753333 11627 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:58.750938 11656 raft_consensus.cc:1240] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:16:58.756965 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:58.774413 11804 raft_consensus.cc:2376] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3. Re-sending same reply.
I20260709 12:16:58.758153 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.752924 11727 raft_consensus.cc:2468] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:16:58.680886 12953 consensus_queue.cc:237] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:58.750192 12841 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:58.760874 11800 raft_consensus.cc:1275] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:58.756006 12899 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:58.754212 12962 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.793002 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.793207 12962 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:58.793697 11801 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:58.793445 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.795145 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.795334 12962 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:16:58.795653 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.753332 12865 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.783748 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:58.689961  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:58.796546 11807 raft_consensus.cc:2376] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4. Re-sending same reply.
I20260709 12:16:58.796693 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:16:58.786523 12969 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:58.797888 12865 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.755069 12437 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:16:58.791994 11481 catalog_manager.cc:5697] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 3 to 4, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 4 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.802098 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:58.802671 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:58.803267 12428 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:58.796236 11804 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:16:58.805923 11481 catalog_manager.cc:5697] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 2, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 2 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.765352 12915 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:58.807428 11481 catalog_manager.cc:5697] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 3, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 3 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:16:58.808135 12915 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.808740 11481 catalog_manager.cc:5697] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 2, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 2 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.812588 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.813889 12865 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:58.801558 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:58.814687 11801 raft_consensus.cc:2393] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 2: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:16:58.817540 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.819152 12970 raft_consensus.cc:3055] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.819447 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.814992 11481 catalog_manager.cc:5697] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 2 to 4, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 4 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.823099 11773 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:16:58.852176 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 109191us
W20260709 12:16:58.852368 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 105301us
W20260709 12:16:58.854409 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 112205us
I20260709 12:16:58.854884 11481 catalog_manager.cc:5697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 3 to 5, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 5 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:16:58.858503 11627 leader_election.cc:400] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:58.867955 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.867434 11701 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:58.870544 11699 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:58.868589 11807 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:16:58.866158 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:16:58.854094 12970 raft_consensus.cc:740] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:58.866020 12769 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:58.902732 11625 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:58.923259 11658 raft_consensus.cc:1275] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.862071 11731 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:16:58.861634 11803 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
W20260709 12:16:58.933907 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 75521.5us
I20260709 12:16:58.880712 12974 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:58.940609 11625 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:16:58.924986 12912 raft_consensus.cc:2749] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:58.985131 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 49141.8us
I20260709 12:16:58.934844 12969 raft_consensus.cc:2804] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:59.018549 11627 leader_election.cc:400] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:59.019006 11627 leader_election.cc:403] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:16:59.019611 12944 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.020325 11627 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:59.022192 12838 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:59.022817 12838 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:16:59.025905 12978 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:16:59.027073 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 127232us
I20260709 12:16:59.030524 11698 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:16:59.031347 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 155725us
I20260709 12:16:58.950397 12769 raft_consensus.cc:697] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:16:59.035779 11627 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:58.996342 12975 raft_consensus.cc:2804] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:58.971220 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:16:58.928823 12759 consensus_queue.cc:1048] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 12:16:58.994565 12832 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:59.044107 12975 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:16:59.048662 12975 raft_consensus.cc:3060] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.050783 11624 leader_election.cc:400] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:59.052201 11624 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:16:59.053232 12981 raft_consensus.cc:2804] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.053716 12981 raft_consensus.cc:697] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:16:59.054661 12981 consensus_queue.cc:237] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:59.091782 11773 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:16:59.029029 12969 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:16:58.986583 12974 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:16:59.093526 11624 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
W20260709 12:16:59.097347 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 69643.6us
I20260709 12:16:59.179005 12841 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:59.203279 12977 raft_consensus.cc:2804] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:16:59.204579 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 111216us
W20260709 12:16:59.180693 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 313325us
I20260709 12:16:59.141633 12832 raft_consensus.cc:2804] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:59.046959 12978 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:59.222775 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:16:59.223649 12978 consensus_queue.cc:1048] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:16:59.117322 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.374037 13033 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:01.374490 13035 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:01.374722 13033 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:01.375108 13035 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:16:59.034174 12970 consensus_queue.cc:260] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:01.376844 12970 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.377110 13033 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:01.377307 13035 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:01.377735 13033 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.377866 13035 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:01.378419 13035 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:01.378399 13033 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:01.380596 13035 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:01.380820 13033 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:16:59.097321 12969 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:59.190280 12993 log.cc:927] Time spent T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:16:59.210122 13002 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:01.384016 11654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34104 (request call id 130) took 2702 ms. Trace:
I20260709 12:17:01.384387 11654 rpcz_store.cc:276] 0709 12:16:58.681554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.688287 (+  6733us) service_pool.cc:224] Handling call
0709 12:16:58.688690 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:58.701845 (+ 13155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:58.701889 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:58.735584 (+ 33695us) log.cc:844] Serialized 26 byte log entry
0709 12:16:58.787552 (+ 51968us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:58.787868 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 12:16:58.788277 (+   409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.788344 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:01.383756 (+2595412us) raft_consensus.cc:1685] finished
0709 12:17:01.383778 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:01.383933 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22248,"prepare.queue_time_us":186,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":13316,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":184,"thread_start_us":35455,"threads_started":1,"wal-append.queue_time_us":109390}
W20260709 12:16:59.219452 12991 log.cc:927] Time spent T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
W20260709 12:17:01.385977 12982 consensus_queue.cc:1175] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cfe9bf206bb14951ba7615683809d178" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:16:59.169982 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 134283us
I20260709 12:16:59.228703 12944 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:16:59.226001 12975 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:01.630287 11627 leader_election.cc:400] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:01.631588 12975 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:01.631758 11627 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:16:59.262729 12985 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.632383 12985 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:01.633935 11660 raft_consensus.cc:1240] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.636561 11660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60060 (request call id 613) took 2586 ms. Trace:
W20260709 12:16:59.243832 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:59.256762 11775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.010s	sys 0.003s
W20260709 12:16:59.178722 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 87023us
I20260709 12:17:01.636863 11660 rpcz_store.cc:276] 0709 12:16:59.049969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.086082 (+ 36113us) service_pool.cc:224] Handling call
0709 12:16:59.086458 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:01.634337 (+2547879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.636335 (+  1998us) spinlock_profiling.cc:243] Waited 2.55 s on lock 0x7b54006e41d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:01.636507 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5858237696}
I20260709 12:16:59.277300 12977 raft_consensus.cc:697] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:01.647365 12847 consensus_queue.cc:1048] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:00.262585 12952 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.648494 12952 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:00.307727 13018 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:01.649451 13018 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:01.650796 12952 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:01.646729 13049 consensus_queue.cc:1048] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:17:01.651973 13018 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:00.321560 13020 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.318396 13017 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.653527 13017 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:01.641533 12975 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:17:01.641873 11627 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:01.655655 13017 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:01.653437 13020 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:00.339519 11624 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.133s	user 0.008s	sys 0.023s
W20260709 12:17:01.657280 11624 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.450s	user 0.010s	sys 0.023s
W20260709 12:17:01.657585 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 2.4514e+06us
I20260709 12:17:01.657940 13020 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:01.647282 12977 consensus_queue.cc:237] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:01.642802 11775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.959s	user 0.013s	sys 0.003s
W20260709 12:17:01.658874 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 2.97506e+06us
I20260709 12:17:01.659439 11775 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:01.661150 13052 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:01.648934 12985 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:00.360816 13019 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:01.021953 13009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.012s	sys 0.015s
I20260709 12:17:01.022656 13023 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:01.663331 12985 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.663662 13023 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:01.663784 12985 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:01.665086 12978 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:01.665688 13023 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:01.070261 12974 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:01.102191 13001 log.cc:927] Time spent T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 2.015s	user 0.007s	sys 0.012s
I20260709 12:17:01.666025 12985 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:01.179991 13024 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:01.666576 12985 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.666620 13024 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:00.323824 13021 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:01.667089 12985 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:01.667543 11653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34104 (request call id 132) took 2868 ms. Trace:
I20260709 12:17:01.668776 13024 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:01.227363 12983 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:01.669307 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:01.669461 12983 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:01.671581 12983 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:01.257274 12995 log.cc:927] Time spent T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 2.075s	user 0.000s	sys 0.017s
W20260709 12:17:01.265228 12998 log.cc:927] Time spent T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 2.232s	user 0.004s	sys 0.020s
I20260709 12:17:01.670567 12985 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:01.333576 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:01.280099 12994 log.cc:927] Time spent T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 2.428s	user 0.007s	sys 0.015s
I20260709 12:17:01.339583 13008 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.673377 11808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56490 (request call id 475) took 3042 ms. Trace:
I20260709 12:17:01.673276 13008 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:01.342176 13006 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
W20260709 12:17:01.339032 12992 log.cc:927] Time spent T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 2.342s	user 0.010s	sys 0.041s
I20260709 12:17:01.673877 11659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 663) took 3236 ms. Trace:
I20260709 12:17:01.344128 13007 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:01.348328 13016 log.cc:927] Time spent T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 1.039s	user 0.007s	sys 0.000s
W20260709 12:17:01.020514 12386 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.007s	sys 0.005s
I20260709 12:16:59.226619 12832 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.663486 13019 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:01.673738 11808 rpcz_store.cc:276] 0709 12:16:58.630566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.638895 (+  8329us) service_pool.cc:224] Handling call
0709 12:16:58.639276 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:58.700047 (+ 60771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:58.700078 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:58.727575 (+ 27497us) log.cc:844] Serialized 26 byte log entry
0709 12:16:58.853730 (+126155us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:58.853861 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.854106 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:01.264659 (+2410553us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:17:01.673101 (+408442us) raft_consensus.cc:1685] finished
0709 12:17:01.673120 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:01.673313 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35,"raft.queue_time_us":45747,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":139506560,"thread_start_us":161463,"threads_started":2,"wal-append.queue_time_us":191748}
I20260709 12:17:01.259370 12840 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:16:59.207876 12899 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:01.673970 11730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36424 (request call id 129) took 3002 ms. Trace:
I20260709 12:17:01.347496 12910 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.681573 11730 rpcz_store.cc:276] 0709 12:16:58.671181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.671630 (+   449us) service_pool.cc:224] Handling call
0709 12:16:58.671980 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:58.731887 (+ 59907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:58.731917 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:58.736457 (+  4540us) log.cc:844] Serialized 26 byte log entry
0709 12:16:58.844164 (+107707us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:58.844207 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.844277 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:01.256645 (+2412368us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:17:01.673686 (+417041us) raft_consensus.cc:1685] finished
0709 12:17:01.673705 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:01.673899 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66162,"raft.queue_time_us":62337,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":6065,"spinlock_wait_cycles":2404224,"thread_start_us":83837,"threads_started":1,"wal-append.queue_time_us":347730}
I20260709 12:17:01.682682 12910 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:01.683506 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:01.658202 11624 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:01.684707 12910 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:16:59.227706 12932 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.686643 11624 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:01.686543 12932 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:16:59.142227 12865 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:01.352866 13022 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.071156 13022 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:02.073556 13022 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:00.316075 12916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.228s	user 0.009s	sys 0.010s
I20260709 12:17:01.359905 13029 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:01.370105 13032 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.459969 13035 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:02.820418 12916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.773s	user 0.014s	sys 0.017s
I20260709 12:17:02.820765 13035 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:01.486841 13036 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:02.822202 13036 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:02.822862  4414 debug-util.cc:398] Leaking SignalData structure 0x7b080000f700 after lost signal to thread 11698
I20260709 12:17:02.823102 13035 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:01.478240 13037 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:02.824113 13036 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:01.488335 13034 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:01.489595 13038 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:02.824772 13032 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:02.825203 13038 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:02.826082  4414 kernel_stack_watchdog.cc:198] Thread 11698 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 437ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:17:01.490759 13039 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:01.491983 13040 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:01.369050 11734 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.165s	user 0.012s	sys 0.027s
W20260709 12:17:03.228404 11734 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 4.025s	user 0.016s	sys 0.031s
W20260709 12:17:02.062615 13058 log.cc:927] Time spent T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.369s	user 0.001s	sys 0.000s
W20260709 12:17:01.283860 11481 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.242s	user 0.014s	sys 0.027s
W20260709 12:17:03.247684 11481 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 4.209s	user 0.018s	sys 0.027s
W20260709 12:17:01.459954 11625 connection.cc:256] RPC call timeout handler was delayed by -1.1287221190000309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 12:17:01.662894 11627 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:01.493263 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.252847 11652 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
W20260709 12:17:03.253417 11652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34104 (request call id 135) took 1760 ms (client timeout 1669 ms). Trace:
I20260709 12:17:01.495373 11654 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.260845 11654 raft_consensus.cc:1275] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:01.494917 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:01.674419 11659 rpcz_store.cc:276] 0709 12:16:58.437424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.460556 (+ 23132us) service_pool.cc:224] Handling call
0709 12:16:58.461008 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:58.647770 (+186762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:58.654730 (+  6960us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:58.719932 (+ 65202us) log.cc:844] Serialized 26 byte log entry
0709 12:16:58.787298 (+ 67366us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:58.787335 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.787411 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:01.279524 (+2492113us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:17:01.673560 (+394036us) raft_consensus.cc:1685] finished
0709 12:17:01.673593 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:01.673814 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53739,"raft.queue_time_us":89832,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":11572,"spinlock_wait_cycles":41451392,"thread_start_us":204527,"threads_started":2,"wal-append.queue_time_us":131509}
I20260709 12:17:01.668082 11653 rpcz_store.cc:276] 0709 12:16:58.799338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.799475 (+   137us) service_pool.cc:224] Handling call
0709 12:16:58.799809 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:58.800162 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:58.800193 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:58.800680 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:16:58.879952 (+ 79272us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:58.984442 (+104490us) log.cc:844] Serialized 14 byte log entry
0709 12:16:59.028878 (+ 44436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.036805 (+  7927us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:01.101576 (+2064771us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:17:01.371639 (+270063us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b1800489220. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:17:01.667333 (+295694us) raft_consensus.cc:1685] finished
0709 12:17:01.667362 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:01.667488 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28945,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":21478,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":182,"spinlock_wait_cycles":51347456,"thread_start_us":51116,"threads_started":1,"wal-append.queue_time_us":169679}
I20260709 12:17:02.777388 13054 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.778810 13052 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.783063 13064 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.264911 13054 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.265039 13052 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.265075 13064 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.267082 13054 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:02.783900 13063 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:02.785211 13065 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.267405 13052 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.267784 13065 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:02.857100 11656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 669) took 3954 ms. Trace:
I20260709 12:17:02.867231 13067 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:01.438362 11731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59512 (request call id 437) took 2741 ms (client timeout 1885 ms). Trace:
I20260709 12:17:03.270112 13065 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:02.792311 13066 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:02.758471 11732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.009s	sys 0.020s
W20260709 12:17:02.702750 11772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.062s	user 0.013s	sys 0.010s
W20260709 12:17:03.280968 11772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.640s	user 0.015s	sys 0.010s
I20260709 12:16:59.847132 12953 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:01.670591 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.288142 11729 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:03.288657 11729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 693) took 1626 ms. Trace:
I20260709 12:17:03.288929 11729 rpcz_store.cc:276] 0709 12:17:01.662356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.670372 (+  8016us) service_pool.cc:224] Handling call
0709 12:17:03.288577 (+1618205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:03.289987 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.291345 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.292399 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:01.693583 11735 raft_consensus.cc:1275] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:17:02.799744 11773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.138s	user 0.014s	sys 0.008s
I20260709 12:17:01.691880 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:03.299173 11801 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51068 (request call id 169) took 1607 ms (client timeout 1776 ms). Trace:
W20260709 12:17:03.299537 11801 rpcz_store.cc:269] 0709 12:17:01.691494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.691628 (+   134us) service_pool.cc:224] Handling call
0709 12:17:03.299078 (+1607450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:03.300654 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:02.772955 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:03.302544 13077 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:02.665303 11802 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.005s	sys 0.017s
I20260709 12:17:01.693717 11807 raft_consensus.cc:1275] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:02.771507 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:03.305893 11804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51068 (request call id 171) took 1611 ms (client timeout 1669 ms). Trace:
W20260709 12:17:03.306233 11804 rpcz_store.cc:269] 0709 12:17:01.694527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.771217 (+1076690us) service_pool.cc:224] Handling call
0709 12:17:03.305840 (+534623us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:01.528326 11809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56490 (request call id 476) took 2828 ms. Trace:
I20260709 12:17:03.309520 11809 rpcz_store.cc:276] 0709 12:16:58.699415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.699921 (+   506us) service_pool.cc:224] Handling call
0709 12:16:58.700219 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:58.700517 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:58.700540 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:58.713966 (+ 13426us) log.cc:844] Serialized 26 byte log entry
0709 12:16:58.734308 (+ 20342us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:58.734340 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.734404 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:01.528047 (+2793643us) raft_consensus.cc:1685] finished
0709 12:17:01.528076 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:01.528237 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14142,"raft.queue_time_us":47205,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":22410,"thread_start_us":20005,"threads_started":1,"wal-append.queue_time_us":41119,"wal-append.run_cpu_time_us":18195,"wal-append.run_wall_time_us":3886437}
W20260709 12:17:01.676527 12386 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.366s	user 0.008s	sys 0.006s
W20260709 12:17:01.018183 12388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.000s	sys 0.007s
W20260709 12:17:02.872339 12387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.248s	user 0.016s	sys 0.009s
W20260709 12:17:03.315132 12387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.691s	user 0.017s	sys 0.010s
W20260709 12:17:03.315445 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 1.69148e+06us
W20260709 12:17:02.756991 12428 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.012s	sys 0.016s
W20260709 12:17:03.316840 12428 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.364s	user 0.013s	sys 0.016s
I20260709 12:17:01.949652 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:01.955183 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:03.320433 12434 raft_consensus.cc:2468] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:03.320933 12434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57338 (request call id 659) took 1372 ms. Trace:
I20260709 12:17:03.321220 12434 rpcz_store.cc:276] 0709 12:17:01.948499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.953605 (+  5106us) service_pool.cc:224] Handling call
0709 12:17:03.320851 (+1367246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:03.322361 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:01.959440 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:03.324577 12436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57338 (request call id 664) took 1366 ms. Trace:
I20260709 12:17:03.324909 12436 rpcz_store.cc:276] 0709 12:17:01.958050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.959112 (+  1062us) service_pool.cc:224] Handling call
0709 12:17:03.324499 (+1365387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:01.637538 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:03.329838 12435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57338 (request call id 649) took 1693 ms (client timeout 1673 ms). Trace:
W20260709 12:17:03.330260 12435 rpcz_store.cc:269] 0709 12:17:01.635944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.637300 (+  1356us) service_pool.cc:224] Handling call
0709 12:17:03.329743 (+1692443us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:02.802428 12432 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.030s	sys 0.016s
W20260709 12:17:03.334493 12432 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.380s	user 0.030s	sys 0.016s
W20260709 12:17:03.111192 11515 debug-util.cc:398] Leaking SignalData structure 0x7b0800313e80 after lost signal to thread 4412
I20260709 12:17:03.335582 13078 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:03.336243 11515 debug-util.cc:398] Leaking SignalData structure 0x7b0800250d60 after lost signal to thread 11518
I20260709 12:17:03.336174 13078 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:03.336835 11515 debug-util.cc:398] Leaking SignalData structure 0x7b08003103e0 after lost signal to thread 11624
I20260709 12:16:59.139397 12769 consensus_queue.cc:237] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:01.602025 12776 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.343183 12776 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.344173 12428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57338 (request call id 662) took 1392 ms. Trace:
I20260709 12:17:03.344655 12428 rpcz_store.cc:276] 0709 12:17:01.951782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.952169 (+   387us) service_pool.cc:224] Handling call
0709 12:17:01.952529 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:01.952766 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:03.317287 (+1364521us) log.cc:844] Serialized 14 byte log entry
0709 12:17:03.343772 (+ 26485us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.343840 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:03.343894 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.343968 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.344108 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107700,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":31,"thread_start_us":1390140,"threads_started":2}
I20260709 12:17:01.701131 12832 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:01.559756 12838 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:01.694916 12840 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.483325 12859 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:02.878806 12865 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.090939 12915 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:01.351927 12922 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:03.354445 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.360140 12922 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:01.706947 12932 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.355897 12859 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.363987 12859 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:01.356384 13004 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.365538 13004 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.356542 12865 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.367573 13004 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:03.368480 12865 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:01.674196 13006 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.371181 13006 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.115988 13068 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:03.372009 13068 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.374106 13068 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:03.375749 12922 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.375859 11733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 690) took 1714 ms. Trace:
I20260709 12:17:01.674932 13007 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.359457 12915 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:01.675851 13008 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:01.666261 13009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.337s	user 0.012s	sys 0.016s
I20260709 12:17:01.344233 13010 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.390307 13010 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.392441 13010 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:01.343313 13012 log.cc:927] Time spent T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 1.034s	user 0.012s	sys 0.005s
I20260709 12:17:03.104113 13018 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.395519 11726 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:01.667644 13021 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.398732 13021 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:01.905613 13023 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:03.403486 13023 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:01.362128 13027 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:03.406718 13027 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.407320 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:01.356323 13028 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.414563 13028 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.415575 11730 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:03.416595 13028 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.416750 11730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 695) took 1753 ms. Trace:
I20260709 12:17:03.417188 11730 rpcz_store.cc:276] 0709 12:17:01.663065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.683285 (+ 20220us) service_pool.cc:224] Handling call
0709 12:17:03.416586 (+1733301us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b540071f2d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:03.416696 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3982032768}
I20260709 12:17:02.827293 13032 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:01.487892 13033 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:03.421180 13033 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.423357 13033 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:02.824823 13034 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.425880 13034 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.427285 11808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 164) took 1747 ms. Trace:
I20260709 12:17:03.427680 11808 rpcz_store.cc:276] 0709 12:17:01.680186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.682087 (+  1901us) service_pool.cc:224] Handling call
0709 12:17:01.682375 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.426460 (+1744085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.426507 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.426550 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:03.426578 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.427094 (+   516us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54004592d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:03.427135 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.427236 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4010587008}
I20260709 12:17:03.428944 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:02.823838 13037 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.431893 13037 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:02.827306 13038 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:02.830022 13040 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.435101 13040 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:02.828123 13039 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.192720 13070 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:03.194751 13071 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.196833 13072 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:03.205129 11803 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.524s	user 0.003s	sys 0.023s
I20260709 12:17:03.436376 13070 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:03.437417 11803 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.756s	user 0.003s	sys 0.024s
I20260709 12:17:03.436429 13071 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.438648 13070 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:01.689244 11624 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:03.437523 13039 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:03.439726 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 1.75038e+06us
I20260709 12:17:03.439833 13039 raft_consensus.cc:2804] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:03.440253 13071 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.440456 11624 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:03.441200 13040 raft_consensus.cc:2749] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.440914 13072 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.213183 12847 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:03.230671 12437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57338 (request call id 648) took 1595 ms. Trace:
I20260709 12:17:03.439116 13027 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.441989 12437 rpcz_store.cc:276] 0709 12:17:01.635692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.691010 (+ 55318us) service_pool.cc:224] Handling call
0709 12:17:01.691320 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:01.691735 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:01.691765 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:01.692269 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:17:01.706184 (+ 13915us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:01.706227 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.706306 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:03.230398 (+1524092us) raft_consensus.cc:1685] finished
0709 12:17:03.230419 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.230586 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":781,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":13475,"threads_started":1,"wal-append.queue_time_us":1270}
I20260709 12:17:03.246142 13074 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:03.230710 11734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 687) took 4061 ms. Trace:
W20260709 12:17:03.254196 11652 rpcz_store.cc:269] 0709 12:17:01.492879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.493006 (+   127us) service_pool.cc:224] Handling call
0709 12:17:03.253329 (+1760323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:03.443638 13074 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.444334 12847 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.444947 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:03.251291 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 1.58831e+06us
I20260709 12:17:03.446056 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.261246 13036 raft_consensus.cc:2749] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:03.261724 11654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34104 (request call id 138) took 1766 ms. Trace:
I20260709 12:17:03.447165 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.447547 11654 rpcz_store.cc:276] 0709 12:17:01.494875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.494979 (+   104us) service_pool.cc:224] Handling call
0709 12:17:01.495254 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.261089 (+1765835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.261652 (+   563us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:03.255769 13030 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:03.448205 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.446190 11627 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:03.448328 13030 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.448751 11808 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:03.267436 13064 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:03.268675 11656 rpcz_store.cc:276] 0709 12:16:58.902232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.904285 (+  2053us) service_pool.cc:224] Handling call
0709 12:17:01.561785 (+2657500us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b5800891998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:17:01.562033 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.855097 (+1293064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:02.855140 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:02.855191 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:02.855229 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.856766 (+  1537us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54009312d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:02.856825 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.857015 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2979074176}
W20260709 12:17:03.269989 11731 rpcz_store.cc:269] 0709 12:16:58.696960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.697508 (+   548us) service_pool.cc:224] Handling call
0709 12:17:01.438077 (+2740569us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54009461d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:01.438242 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231548160}
I20260709 12:17:03.450161 13036 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.450755 13074 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:03.450824 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.452195 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:03.440246 13039 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:02.746819 11727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36424 (request call id 130) took 3840 ms. Trace:
I20260709 12:17:03.270918 13066 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.268867 13067 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:03.272665 11732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.581s	user 0.009s	sys 0.020s
I20260709 12:17:03.457922 11727 rpcz_store.cc:276] 0709 12:16:58.905947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.920916 (+ 14969us) service_pool.cc:224] Handling call
0709 12:17:01.450530 (+2529614us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b58005e4798. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:17:01.450780 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:02.072653 (+621873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:02.072689 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:02.073229 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 12:17:02.108112 (+ 34883us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:02.108173 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.746426 (+638253us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54005654d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:02.746499 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.746551 (+    52us) raft_consensus.cc:1685] finished
0709 12:17:02.746565 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.746748 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":735,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":130,"spinlock_wait_cycles":1513715712,"thread_start_us":31967,"threads_started":1,"wal-append.queue_time_us":17593,"wal-append.run_cpu_time_us":4020,"wal-append.run_wall_time_us":1016862}
I20260709 12:17:03.273289 13063 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.276796 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:03.460284 13067 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.460438 11732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 688) took 1799 ms. Trace:
I20260709 12:17:01.460256 12942 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:01.641387 12944 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:03.460856 11732 rpcz_store.cc:276] 0709 12:17:01.660758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.666018 (+  5260us) service_pool.cc:224] Handling call
0709 12:17:01.666349 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:01.690762 (+ 24413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:01.690790 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:01.691241 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:17:03.459162 (+1767921us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:03.459206 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.460081 (+   875us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b54003930d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:03.460120 (+    39us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:03.460160 (+    40us) raft_consensus.cc:1685] finished
0709 12:17:03.460173 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.460386 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17084,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":144,"spinlock_wait_cycles":48263936,"thread_start_us":1767563,"threads_started":1,"wal-append.queue_time_us":373398,"wal-append.run_cpu_time_us":1738,"wal-append.run_wall_time_us":1001749}
I20260709 12:17:03.466730 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.466884 13063 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.467360 11732 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:17:03.446528 11734 rpcz_store.cc:276] 0709 12:16:59.169341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.182227 (+ 12886us) service_pool.cc:224] Handling call
0709 12:16:59.203149 (+ 20922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:59.203361 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:03.228890 (+4025529us) log.cc:844] Serialized 14 byte log entry
0709 12:17:03.230383 (+  1493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.230433 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:03.230482 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.230545 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.230656 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":843513,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":491,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":4026220,"threads_started":2,"wal-append.queue_time_us":838}
I20260709 12:17:03.468317 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.468472 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.282511 12953 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.470328 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.470890 11734 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:03.471704 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.471756 12953 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.472205 13065 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:03.472286 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.473109 11732 raft_consensus.cc:2410] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:01.688928 12975 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:03.474550 12975 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:03.474926 12975 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:01.364153 11698 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.68:40845 timed out after 1.827s (SENT) [suppressed 45 similar messages]
I20260709 12:17:01.483004 12970 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.480964 12970 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.473909 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.460285 13066 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.439172 13070 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:01.661382 12984 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.484279 12984 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.484653 12984 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.485070 13021 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.485566 13021 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.487037 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.285125 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.488075 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.292613 13052 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.488507 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.489712 13052 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.490506 12953 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.490996 12953 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.491690 13052 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.492870 12953 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.496556 12984 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:03.296943 11773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.635s	user 0.016s	sys 0.009s
W20260709 12:17:03.499028 11773 connection.cc:256] RPC call timeout handler was delayed by -1.7128559269999641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 12:17:03.499249 13021 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.499989 13066 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.500697 13067 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.500522 13066 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.501257 11773 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:03.303097 13077 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:03.304724 11802 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.623s	user 0.005s	sys 0.017s
I20260709 12:17:03.502159 11773 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:03.305251 11807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 170) took 1612 ms. Trace:
W20260709 12:17:03.314116 12388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.995s	user 0.001s	sys 0.007s
I20260709 12:17:03.503156 13077 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.503842 13032 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.504159 13071 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.504645 13071 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.506512 13071 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:03.506961 13071 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.507362 13071 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.502815 11807 rpcz_store.cc:276] 0709 12:17:01.692930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.693154 (+   224us) service_pool.cc:224] Handling call
0709 12:17:01.693417 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.304988 (+1611571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.305181 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:03.504192 13077 raft_consensus.cc:2804] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.509414 13077 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.509737 13077 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.516988 13077 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.504187 13032 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.518333 13032 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.522607 12984 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:03.542860 12434 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:03.318068 11729 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:17:03.319883 12429 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
W20260709 12:17:03.551653 12429 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57338 (request call id 660) took 1602 ms (client timeout 1964 ms). Trace:
W20260709 12:17:03.552062 12429 rpcz_store.cc:269] 0709 12:17:01.948901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.949327 (+   426us) service_pool.cc:224] Handling call
0709 12:17:03.551580 (+1602253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:03.355858 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.553182 11659 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:01.487063 13002 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.358435 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:03.376648 11515 debug-util.cc:398] Leaking SignalData structure 0x7b0800246ea0 after lost signal to thread 11685
I20260709 12:17:03.554926 13002 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:03.555574 11515 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6f20 after lost signal to thread 11686
W20260709 12:17:03.556896 11515 debug-util.cc:398] Leaking SignalData structure 0x7b080023fae0 after lost signal to thread 11759
I20260709 12:17:03.371095 11701 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:03.378839 13007 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.376327 11733 rpcz_store.cc:276] 0709 12:17:01.661389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.667039 (+  5650us) service_pool.cc:224] Handling call
0709 12:17:01.667304 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.374688 (+1707384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.374717 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.374756 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:03.374783 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.375541 (+   758us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400a16b54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:03.375580 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.375694 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3926165248}
W20260709 12:17:03.558220 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 187185us
I20260709 12:17:03.558817 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.560230 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.560691 13008 raft_consensus.cc:2804] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.561209 13008 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:03.561601 13008 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.564211 13002 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.561462 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.565961 11733 raft_consensus.cc:2410] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:03.566905 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.347985 13078 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.383647 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.569301 11653 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:17:03.387476 12865 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.570278 12865 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.572342 12865 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:03.388409 11728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 689) took 1727 ms. Trace:
I20260709 12:17:03.572971 11728 rpcz_store.cc:276] 0709 12:17:01.661112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.666527 (+  5415us) service_pool.cc:224] Handling call
0709 12:17:01.666818 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.380415 (+1713597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.380455 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.380501 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:03.380537 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.388168 (+  7631us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54004b1754. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:03.388217 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.388350 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3940347776}
W20260709 12:17:03.574024 11515 debug-util.cc:398] Leaking SignalData structure 0x7b080011f8a0 after lost signal to thread 11833
I20260709 12:17:03.574456 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.394536 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.395203 13018 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.575690 11661 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
W20260709 12:17:03.574402 11515 debug-util.cc:398] Leaking SignalData structure 0x7b08003589c0 after lost signal to thread 11834
W20260709 12:17:03.576697 11515 debug-util.cc:398] Leaking SignalData structure 0x7b08002026c0 after lost signal to thread 12388
I20260709 12:17:03.576992 13018 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:03.399621 11726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 685) took 4304 ms (client timeout 2243 ms). Trace:
I20260709 12:17:01.680037 13019 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.412216 12838 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.579053 12838 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:02.820696 13029 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.418408 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.419356 12431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57338 (request call id 655) took 1781 ms. Trace:
I20260709 12:17:03.443104 13072 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.405565 13023 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.449676 11627 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:03.261888 11657 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.413610 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.580770 12431 rpcz_store.cc:276] 0709 12:17:01.638190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.646344 (+  8154us) service_pool.cc:224] Handling call
0709 12:17:01.646618 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.417361 (+1770743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.417392 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.417433 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:03.417461 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.419136 (+  1675us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b540063abd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:03.419178 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.419300 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4071899904}
I20260709 12:17:03.446343 12847 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:03.582085 12944 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:03.453516 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.452817 11731 raft_consensus.cc:3060] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.582610 12944 raft_consensus.cc:697] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:03.452796 13039 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.454094 11624 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:03.583447 12944 consensus_queue.cc:237] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:03.584177 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 142423us
I20260709 12:17:03.584896 11624 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:03.458689 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.585845 13036 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:03.472770 13065 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:03.581818 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 132224us
I20260709 12:17:03.588284 13065 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:03.588742 11657 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:03.588888 13038 raft_consensus.cc:2749] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.472240 11734 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
I20260709 12:17:03.586269 13036 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:03.589794 13036 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.486862 12969 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.591205 12840 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.591742 12840 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:03.592074 12386 connection.cc:256] RPC call timeout handler was delayed by -3.198128362000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 12:17:03.592540 12386 connection.cc:256] RPC call timeout handler was delayed by -2.8845159540001077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 12:17:03.592859 12969 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.473875 11803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 166) took 1793 ms. Trace:
I20260709 12:17:03.593536 11803 rpcz_store.cc:276] 0709 12:17:01.680725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.680830 (+   105us) service_pool.cc:224] Handling call
0709 12:17:01.681117 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:01.681307 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:03.437885 (+1756578us) log.cc:844] Serialized 14 byte log entry
0709 12:17:03.471989 (+ 34104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.472045 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:03.472092 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.473677 (+  1585us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.473822 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":378665,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":10474,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"thread_start_us":1789973,"threads_started":2,"wal-append.queue_time_us":32853}
I20260709 12:17:03.595657 11658 raft_consensus.cc:1240] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:03.596210 12969 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.596758 12969 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.598034 11625 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:03.593685 12840 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.598973 13040 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.599164 12840 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:03.599677 12840 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.460630 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.600103 12840 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.600957 11731 raft_consensus.cc:2468] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:17:03.601053 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.598824 12969 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.602453 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.602550 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.603351 11731 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:03.603727 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.604175 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.604651 11727 raft_consensus.cc:2410] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:03.605185 11731 raft_consensus.cc:2410] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:03.599452 13040 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.607847 13040 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.464974 12942 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.483188 13070 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.295740 13054 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.609126 13054 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.609795 12942 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.611240 13054 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.482909 12970 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.501133 13067 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.612486 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.586078 11656 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:03.612891 13006 consensus_queue.cc:1048] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:03.613503 13067 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:03.479869 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 2.11554e+06us
I20260709 12:17:03.614475 13036 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.615564 13070 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.297971 11735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36424 (request call id 131) took 1951 ms. Trace:
I20260709 12:17:03.616153 11735 rpcz_store.cc:276] 0709 12:17:01.346799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.347956 (+  1157us) service_pool.cc:224] Handling call
0709 12:17:01.348286 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.294634 (+1946348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.297693 (+  3059us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54003a9654. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:03.297884 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780784896}
I20260709 12:17:03.617807 11735 raft_consensus.cc:1275] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.582269 13029 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.619217 11735 raft_consensus.cc:1275] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:03.619547 11735 pending_rounds.cc:85] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef: Aborting all ops after (but not including) 1
I20260709 12:17:03.619751 11735 pending_rounds.cc:107] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:03.620015 11735 raft_consensus.cc:2889] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:03.621208 11735 raft_consensus.cc:1240] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.316066 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.622145 11733 raft_consensus.cc:2468] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 1.
I20260709 12:17:03.538108 13066 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.488612 11805 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:03.530004 13071 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:03.576772 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:03.577495 11726 rpcz_store.cc:269] 0709 12:16:59.095636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.096958 (+  1322us) service_pool.cc:224] Handling call
0709 12:17:01.333464 (+2236506us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b58005e4798. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:17:03.399386 (+2065922us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540028b4d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:03.399528 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3967433216}
I20260709 12:17:03.626616 12840 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.627708 11698 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:03.628540 12912 raft_consensus.cc:2749] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:03.628702 12840 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.345490 12776 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:03.630481 13036 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.581102 12838 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.590001 11808 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:03.635095 11481 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33118 (request call id 108) took 5223 ms. Trace:
I20260709 12:17:03.590296 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.456066 13030 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:03.579392 11515 debug-util.cc:398] Leaking SignalData structure 0x7b08003361e0 after lost signal to thread 12463
I20260709 12:17:03.637367 12975 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.638242 13039 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.639609 12975 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.639938 11731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 694) took 1977 ms. Trace:
I20260709 12:17:03.632022 11482 catalog_manager.cc:5697] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 2, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 2 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:03.590268 13035 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.552075 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.630311 11483 catalog_manager.cc:5697] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 2 to 3, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 3 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:03.631206 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 58110.8us
I20260709 12:17:03.605564 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.642719 11701 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:03.643481 13030 raft_consensus.cc:2804] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:03.643875 13030 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:03.644223 13030 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.641413 13035 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.645080 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:03.645685 12431 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
W20260709 12:17:03.592905 12386 connection.cc:256] RPC call timeout handler was delayed by -2.3663220040000397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 12:17:03.646543 13035 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:03.589306 11657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34104 (request call id 137) took 2094 ms (client timeout 2228 ms). Trace:
W20260709 12:17:03.648308 11657 rpcz_store.cc:269] 0709 12:17:01.494573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.494683 (+   110us) service_pool.cc:224] Handling call
0709 12:17:03.589250 (+2094567us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:03.641384 11515 debug-util.cc:398] Leaking SignalData structure 0x7b080026ee00 after lost signal to thread 12464
W20260709 12:17:03.650339 11515 debug-util.cc:398] Leaking SignalData structure 0x7b08001c7f00 after lost signal to thread 12769
W20260709 12:17:03.650648 11515 debug-util.cc:398] Leaking SignalData structure 0x7b0800158fc0 after lost signal to thread 12827
I20260709 12:17:03.650775 13035 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:03.651072 11515 debug-util.cc:398] Leaking SignalData structure 0x7b08003ee8e0 after lost signal to thread 12915
I20260709 12:17:03.526328 12387 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:03.651261 13035 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.652047 13036 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.652117 12838 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:03.652686 12838 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:03.653115 12838 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:03.653813 13035 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.654317 13035 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.650658 11482 catalog_manager.cc:5697] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 3, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 3 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:03.640584 13039 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:03.652621 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 126359us
I20260709 12:17:03.657850 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.640143 13095 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.676294 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.682297 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.683048 11654 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:03.654712 13035 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.689235 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.689990 11653 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:03.690932 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.651810 13030 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.692013 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.693006 13030 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.668664 13036 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.694543 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.695698 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.696322 11659 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:03.697196 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.697748 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.698483 11658 raft_consensus.cc:2393] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 3: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:03.665303 11731 rpcz_store.cc:276] 0709 12:17:01.662754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.605920 (+1943166us) service_pool.cc:224] Handling call
0709 12:17:03.635618 (+ 29698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.635821 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.635849 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.635899 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:03.635932 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.636003 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.636756 (+   753us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b5400072450. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:03.639866 (+  3110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67461504}
I20260709 12:17:03.699185 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.699811 11658 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:03.700583 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.701063 11483 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42110 (request call id 149) took 5841 ms. Trace:
I20260709 12:17:03.701535 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:03.703395 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.703482 11658 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.709736 11660 raft_consensus.cc:2393] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 2: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:03.710364 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.695712 13036 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.715510 11699 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:03.701421 11483 rpcz_store.cc:276] 0709 12:16:57.859473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.859624 (+   151us) service_pool.cc:224] Handling call
0709 12:17:03.701008 (+5841384us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:03.647353 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:03.647849 (+   496us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:03.647880 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:17:03.647896 (+    16us) tablet.cc:662] Decoding operations
0709 12:17:03.648200 (+   304us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:03.648327 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:03.648354 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:17:03.648521 (+   167us) tablet.cc:701] Row locks acquired
0709 12:17:03.648537 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:17:03.648669 (+   132us) write_op.cc:270] Start()
0709 12:17:03.648849 (+   180us) write_op.cc:276] Timestamp: P: 1783599423648628 usec, L: 0
0709 12:17:03.648870 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:17:03.684388 (+ 35518us) log.cc:844] Serialized 534 byte log entry
0709 12:17:03.688261 (+  3873us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5400701a54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda46e28 00007f4501481581 00007f4501480d58 00007f45014859f1 00007f45014859a9 00007f4501485939 00007f4501485901 00007f4501484b2d 0000000000388634 0000000000388479
0709 12:17:03.696053 (+  7792us) op_driver.cc:464] REPLICATION: finished
0709 12:17:03.696562 (+   509us) write_op.cc:301] APPLY: starting
0709 12:17:03.696645 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:03.696738 (+    93us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:03.696758 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:03.696966 (+   208us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:03.697127 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:17:03.697170 (+    43us) write_op.cc:312] APPLY: finished
0709 12:17:03.697353 (+   183us) log.cc:844] Serialized 22 byte log entry
0709 12:17:03.697511 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:03.697585 (+    74us) write_op.cc:454] Released schema lock
0709 12:17:03.697626 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:03.697974 (+   348us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:03.698001 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":82150,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":294,"apply.run_cpu_time_us":1382,"apply.run_wall_time_us":1382,"num_ops":1,"prepare.queue_time_us":2806,"prepare.run_cpu_time_us":4529,"prepare.run_wall_time_us":41085,"replication_time_us":47043,"spinlock_wait_cycles":39362304}]]}
I20260709 12:17:03.635567 11481 rpcz_store.cc:276] 0709 12:16:58.411553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.433325 (+ 21772us) service_pool.cc:224] Handling call
0709 12:17:03.634987 (+5201662us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:00.307246 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:00.316791 (+  9545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:00.316832 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:17:00.316849 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:00.321447 (+  4598us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:00.322737 (+  1290us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:00.322972 (+   235us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:17:00.328300 (+  5328us) tablet.cc:701] Row locks acquired
0709 12:17:00.328321 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:17:00.328510 (+   189us) write_op.cc:270] Start()
0709 12:17:00.328634 (+   124us) write_op.cc:276] Timestamp: P: 1783599420328448 usec, L: 0
0709 12:17:00.328657 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:17:00.329395 (+   738us) log.cc:844] Serialized 2445 byte log entry
0709 12:17:03.381510 (+3052115us) op_driver.cc:464] REPLICATION: finished
0709 12:17:03.395072 (+ 13562us) write_op.cc:301] APPLY: starting
0709 12:17:03.395151 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:03.395331 (+   180us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:03.395453 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:03.398997 (+  3544us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b5400701a54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4832a 00007f44fd9cdf14 00007f44fd9cdec3 00007f44fd9cde38 00007f44fd9cddf3 00007f44fd9cd0dc 00007f44fd9f6e16 00007f44fd9decbb 00007f44fd9c939d 00007f44fd9ccd75
0709 12:17:03.527605 (+128608us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:03.527805 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:17:03.527863 (+    58us) write_op.cc:312] APPLY: finished
0709 12:17:03.528096 (+   233us) log.cc:844] Serialized 52 byte log entry
0709 12:17:03.538110 (+ 10014us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:03.538229 (+   119us) write_op.cc:454] Released schema lock
0709 12:17:03.538274 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:03.544348 (+  6074us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:03.544382 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":101750,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":13306,"apply.run_cpu_time_us":3013,"apply.run_wall_time_us":149083,"num_ops":6,"prepare.queue_time_us":1260538,"prepare.run_cpu_time_us":33660,"prepare.run_wall_time_us":3074239,"raft.queue_time_us":11846,"raft.run_cpu_time_us":27778,"raft.run_wall_time_us":2329720,"replication_time_us":3052676,"spinlock_wait_cycles":5315657472,"thread_start_us":7292022,"threads_started":5,"wal-append.queue_time_us":739464,"wal-append.run_cpu_time_us":8487,"wal-append.run_wall_time_us":1010888}]]}
I20260709 12:17:03.717519 11699 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:03.693169 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:03.720441 11699 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:03.718488 13027 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.680915 12776 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:17:03.727995 13077 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:03.668165 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.729719 11657 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:03.738639 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.739364 11808 raft_consensus.cc:2468] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
W20260709 12:17:03.745453 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 70552.7us
I20260709 12:17:03.754693 11658 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:03.755784 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:03.734074 11659 raft_consensus.cc:2393] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 2: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:03.770246 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:03.781023 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.771086 12434 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:03.763408 12431 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
I20260709 12:17:03.784102 11654 raft_consensus.cc:2376] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3. Re-sending same reply.
I20260709 12:17:03.786062 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.786882 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.781498 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.788025 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.790066 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.790767 11657 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
W20260709 12:17:03.793264 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 143613us
I20260709 12:17:03.787177 13071 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.795233 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.795611 13071 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.796559 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.666550 12832 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.722078 13027 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.831405 11732 raft_consensus.cc:2393] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:03.796357 13008 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:03.733331 13010 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:03.803654 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.799255 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.847815 11654 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:03.737651 11653 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.799388 12387 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:03.841820 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:03.740935 13030 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.686235 13095 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:03.848115 11660 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
W20260709 12:17:03.869735 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 70600.8us
I20260709 12:17:03.869400 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.869298 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.882476 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:03.884079 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:03.887336 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.886248 11657 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:03.888060 11659 raft_consensus.cc:2393] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:03.888065 11735 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.890326 11809 raft_consensus.cc:1240] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:03.890936 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.891631 11658 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:03.797684 13071 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:03.886489 12386 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:03.894240 11730 raft_consensus.cc:2393] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:03.894937 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.898824 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.899415 11806 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:17:03.846704 13027 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.896180 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.893942 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.905180 11807 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:03.912164 13027 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:03.847821 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.941907 11652 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:03.943022 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.944235 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.846676 13010 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.946043 13010 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:03.868376 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:03.949769 12429 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:03.915773 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.950915 11660 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:03.916641 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:03.917423 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:03.959059 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.960196 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.961213 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.918087 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:03.962128 11809 raft_consensus.cc:2368] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:03.918877 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:03.962296 11732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:03.962904 11806 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.963011 11732 raft_consensus.cc:606] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:03.970147 11807 raft_consensus.cc:2410] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:17:03.919315 12432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.010s	sys 0.010s
I20260709 12:17:03.920867 11773 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:17:03.971129 12432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.010s	sys 0.010s
W20260709 12:17:03.971436 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 50643us
I20260709 12:17:03.972012 11806 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:03.922695 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.923508 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.927933 12387 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:03.928766 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:03.972388 11773 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:03.974143 11654 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:03.930164 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:03.893710 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:03.924062 12386 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:03.937038 13019 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.937444 13071 consensus_queue.cc:1048] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:03.885967 13032 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:03.975660 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 47828.8us
I20260709 12:17:03.988247 12387 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:03.989344 12387 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:03.929719 12769 consensus_queue.cc:1059] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:17:03.976708 11773 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:03.969552 11805 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
W20260709 12:17:03.934459 13091 log.cc:927] Time spent T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:17:03.937155 12838 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.978713 13065 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:03.982774 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 58775.4us
W20260709 12:17:04.049961 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 73279.6us
I20260709 12:17:03.977350 12432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57338 (request call id 663) took 2025 ms. Trace:
I20260709 12:17:04.050720 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:03.887042 13080 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.051579 11773 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:03.984791 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:03.986024 13078 raft_consensus.cc:2804] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:03.996614 11661 raft_consensus.cc:1275] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.998462 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:03.930176 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 332175us
I20260709 12:17:04.054749 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.056522 11625 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:03.981477 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:04.057263 11658 raft_consensus.cc:2468] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
I20260709 12:17:03.982494 12776 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:03.978826 12953 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:03.983181 13019 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.060235 13019 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.052286 11806 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:03.986279 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.052441 11773 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:04.062995 12838 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.063652 11773 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:04.063902 11801 raft_consensus.cc:2393] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:04.064559 11773 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:04.050604 12386 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:04.065192 11802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 165) took 2378 ms. Trace:
I20260709 12:17:04.002553 13023 raft_consensus.cc:2804] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:04.069227 13033 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.043009 13063 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:04.070284 13008 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:04.070152 13063 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:03.999920 12832 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:03.999678 13072 consensus_queue.cc:1059] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:17:04.071491 13072 raft_consensus.cc:3055] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:04.071794 13052 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.071575 13010 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:04.073599 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.074904 12953 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:04.054437 13080 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.999509 13021 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.041229 13054 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.058663 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:04.067932 13064 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.065610 11802 rpcz_store.cc:276] 0709 12:17:01.680471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.680579 (+   108us) service_pool.cc:224] Handling call
0709 12:17:01.680892 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:01.681093 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:03.502145 (+1821052us) log.cc:844] Serialized 14 byte log entry
0709 12:17:03.983595 (+481450us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.996460 (+ 12865us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:03.999268 (+  2808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.041386 (+ 42118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.058749 (+ 17363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6885,"prepare.queue_time_us":378620,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":6970,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":39607,"thread_start_us":2251395,"threads_started":2}
I20260709 12:17:04.069689 13033 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.075237 13095 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:04.055698 11808 raft_consensus.cc:2393] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:04.051124 12432 rpcz_store.cc:276] 0709 12:17:01.952060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.953891 (+  1831us) service_pool.cc:224] Handling call
0709 12:17:01.954184 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:01.954394 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:03.334928 (+1380534us) log.cc:844] Serialized 14 byte log entry
0709 12:17:03.976994 (+642066us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.977051 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:03.977095 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.977158 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.977285 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6166,"prepare.queue_time_us":106259,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":5413,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4638,"thread_start_us":2016451,"threads_started":2}
I20260709 12:17:04.099951 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.100634 11731 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:04.078572 11698 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:04.077112 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.102234 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.103209 12437 raft_consensus.cc:1240] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:04.072220 13052 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:04.103701 13052 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.104293 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.058411 13034 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:04.104939 12437 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:04.080744 11735 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:04.076583 13035 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:04.089030 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.108196 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.089598 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:04.109479 11658 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:04.093386 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:04.090745 11773 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:04.094463 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:04.076042 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:04.088630 13036 consensus_queue.cc:1048] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:17:04.058854 13078 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.063671 12984 raft_consensus.cc:2804] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.097184 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.067245 12776 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.098449 13032 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:04.128018 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.090185 12975 raft_consensus.cc:2804] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:04.106525 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.107081 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.081693 11625 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:04.088949 12769 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.096873 13033 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.138123 12975 raft_consensus.cc:697] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:04.139072 12975 consensus_queue.cc:237] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.141378 11801 raft_consensus.cc:2393] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:04.110057 11661 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:04.141965 13019 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.138008 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.142992 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.143683 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.144160 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.075898 13065 raft_consensus.cc:697] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.144747 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.145560 13065 consensus_queue.cc:237] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.146281 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.148032 13019 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.149235 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.131031 12776 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.150610 11701 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:04.108211 13039 consensus_queue.cc:1048] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 12:17:04.117623 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08001067c0 after lost signal to thread 4412
W20260709 12:17:04.153573 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800097d20 after lost signal to thread 11481
W20260709 12:17:04.154440 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08002cb660 after lost signal to thread 11518
W20260709 12:17:04.154955 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08000b5920 after lost signal to thread 11624
W20260709 12:17:04.155202 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08001b66e0 after lost signal to thread 11625
W20260709 12:17:04.155429 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08000b58a0 after lost signal to thread 11627
I20260709 12:17:04.155632 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:04.156023 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800135260 after lost signal to thread 11652
I20260709 12:17:04.117865 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.126870 11699 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.076120 13080 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.115281 11773 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:04.071864 13072 raft_consensus.cc:740] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:04.107499 13034 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:04.128078 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:04.167644 11658 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.083469 13064 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.083191 13021 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:04.120668 11698 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:04.172588 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 51987.4us
I20260709 12:17:04.116845 12984 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:04.088835 13023 raft_consensus.cc:697] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:04.134459 12387 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.158918 12769 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.135902 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.136387 13095 raft_consensus.cc:2804] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:04.134831 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 53226.5us
I20260709 12:17:04.142463 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:04.116194 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:04.187222 11805 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.162283 11735 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:04.129317 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:04.113688 13078 raft_consensus.cc:3060] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:04.163414 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080020e840 after lost signal to thread 11653
W20260709 12:17:04.171288 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 44533.5us
I20260709 12:17:04.132599 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.131356 13037 raft_consensus.cc:2804] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.131342 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.177680 11698 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.095767 13018 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:04.180759 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 46396.9us
I20260709 12:17:04.196870 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:04.197604 12431 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.197855 12387 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.186507 11661 raft_consensus.cc:2468] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 1.
I20260709 12:17:04.176128 13064 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.180759 12984 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.183126 12859 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.198935 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:04.278911 11661 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
W20260709 12:17:04.211833  4414 debug-util.cc:398] Leaking SignalData structure 0x7b080000fd00 after lost signal to thread 11624
I20260709 12:17:04.182168 13008 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.195739 13037 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.183941 13010 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.173796 13034 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.243995 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:04.244240 13104 log.cc:927] Time spent T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:17:04.243654 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.190603 13095 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:04.192643 12932 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:04.245287 13106 log.cc:927] Time spent T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:04.199502 13018 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.189795 12769 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.294633 13095 raft_consensus.cc:3060] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.188577 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:04.175748 13021 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.243623 13023 consensus_queue.cc:237] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.278664 12859 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:04.166363 13066 consensus_queue.cc:1059] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:17:04.250759 12865 raft_consensus.cc:2804] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.181995 13071 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:04.281383 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08000c4ae0 after lost signal to thread 4412
I20260709 12:17:04.296129 13018 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:04.193313 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080020e8e0 after lost signal to thread 11654
I20260709 12:17:04.283263 13037 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.318881 12859 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.277901 13007 raft_consensus.cc:2749] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.301616 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:04.281436 13032 raft_consensus.cc:2749] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.242305 12387 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:04.310699 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 195463us
I20260709 12:17:04.295338 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:04.166630 11701 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:04.338624 11773 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:04.338673 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 172206us
I20260709 12:17:04.314291 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.316439 11658 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:04.346935 11661 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.342549 11773 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:04.348133 11701 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:04.350373 11701 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:04.332669 11805 raft_consensus.cc:2468] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:04.296639 11655 raft_consensus.cc:2393] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:04.348246 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:04.352151 11728 raft_consensus.cc:2368] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.352285 13010 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:04.352737 13084 log.cc:927] Time spent T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:04.352981 13107 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:04.353448 13107 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.349277 12915 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:04.358261 13098 log.cc:927] Time spent T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:17:04.319919 12865 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:04.362072 12865 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.353194 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.364606 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.334925 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.245209 13072 consensus_queue.cc:260] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:04.365887 13002 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.358263 12915 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:04.366389 13072 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.366719 12915 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:04.368466 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 126262us
I20260709 12:17:04.369243 12387 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.370312 12387 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:04.371841 13107 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:04.352778 13010 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.373445 13010 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:04.334918 13066 raft_consensus.cc:3055] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:04.375924 13066 raft_consensus.cc:740] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.376914 13066 consensus_queue.cc:260] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.378108 13066 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:04.378947 11658 raft_consensus.cc:1275] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:04.380192 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.382092 11656 raft_consensus.cc:1275] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:04.385862 11653 raft_consensus.cc:2468] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:04.387521 13078 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:04.387792 13033 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.388145 13052 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.389117 11806 raft_consensus.cc:1240] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:04.390933 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:04.393836 13068 consensus_queue.cc:1175] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "264376c764c64dc78c4cef6031c15eef" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 1 last_received_current_leader { term: 2 index: 2 } }
W20260709 12:17:04.394963 11830 debug-util.cc:398] Leaking SignalData structure 0x7b0800133220 after lost signal to thread 11518
W20260709 12:17:04.396386 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3560 after lost signal to thread 11685
I20260709 12:17:04.397837 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.398532 12436 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:04.399636 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.401600 12953 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:04.338302 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080020e820 after lost signal to thread 11657
W20260709 12:17:04.402849 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080020e760 after lost signal to thread 11659
I20260709 12:17:04.403359 13027 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:04.403995 13115 raft_consensus.cc:2749] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.404289 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.406586 12932 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.407039 12932 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.407713 13107 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:04.408499 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:04.409051 11660 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
W20260709 12:17:04.403422 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800110600 after lost signal to thread 11685
I20260709 12:17:04.410167 13032 raft_consensus.cc:2749] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.406757 12776 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.412406 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:04.410140 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7da0 after lost signal to thread 11686
W20260709 12:17:04.474584 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08002199c0 after lost signal to thread 11698
I20260709 12:17:04.475222 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:04.476143 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:17:04.417573 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 46297.5us
I20260709 12:17:04.417953 11661 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
W20260709 12:17:04.475306 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08001260c0 after lost signal to thread 11729
W20260709 12:17:04.477144 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800126020 after lost signal to thread 11731
W20260709 12:17:04.477473 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08001260a0 after lost signal to thread 11735
I20260709 12:17:04.477711 11661 raft_consensus.cc:1240] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:17:04.478084 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800360100 after lost signal to thread 11759
I20260709 12:17:04.478482 13054 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.478943 13054 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.486444 13034 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.487545 11809 raft_consensus.cc:1240] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:04.489826 13008 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.485265 12769 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.492246 12769 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.419495 13070 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.419878 12838 raft_consensus.cc:2749] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.419744 12932 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:04.420374 13052 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:04.419492 13095 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.520108 12932 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.520359 13095 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:04.420921 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.520891 11726 raft_consensus.cc:1240] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:04.521961 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:04.522881 12431 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:04.520952 11660 raft_consensus.cc:1240] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.519678 12915 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:04.527493 12915 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:04.422333 11657 raft_consensus.cc:1240] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:04.530177 13054 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.532333 13054 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.532873 13107 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:04.535147 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.536423 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.537050 12431 raft_consensus.cc:2368] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.537793 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.538756 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.539307 12431 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
W20260709 12:17:04.539675 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 197200us
I20260709 12:17:04.540027 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.541000 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.544304 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.413942 12776 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.426194 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.545707 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:17:04.427536 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 210058us
I20260709 12:17:04.545805 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:04.428574 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.547214 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.431288 11482 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42134 (request call id 150) took 5860 ms. Trace:
I20260709 12:17:04.432202 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.548318 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:04.549048 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.439471 12438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57338 (request call id 650) took 2803 ms. Trace:
I20260709 12:17:04.549369 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:04.424914 12984 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.420068 13019 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:04.550740 13019 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.551113 13019 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:04.552030 12984 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.552338 12769 consensus_queue.cc:1059] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.553172 12984 raft_consensus.cc:3055] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.553503 12984 raft_consensus.cc:740] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.450217 13071 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:04.451015 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.451915 13067 raft_consensus.cc:3055] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.574678 13067 raft_consensus.cc:740] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.575647 13067 consensus_queue.cc:260] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.577013 13067 raft_consensus.cc:3060] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.574482 12984 consensus_queue.cc:260] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.578969 12984 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.452937 11729 raft_consensus.cc:1240] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:04.456277 12435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57338 (request call id 678) took 1256 ms. Trace:
I20260709 12:17:04.460912 11658 raft_consensus.cc:1240] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.583138 12429 raft_consensus.cc:1240] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:04.465826 11659 raft_consensus.cc:1240] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:04.469648 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.471239 11733 raft_consensus.cc:1240] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:04.476526 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08001bb680 after lost signal to thread 11759
W20260709 12:17:04.478945 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5580 after lost signal to thread 11801
I20260709 12:17:04.586133 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:17:04.586290 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad4c0 after lost signal to thread 11833
I20260709 12:17:04.586434 11733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 699) took 1063 ms. Trace:
I20260709 12:17:04.418196 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.471135 11730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36424 (request call id 133) took 1097 ms. Trace:
I20260709 12:17:04.484364 13064 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:04.587093 11733 rpcz_store.cc:276] 0709 12:17:03.522926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.624317 (+101391us) service_pool.cc:224] Handling call
0709 12:17:04.471043 (+846726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:04.585229 (+114186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.586209 (+   980us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b54004b0d50. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:04.586331 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946422144}
I20260709 12:17:04.496906 13034 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:04.498409 13018 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:04.587148 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080023d580 after lost signal to thread 11807
I20260709 12:17:04.588421 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:04.588618 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080031fe00 after lost signal to thread 11809
W20260709 12:17:04.589326 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080025f240 after lost signal to thread 11833
W20260709 12:17:04.589591 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080011e560 after lost signal to thread 11834
I20260709 12:17:04.499728 12387 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
W20260709 12:17:04.589980 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08002352a0 after lost signal to thread 12386
I20260709 12:17:04.497437 13021 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.589900 13018 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:04.590281 13064 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:04.506331 13033 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.396888 11701 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:04.510121 11699 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:04.511289 13063 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.510982 13010 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:04.384667 13080 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.513877 13078 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:04.594718 12915 raft_consensus.cc:2804] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.595112 12915 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:04.595448 12915 raft_consensus.cc:3060] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.595857 13010 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:04.514528 11484 catalog_manager.cc:5697] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 3, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:04.593011 13107 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.597381 11484 catalog_manager.cc:5697] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 4, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:04.515864 12865 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:04.544343 11773 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:17:04.598815 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 54537.9us
I20260709 12:17:04.599206 11484 catalog_manager.cc:5697] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 3, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:04.600453 13021 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.593532 13018 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.601280 13018 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:04.473471 13037 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.601706 13018 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.550414 12431 raft_consensus.cc:2368] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.450440 11625 leader_election.cc:400] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.602314 11625 leader_election.cc:403] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:04.549741 11482 rpcz_store.cc:276] 0709 12:16:58.570917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.571118 (+   201us) service_pool.cc:224] Handling call
0709 12:17:04.431210 (+5860092us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:03.688643 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:03.689180 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:03.689209 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:17:03.689226 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:03.689622 (+   396us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:03.689665 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:03.689691 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:03.709655 (+ 19964us) tablet.cc:701] Row locks acquired
0709 12:17:03.713770 (+  4115us) write_op.cc:260] PREPARE: finished
0709 12:17:03.713907 (+   137us) write_op.cc:270] Start()
0709 12:17:03.714013 (+   106us) write_op.cc:276] Timestamp: P: 1783599423713864 usec, L: 0
0709 12:17:03.714037 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:17:03.722017 (+  7980us) log.cc:844] Serialized 916 byte log entry
0709 12:17:04.076559 (+354542us) op_driver.cc:464] REPLICATION: finished
0709 12:17:04.097786 (+ 21227us) write_op.cc:301] APPLY: starting
0709 12:17:04.097870 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:04.097985 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:04.098076 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:04.098379 (+   303us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:04.098540 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:04.098581 (+    41us) write_op.cc:312] APPLY: finished
0709 12:17:04.098765 (+   184us) log.cc:844] Serialized 28 byte log entry
0709 12:17:04.098915 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:04.099002 (+    87us) write_op.cc:454] Released schema lock
0709 12:17:04.099045 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:04.099359 (+   314us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:04.099384 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":280159,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":6075,"apply.run_cpu_time_us":1559,"apply.run_wall_time_us":1560,"num_ops":2,"prepare.queue_time_us":3527,"prepare.run_cpu_time_us":2992,"prepare.run_wall_time_us":52706,"replication_time_us":362372}]]}
I20260709 12:17:04.547164 11698 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.550458 12438 rpcz_store.cc:276] 0709 12:17:01.636220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.654141 (+ 17921us) service_pool.cc:224] Handling call
0709 12:17:01.654485 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.472461 (+1817976us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:03.472780 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 12:17:03.913560 (+440780us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.932845 (+ 19285us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:03.933381 (+   536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.439135 (+505754us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54000087d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:04.439195 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.439372 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4386,"prepare.queue_time_us":837,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":38475,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8182,"spinlock_wait_cycles":4180405504,"thread_start_us":393861,"threads_started":1,"wal-append.queue_time_us":578816}
I20260709 12:17:04.558848 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:04.564414 13019 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:04.444851 13030 consensus_meta.cc:287] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 12:17:04.566659 12434 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:04.610080 13030 raft_consensus.cc:2749] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.608753 13037 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:04.568584 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 410354us
I20260709 12:17:04.493150 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.611593 12436 raft_consensus.cc:2368] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.611896 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.612453 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.609128 13010 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.613162 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.610634 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.587414 11730 rpcz_store.cc:276] 0709 12:17:03.373970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.418141 (+ 44171us) service_pool.cc:224] Handling call
0709 12:17:04.470877 (+1052736us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54004b0d54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:04.471060 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717235072}
I20260709 12:17:04.614751 12430 raft_consensus.cc:2368] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.613113 12436 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:04.615660 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.614704 12434 raft_consensus.cc:2368] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 6.
I20260709 12:17:04.582888 12435 rpcz_store.cc:276] 0709 12:17:03.200037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.422460 (+222423us) service_pool.cc:224] Handling call
0709 12:17:03.422719 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.606980 (+184261us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:03.607315 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 12:17:03.929655 (+322340us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.939523 (+  9868us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:03.941255 (+  1732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.456029 (+514774us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400004bd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:04.456079 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.456216 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25296,"prepare.queue_time_us":152,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":46262,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3895,"spinlock_wait_cycles":423186176,"thread_start_us":278792,"threads_started":1,"wal-append.queue_time_us":643159}
I20260709 12:17:04.502388 11653 raft_consensus.cc:1240] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.618702 13080 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.619295 13063 consensus_queue.cc:1059] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:04.620324 13063 raft_consensus.cc:3055] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:04.620656 13063 raft_consensus.cc:740] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.609645 12944 raft_consensus.cc:2749] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.590698 12428 raft_consensus.cc:2368] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 5. Current term is 6.
W20260709 12:17:04.623266 12386 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.624347 11775 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.504835 13029 raft_consensus.cc:993] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef: : Instructing follower b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:17:04.626065 13029 raft_consensus.cc:1081] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Signalling peer b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:17:04.626437 13033 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:04.586818 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08001ddc60 after lost signal to thread 11834
W20260709 12:17:04.592497 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 195701us
W20260709 12:17:04.628226 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08003fb060 after lost signal to thread 12463
W20260709 12:17:04.629101 11830 debug-util.cc:398] Leaking SignalData structure 0x7b0800310760 after lost signal to thread 12942
I20260709 12:17:04.592849 12432 raft_consensus.cc:2393] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 4: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:04.631145 12432 raft_consensus.cc:1240] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:04.592317 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 92651us
I20260709 12:17:04.592093 12429 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
W20260709 12:17:04.590346 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800140020 after lost signal to thread 12388
W20260709 12:17:04.633991 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08000d38a0 after lost signal to thread 12429
W20260709 12:17:04.634306 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800096ee0 after lost signal to thread 12434
W20260709 12:17:04.634526 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08001b5dc0 after lost signal to thread 12435
W20260709 12:17:04.634732 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08000f0060 after lost signal to thread 12436
W20260709 12:17:04.594203 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 84169.4us
I20260709 12:17:04.598104 13107 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:04.426402 12859 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.611099 11735 raft_consensus.cc:1240] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:04.637012 12859 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:04.629351 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08003056e0 after lost signal to thread 12944
I20260709 12:17:04.638556 11699 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:04.639183 12438 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:04.639487 11699 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
W20260709 12:17:04.603242 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 56157.2us
I20260709 12:17:04.639971 12430 raft_consensus.cc:1240] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:04.635237 12387 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:04.603116 11624 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:04.643580 11627 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.644246 11624 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.645345 11624 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:04.605994 13095 consensus_queue.cc:1059] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.650043 12944 raft_consensus.cc:2749] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.650588 13096 raft_consensus.cc:3055] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:04.641448 13018 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:04.606906 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 156598us
I20260709 12:17:04.651151 11699 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:04.651614 11658 raft_consensus.cc:1240] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.607810 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:04.608453 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:04.599954 12865 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:04.608835 13019 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:04.609112 11728 raft_consensus.cc:1240] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:04.657097 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:04.609475 13067 raft_consensus.cc:2804] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:04.609943 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:04.625437 11775 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.588655 12437 raft_consensus.cc:2393] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 5: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:04.629310 11701 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:17:04.638725 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfaa0 after lost signal to thread 12953
I20260709 12:17:04.646486 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:04.647194 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.647258 11698 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.650998 13096 raft_consensus.cc:740] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:04.606153 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:04.652688 11729 raft_consensus.cc:2393] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:04.668568 11775 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.601169 11484 catalog_manager.cc:5697] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 4, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:04.655298 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:04.669339 11658 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.650908 11802 raft_consensus.cc:1275] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:04.654433 11627 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.649971 13107 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.663259 12847 consensus_queue.cc:1048] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:17:04.670679 11627 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.671782 11627 leader_election.cc:400] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.672050 13119 raft_consensus.cc:2749] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.672760 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:04.673153 13067 raft_consensus.cc:697] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.673332 11657 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.673856 13121 consensus_queue.cc:1059] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.674266 13036 raft_consensus.cc:2749] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.674968 13036 raft_consensus.cc:2749] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.675202 11775 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.663388 13034 consensus_queue.cc:1048] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:17:04.676311 11775 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.676905 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:04.677383 11775 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.663672 12387 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:04.664335 11625 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:04.681241 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 51988.5us
I20260709 12:17:04.664814 12436 raft_consensus.cc:1240] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:04.621376 13063 consensus_queue.cc:260] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:04.661845 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:04.658984 13039 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:04.654238 11624 leader_election.cc:400] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
W20260709 12:17:04.635289 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3480 after lost signal to thread 12463
I20260709 12:17:04.677491 11661 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.679255 11627 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.659762 11733 raft_consensus.cc:1240] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.680027 12434 raft_consensus.cc:1240] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:04.650310 13095 raft_consensus.cc:2749] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.652540 12975 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.707796 11661 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:04.707962 12975 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.708364 12975 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:04.711246 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08000487a0 after lost signal to thread 12464
W20260709 12:17:04.711665 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3900 after lost signal to thread 12769
W20260709 12:17:04.711880 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800380280 after lost signal to thread 12776
W20260709 12:17:04.712173 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080030b660 after lost signal to thread 12832
W20260709 12:17:04.712409 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08003592c0 after lost signal to thread 12838
W20260709 12:17:04.712626 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed2a0 after lost signal to thread 12840
W20260709 12:17:04.712884 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08002b97c0 after lost signal to thread 12859
I20260709 12:17:04.714375 13036 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.676762 13034 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.678149 13008 raft_consensus.cc:2804] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:04.715405 13036 consensus_queue.cc:1059] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:04.716614 13095 raft_consensus.cc:3055] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:04.717001 13095 raft_consensus.cc:740] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:04.717726 13095 consensus_queue.cc:260] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:04.677659 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2940 after lost signal to thread 12969
I20260709 12:17:04.718633 13034 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:04.718801 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08001493c0 after lost signal to thread 12970
W20260709 12:17:04.719165 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08001a8140 after lost signal to thread 12975
W20260709 12:17:04.719431 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08002afa20 after lost signal to thread 12984
I20260709 12:17:04.677467 13096 consensus_queue.cc:260] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.720525 13096 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.652904 13080 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:04.675379 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:04.686281 12859 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:04.697650 11624 leader_election.cc:403] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:04.701155 11658 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:04.696143 12932 raft_consensus.cc:2749] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.676805 13107 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:04.674439 13037 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:04.702157 13064 consensus_queue.cc:1059] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.702726 11728 raft_consensus.cc:1240] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.697213 13039 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:04.697338 13019 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.696059 12820 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.738600 12820 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:04.738984 12820 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.737915 13054 raft_consensus.cc:3055] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.739590 13054 raft_consensus.cc:740] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.740353 13054 consensus_queue.cc:260] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.694149 13035 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.741593 13054 raft_consensus.cc:3060] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.678009 12769 raft_consensus.cc:2749] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.674144 13067 consensus_queue.cc:237] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.686268 13052 consensus_queue.cc:1059] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:17:04.743125 13052 raft_consensus.cc:3055] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:04.743448 13052 raft_consensus.cc:740] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.744153 13052 consensus_queue.cc:260] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.745321 13052 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.707019 13063 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.746337 13107 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.747149 13039 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.677523 13077 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.718065 11775 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.750705 13019 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.751237 11775 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.751456 12859 raft_consensus.cc:697] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:04.752386 12859 consensus_queue.cc:237] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.689262 11698 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.751183 13019 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.711915 11627 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.754915 13006 raft_consensus.cc:2749] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:17:04.755402 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 43584.2us
I20260709 12:17:04.756400 11627 leader_election.cc:400] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.756652 11627 leader_election.cc:403] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:04.757243 11627 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:04.758147 13077 raft_consensus.cc:2749] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.758872 13077 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.759423 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:04.759687 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:04.760447 11733 raft_consensus.cc:2393] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:04.760684 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:04.761510 13035 raft_consensus.cc:2749] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.761895 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:04.762359 13035 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.762698 11728 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 6: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:04.763063 13035 raft_consensus.cc:2804] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:04.763561 13035 raft_consensus.cc:697] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:04.764468 13035 consensus_queue.cc:237] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:04.766444 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:04.767350 11733 raft_consensus.cc:2393] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 2: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:04.654541 11727 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
W20260709 12:17:04.754684 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 65502.6us
I20260709 12:17:04.771137 11698 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.753679 11775 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.773787 11775 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.683938 12387 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:17:04.728391 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 74708.6us
I20260709 12:17:04.775298 11624 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.776467 11624 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:04.713164 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800323a00 after lost signal to thread 12915
I20260709 12:17:04.732733 13121 consensus_queue.cc:1059] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:04.761592 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:04.733530 13008 raft_consensus.cc:697] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:04.734270 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:04.662308 12984 consensus_queue.cc:1048] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:17:04.736109 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:04.737289 13064 raft_consensus.cc:3055] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:17:04.780601 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08003570c0 after lost signal to thread 12922
I20260709 12:17:04.737738 13037 raft_consensus.cc:697] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:04.721994 13080 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.729518 12944 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.799244 12944 raft_consensus.cc:2804] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:04.799717 12944 raft_consensus.cc:697] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:04.800560 12944 consensus_queue.cc:237] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.795835 13064 raft_consensus.cc:740] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.732379 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:17:04.777940 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 94081.8us
I20260709 12:17:04.803972 12387 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:04.774471 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:04.732993 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:04.721338 12915 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.782549 11775 leader_election.cc:400] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 5. Current term is 6.
I20260709 12:17:04.808701 11775 leader_election.cc:403] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:04.792326 11627 leader_election.cc:400] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.809940 11627 leader_election.cc:400] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:04.783058 12865 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.794389 11731 raft_consensus.cc:2393] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 7: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:04.795372 11733 raft_consensus.cc:1240] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.796916 13036 raft_consensus.cc:2749] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.797087 12430 raft_consensus.cc:2393] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 7: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:04.754758 12975 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:04.797878 13037 consensus_queue.cc:237] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:04.798635 13080 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.779780 11657 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
W20260709 12:17:04.792940 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 72070.2us
I20260709 12:17:04.781992 13018 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:04.810863 11627 leader_election.cc:400] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 6.
I20260709 12:17:04.780902 12847 raft_consensus.cc:2749] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.782946 13034 raft_consensus.cc:2749] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.814126 11775 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:04.802990 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08003dbe00 after lost signal to thread 12932
I20260709 12:17:04.814273 11698 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.787269 13029 consensus_queue.cc:1059] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:17:04.816211 12387 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:04.819599 13032 consensus_queue.cc:1059] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.815248 12865 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.817185 13021 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.795167 13108 raft_consensus.cc:2749] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.785292 12769 consensus_queue.cc:1059] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 12:17:04.832512 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080016d380 after lost signal to thread 12942
W20260709 12:17:04.843277 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080035ddc0 after lost signal to thread 12944
I20260709 12:17:04.824301 11627 leader_election.cc:403] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:04.785741 13077 consensus_queue.cc:1059] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 12:17:04.825567 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:04.826318 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 49935.8us
I20260709 12:17:04.847836 11624 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.825984 11625 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.817926 13121 consensus_queue.cc:1059] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:17:04.820842 13019 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:04.848323 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:04.850778 13019 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:04.851537 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:04.833671 13078 raft_consensus.cc:2804] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.852075 12915 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:04.832813 13119 raft_consensus.cc:2749] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.852342 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:04.853719 12975 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:04.855370 11731 raft_consensus.cc:1240] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:04.856277 13095 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.823571 13033 consensus_queue.cc:1059] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:17:04.853777 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:04.858662 13078 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:04.842092 12865 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.858402 13130 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:04.861912 13036 raft_consensus.cc:2749] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.859508 13078 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.862793 13036 raft_consensus.cc:2749] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.859602 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:04.823714 13063 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:04.866181 13039 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.840396 13066 consensus_queue.cc:1059] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:17:04.840269 12820 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:04.858486 13002 raft_consensus.cc:3055] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:04.868994 13002 raft_consensus.cc:740] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.824946 12438 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 6: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:04.842276 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:04.869948 13002 consensus_queue.cc:260] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:04.870800 11809 raft_consensus.cc:2393] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:04.859450 11803 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:04.843550 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080015ccc0 after lost signal to thread 12953
W20260709 12:17:04.883036 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08001dba00 after lost signal to thread 12969
W20260709 12:17:04.883358 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800256b20 after lost signal to thread 12970
W20260709 12:17:04.883589 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08003eb3c0 after lost signal to thread 12975
W20260709 12:17:04.883805 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08000c80e0 after lost signal to thread 12984
W20260709 12:17:04.884068 11682 debug-util.cc:398] Leaking SignalData structure 0x7b080034bc40 after lost signal to thread 13002
I20260709 12:17:04.840399 13007 raft_consensus.cc:2804] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:04.884279 13028 raft_consensus.cc:3055] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:04.884837 13028 raft_consensus.cc:740] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:04.862095 13008 consensus_queue.cc:237] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:04.832341 12387 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:17:04.879055 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 46636.9us
W20260709 12:17:04.889195 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 56936.2us
I20260709 12:17:04.889885 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.891372 12387 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:04.902094 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 91347.4us
I20260709 12:17:04.903566 11627 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:04.902686 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 54944.9us
I20260709 12:17:04.905268 11624 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.906791 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.907652 11808 raft_consensus.cc:2393] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:04.908644 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.817298 12912 consensus_queue.cc:1059] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 12:17:04.884361 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800283ae0 after lost signal to thread 13004
I20260709 12:17:04.910545 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:17:04.911015 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 85119.2us
I20260709 12:17:04.924091 11625 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:04.911444 11627 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:04.911631 11809 raft_consensus.cc:1240] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:04.919329 13133 consensus_queue.cc:1048] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.884797 13007 raft_consensus.cc:697] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:04.936465 11808 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
I20260709 12:17:04.912539 11624 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.920949 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.938177 11807 raft_consensus.cc:2393] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:04.921666 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.924309 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.940541 11808 raft_consensus.cc:1240] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.926451 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:04.913337 13067 consensus_queue.cc:1059] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:17:04.930397 12769 raft_consensus.cc:3055] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.931363 13121 raft_consensus.cc:3055] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:17:04.922576 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800127960 after lost signal to thread 13006
I20260709 12:17:04.923013 12820 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:04.924345 12387 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
W20260709 12:17:04.946951 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 90045.8us
I20260709 12:17:04.910051 13019 raft_consensus.cc:2749] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.912106 12975 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.910778 13021 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.912308 13036 raft_consensus.cc:2749] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.934381 12912 raft_consensus.cc:3055] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:04.969281 11698 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:04.964221 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08001934c0 after lost signal to thread 13007
I20260709 12:17:04.947270 13039 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:04.952415 12769 raft_consensus.cc:740] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.964452 11731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:04.952229 13121 raft_consensus.cc:740] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.975728 12387 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:05.017450 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.019659 11698 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:04.969122 13018 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.973541 12912 raft_consensus.cc:740] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:04.976706 13067 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:05.062794 13067 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:05.063027 12912 consensus_queue.cc:260] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:05.064381 12912 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:04.977362 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08001a4940 after lost signal to thread 13008
W20260709 12:17:05.066048 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8e40 after lost signal to thread 13009
W20260709 12:17:05.066298 11682 debug-util.cc:398] Leaking SignalData structure 0x7b08001be8e0 after lost signal to thread 13010
W20260709 12:17:05.066516 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800127880 after lost signal to thread 13012
W20260709 12:17:05.066766 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800318f20 after lost signal to thread 13019
W20260709 12:17:05.066987 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800121b60 after lost signal to thread 13021
W20260709 12:17:05.067205 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800098e80 after lost signal to thread 13023
W20260709 12:17:05.067469 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800039ca0 after lost signal to thread 13027
I20260709 12:17:05.067282 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:05.067729 11682 debug-util.cc:398] Leaking SignalData structure 0x7b0800327140 after lost signal to thread 13028
I20260709 12:17:05.068131 13067 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:04.976538 13071 consensus_queue.cc:1059] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 12:17:05.031625 11807 raft_consensus.cc:2393] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:05.020113 11802 raft_consensus.cc:2393] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:04.976390 13115 raft_consensus.cc:3055] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:04.971009 13021 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.087653 13115 raft_consensus.cc:740] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:04.970005 13065 consensus_queue.cc:1059] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
W20260709 12:17:05.083738 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 171262us
I20260709 12:17:05.088048 13021 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.102005 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:17:05.070068 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 50499.7us
I20260709 12:17:05.018074 12820 raft_consensus.cc:2749] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:04.970561 13134 raft_consensus.cc:2749] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.140260 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:05.141027 11661 raft_consensus.cc:2393] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 2: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:05.142124 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:05.090164 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:17:05.090961 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 184509us
I20260709 12:17:05.061267 13036 raft_consensus.cc:2749] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:05.071898 13018 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:05.079932 13039 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:05.180385 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 76265.2us
I20260709 12:17:05.148128 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.195564 13115 consensus_queue.cc:260] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:05.196786 13115 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.081792 13007 consensus_queue.cc:237] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:05.073480 13107 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.073043 11731 raft_consensus.cc:606] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:05.193308 11658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:17:05.207429 11729 raft_consensus.cc:1240] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.210369 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:05.211658 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.212812 13077 raft_consensus.cc:3055] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:05.213294 13077 raft_consensus.cc:740] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:05.214115 13077 consensus_queue.cc:260] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:05.215209 13077 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.217340 12847 raft_consensus.cc:3055] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:05.217742 12847 raft_consensus.cc:740] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:05.218720 12847 consensus_queue.cc:260] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:05.221355 13002 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:05.221741 12975 raft_consensus.cc:2749] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:05.231599 12386 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:05.232740 12386 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:05.234153 13034 raft_consensus.cc:3055] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:05.234606 13034 raft_consensus.cc:740] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:05.235466 13034 consensus_queue.cc:260] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:05.236456 13034 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.240885 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:17:05.185513 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:05.245973 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.175557 11661 raft_consensus.cc:1240] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:05.187222 11733 raft_consensus.cc:1240] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.977109 13080 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:05.184149 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.189002 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:17:05.190307 11701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.192260 12838 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:04.972092 13023 consensus_queue.cc:1059] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 12:17:05.019272 13035 consensus_queue.cc:1059] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
W20260709 12:17:05.147914 13128 log.cc:927] Time spent T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:17:05.202867 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:05.198745 13039 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:05.247629 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 305152us
I20260709 12:17:05.276237 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:05.276934 11625 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:05.258697 11660 raft_consensus.cc:2393] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:05.194072 13018 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.261467 11804 raft_consensus.cc:2393] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
W20260709 12:17:05.261811 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 286230us
I20260709 12:17:05.272819 11657 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.274673 11734 raft_consensus.cc:1240] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:17:05.275166 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.207201 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.289361 11807 raft_consensus.cc:2393] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:05.194839 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:05.294919 11773 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:05.297778 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.298517 11807 raft_consensus.cc:2393] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:05.299316 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.301108 13130 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 6.
I20260709 12:17:05.289726 13023 raft_consensus.cc:2749] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:05.192914 13121 consensus_queue.cc:260] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:05.306532 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:05.307061 13121 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:05.308001 13035 raft_consensus.cc:3055] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:05.308399 13035 raft_consensus.cc:740] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:05.309989 13148 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.310909 13142 raft_consensus.cc:2749] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.288558 13054 consensus_queue.cc:1059] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:05.287853 12437 raft_consensus.cc:2393] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 5: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:05.313382 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:05.314883 13080 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:05.315068 13023 raft_consensus.cc:3055] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:05.315454 13023 raft_consensus.cc:740] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:05.316222 13023 consensus_queue.cc:260] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:05.317305 13023 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:05.283867 13039 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:05.319453 11773 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:05.320420 11733 raft_consensus.cc:1240] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:05.320523 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:05.309152 13035 consensus_queue.cc:260] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:05.283695 11728 raft_consensus.cc:1240] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.327811 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:05.288547 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:17:05.301359 13052 consensus_meta.cc:287] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.002s
I20260709 12:17:05.326328 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:05.283457 11727 raft_consensus.cc:1240] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:05.323239 11735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:05.346061 11735 raft_consensus.cc:606] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:05.329564 11660 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.321967 11659 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.330461 11657 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:05.346662 11808 raft_consensus.cc:1275] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:05.295463 11806 raft_consensus.cc:2468] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:05.341238 11807 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:05.306743 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:05.317663 12865 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:05.351404 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:05.352029 11661 raft_consensus.cc:2393] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:05.240265 12769 consensus_queue.cc:260] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:05.283174 13077 consensus_queue.cc:1059] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:17:05.356290 11657 raft_consensus.cc:1240] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:05.355427 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.354592 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.357290 11699 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:05.357931 11657 raft_consensus.cc:1240] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:05.314939 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:17:05.371874 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 45620.7us
I20260709 12:17:05.349906 11802 raft_consensus.cc:2393] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 5: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
W20260709 12:17:05.394294 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 160583us
I20260709 12:17:05.396204 12386 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:05.327906 13065 raft_consensus.cc:2749] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:05.376127 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 88464.6us
I20260709 12:17:05.381450 11659 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:05.354012 13063 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 5. Current term is 6.
I20260709 12:17:05.392482 11661 raft_consensus.cc:1240] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:05.360049 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.393740 11773 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:05.375854 13140 raft_consensus.cc:2749] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:05.398463 11657 raft_consensus.cc:1275] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:05.409703 11660 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:05.408454 12386 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:05.411123 11659 raft_consensus.cc:1240] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.413687 11773 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:05.395059 13034 raft_consensus.cc:2749] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:05.401816 12387 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:05.392185 12428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57346 (request call id 395) took 1265 ms. Trace:
I20260709 12:17:05.399163 11655 raft_consensus.cc:2393] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:05.395506 12838 raft_consensus.cc:697] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:05.402175 13019 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:05.427114 12387 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:05.432487 11773 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:05.428874 12386 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:05.376133 13148 consensus_queue.cc:1059] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:17:05.408449 11731 raft_consensus.cc:1275] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:05.436506 11805 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
I20260709 12:17:05.401357 13145 raft_consensus.cc:2749] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:05.441025 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:05.442247 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:05.443120 13157 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.445473 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:05.447505 13032 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:05.448613 11727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:05.450747 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.419163 13115 raft_consensus.cc:2749] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:05.399353 13021 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:05.492684 11655 raft_consensus.cc:1275] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:05.421906 13150 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.422268 12428 rpcz_store.cc:276] 0709 12:17:04.117299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.625440 (+508141us) service_pool.cc:224] Handling call
0709 12:17:04.625721 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.630886 (+  5165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:04.630918 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:04.631445 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:17:04.785348 (+153903us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:05.001215 (+215867us) log.cc:844] Serialized 14 byte log entry
0709 12:17:05.341026 (+339811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:05.350306 (+  9280us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:05.355542 (+  5236us) raft_consensus.cc:1685] finished
0709 12:17:05.355560 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:05.382559 (+ 26999us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37404,"prepare.queue_time_us":396497,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":4627,"raft.queue_time_us":74638,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":36018,"thread_start_us":491034,"threads_started":3,"wal-append.queue_time_us":197837}
I20260709 12:17:05.504439 13150 raft_consensus.cc:697] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:05.506038 13150 consensus_queue.cc:237] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:05.506758 12865 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:05.457343 13078 consensus_meta.cc:287] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.004s
I20260709 12:17:05.507556 13078 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:05.515857 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:05.516193 13021 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:05.421952 13077 consensus_queue.cc:1059] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:17:05.423203 13130 consensus_queue.cc:1048] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:17:05.497408 11809 raft_consensus.cc:2410] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:17:05.517596 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 88781.7us
W20260709 12:17:05.502434 11803 consensus_meta.cc:287] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.001s
I20260709 12:17:05.546512 11804 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
W20260709 12:17:05.603775 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:05.510485 13095 consensus_meta.cc:287] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.000s
I20260709 12:17:05.500414 13032 raft_consensus.cc:697] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 4 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:05.663776 11661 raft_consensus.cc:2410] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:05.533975 13078 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:05.665097 11804 raft_consensus.cc:1275] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:17:05.665570 11804 pending_rounds.cc:85] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178: Aborting all ops after (but not including) 1
I20260709 12:17:05.665788 11804 pending_rounds.cc:107] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 12:17:05.651932 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 258001us
W20260709 12:17:05.652544 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:05.666289 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 134752us
I20260709 12:17:05.496380 13156 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:05.668282 12386 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:05.666000 11804 raft_consensus.cc:2889] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:05.666849 12387 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:05.518596 11727 raft_consensus.cc:606] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:05.500298 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:05.451321 13149 consensus_queue.cc:1059] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 12:17:05.524219 13158 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:05.652057 13133 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.547289 13071 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.680189 12387 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:05.548611 11803 raft_consensus.cc:2468] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
W20260709 12:17:05.680918 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.657598 12832 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:05.675292 12430 raft_consensus.cc:2393] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:05.677326 11801 raft_consensus.cc:2410] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:05.677063 11652 raft_consensus.cc:2393] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:05.710949 11699 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:05.738971 11809 raft_consensus.cc:1240] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:05.739506 12912 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:05.739789 11774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.739991 12912 raft_consensus.cc:697] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:05.503070 12838 consensus_queue.cc:237] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:05.740906 12912 consensus_queue.cc:237] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:05.719889 13149 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.724597 13163 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:05.743464 13163 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:05.725139 13156 raft_consensus.cc:2749] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:05.726866 13078 raft_consensus.cc:3055] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:05.746367 13078 raft_consensus.cc:740] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:05.710575 13133 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:05.747253 13078 consensus_queue.cc:260] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:05.748513 13078 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.742973 13130 consensus_queue.cc:1059] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:17:05.750496 13130 raft_consensus.cc:3055] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:05.750844 13130 raft_consensus.cc:740] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:05.751628 13130 consensus_queue.cc:260] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:05.750582 12832 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:05.752710 13130 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.753595 11652 raft_consensus.cc:1240] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:05.745569 13163 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:05.729524 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.734876 13032 consensus_queue.cc:237] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:05.736615 13064 consensus_queue.cc:260] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:05.759333 13064 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.729373 13071 raft_consensus.cc:2749] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:05.761407 11698 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
W20260709 12:17:05.727815 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 59594.6us
I20260709 12:17:05.764329 12386 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:05.767064 13007 raft_consensus.cc:2804] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:05.746968 13018 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:05.767755 13007 raft_consensus.cc:697] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:05.768680 13007 consensus_queue.cc:237] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:05.769874 13018 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:05.773571 13165 raft_consensus.cc:2749] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:05.778460 12386 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:17:05.778757 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:05.797266 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.676297 13157 raft_consensus.cc:697] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:05.738971 11803 raft_consensus.cc:1275] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:05.800496 12944 consensus_queue.cc:1048] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:17:05.805016 13018 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:05.810202 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.803650 12932 consensus_queue.cc:1059] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:17:05.818571 12386 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:05.826311 13167 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:05.826828 13167 raft_consensus.cc:697] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:05.827665 13167 consensus_queue.cc:237] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:05.829263 13149 raft_consensus.cc:2749] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.830950 12386 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:05.844678 13165 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.842586 13161 consensus_queue.cc:1048] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:17:05.852603 11729 consensus_meta.cc:287] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260709 12:17:05.853111 11729 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
W20260709 12:17:05.836648 13023 consensus_meta.cc:287] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.001s
I20260709 12:17:05.837239 12832 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:05.837935 13133 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:05.846319 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:17:05.873265 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.937309 12434 raft_consensus.cc:1240] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:05.947122 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:17:05.820003 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 139880us
I20260709 12:17:05.949654 12387 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:05.965984 12434 raft_consensus.cc:1240] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.968312 12434 raft_consensus.cc:1275] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:05.968446 12386 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.968659 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:05.824497 13018 raft_consensus.cc:697] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:05.975744 12387 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:05.978327 13159 log.cc:927] Time spent T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.256s	user 0.005s	sys 0.018s
I20260709 12:17:05.942723 13158 raft_consensus.cc:697] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:05.942775 13019 raft_consensus.cc:697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:05.942693 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:05.975869 13028 consensus_queue.cc:260] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:05.945384 13071 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:05.988672 13158 consensus_queue.cc:237] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:05.989979 12429 raft_consensus.cc:1240] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:05.968010 13023 raft_consensus.cc:2749] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:17:05.992964 13039 consensus_meta.cc:287] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 12:17:05.988358 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:06.007885 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.846314 13157 consensus_queue.cc:237] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:05.996803 12428 raft_consensus.cc:2393] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:05.974555 13149 consensus_queue.cc:1048] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:17:05.985944 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:06.001641 13150 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.021777 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:06.007625 11727 raft_consensus.cc:1240] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:06.005575 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:06.023626 12431 raft_consensus.cc:3055] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:06.029247 12431 raft_consensus.cc:740] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:06.023746 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.024013 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:06.030689 11625 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:06.026793 11732 raft_consensus.cc:1275] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:06.003831 13018 consensus_queue.cc:237] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:06.032411 12944 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:06.032914 12944 raft_consensus.cc:697] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:06.033774 12944 consensus_queue.cc:237] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:06.017352 13028 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.037086 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:06.022643 12436 raft_consensus.cc:2393] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 4: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:06.046833 12435 raft_consensus.cc:1275] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:06.020658 13152 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.028698 13150 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:06.003207 13071 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.050550 11803 raft_consensus.cc:1275] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:06.051837 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:06.052347 13071 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.055229 13133 consensus_queue.cc:1048] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.056632 13095 consensus_queue.cc:1048] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:06.057732 13150 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.060359 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.010089 13039 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.085922 11654 raft_consensus.cc:1240] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:06.086450 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:06.087122 13039 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.069864 11734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:06.087636 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:06.088114 11734 raft_consensus.cc:606] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:06.070187 13171 consensus_queue.cc:1048] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.063660 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:06.079952 12431 consensus_queue.cc:260] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:06.080921 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:06.082310 13137 raft_consensus.cc:3055] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:06.083510 11652 raft_consensus.cc:2393] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:06.064543 13019 consensus_queue.cc:237] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:06.089021 11627 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:06.095387 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:06.119345 11654 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:06.120461 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:06.120695 12387 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:06.121596 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:06.095450 12431 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:06.095563 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.102952 11698 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
W20260709 12:17:06.117002 11774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.128942 12434 raft_consensus.cc:1240] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:06.130117 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:06.129197  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:06.114161 11655 raft_consensus.cc:2393] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:06.135427 12387 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:06.137068 11654 raft_consensus.cc:1240] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:06.115584 13137 raft_consensus.cc:740] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:06.144325 11654 raft_consensus.cc:1275] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:06.132678 13010 raft_consensus.cc:2804] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:06.161273 11654 raft_consensus.cc:1275] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:06.134586 13169 log.cc:927] Time spent T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.096s	user 0.004s	sys 0.000s
I20260709 12:17:06.131961 13148 raft_consensus.cc:2804] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:06.135119 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:06.166962 12431 raft_consensus.cc:1275] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:06.141136 13167 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:06.162685 11731 raft_consensus.cc:2393] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:06.168151 12432 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:06.144348 13149 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.143090 13095 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.159072 11653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 712) took 1058 ms. Trace:
I20260709 12:17:06.174875 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.165383 13148 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:06.171941 12776 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:17:06.170945 12436 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:06.176169 11653 rpcz_store.cc:276] 0709 12:17:05.100961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.105424 (+  4463us) service_pool.cc:224] Handling call
0709 12:17:06.080774 (+975350us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800891998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926e9c 00007f44fa926a5b 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:17:06.145252 (+ 64478us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32599296}
I20260709 12:17:06.172878 13018 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:06.173597 13167 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.206346 13018 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.207922 13167 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.208683 13018 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.176628 13158 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:06.197980 13179 log.cc:927] Time spent T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:17:06.199359 13170 log.cc:927] Time spent T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.159s	user 0.002s	sys 0.000s
I20260709 12:17:06.200970 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.187579 13137 consensus_queue.cc:260] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:06.213369 11729 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:17:06.173285 13039 consensus_queue.cc:1048] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:17:06.204645 11658 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:17:06.190999 13177 log.cc:927] Time spent T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:17:06.212072 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.179081 13148 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.214126 11658 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:06.215600 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.216379 11734 raft_consensus.cc:2393] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
W20260709 12:17:06.223165 11774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.212229 13158 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:06.218253 13137 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.219038 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.246515 13054 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.269315 13018 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:06.270057 13018 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:06.270237 13054 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:06.272341 13018 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:06.273751 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:06.278005 11654 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:06.275532 11658 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:06.272248 13033 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:06.281260 13182 log.cc:927] Time spent T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
W20260709 12:17:06.281352 13173 log.cc:927] Time spent T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.209s	user 0.004s	sys 0.000s
W20260709 12:17:06.307143 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.307446 13148 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.310917 13148 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.284819 13033 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:06.312624 13078 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:06.313241 13078 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.292695 12438 raft_consensus.cc:1240] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:06.317188 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:06.290884 13174 log.cc:927] Time spent T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.244s	user 0.003s	sys 0.000s
I20260709 12:17:06.299890 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:06.318570 11652 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:06.300642 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:06.300879 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:06.298524 11729 raft_consensus.cc:1275] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:06.301738 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:06.286197 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.320398 11734 raft_consensus.cc:3055] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:06.320796 11734 raft_consensus.cc:740] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:06.277130 13054 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:06.321470 11734 consensus_queue.cc:260] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:06.322387 13054 consensus_queue.cc:1048] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.323275 13078 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.324020 13039 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.324499 13039 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:06.325522 12387 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:06.303723 12436 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:06.313447 13033 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:06.332607 12431 raft_consensus.cc:1240] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:06.327519  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:06.280164 13018 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:06.335294 12431 raft_consensus.cc:1240] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:06.328006 11775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.336807 11804 raft_consensus.cc:1240] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:06.292608 12437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57338 (request call id 707) took 1560 ms. Trace:
I20260709 12:17:06.348409 11775 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:06.340224 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.354064 11627 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:06.344125 12386 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:06.322405 11734 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:06.346565 11773 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:06.370393 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:06.371163 11774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.326584 13039 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:06.374917 11658 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:06.333938 13078 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:06.339337 13152 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:06.320482 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:06.389806 11775 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:06.382478 11773 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:06.394954 11658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:60030 (request call id 714) took 1276 ms. Trace:
I20260709 12:17:06.370185 13130 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.374641 13054 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.395421 11658 rpcz_store.cc:276] 0709 12:17:05.133249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.134517 (+  1268us) service_pool.cc:224] Handling call
0709 12:17:06.204424 (+1069907us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b5800891998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a27a40 00007f4502a131e9 00007f4502a12c85 00007f44fbf97254
0709 12:17:06.377787 (+173363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80789376}
I20260709 12:17:06.372567 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:06.378383 13133 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.349203 13033 consensus_queue.cc:1048] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
W20260709 12:17:06.405484 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.377234 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.379074 13078 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:06.378353 12915 consensus_queue.cc:1048] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:17:06.391638 13067 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.382009 13168 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:06.348819 13018 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:06.376293 13007 consensus_queue.cc:1059] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:17:06.375836 13164 consensus_queue.cc:1048] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:17:06.423146 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.394605 13121 consensus_queue.cc:1048] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:17:06.410061 13039 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:06.418601 13078 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.403203 13010 raft_consensus.cc:697] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:06.348206 12437 rpcz_store.cc:276] 0709 12:17:04.731989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.732098 (+   109us) service_pool.cc:224] Handling call
0709 12:17:06.292349 (+1560251us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54002b0054. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:06.292543 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1115079424}
I20260709 12:17:06.416731 13064 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.420627 13054 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:06.396175 13152 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:06.456439 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 66736us
I20260709 12:17:06.411448 13130 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:06.457957 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 75559.8us
I20260709 12:17:06.465883 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:06.422711 13067 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:06.448060 13158 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:06.417133 13133 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:06.475912 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:06.432034 13032 consensus_queue.cc:1048] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:17:06.460351 13054 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.488168 13119 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:06.500053 11805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56490 (request call id 518) took 1658 ms. Trace:
I20260709 12:17:06.500837 11775 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:06.501472 12434 raft_consensus.cc:1275] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:06.505638 11804 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:17:06.500424 11805 rpcz_store.cc:276] 0709 12:17:04.841325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.841863 (+   538us) service_pool.cc:224] Handling call
0709 12:17:06.499909 (+1658046us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400447854. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:06.500003 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309895936}
I20260709 12:17:06.489733 13150 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:06.473805 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:06.488008 12984 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:06.490857 13035 raft_consensus.cc:3060] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.491446 11728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 726) took 1292 ms. Trace:
I20260709 12:17:06.492599 12387 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:06.495352 12769 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.454957 13039 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:06.471669 13019 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:06.508482 11698 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:06.546214 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 53697.7us
W20260709 12:17:06.519467 12386 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.68:40845 timed out after 1.910s (SENT) [suppressed 10 similar messages]
I20260709 12:17:06.547572 12387 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:06.539883 11775 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:06.506529 13054 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:06.476768 12944 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.498433 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:06.549137 12387 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:06.550648 11730 raft_consensus.cc:1275] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:17:06.550962 13190 log.cc:927] Time spent T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:17:06.552102 13165 raft_consensus.cc:2749] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:06.552263 13039 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:06.536564 13144 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:06.532948 13119 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:06.552641 13019 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.544414 13121 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:06.552654 13067 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.506325 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:17:06.568502 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 60109.7us
I20260709 12:17:06.535957 13130 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:06.573187 13137 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.532275 13010 consensus_queue.cc:237] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:06.545157 12984 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:06.587984 13203 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:06.601804 13130 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:06.537269 13150 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:06.602361 13130 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.602723 12984 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:06.603642 13150 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:06.604245 13130 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.604611 13203 raft_consensus.cc:697] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:06.589891 13199 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.605684 12435 raft_consensus.cc:1240] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:06.574409 13064 raft_consensus.cc:2804] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:06.591976 13019 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.573887 13197 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.606353 13064 raft_consensus.cc:697] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:06.606745 13197 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:06.579161 11808 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:06.548156 12838 raft_consensus.cc:2749] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.608089 13144 raft_consensus.cc:697] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
W20260709 12:17:06.590641 13193 log.cc:927] Time spent T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:17:06.609750 13133 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:06.592020 13018 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:06.596124 13137 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:06.611140 13119 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:06.586221 13168 consensus_queue.cc:1048] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:17:06.612659 13137 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:06.612881 13168 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:06.582365 13164 raft_consensus.cc:2749] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.573230 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:06.582628 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:06.584869 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 108569us
I20260709 12:17:06.621889 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.587813 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:06.582182 12769 consensus_queue.cc:1048] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:17:06.605548 13199 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.596758 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.595927 11800 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:06.599587 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.598665 12847 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.617534 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:06.608229 11808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51068 (request call id 204) took 1395 ms. Trace:
I20260709 12:17:06.575244 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:06.595415 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.604266 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:06.644542 11808 rpcz_store.cc:276] 0709 12:17:05.213219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.354335 (+141116us) service_pool.cc:224] Handling call
0709 12:17:06.608083 (+1253748us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540027b0d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:06.608180 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2767072640}
I20260709 12:17:06.638693 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.638751 11809 raft_consensus.cc:2393] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:06.630837 11734 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:06.622627 11730 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:06.643266 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.647884 11732 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
W20260709 12:17:06.601509 13188 log.cc:927] Time spent T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:17:06.651314 12820 consensus_queue.cc:1059] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:06.652091 11701 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:06.614809 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:06.654104 12387 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:06.598718 13152 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.655210 13152 raft_consensus.cc:2749] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.655252 12387 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:06.655810 12428 raft_consensus.cc:2393] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:06.607293 13064 consensus_queue.cc:237] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:06.658794 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:06.662760 11773 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:06.592161 13198 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:06.614831 13197 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:06.675796 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:06.676820 11658 raft_consensus.cc:1275] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:06.678090 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:06.678789 11734 raft_consensus.cc:2468] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:06.544144 11728 rpcz_store.cc:276] 0709 12:17:05.199239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.201752 (+  2513us) service_pool.cc:224] Handling call
0709 12:17:05.204460 (+  2708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:05.344869 (+140409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.491131 (+1146262us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b5400a16b54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:06.491375 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127205248}
I20260709 12:17:06.583927 12944 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:06.667744 13152 raft_consensus.cc:2749] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.693718 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:06.659389 11803 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:06.673615 13033 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:06.692165 12387 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:06.644869 13006 consensus_queue.cc:1059] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:17:06.706720 13006 raft_consensus.cc:3055] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:06.707077 13006 raft_consensus.cc:740] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:06.692551 13133 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:06.707691 13133 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.707909 13006 consensus_queue.cc:260] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.709043 13006 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.710099 11656 raft_consensus.cc:1275] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:06.691008 13198 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:06.699437 13033 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:06.700719 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 48733.2us
I20260709 12:17:06.715783 11701 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:06.605541 13203 consensus_queue.cc:237] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:06.704396 13201 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:06.608959 13144 consensus_queue.cc:237] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.690323 13019 consensus_queue.cc:1048] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 12:17:06.698203 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 178779us
I20260709 12:17:06.613377 13168 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:06.717087 12387 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:06.870572 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 153552us
I20260709 12:17:06.695226 13183 raft_consensus.cc:3055] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:17:06.749835 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.845090 11775 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:06.841224 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 105969us
I20260709 12:17:06.845177 12386 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:06.876350 13141 raft_consensus.cc:2749] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:06.840598 13018 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.882793 11701 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:06.897923 12838 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.709677 13133 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:06.722815 13033 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.879662 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:06.970201 11806 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:06.961651 13198 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:06.841177 13197 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.840242 12820 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:06.970687 12432 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:06.971805 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:17:06.890727 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 45606.5us
I20260709 12:17:06.980798 12386 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:06.981614 11806 raft_consensus.cc:2376] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2. Re-sending same reply.
W20260709 12:17:06.974730 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 103383us
I20260709 12:17:06.983791 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:06.984624 12428 raft_consensus.cc:2393] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
W20260709 12:17:06.987135 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.914378 13080 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:07.034859 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 54146us
I20260709 12:17:07.035853 12386 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:06.959879 13183 raft_consensus.cc:740] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:07.034202 13018 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.989504 13197 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.057170 13183 consensus_queue.cc:260] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:07.050335 13078 consensus_meta.cc:287] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.000s
I20260709 12:17:06.988684 12838 consensus_queue.cc:1048] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:17:07.048964 13164 raft_consensus.cc:2749] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:06.876883 13201 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.076481 13019 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.074072 13018 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.086094 13078 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.114250 13185 raft_consensus.cc:2749] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:07.114014 13205 raft_consensus.cc:2749] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:07.127765 13035 consensus_meta.cc:287] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.000s
W20260709 12:17:07.153308 13213 log.cc:927] Time spent T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:17:07.133280 12944 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.151356 13199 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:07.158849 13214 log.cc:927] Time spent T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:17:07.167367 12847 consensus_meta.cc:287] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 12:17:07.168009 13207 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.168507 13207 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:07.170307 13018 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.162315 13168 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.172272 13201 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:07.174618 13054 consensus_meta.cc:287] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178: Time spent flushing consensus metadata: real 0.592s	user 0.005s	sys 0.004s
I20260709 12:17:07.175098 13054 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:07.177392 13054 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:07.198577 13078 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.187186 13033 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.113613 13183 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:07.223748 13006 consensus_meta.cc:287] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 12:17:07.266348 13197 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.268074 13033 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:07.320744 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 603622us
I20260709 12:17:06.988677 11800 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
W20260709 12:17:07.324395 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.326193 11653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34104 (request call id 187) took 1001 ms. Trace:
I20260709 12:17:07.326761 11653 rpcz_store.cc:276] 0709 12:17:06.324940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.325660 (+   720us) service_pool.cc:224] Handling call
0709 12:17:06.326004 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.326206 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:06.417906 (+ 91700us) log.cc:844] Serialized 14 byte log entry
0709 12:17:06.675161 (+257255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.683700 (+  8539us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:06.686705 (+  3005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.699349 (+ 12644us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.325890 (+626541us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":171087,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":36056,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1821,"thread_start_us":332888,"threads_started":2}
W20260709 12:17:07.333771 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.340097 11807 raft_consensus.cc:2410] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:07.341310 11809 raft_consensus.cc:1275] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 12:17:07.341878 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 305952us
I20260709 12:17:07.358338 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.359556 13036 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.360671 13036 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.362190 13095 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.363317 13095 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:07.366147 13096 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.367198 13096 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.369167 11656 raft_consensus.cc:1275] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.361135 11802 raft_consensus.cc:1275] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:07.370090 13130 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.355357 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.361187 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.372243 12944 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.373562 11803 raft_consensus.cc:1275] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:17:07.375010 12435 raft_consensus.cc:1275] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:17:07.375691 13133 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.375816 13144 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.376617 13199 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.379976 12435 pending_rounds.cc:85] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Aborting all ops after (but not including) 3
I20260709 12:17:07.399933 12435 pending_rounds.cc:107] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:17:07.400341 12435 raft_consensus.cc:2889] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:07.405289 13035 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.406220 13035 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:07.407800 13036 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.408712 13036 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.409089 13035 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.409729 11802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56490 (request call id 549) took 1071 ms. Trace:
I20260709 12:17:07.409554 13133 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.377589 13141 consensus_queue.cc:1059] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:17:07.388409 11807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51068 (request call id 206) took 2164 ms (client timeout 2092 ms). Trace:
I20260709 12:17:07.380070 11803 pending_rounds.cc:85] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: Aborting all ops after (but not including) 1
I20260709 12:17:07.412027 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.413336 13095 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.414623 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:07.416076 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:07.417925 13064 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.418817 13199 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.419961 12944 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.421110 13096 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.421720 13130 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:07.423010 13197 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.423274 13198 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.423847 13054 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.424299 13150 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.430269 11803 pending_rounds.cc:107] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:17:07.442724 11803 raft_consensus.cc:2889] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:07.442342 13198 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.442520 13054 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.444617 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:07.445636 11731 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.445988 13054 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.445983 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.447518 12428 raft_consensus.cc:2468] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:07.428792 11802 rpcz_store.cc:276] 0709 12:17:06.338468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.341029 (+  2561us) service_pool.cc:224] Handling call
0709 12:17:07.360071 (+1019042us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b5800202b98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926eee 000000000036eb39 00007f450299a1e0 00007f4502a630c4 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:17:07.360409 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.378841 (+ 18432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.398183 (+ 19342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8542080}
I20260709 12:17:07.438556 13185 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.439136 13201 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.440248 13144 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:07.429090 11807 rpcz_store.cc:269] 0709 12:17:05.213726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.355179 (+141453us) service_pool.cc:224] Handling call
0709 12:17:07.348714 (+1993535us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54001c8c54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:07.377865 (+ 29151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4557997312}
I20260709 12:17:07.427971 13036 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:07.442548 13150 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:07.435937 12437 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
I20260709 12:17:07.442487 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:07.471756 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:07.467075 11654 raft_consensus.cc:1275] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:07.460820 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:07.456804 11775 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:07.485595 12847 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.469686 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.486481 11775 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:07.487094 13176 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.458214 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:07.487957 13176 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.488984 13197 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.455408 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:07.489929 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.490208 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.455726 13201 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:07.491184 13171 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.491561 13197 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.491904 13171 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.492501 13201 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:07.456679 13205 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.492913 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.457343 13064 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.489451 12769 raft_consensus.cc:2749] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.494062 13189 consensus_queue.cc:1048] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:07.495313 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:07.496536 13199 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:07.457513 13185 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.498392 13133 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.498936 13096 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.499698 13096 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.500388 13185 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.465072 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:07.464296 11655 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:07.501933 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:07.502976 13176 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:07.493620 13205 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.503257 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:07.496409 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.460280 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:07.504060 11807 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:07.470489 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.459378 13144 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:07.505191 12436 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:07.501240 13141 consensus_queue.cc:1048] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:07.498557 13171 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:07.470769 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:07.458711 13006 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.508200 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:07.508502 11660 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:07.510283 13218 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:07.510766 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:07.510576 13006 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.511747 11802 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:07.512984 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.513785 11727 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:07.514348 11654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60060 (request call id 661) took 1220 ms. Trace:
I20260709 12:17:07.460642 13198 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.515292 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.511248 13218 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.516798 12431 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
W20260709 12:17:07.471536 11801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.026s	sys 0.005s
I20260709 12:17:07.477947 13036 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.514750 11654 rpcz_store.cc:276] 0709 12:17:06.294280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.326772 (+ 32492us) service_pool.cc:224] Handling call
0709 12:17:07.466036 (+1139264us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5800891998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:17:07.466409 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.483408 (+ 16999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.514265 (+ 30857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25520896}
I20260709 12:17:07.475817 13150 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:07.463690 13195 log.cc:927] Time spent T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 1.021s	user 0.028s	sys 0.026s
I20260709 12:17:07.528498 13205 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.529982 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:07.470952 12944 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:07.522039 11801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.027s	sys 0.005s
I20260709 12:17:07.538378 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:07.513321 13006 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.544130 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.553525 11728 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:07.555601 11805 raft_consensus.cc:1275] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:07.556843 11627 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:17:07.557948 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.416782  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:07.560526 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:07.561323 11804 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:07.534284 13130 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.561530 13096 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.563933 11804 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:07.565402 11804 raft_consensus.cc:1275] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.551599 11652 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.567111 11804 raft_consensus.cc:1275] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:07.570227 11698 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:07.571972 13002 raft_consensus.cc:2749] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.584976 12386 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:07.586516 13035 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:07.587074 13035 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.587452 13035 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:07.588150 12386 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:07.590651 11627 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:07.549593 13036 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.591208 13096 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.593658 13036 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.594259 13096 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.591316 13130 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.597959 13144 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.598668 13144 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.600963 13144 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.597947 13130 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.603569 13130 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:07.587522 13157 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.604250 13157 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.604532 11803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 215) took 1032 ms. Trace:
I20260709 12:17:07.605614 13218 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:07.606168 12776 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.606756 13006 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:07.607266 13006 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.607743 13006 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:07.608537 12386 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
W20260709 12:17:07.608953 13200 log.cc:927] Time spent T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 1.051s	user 0.012s	sys 0.035s
W20260709 12:17:07.606182 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 57406.5us
I20260709 12:17:07.604638 13157 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.610579 11801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56474 (request call id 615) took 1274 ms. Trace:
I20260709 12:17:07.611078 11801 rpcz_store.cc:276] 0709 12:17:06.336457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.340810 (+  4353us) service_pool.cc:224] Handling call
0709 12:17:06.351225 (+ 10415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:06.396762 (+ 45537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.398947 (+  2185us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:06.454571 (+ 55624us) log.cc:844] Serialized 26 byte log entry
0709 12:17:07.343717 (+889146us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fa9410ac 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b
0709 12:17:07.571514 (+227797us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:07.571583 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.571734 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:07.610191 (+ 38457us) raft_consensus.cc:1685] finished
0709 12:17:07.610228 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.610473 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4969,"raft.queue_time_us":16469,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5370,"spinlock_wait_cycles":17871104,"thread_start_us":1111481,"threads_started":1,"wal-append.queue_time_us":941286}
I20260709 12:17:07.605120 11803 rpcz_store.cc:276] 0709 12:17:06.571924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.700782 (+128858us) service_pool.cc:224] Handling call
0709 12:17:07.372872 (+672090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.443862 (+ 70990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.604310 (+160448us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54001c8c50. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:07.604469 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498200960}
I20260709 12:17:07.606696 12776 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.614073 12776 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.615396 13207 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:07.616472 12438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57346 (request call id 408) took 2183 ms. Trace:
I20260709 12:17:07.616889 12438 rpcz_store.cc:276] 0709 12:17:05.432960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.436016 (+  3056us) service_pool.cc:224] Handling call
0709 12:17:06.292493 (+856477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.314385 (+ 21892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.616088 (+1301703us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54002b0050. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:07.616300 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956203904}
I20260709 12:17:07.617978 13130 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:07.618407 13130 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.618736 13130 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:07.620994 13064 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.622742 13196 raft_consensus.cc:993] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:07.623319 13196 raft_consensus.cc:1081] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:07.624675 11698 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:07.596837 13096 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:07.626336 13172 raft_consensus.cc:2804] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.626566 11698 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:07.626878 13172 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.627382 13172 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.629952 11808 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:07.647307 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:07.647812 12387 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:07.649024 12387 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:07.650127 13218 consensus_queue.cc:1048] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:07.651284 13164 raft_consensus.cc:2804] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:07.652025 13164 raft_consensus.cc:697] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:07.652494 13218 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.652964 13218 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.653393 13218 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.655118 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:07.655721 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.634951 13196 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.657464 13196 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.657721 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.658442 11729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 731) took 1333 ms. Trace:
I20260709 12:17:07.658795 11729 rpcz_store.cc:276] 0709 12:17:06.328349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.329889 (+  1540us) service_pool.cc:224] Handling call
0709 12:17:06.330167 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:06.330480 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.330509 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:06.332650 (+  2141us) log.cc:844] Serialized 26 byte log entry
0709 12:17:06.411792 (+ 79142us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:06.411819 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.411867 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:07.462505 (+1050638us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:17:07.628323 (+165818us) raft_consensus.cc:1685] finished
0709 12:17:07.628342 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.658249 (+ 29907us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3000,"raft.queue_time_us":794,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":19361,"spinlock_wait_cycles":16514432,"thread_start_us":78818,"threads_started":1,"wal-append.queue_time_us":109085}
I20260709 12:17:07.659968 11627 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:07.661316 13036 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:07.662011 13036 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.662390 13036 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.662564 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.663583 12438 raft_consensus.cc:2393] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 2: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:07.664594 11773 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:07.657812 13196 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.666026 13064 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:07.666404 13064 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.666771 13064 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:07.668726 11661 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:07.665750 11773 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:07.670442 12847 raft_consensus.cc:2804] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.670895 12847 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.671253 12847 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.652289 13080 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:07.675462 13080 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.675927 13080 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:07.670549 13164 consensus_queue.cc:237] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.674248 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:07.678232 13036 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.688401 12859 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:07.689128 12859 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.689872 11653 raft_consensus.cc:1275] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:07.690894 11653 pending_rounds.cc:85] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03: Aborting all ops after (but not including) 1
I20260709 12:17:07.691182 11653 pending_rounds.cc:107] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:07.691435 11653 raft_consensus.cc:2889] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:07.692281 12859 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:07.692649 11624 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:07.693008 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:07.693885 11653 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:07.674587 11656 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:07.695168 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:07.695667 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:07.693517 13144 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.696216 13144 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.696588 13144 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.697075 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:07.701622 11484 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42126 (request call id 161) took 4246 ms. Trace:
I20260709 12:17:07.701191 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:07.694191 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:07.714923 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:07.713929 12944 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:07.718055 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 124979us
I20260709 12:17:07.719852 11625 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:07.722714 12847 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.724660 12776 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.725005 13199 raft_consensus.cc:2749] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.726014 12769 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:07.726497 12769 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.726861 12769 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:07.725926 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 51954.3us
I20260709 12:17:07.705976 11652 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:07.572016 11804 raft_consensus.cc:1275] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:07.709115 12387 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:07.709337 11654 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:07.716126 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:07.703964 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:07.721645 11625 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:07.737107 11773 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:07.737958 11661 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:07.730552 11731 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:07.725071 12847 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.718312 12944 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:07.753257 11699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.702035 11484 rpcz_store.cc:276] 0709 12:17:03.455457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.455608 (+   151us) service_pool.cc:224] Handling call
0709 12:17:03.669446 (+213838us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400701a54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b5090 00007f44fda53f3a 00007f4503809e9c 00007f450390804e 00007f4501dc92a4 00007f4501dc9232 00007f4501dc9161 00007f4501dc90dc 00007f4501dc8392 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:07.701395 (+4031949us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:04.798515 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:04.799034 (+   519us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:04.799066 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:17:04.799083 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:04.799647 (+   564us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:04.799718 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:04.799743 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:17:04.800118 (+   375us) tablet.cc:701] Row locks acquired
0709 12:17:04.800139 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:17:04.800276 (+   137us) write_op.cc:270] Start()
0709 12:17:04.800379 (+   103us) write_op.cc:276] Timestamp: P: 1783599424800237 usec, L: 0
0709 12:17:04.800398 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:17:04.801030 (+   632us) log.cc:844] Serialized 1681 byte log entry
0709 12:17:05.221836 (+420806us) op_driver.cc:464] REPLICATION: finished
0709 12:17:05.506089 (+284253us) write_op.cc:301] APPLY: starting
0709 12:17:05.506188 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:05.506349 (+   161us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:05.506480 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:05.507063 (+   583us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:05.507289 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:17:05.507336 (+    47us) write_op.cc:312] APPLY: finished
0709 12:17:05.507587 (+   251us) log.cc:844] Serialized 40 byte log entry
0709 12:17:05.507750 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:05.507858 (+   108us) write_op.cc:454] Released schema lock
0709 12:17:05.507905 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:05.508338 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:05.508368 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16728,"reported_tablets":14,"spinlock_wait_cycles":467092224,"child_traces":[["op",{"apply.queue_time_us":283934,"apply.run_cpu_time_us":2250,"apply.run_wall_time_us":2250,"num_ops":4,"prepare.queue_time_us":126881,"prepare.run_cpu_time_us":2781,"prepare.run_wall_time_us":2781,"replication_time_us":421266,"thread_start_us":129086,"threads_started":2}]]}
I20260709 12:17:07.757436 13096 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:07.742636 11652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34104 (request call id 188) took 1415 ms. Trace:
I20260709 12:17:07.763921 12832 consensus_queue.cc:1048] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:17:07.769678 11701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.770121 13034 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.764320 13152 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:07.745060 11656 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
W20260709 12:17:07.767560 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 159129us
I20260709 12:17:07.776887 11654 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.774801 13034 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.738598 13064 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:07.792191 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 80371.2us
I20260709 12:17:07.795087 12434 raft_consensus.cc:1275] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:07.794013 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.795260 11773 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:07.764307 11652 rpcz_store.cc:276] 0709 12:17:06.325234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.330615 (+  5381us) service_pool.cc:224] Handling call
0709 12:17:07.537992 (+1207377us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5800891998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926e9c 00007f44fa926a5b 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:17:07.740481 (+202489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53309312}
I20260709 12:17:07.785377 13152 raft_consensus.cc:697] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:07.775465 13035 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.803467 11809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56490 (request call id 553) took 1204 ms. Trace:
I20260709 12:17:07.794472 13034 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.826301 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.813144 13218 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.826923 12434 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 1.
I20260709 12:17:07.825318 13096 raft_consensus.cc:697] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:07.830693 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:07.838928 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 49702.2us
I20260709 12:17:07.849260 13239 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:07.850137 13239 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:07.852015 11660 raft_consensus.cc:1240] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:07.854077 13115 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.854508 13218 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.854938 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.849315 11659 raft_consensus.cc:1275] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:07.849370 13158 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 12:17:07.849260 11700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.859104 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:07.859930 11731 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.864935 13080 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.865885 13239 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.855875 12431 raft_consensus.cc:1275] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:07.867033 13096 consensus_queue.cc:237] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.869498 13006 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.869992 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.843206 12438 raft_consensus.cc:1275] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:07.870901 12944 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.872040 13144 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.813591 11809 rpcz_store.cc:276] 0709 12:17:06.599238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.343703 (+744465us) service_pool.cc:224] Handling call
0709 12:17:07.344342 (+   639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.345015 (+   673us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:07.389198 (+ 44183us) log.cc:844] Serialized 14 byte log entry
0709 12:17:07.799406 (+410208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:07.799466 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:07.799512 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.799582 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.803394 (+  3812us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50021,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":4702,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8007,"thread_start_us":374775,"threads_started":2}
I20260709 12:17:07.886833 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.855835 12428 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:07.870539 13178 raft_consensus.cc:3055] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:07.873311 12776 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:07.883888 13115 raft_consensus.cc:697] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:07.914608 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.912545 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:07.912842 13035 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.889539 13218 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:07.924142 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 93830.7us
I20260709 12:17:07.928725 13115 consensus_queue.cc:237] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.904479 13178 raft_consensus.cc:740] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:07.914001 11653 raft_consensus.cc:2393] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:07.957691 11654 raft_consensus.cc:1275] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:07.963598 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.965847 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 233006us
I20260709 12:17:07.968582 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:07.974618 13064 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:07.975376 13064 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:07.975966 13064 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.978880 13196 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.980458 13144 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:07.983408 13152 consensus_queue.cc:237] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.986284 13178 consensus_queue.cc:260] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.987210 13034 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.970419 13035 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:07.988386 13035 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:07.989027 11802 raft_consensus.cc:1275] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:07.990936 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:07.991791 11727 raft_consensus.cc:2393] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:07.992268 13036 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.990972 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:07.996475 13130 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:07.996668 13172 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:07.998940 13006 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:07.999994 13064 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:07.973415 11624 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:08.000614 13008 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.000838 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.003086 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.003392 11734 raft_consensus.cc:1240] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:08.004407 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.004550 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.005003 13133 raft_consensus.cc:2749] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.005317 11735 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
W20260709 12:17:08.007468 13233 log.cc:927] Time spent T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 12:17:07.987675 13228 log.cc:927] Time spent T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:17:08.009874 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.016649 12387 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:08.004676 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:07.999866 11729 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:08.005844 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:07.962641 13002 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.016011 13183 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:08.017163 11624 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:08.016124 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:07.954325 13218 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:08.024529 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:07.989857 13034 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:08.016520 12776 consensus_queue.cc:1048] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:17:07.987321 13178 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.040208 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.038506 11805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 219) took 1195 ms. Trace:
I20260709 12:17:08.041527 11807 raft_consensus.cc:2368] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3.
I20260709 12:17:08.020447 13158 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.030601 13133 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.036638 12438 raft_consensus.cc:1240] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:08.034042 11802 raft_consensus.cc:1240] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:08.037290 13035 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:08.103160 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 60596.5us
I20260709 12:17:08.115958 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.116384 11775 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:08.117301 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.118188 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.118911 11734 raft_consensus.cc:1275] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:08.119326 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.119624 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.119814 13064 consensus_queue.cc:1048] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:17:08.120464 13236 log.cc:927] Time spent T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:17:08.120759 13207 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:08.114044 13148 raft_consensus.cc:2804] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:08.120085 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 103032us
I20260709 12:17:08.124971 13144 consensus_queue.cc:1048] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:08.126570 13034 consensus_queue.cc:1048] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:08.127064 13218 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:08.127278 13158 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:08.128165 11653 raft_consensus.cc:1240] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:08.128986 13149 consensus_queue.cc:1048] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:08.129319 11729 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 8.
I20260709 12:17:08.117658 11775 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:08.130694 13207 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:08.131119 13207 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.131470 13207 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:08.132012 13241 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:08.134253 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:08.135042 11657 raft_consensus.cc:2393] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 6: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:08.135924 13036 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:08.136072 11775 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:08.137157 13148 raft_consensus.cc:697] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:08.138248 13148 consensus_queue.cc:237] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:08.130581 11660 raft_consensus.cc:1275] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:08.035128 13172 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:08.033028 13080 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:08.136360 11661 raft_consensus.cc:1240] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.110163 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.141516 11773 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:08.033316 11731 raft_consensus.cc:2468] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:08.035352 13196 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:08.036118 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.029850 13008 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:08.032469 13157 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:08.147372 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:08.148280 11659 raft_consensus.cc:1240] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:08.146785 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:08.146569 12847 raft_consensus.cc:2804] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:08.151489 13080 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.151763 12847 raft_consensus.cc:697] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 8 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:08.134977 11800 raft_consensus.cc:1275] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:08.154951 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.155166 11773 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:08.142779 13064 raft_consensus.cc:2749] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:08.038484 13002 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:08.167116 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:08.171576 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:08.104190 11805 rpcz_store.cc:276] 0709 12:17:06.843547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.556496 (+712949us) service_pool.cc:224] Handling call
0709 12:17:07.556967 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:07.557444 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:07.557474 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:07.580679 (+ 23205us) log.cc:844] Serialized 26 byte log entry
0709 12:17:07.733631 (+152952us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:07.754087 (+ 20456us) log.cc:844] Serialized 14 byte log entry
0709 12:17:07.756940 (+  2853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.757013 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:08.038302 (+281289us) raft_consensus.cc:1685] finished
0709 12:17:08.038323 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:08.038452 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4984,"prepare.queue_time_us":15911,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":4323,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":4784,"thread_start_us":146264,"threads_started":1,"wal-append.queue_time_us":225403}
I20260709 12:17:08.177953 11658 raft_consensus.cc:1275] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:17:08.178450 11658 pending_rounds.cc:85] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03: Aborting all ops after (but not including) 1
I20260709 12:17:08.178701 11658 pending_rounds.cc:107] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:17:08.178911 11658 raft_consensus.cc:2889] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:08.153470 12769 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:08.182403 12769 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:08.184397 11804 raft_consensus.cc:2393] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:08.186110 13205 raft_consensus.cc:2804] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:08.186681 13205 raft_consensus.cc:697] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 4 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:08.187634 13205 consensus_queue.cc:237] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:08.190153 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.191545 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.192735 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:08.194015 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:08.194684 11734 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:08.194085 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:08.198704 11733 raft_consensus.cc:2393] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:08.199597 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:08.201239 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.201654 13002 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:08.202698 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:08.203418 12437 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 1.
W20260709 12:17:08.204293 11701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.205775 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:08.206431 11808 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:08.209669 12432 raft_consensus.cc:1240] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:08.212411 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:08.213066 11806 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:08.215093 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:08.215817 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:08.219051 13006 consensus_queue.cc:1048] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:08.222759 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:08.223026 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:08.223680 11802 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.223968 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:08.147119 11728 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:08.200610 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:08.164623 11726 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:08.162147 13080 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:08.234285 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
W20260709 12:17:08.234808 11698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.235813 11733 raft_consensus.cc:2393] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:08.236379 11734 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:08.241716 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:08.245576 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:08.246511 12432 raft_consensus.cc:1275] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:08.246308 11809 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:08.247334 11732 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.241653 13080 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:08.250391 13144 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.235703 13130 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:08.253278 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.256393 11729 raft_consensus.cc:2368] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3.
W20260709 12:17:08.262883 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 251185us
I20260709 12:17:08.252928 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:08.285116 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:08.236166 12769 consensus_queue.cc:1048] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:17:08.215842 11800 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:08.285882 11809 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:08.233230 13002 consensus_queue.cc:1048] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:17:08.290614 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:08.302177 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:08.303042 11661 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.305064 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:08.306144 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:08.307466 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 43789.6us
I20260709 12:17:08.305653 12431 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:08.310424 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:08.311149 11809 raft_consensus.cc:2368] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5.
I20260709 12:17:08.287038 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:08.290366 13036 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:08.252521 12847 consensus_queue.cc:237] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:08.324009 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:08.334643 11701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.295217 13144 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:08.378901 13144 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:08.316779 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:08.360368 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:08.362805 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:08.368806 11657 raft_consensus.cc:1275] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:08.375181 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:08.375746 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:08.309216 13080 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:17:08.381151 11624 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:08.396170 11624 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:08.381837 11773 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:08.377584 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:08.400261 11654 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:08.387425 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:08.392622 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 108512us
I20260709 12:17:08.397986 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:08.402207 12429 raft_consensus.cc:2393] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 4: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:08.403136 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:08.403223 13080 consensus_queue.cc:1048] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:08.403764 12429 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:08.394703 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:08.404683 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:08.405155 12435 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.387848 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:08.408495 12428 raft_consensus.cc:2393] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 6: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:08.409725 12428 raft_consensus.cc:1275] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:08.411036 12428 raft_consensus.cc:1240] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:08.411577 11660 raft_consensus.cc:1240] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:08.416432 11624 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:08.417641 11624 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:08.423848 11806 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
I20260709 12:17:08.427692 11698 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:17:08.428650 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 46911.5us
I20260709 12:17:08.429523 11773 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:08.384202 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:08.433624 12431 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:08.346349 13036 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:08.435113 11627 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:08.435648 11809 raft_consensus.cc:1240] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:08.317305 12434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:17:08.440711 12434 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:08.441073 12434 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.441852 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:08.421482 13096 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:08.428028 13144 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.416303 11656 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:08.449878 11624 leader_election.cc:400] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5.
I20260709 12:17:08.470289 11624 leader_election.cc:403] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:08.434463 13206 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:08.432999 13034 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:08.470767 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 48082.7us
I20260709 12:17:08.468490 11627 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:17:08.479802 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 50384.5us
I20260709 12:17:08.480576 11773 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:08.448637 13064 raft_consensus.cc:2749] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:08.448148 13157 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:08.504338 12859 consensus_queue.cc:1059] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:08.448063 13096 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:08.492532 11802 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:08.470521 13199 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:08.496954 12776 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.438112 13158 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:08.478914 13034 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.491429 13071 consensus_queue.cc:1048] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:17:08.497296 11732 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:08.514919 11661 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:08.464660 13144 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:08.477576 12429 raft_consensus.cc:1240] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:08.473263 12428 raft_consensus.cc:1240] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:08.477906 13133 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.466588 13008 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:08.528430 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 47929.7us
I20260709 12:17:08.539202 13241 raft_consensus.cc:2749] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5.
I20260709 12:17:08.540939 13108 consensus_queue.cc:1059] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:17:08.542656 13036 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:08.525501 13034 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:08.548694 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:08.551103 13035 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:08.553211 11772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.554319 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:08.525895 12776 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:08.560626 13144 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.518246 13096 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.527017 13006 raft_consensus.cc:3055] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:08.598631 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 161517us
I20260709 12:17:08.566198 13002 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.628026 12386 leader_election.cc:400] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3.
I20260709 12:17:08.628425 12386 leader_election.cc:403] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:08.630852 11773 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:08.626849 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 158426us
I20260709 12:17:08.598104 13035 raft_consensus.cc:697] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:08.655496 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:08.620407 13006 raft_consensus.cc:740] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:08.658334 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:08.663172 12769 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.663988 13161 raft_consensus.cc:3055] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:08.664403 13161 raft_consensus.cc:740] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:08.664649 11775 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:08.665344 13263 log.cc:927] Time spent T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:17:08.666196 13252 log.cc:927] Time spent T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:17:08.667852 11800 raft_consensus.cc:1240] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.671895 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:08.676029 11698 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:17:08.680334 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 60541.8us
I20260709 12:17:08.621897 13207 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:08.665232 13161 consensus_queue.cc:260] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:08.687477 13133 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.687944 13133 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:08.690867 13271 log.cc:927] Time spent T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 12:17:08.691437 13178 consensus_meta.cc:287] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef: Time spent flushing consensus metadata: real 0.585s	user 0.002s	sys 0.006s
I20260709 12:17:08.692094 11735 raft_consensus.cc:2468] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:17:08.693157 13035 consensus_queue.cc:237] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:08.655819 13130 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:08.687043 13006 consensus_queue.cc:260] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:08.703042 11773 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:08.684629 13250 log.cc:927] Time spent T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:17:08.681488 13196 raft_consensus.cc:2804] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:08.707059 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 258565us
I20260709 12:17:08.680353 13071 consensus_queue.cc:1048] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:17:08.708261 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:08.707158 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:08.710543 11700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.711696 11804 raft_consensus.cc:1240] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:08.710736 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 45016.1us
W20260709 12:17:08.713639 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 231785us
I20260709 12:17:08.714663 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:08.715301 12431 raft_consensus.cc:3060] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.698686 12435 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:08.700563 13206 raft_consensus.cc:697] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:08.721175 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:08.681813 13257 consensus_queue.cc:1059] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:17:08.706306 13064 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.707942 13002 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:08.739897 13002 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.740329 13002 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.741406 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:08.722997 13256 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3.
I20260709 12:17:08.730309 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:08.730438 13275 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.731038 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:08.734479 12776 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:08.737164 13207 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:08.727336 12437 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:08.711231 13196 raft_consensus.cc:697] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:08.762235 12431 raft_consensus.cc:2468] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:08.764897 11775 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:08.755105 12434 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:08.768695 12432 raft_consensus.cc:1240] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.768512 12438 raft_consensus.cc:3060] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:08.727123 13257 consensus_queue.cc:1243] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer cfe9bf206bb14951ba7615683809d178 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:08.768913 13275 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:08.774290 13196 consensus_queue.cc:237] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:08.776678 13144 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:08.777944 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:08.778574 12435 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:08.810127 12434 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:08.827135 11698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:08.840354 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 117029us
W20260709 12:17:08.844512 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 49681.9us
I20260709 12:17:08.783147 13218 consensus_queue.cc:1059] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:17:08.847959 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:08.911566 13277 consensus_queue.cc:1059] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 12:17:08.815176 12832 consensus_queue.cc:1048] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 12:17:08.913594 13144 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:08.849454 12430 raft_consensus.cc:2393] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:08.844668 13207 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:08.934106 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 88029.8us
W20260709 12:17:08.938652 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 59927.3us
I20260709 12:17:08.844461 13002 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:08.954727 13279 log.cc:927] Time spent T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:17:08.955168 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:08.960070 13281 consensus_queue.cc:1048] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:17:08.960222 13037 consensus_queue.cc:1059] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:08.961323 13196 raft_consensus.cc:3055] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.961696 13196 raft_consensus.cc:740] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:08.962592 13196 consensus_queue.cc:260] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:08.963469 12435 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
I20260709 12:17:08.963800 11701 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:08.964015 13275 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:08.955140 13274 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:17:08.965090 13290 consensus_queue.cc:1048] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:08.965690 13178 consensus_queue.cc:1059] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:08.966239 13274 consensus_queue.cc:1059] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:08.966964 13196 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.968873 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:08.972275 11701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.999989 12437 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:09.001075 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:08.945052 13071 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:09.008380 12820 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.966717 13178 raft_consensus.cc:3055] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:09.010278 11701 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:09.033260 11773 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:09.015385 13178 raft_consensus.cc:740] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:09.039469 12435 raft_consensus.cc:1240] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:09.040100 13222 consensus_queue.cc:1048] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:08.846287 13206 consensus_queue.cc:237] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:09.021485 13008 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.055542 11773 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:09.066478 13158 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.066987 13037 consensus_queue.cc:1059] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:09.067157 13158 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:09.068861 13283 raft_consensus.cc:3055] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:09.069221 13283 raft_consensus.cc:740] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:09.069541 13158 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:09.096535 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:09.098323 13008 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:09.051118 13277 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:09.145139 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 380292us
I20260709 12:17:09.107992 12431 raft_consensus.cc:1240] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:09.151796 11775 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:09.100150 13205 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:09.156426 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 105444us
I20260709 12:17:09.136030 13277 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:09.151281 13280 log.cc:927] Time spent T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:17:09.135974 13144 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:09.163978 11699 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.052934 13071 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:09.074924 13283 consensus_queue.cc:260] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:09.163540 13034 consensus_meta.cc:287] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.005s
I20260709 12:17:09.153577 12438 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 8.
I20260709 12:17:09.163856 13277 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.179893 13274 raft_consensus.cc:2749] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.183488 12820 raft_consensus.cc:697] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
W20260709 12:17:09.201850 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 131704us
I20260709 12:17:09.165465 13144 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:09.193970 13205 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:09.202642 13283 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:09.223212 11699 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:09.221189 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 48576us
I20260709 12:17:09.186235 13034 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:09.219887 13205 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.221158 13298 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:09.293514 13163 raft_consensus.cc:3055] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:09.294008 13163 raft_consensus.cc:740] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:09.294821 13163 consensus_queue.cc:260] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:09.297722 13096 consensus_meta.cc:287] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.000s
I20260709 12:17:09.298300 11804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56490 (request call id 581) took 1075 ms. Trace:
I20260709 12:17:09.298169 13096 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:09.298678 11804 rpcz_store.cc:276] 0709 12:17:08.222641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.232001 (+  9360us) service_pool.cc:224] Handling call
0709 12:17:08.232292 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:08.716661 (+484369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.298065 (+581404us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b5400447854. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:09.298246 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090298752}
I20260709 12:17:09.299404 13144 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:09.300197 13096 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:09.302011 13002 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:09.307971 11700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.285097 13205 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.284915 13222 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:09.330714 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 107628us
I20260709 12:17:09.285777 13308 raft_consensus.cc:2749] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:09.337273 13260 log.cc:927] Time spent T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.799s	user 0.006s	sys 0.013s
W20260709 12:17:09.338434 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 186731us
I20260709 12:17:09.340473 11775 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:09.331636 13222 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.331835 13298 raft_consensus.cc:697] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
W20260709 12:17:09.342053 13133 consensus_meta.cc:287] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.000s
I20260709 12:17:09.338239 11802 raft_consensus.cc:1240] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:17:09.371977 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 275635us
I20260709 12:17:09.384274 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:09.342931 13207 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:09.286077 13303 consensus_queue.cc:1048] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:17:09.344439 12435 raft_consensus.cc:1275] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:09.377236 12387 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.399175 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:09.345170 13222 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.401855 13148 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:09.402604 13301 log.cc:927] Time spent T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:17:09.403090 13313 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:09.403640 13313 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:09.393134 13008 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:09.407011 13199 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:09.407539 13199 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:09.414072 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:09.420830 12387 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:09.416355 13315 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:09.347366 13034 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:09.423992 11804 raft_consensus.cc:1240] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:09.399647 11624 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.426676 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:09.372494 13305 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
W20260709 12:17:09.429797 11699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.429853 11659 raft_consensus.cc:1275] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:09.393743 13218 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
W20260709 12:17:09.452980 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 53721.1us
W20260709 12:17:09.402040 13292 log.cc:927] Time spent T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:17:09.432636 11806 raft_consensus.cc:1240] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:17:09.448937 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 49350.4us
I20260709 12:17:09.447286 11735 raft_consensus.cc:1275] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:09.455330 11732 raft_consensus.cc:1275] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:09.455847 11804 raft_consensus.cc:1240] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:09.454530 11625 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.460831 12387 leader_election.cc:400] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3.
I20260709 12:17:09.464215 12387 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:09.424521 13313 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:09.465912 12387 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.429260 13148 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:09.473248 11701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.400125 13035 consensus_queue.cc:1059] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:17:09.451833 13241 raft_consensus.cc:2749] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.460157 11653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34104 (request call id 210) took 1324 ms. Trace:
I20260709 12:17:09.347227 12820 consensus_queue.cc:237] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:09.466770 13257 raft_consensus.cc:2749] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:09.427291 13289 consensus_queue.cc:1048] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:17:09.460060 13218 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:09.528002 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 65366.5us
I20260709 12:17:09.451246 13207 raft_consensus.cc:697] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:09.419196 13133 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:09.516800 13148 raft_consensus.cc:2749] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.452659 13315 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:09.534389 11699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.518373 13318 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:09.460469 13305 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:09.548918 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:17:09.534629 13196 consensus_meta.cc:287] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.003s
I20260709 12:17:09.557870 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:09.531144 13320 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.531229 13304 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:09.555763  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:09.561997 11658 raft_consensus.cc:1275] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:09.530500 13144 consensus_queue.cc:1059] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:17:09.569105 13034 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:09.569795 13034 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:09.548019 13241 raft_consensus.cc:2749] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.572860 13322 consensus_queue.cc:1048] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:09.574378 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:09.574784 13322 consensus_queue.cc:1048] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:09.575496 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:09.576576 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:09.577174 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:09.577611 11624 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:09.580332 11700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:09.582334 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 127866us
I20260709 12:17:09.583218 11625 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.584549 11625 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:09.578719 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:09.590255 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:09.559859 13318 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:09.555179 13205 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:09.556298 13257 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:09.592662 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:09.600883 11625 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.521365 13298 consensus_queue.cc:237] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:09.590893 11657 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:09.608904 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:09.580578 13148 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:09.612229 11773 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:09.613900 11734 raft_consensus.cc:2410] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:09.615469 11625 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:09.592634 13318 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:09.593245 13324 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.617393 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:09.627970 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:09.620621 11625 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.592998 13315 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:09.591624 13071 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:09.626247 13326 raft_consensus.cc:2749] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.619422 11730 raft_consensus.cc:1275] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:09.622092 13133 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:09.636226 11624 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.633605 11625 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.622519 13322 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:09.630790 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 164937us
I20260709 12:17:09.611387 13002 consensus_queue.cc:1048] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:17:09.587031 13304 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:09.566109 13320 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:09.618759 13289 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:17:09.622638 13148 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:09.593355 13207 consensus_queue.cc:237] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:09.642634 11803 raft_consensus.cc:2393] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 4: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:09.608371 13257 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:09.634819 13218 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:09.662618 13329 raft_consensus.cc:2749] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.664655 13320 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:09.643658 13326 raft_consensus.cc:2749] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.686930 13326 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.687438 11733 raft_consensus.cc:1275] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:09.667536 11806 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:09.643860 13277 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:09.688460 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:09.689143 11733 raft_consensus.cc:2393] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:09.689567 13323 consensus_queue.cc:1048] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:09.670424 13199 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:09.691023 13305 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:09.691699 13257 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:09.692131 13199 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:09.671443 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:09.673213 13148 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:09.673614 11726 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:09.673820 13337 raft_consensus.cc:2749] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.640105 13322 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:09.694075 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:09.694378 13322 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.694561 13205 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:09.695792 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:09.697057 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:09.531973 11653 rpcz_store.cc:276] 0709 12:17:08.132549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.142550 (+ 10001us) service_pool.cc:224] Handling call
0709 12:17:08.156772 (+ 14222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:08.161041 (+  4269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:08.161089 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:08.161583 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:17:08.180001 (+ 18418us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b18003fcb80. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:17:08.450850 (+270849us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:08.450904 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.450980 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:09.336675 (+885695us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:17:09.426197 (+ 89522us) raft_consensus.cc:1685] finished
0709 12:17:09.426224 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:09.456633 (+ 30409us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3581,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":21679,"spinlock_wait_cycles":64936448,"thread_start_us":265665,"threads_started":1,"wal-append.queue_time_us":376194}
I20260709 12:17:09.697835 11726 raft_consensus.cc:3055] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:09.698588 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
W20260709 12:17:09.682713 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 49191.9us
I20260709 12:17:09.689873 13277 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:09.670943 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:09.698223 11726 raft_consensus.cc:740] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:09.631738 13324 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:09.702623 11726 consensus_queue.cc:260] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:09.703883 11726 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:09.704540 13324 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:09.702584 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:09.706578 11735 raft_consensus.cc:2468] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:09.700254 11625 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:09.701376 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:09.682655 13342 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.713580 13006 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.696926 13304 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:09.714468 11733 raft_consensus.cc:1240] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:09.720007 11625 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:09.722153 13342 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:09.722564 13342 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:09.722903 13342 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.721437 11625 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:09.727371 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:09.728587 13329 raft_consensus.cc:2804] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:09.728979 13329 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:09.729300 13329 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:09.730465 13289 consensus_queue.cc:1048] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:09.732024 13222 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:09.732571 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:09.734095 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:09.735199 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:09.739259 13161 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:09.740687 11726 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:09.742004 13130 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:09.742472 13130 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.747910 13034 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:09.747781 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:09.749349 11726 raft_consensus.cc:606] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:09.763561 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:09.766305 13178 consensus_queue.cc:260] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:09.767202 11805 raft_consensus.cc:1275] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:09.767702 11733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "896664897f42444796f0be51911c9ec7"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:09.768369 11733 raft_consensus.cc:606] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:09.768708 11733 raft_consensus.cc:614] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:09.769554 11735 raft_consensus.cc:1240] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:09.777674 13330 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.779675 11658 raft_consensus.cc:1275] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:09.780787 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:09.781337 11661 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:09.783396 12430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57354 (request call id 622) took 1068 ms. Trace:
I20260709 12:17:09.783784 12430 rpcz_store.cc:276] 0709 12:17:08.714945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.726114 (+ 11169us) service_pool.cc:224] Handling call
0709 12:17:09.783184 (+1057070us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5400003cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:09.783316 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39021440}
I20260709 12:17:09.784255 13337 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.785164 11733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:09.785789 11733 raft_consensus.cc:606] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:09.786209 11733 raft_consensus.cc:614] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:09.785632 13152 raft_consensus.cc:3055] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.788205 13152 raft_consensus.cc:740] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:09.789018 13152 consensus_queue.cc:260] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:09.789897 13152 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.791860 11805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:51054
I20260709 12:17:09.792426 11805 raft_consensus.cc:606] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:09.792732 11805 raft_consensus.cc:614] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:09.798242 12435 raft_consensus.cc:1275] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:09.799747 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:09.801347 11657 raft_consensus.cc:1240] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:09.802338 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:09.803071 12436 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:09.803411 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:09.804615 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:09.804745 13273 raft_consensus.cc:3055] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:09.805200 13273 raft_consensus.cc:740] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
W20260709 12:17:09.806469 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 78678.6us
I20260709 12:17:09.806159 13273 consensus_queue.cc:260] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:09.807806 13273 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.808225 13205 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:09.808756 13205 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:09.798364 11729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:09.809912 11729 raft_consensus.cc:606] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:09.810994 13205 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:09.811836 13291 log.cc:927] Time spent T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.648s	user 0.000s	sys 0.001s
W20260709 12:17:09.808248 13267 log.cc:927] Time spent T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 1.267s	user 0.008s	sys 0.028s
I20260709 12:17:09.815160 13275 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:09.816707 11625 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:09.820438 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:09.824329 13178 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.830385 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:09.761037 13322 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:09.837687 11661 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
W20260709 12:17:09.854626 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 218461us
I20260709 12:17:09.835189 11698 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.863056 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:09.865435 11807 raft_consensus.cc:1240] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:09.939863 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:09.940586 12437 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.948035 12437 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:09.951583 11627 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.952726 13199 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:09.953110 13199 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:09.953434 13199 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.960417 13199 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:09.798525 13269 log.cc:927] Time spent T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 1.258s	user 0.013s	sys 0.003s
I20260709 12:17:09.965598 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:09.974651 12431 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:09.969244 11627 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:09.974923 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:09.975033 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 105863us
W20260709 12:17:09.974575 11701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:09.975178 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 140099us
I20260709 12:17:09.970577 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:09.972415 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:09.976493 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:09.977155 11654 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:09.978142 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:09.966773 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:09.981729 11658 raft_consensus.cc:2393] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:09.985538 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:09.929013 13275 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.993139 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:10.007802 12386 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.008684 11775 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:10.012576 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:10.014256 11775 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:10.016489 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:09.995105 11699 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
W20260709 12:17:10.018463 12386 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.026193 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:09.980515 13108 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:10.026445 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:10.031168 11775 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:09.983850 13196 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:10.034783 11775 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:10.035531 12431 raft_consensus.cc:2393] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:09.985644 11801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 241) took 1321 ms. Trace:
I20260709 12:17:09.989362 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:10.002955 12832 raft_consensus.cc:2749] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:10.040766 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:10.041742 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 46752.8us
W20260709 12:17:10.042654 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 61264.3us
I20260709 12:17:10.043313 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:10.049775 13336 raft_consensus.cc:2804] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:10.050242 13336 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:10.050626 13336 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.028242 13002 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.016419 13305 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:10.056795 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:10.047361 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:10.054152 11775 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:10.061393 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:10.003474 13115 consensus_queue.cc:1048] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:10.036396 13205 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:10.041642 13313 raft_consensus.cc:2749] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:10.048473 13199 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:09.980314 13337 consensus_queue.cc:1059] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:17:10.042116 13275 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:10.050460 13270 log.cc:927] Time spent T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 1.510s	user 0.006s	sys 0.016s
I20260709 12:17:10.071583 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:10.043965 13108 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:10.073242 13327 raft_consensus.cc:2749] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:10.073428 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:10.075325 11807 raft_consensus.cc:1240] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:10.075573 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:10.077967 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.082502 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:10.085155 13133 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:10.086366 13163 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:10.088696 11731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:10.090198 11802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 234) took 1432 ms. Trace:
W20260709 12:17:10.097154 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 54002.4us
I20260709 12:17:10.096550 12387 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:10.385583 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 289096us
I20260709 12:17:10.060421 11658 raft_consensus.cc:2468] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:10.072675 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:10.387616 12435 raft_consensus.cc:1240] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:10.070472 13130 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:10.184660 11727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.028s	sys 0.077s
I20260709 12:17:10.041479 13206 consensus_queue.cc:1048] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 12:17:10.185406 12820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.062s	sys 0.047s
I20260709 12:17:10.059384 13320 raft_consensus.cc:2804] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:10.056466 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:10.056869 12428 raft_consensus.cc:1275] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:10.068466 13305 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:10.215155 12859 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.045696 13196 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:10.075165 13315 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.058027 13222 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:10.030997 13329 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:10.070178 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:10.392624 11731 raft_consensus.cc:606] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:10.049834 13338 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:10.187783 13034 consensus_queue.cc:1048] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:17:10.217779 13207 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:10.241957 13199 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:10.295450 13342 consensus_meta.cc:287] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 12:17:10.308892 11735 raft_consensus.cc:1240] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:10.317173 13336 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:10.325855 13343 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.327324 12434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57338 (request call id 762) took 1356 ms. Trace:
I20260709 12:17:10.299970 13035 raft_consensus.cc:3055] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:10.330540 13340 log.cc:927] Time spent T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:17:10.333889 13322 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:10.214048 11734 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
W20260709 12:17:10.336803 13273 consensus_meta.cc:287] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.000s
W20260709 12:17:10.337687 13298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.001s	sys 0.028s
W20260709 12:17:10.360551 11659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.010s	sys 0.014s
W20260709 12:17:10.475486 11659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.010s	sys 0.014s
I20260709 12:17:10.317022 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:10.339920 11800 raft_consensus.cc:1275] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:10.394203 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:17:10.386685 13161 consensus_meta.cc:287] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.000s
I20260709 12:17:10.383150 13275 raft_consensus.cc:697] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
W20260709 12:17:10.406509 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 335148us
I20260709 12:17:10.391350 13144 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
W20260709 12:17:10.398716 12820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.073s	sys 0.061s
W20260709 12:17:10.395037 11727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.035s	sys 0.095s
I20260709 12:17:10.502357 11730 raft_consensus.cc:2410] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:10.393008 13327 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:10.396009 13008 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.004s	sys 0.011s
I20260709 12:17:10.399075 13320 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:10.395229 13164 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:17:10.452428 11657 raft_consensus.cc:2468] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:10.462594 12434 rpcz_store.cc:276] 0709 12:17:08.971187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.000529 (+ 29342us) service_pool.cc:224] Handling call
0709 12:17:09.008122 (+  7593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.189398 (+181276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.189439 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:09.189496 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:09.189526 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.327091 (+1137565us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54002b0a54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:10.327133 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.327250 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416395520}
I20260709 12:17:10.419014 13257 consensus_queue.cc:1059] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:17:10.384780 11802 rpcz_store.cc:276] 0709 12:17:08.657325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.738871 (+ 81546us) service_pool.cc:224] Handling call
0709 12:17:08.739184 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.396099 (+656915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.089904 (+693805us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54004bf854. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:10.090132 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1306487040}
I20260709 12:17:10.423435 13315 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:10.421504 12859 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:10.420640 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:10.467257 13035 raft_consensus.cc:740] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
W20260709 12:17:10.475404 13298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.001s	sys 0.029s
I20260709 12:17:10.041771 11801 rpcz_store.cc:276] 0709 12:17:08.664317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.073136 (+408819us) service_pool.cc:224] Handling call
0709 12:17:09.073434 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.394792 (+321358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.397333 (+  2541us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:09.478415 (+ 81082us) log.cc:844] Serialized 26 byte log entry
0709 12:17:09.636485 (+158070us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:09.655413 (+ 18928us) log.cc:844] Serialized 14 byte log entry
0709 12:17:09.836298 (+180885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.895305 (+ 59007us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:09.938665 (+ 43360us) raft_consensus.cc:1685] finished
0709 12:17:09.968544 (+ 29879us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:09.984181 (+ 15637us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37532,"prepare.queue_time_us":13099,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":120757,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":7558,"thread_start_us":342884,"threads_started":2,"wal-append.queue_time_us":141244}
W20260709 12:17:10.507632 13008 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.005s	sys 0.012s
I20260709 12:17:10.596267 13341 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:10.470232 13343 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:10.611287 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 210961us
I20260709 12:17:10.612165 13341 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:10.613108 13316 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:10.609334 13303 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.606871 13108 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:10.618336 11660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60060 (request call id 683) took 1070 ms. Trace:
I20260709 12:17:10.507270 13144 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:10.430724 13207 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:10.452791 13199 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:10.478129 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:10.491943 13290 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.465363 13218 consensus_queue.cc:1059] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:17:10.506027 13320 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.427616 13338 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:10.464730 13342 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:10.574304 13206 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.510011 13148 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:10.506780 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 441273us
I20260709 12:17:10.482476 13172 consensus_queue.cc:1059] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 12:17:10.478372 13241 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:10.634646 11775 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:10.596024 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:10.620296 11660 rpcz_store.cc:276] 0709 12:17:09.547540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.547661 (+   121us) service_pool.cc:224] Handling call
0709 12:17:09.555247 (+  7586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.046200 (+490953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.046230 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.052410 (+  6180us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.389924 (+337514us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:10.389962 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.390080 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.618116 (+228036us) raft_consensus.cc:1685] finished
0709 12:17:10.618137 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.618279 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17122,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":813223,"threads_started":2,"wal-append.queue_time_us":547186}
I20260709 12:17:10.680967 12435 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.671361 11728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 757) took 1068 ms. Trace:
I20260709 12:17:10.614208 13316 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:10.718591 11660 raft_consensus.cc:1240] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:10.720794 11656 raft_consensus.cc:1240] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:10.728523 13347 log.cc:927] Time spent T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 12:17:10.730196 12859 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:10.662679 13256 consensus_queue.cc:1059] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 12:17:10.731974 13346 log.cc:927] Time spent T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 12:17:10.733255 13312 consensus_queue.cc:1048] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:17:10.695796 13148 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:10.738808 13316 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:10.739378 13336 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:10.740142 13148 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:10.609177 13275 consensus_queue.cc:237] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:10.742105 13350 log.cc:927] Time spent T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:17:10.714102 13305 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:10.683230 13290 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:10.710719 12438 raft_consensus.cc:1275] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:10.745846 12438 pending_rounds.cc:85] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Aborting all ops after (but not including) 1
I20260709 12:17:10.746105 12438 pending_rounds.cc:107] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:10.746354 12438 raft_consensus.cc:2889] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:10.614449 13298 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:10.615047 13130 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:10.662367 11652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 749) took 2439 ms. Trace:
I20260709 12:17:10.508522 13327 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:10.737669 13207 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:10.750672 11653 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.693540 13206 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:10.717264 13361 raft_consensus.cc:2749] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:10.614895 13303 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:10.767820 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 448458us
I20260709 12:17:10.697777 13218 raft_consensus.cc:3055] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:10.746467 13344 log.cc:927] Time spent T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
W20260709 12:17:10.686005 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 293592us
I20260709 12:17:10.613737 13035 consensus_queue.cc:260] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:10.777735 12434 raft_consensus.cc:1240] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:10.704294 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 69726.8us
I20260709 12:17:10.715317 13196 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:10.803615 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 111420us
I20260709 12:17:10.812569 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:10.803414 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:10.780890 13315 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:10.825711 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:10.778538 13336 consensus_queue.cc:1048] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:17:10.832471 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:10.833719 12434 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:10.802830 13218 raft_consensus.cc:740] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:10.783581 13298 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:10.842954 12435 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:10.844563 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:10.844957 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:10.846282 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:10.827565 13329 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:10.825196 13338 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:10.854720 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:10.854840 12435 raft_consensus.cc:1275] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:10.848762 11775 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:10.862103 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:10.842726 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:10.854164 13342 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:10.866008 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:10.868783 11661 raft_consensus.cc:2393] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:10.860325 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:10.860554 12436 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:10.863229 13316 raft_consensus.cc:2804] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:10.864660 11726 raft_consensus.cc:1275] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:17:10.874603 11727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 758) took 1268 ms. Trace:
I20260709 12:17:10.896929 11727 rpcz_store.cc:276] 0709 12:17:09.605974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.606879 (+   905us) service_pool.cc:224] Handling call
0709 12:17:09.632883 (+ 26004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.662434 (+ 29551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.662468 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:09.662982 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.593338 (+930356us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:10.594780 (+  1442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.605285 (+ 10505us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.867647 (+262362us) raft_consensus.cc:1685] finished
0709 12:17:10.868857 (+  1210us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.873702 (+  4845us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6903,"raft.queue_time_us":19606,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":839241,"threads_started":1,"wal-append.queue_time_us":722254}
I20260709 12:17:10.896823 11726 pending_rounds.cc:85] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef: Aborting all ops after (but not including) 3
I20260709 12:17:10.898833 11726 pending_rounds.cc:107] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:17:10.899150 11726 raft_consensus.cc:2889] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:10.895169 13163 consensus_meta.cc:287] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 12:17:10.898341 13298 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:10.878191 13370 log.cc:927] Time spent T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:17:10.873860 13316 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.902053 13316 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.884003 13303 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:10.867715 13361 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:10.884997 13206 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:10.712244 11728 rpcz_store.cc:276] 0709 12:17:09.594388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.602274 (+  7886us) service_pool.cc:224] Handling call
0709 12:17:09.609703 (+  7429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.610164 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.610200 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:09.610690 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:17:09.714008 (+103318us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:09.714052 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.714125 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.609719 (+895594us) raft_consensus.cc:1685] finished
0709 12:17:10.609742 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.662699 (+ 52957us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1709,"raft.queue_time_us":4093,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":10576,"thread_start_us":100677,"threads_started":1,"wal-append.queue_time_us":453068}
I20260709 12:17:10.886178 13327 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:10.889984 13373 log.cc:927] Time spent T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:17:10.892581 11801 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:10.892993 13199 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:10.773011 11652 rpcz_store.cc:276] 0709 12:17:08.184748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.185207 (+   459us) service_pool.cc:224] Handling call
0709 12:17:08.546657 (+361450us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b5800891998. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:17:08.546883 (+   226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:08.709749 (+162866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:08.711082 (+  1333us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:08.840038 (+128956us) log.cc:844] Serialized 26 byte log entry
0709 12:17:09.342780 (+502742us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:09.428535 (+ 85755us) log.cc:844] Serialized 14 byte log entry
0709 12:17:09.768292 (+339757us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b1800141dc0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:17:10.315796 (+547504us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b1800141dc0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95b455 00007f44fda43060 00007f44fda55716 00007f44fda66287 00007f44fda66208
0709 12:17:10.579118 (+263322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.597192 (+ 18074us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.598707 (+  1515us) raft_consensus.cc:1685] finished
0709 12:17:10.602268 (+  3561us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.622198 (+ 19930us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":64991,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":4571,"raft.queue_time_us":46361,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":40071,"spinlock_wait_cycles":109876096,"thread_start_us":757269,"threads_started":3,"wal-append.queue_time_us":601556,"wal-append.run_cpu_time_us":9118,"wal-append.run_wall_time_us":1120014}
I20260709 12:17:10.930418 11658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 771) took 1052 ms. Trace:
I20260709 12:17:10.935242 11658 rpcz_store.cc:276] 0709 12:17:09.877722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.399213 (+521491us) service_pool.cc:224] Handling call
0709 12:17:10.420823 (+ 21610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.425892 (+  5069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.425924 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.467174 (+ 41250us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.785129 (+317955us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:10.858434 (+ 73305us) log.cc:844] Serialized 14 byte log entry
0709 12:17:10.858691 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.858768 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.930151 (+ 71383us) raft_consensus.cc:1685] finished
0709 12:17:10.930171 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.930358 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42836,"prepare.queue_time_us":68427,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":1816,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":5249,"thread_start_us":212199,"threads_started":2,"wal-append.queue_time_us":373125}
I20260709 12:17:10.895275 13320 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:10.949731 12386 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:10.946933 13316 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:10.952973  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:17:10.953860 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:10.954906  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:10.955307 11655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60060 (request call id 690) took 1076 ms. Trace:
I20260709 12:17:10.956336  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:10.957510 11657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34104 (request call id 230) took 1155 ms. Trace:
I20260709 12:17:10.957902 11657 rpcz_store.cc:276] 0709 12:17:09.802311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.804374 (+  2063us) service_pool.cc:224] Handling call
0709 12:17:10.957361 (+1152987us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54002e09d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:10.957455 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488300416}
I20260709 12:17:10.960678 11654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60060 (request call id 691) took 1082 ms. Trace:
I20260709 12:17:10.956244 11655 rpcz_store.cc:276] 0709 12:17:09.878430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.605603 (+727173us) service_pool.cc:224] Handling call
0709 12:17:10.695458 (+ 89855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.732858 (+ 37400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.732896 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.802466 (+ 69570us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.866568 (+ 64102us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:10.869205 (+  2637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.871609 (+  2404us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.955096 (+ 83487us) raft_consensus.cc:1685] finished
0709 12:17:10.955125 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.955247 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":22697,"threads_started":1,"wal-append.queue_time_us":121965}
I20260709 12:17:10.963002 11653 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:10.963158 13316 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:10.964130 11653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 767) took 1089 ms. Trace:
I20260709 12:17:10.964476 11653 rpcz_store.cc:276] 0709 12:17:09.876078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.927931 (+ 51853us) service_pool.cc:224] Handling call
0709 12:17:10.963959 (+1036028us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b5400557154. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:10.964074 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1520091520}
I20260709 12:17:10.967823 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:10.969049 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:10.955232 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:10.970165 12436 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
I20260709 12:17:10.970278 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:10.972535 13290 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:10.969604 11661 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:10.961083 11654 rpcz_store.cc:276] 0709 12:17:09.878646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.393953 (+515307us) service_pool.cc:224] Handling call
0709 12:17:10.960463 (+566510us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400310bd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:10.960606 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884372224}
I20260709 12:17:10.965569 11699 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:10.970239 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:10.990752 11699 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:10.977931 13320 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:10.992216 13161 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:10.997028 11699 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:10.997951 13161 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:10.998463 13161 raft_consensus.cc:697] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:11.001250 11699 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:11.000025 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:11.012234 13035 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:11.013298 11653 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.002650 13161 consensus_queue.cc:237] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.013981 13273 raft_consensus.cc:3055] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:11.014463 13273 raft_consensus.cc:740] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:11.015250 13273 consensus_queue.cc:260] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:11.016544 13273 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.019861 11730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59512 (request call id 505) took 1349 ms. Trace:
I20260709 12:17:11.020380 11730 rpcz_store.cc:276] 0709 12:17:09.670223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.671169 (+   946us) service_pool.cc:224] Handling call
0709 12:17:11.019633 (+1348464us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54003a9654. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:11.019790 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1838452480}
I20260709 12:17:11.019958 13328 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.023046 12820 raft_consensus.cc:993] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:17:11.023676 12820 raft_consensus.cc:1081] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Signalling peer b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:17:11.025123 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.025799 12432 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:11.027776 13183 raft_consensus.cc:2749] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:11.024366 13328 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.030133 13328 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.030977 13144 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.035064 13304 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.035780 13304 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.038879 13183 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.039366 13183 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.041366 13183 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.043138 13304 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.028015 11729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59512 (request call id 515) took 1034 ms. Trace:
I20260709 12:17:11.051493 11732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59512 (request call id 517) took 1057 ms. Trace:
W20260709 12:17:11.131603 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.049121 11729 rpcz_store.cc:276] 0709 12:17:09.993789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.302132 (+308343us) service_pool.cc:224] Handling call
0709 12:17:10.302577 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.302958 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.302983 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.303505 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.593888 (+290383us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:10.780195 (+186307us) log.cc:844] Serialized 14 byte log entry
0709 12:17:11.027544 (+247349us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b5400274320. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9c6733 00007f44fda4bdbf 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c
0709 12:17:11.027596 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.027693 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.027734 (+    41us) raft_consensus.cc:1685] finished
0709 12:17:11.027826 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.027952 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3624,"prepare.queue_time_us":90435,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":430,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":17799,"spinlock_wait_cycles":9487104,"thread_start_us":442739,"threads_started":2,"wal-append.queue_time_us":445395}
I20260709 12:17:11.059823 12437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57354 (request call id 636) took 1075 ms. Trace:
W20260709 12:17:11.059988 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 255023us
I20260709 12:17:11.058683 11625 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.183668 12387 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:11.065580 11732 rpcz_store.cc:276] 0709 12:17:09.994283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.326462 (+332179us) service_pool.cc:224] Handling call
0709 12:17:10.882047 (+555585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.882407 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.882438 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.882908 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.951058 (+ 68150us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:10.951101 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.951167 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.017704 (+ 66537us) raft_consensus.cc:1685] finished
0709 12:17:11.017722 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.051234 (+ 33512us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54009cbdd0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:11.051433 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14661,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":1276887808,"thread_start_us":67757,"threads_started":1,"wal-append.queue_time_us":119738}
W20260709 12:17:11.062296 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 112650us
I20260709 12:17:11.195351 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.196141 11660 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
W20260709 12:17:11.196218 12386 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.181885 12437 rpcz_store.cc:276] 0709 12:17:09.984028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.987656 (+  3628us) service_pool.cc:224] Handling call
0709 12:17:10.010505 (+ 22849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:10.010715 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:10.473554 (+462839us) log.cc:844] Serialized 14 byte log entry
0709 12:17:11.059488 (+585934us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.059550 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:11.059593 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.059664 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.059769 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307088,"prepare.queue_time_us":585676,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":3729,"raft.queue_time_us":288309,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":65,"spinlock_wait_cycles":1095936,"thread_start_us":721459,"threads_started":2,"wal-append.queue_time_us":353313}
I20260709 12:17:11.198338 12387 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.199621 12387 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:11.060894 13071 raft_consensus.cc:2749] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.060606 13274 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.054960 13343 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:11.050241 11655 raft_consensus.cc:1275] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:11.064286 13078 raft_consensus.cc:3055] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:11.221163 13078 raft_consensus.cc:740] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:11.221692 12859 raft_consensus.cc:993] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:11.059340 13148 raft_consensus.cc:3055] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:11.063279 13163 raft_consensus.cc:2804] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.211432 11699 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:11.063951 13241 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:11.064056 13256 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.219803 13328 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.267104 13241 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.057586 12430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57354 (request call id 627) took 1260 ms. Trace:
I20260709 12:17:11.269019 13328 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.269356 13241 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.268049 12430 rpcz_store.cc:276] 0709 12:17:09.796866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.797024 (+   158us) service_pool.cc:224] Handling call
0709 12:17:09.797318 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.797519 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:10.293972 (+496453us) log.cc:844] Serialized 14 byte log entry
0709 12:17:11.056960 (+762988us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b1800061c60. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa8d8c0a 00007f4504018219 00007f44fa960a40 00007f44fa95b4e4 00007f44fa95b455 00007f44fda43060 00007f44fda55716 00007f44fda66287 00007f44fda66208
0709 12:17:11.057164 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.057229 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:11.057278 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.057357 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.057520 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4171,"prepare.queue_time_us":663737,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2361,"raft.queue_time_us":290496,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":6153088,"thread_start_us":884138,"threads_started":2,"wal-append.queue_time_us":474102}
I20260709 12:17:11.045717 11653 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:11.224524 12437 raft_consensus.cc:1275] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:11.199635 13115 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.271418 13115 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.233338 13163 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:11.257228 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:11.222077 13078 consensus_queue.cc:260] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.260162 13330 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.260761 12820 raft_consensus.cc:993] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:11.250568 13357 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.250054 13336 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:11.217267 13035 raft_consensus.cc:2749] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.262125 11701 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:11.246426 13308 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:11.256006 13322 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:11.263365 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.244508 13341 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:11.257267 13002 consensus_queue.cc:1059] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 12:17:11.265620 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 207006us
I20260709 12:17:11.296329 11625 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.223389 13274 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.220618 11655 pending_rounds.cc:85] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03: Aborting all ops after (but not including) 3
I20260709 12:17:11.217869 11652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:17:11.267179 13256 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.220109 11806 raft_consensus.cc:1240] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:11.272840 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.255146 11773 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.302410 12431 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
W20260709 12:17:11.302809 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 47742.6us
I20260709 12:17:11.274606 11699 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.280428 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:11.306005 11654 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.224565 13148 raft_consensus.cc:740] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
W20260709 12:17:11.249415 13348 log.cc:927] Time spent T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.651s	user 0.001s	sys 0.005s
I20260709 12:17:11.227272 12859 raft_consensus.cc:1081] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:11.319221 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.234314 11801 raft_consensus.cc:1240] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:17:11.320003 13115 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.289994 11701 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:11.280671 13163 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.278087 13343 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.283761 13336 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.299646 11625 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.288698 13078 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.285989 13281 raft_consensus.cc:1081] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:11.308879 13256 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:11.291481 13328 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:11.312644 11773 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.312127 13241 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.309967 13305 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:11.318217 11652 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:11.302100 11655 pending_rounds.cc:107] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:11.328564 13241 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.311543 13064 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.328670 13305 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.294690 13035 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.329222 11655 raft_consensus.cc:2889] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:11.326226 13343 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.293301 13308 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.326192 13144 raft_consensus.cc:2749] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.329022 11652 raft_consensus.cc:3060] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.324407 13336 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:11.333596 13035 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.334425 11659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60060 (request call id 681) took 1787 ms. Trace:
I20260709 12:17:11.335651 13035 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.334822 11659 rpcz_store.cc:276] 0709 12:17:09.546927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.547060 (+   133us) service_pool.cc:224] Handling call
0709 12:17:09.557254 (+ 10194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.634104 (+ 76850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.634135 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:09.642420 (+  8285us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.475961 (+833541us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:10.476005 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.476076 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.248794 (+772718us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:17:11.334152 (+ 85358us) raft_consensus.cc:1685] finished
0709 12:17:11.334172 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.334371 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15327,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":13162240,"thread_start_us":789564,"threads_started":2,"wal-append.queue_time_us":708839}
I20260709 12:17:11.316222 12820 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:11.304045 13341 raft_consensus.cc:2749] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:11.298381 12428 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:11.286849 13357 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.309751 13274 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.328935 13290 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.285209 13330 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.294093 13322 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:11.330756 13328 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.344501 11654 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
W20260709 12:17:11.346850 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 47284.5us
I20260709 12:17:11.353868 11625 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.347889 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.325012 13303 raft_consensus.cc:2804] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.345171 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.326553 13002 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.321024 13283 consensus_queue.cc:1048] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:17:11.337080 13320 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:11.354616 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.355561 11625 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.356694 11804 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
W20260709 12:17:11.368598 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 56044.7us
I20260709 12:17:11.368692 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.361985 13327 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.350476 13315 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:11.349566 12820 raft_consensus.cc:697] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:11.372833 11625 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.373090 13361 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.354279 13035 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.356380 13144 raft_consensus.cc:2749] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:11.362367 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:11.354571 13328 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:11.386932 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.380252 11773 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.356251 13303 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:11.361985 13313 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:11.383884 11625 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.390471 11800 raft_consensus.cc:1240] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:11.365618 13281 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.353317 13290 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.373847 13274 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.403129 11773 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:11.405537 11805 raft_consensus.cc:2393] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 4: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:11.398775 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.395057 13133 raft_consensus.cc:2749] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:11.393419 13115 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:11.397967 13281 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.386749 13337 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:11.366434 13002 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.387943 13308 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.393811 13303 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.349512 13148 consensus_queue.cc:260] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.415555 11773 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:11.419025 12820 consensus_queue.cc:237] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.420764 13357 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.381037 13315 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.421866 13322 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:11.378515 13327 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.422498 13241 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.395435 13313 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.424183 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.425420 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.428550 11699 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:11.374154 13320 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:11.383116 12859 consensus_queue.cc:1048] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:17:11.432664 13361 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.390091 13035 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.442224 11773 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:11.443806 13330 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:11.436975 13392 log.cc:927] Time spent T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:17:11.437274 13389 log.cc:927] Time spent T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.202s	user 0.000s	sys 0.002s
I20260709 12:17:11.411798 13274 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.455042 13357 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:11.445437 13308 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:11.449353 13148 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:11.429464 13163 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.459976 13322 raft_consensus.cc:2749] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.470379 11804 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
W20260709 12:17:11.453851 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 53923.1us
W20260709 12:17:11.475841 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 80054.7us
W20260709 12:17:11.461735 13391 log.cc:927] Time spent T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:17:11.490564 13338 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.493018 13338 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.493532 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:11.494141 12435 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.495085 13071 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:11.495625 13071 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.459326 13305 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.475919 13308 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.498057 13308 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:11.498466 12437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:17:11.499039 12437 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:11.499347 12437 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.456501 11800 raft_consensus.cc:2468] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:17:11.501024 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.456465 11802 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:11.502405 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.502882 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.503489 12432 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:11.506292 13308 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:11.508939 13338 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.509542 13035 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.509938 13241 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.464921 13316 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:11.483294 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:11.483989 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:11.484107 13257 raft_consensus.cc:2804] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:11.484603 13164 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.487389 13371 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.488529 13152 raft_consensus.cc:2804] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:11.490549 13281 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.492040 13064 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.515996 12435 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:11.498163 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.519532 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.538676 11654 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
W20260709 12:17:11.520694 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 321121us
I20260709 12:17:11.523711 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:11.482252 11698 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.528877 12431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:17:11.529438 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:11.497617 13071 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:11.473168 13115 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:17:11.480726 13357 raft_consensus.cc:697] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:11.516695 13327 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.536784 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.537513 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.540268 11699 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:11.540395 12431 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:11.517037 12437 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.540465 11729 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:11.543800 12431 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.544983 13357 consensus_queue.cc:237] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.546773 13071 consensus_queue.cc:1059] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:11.547381 11803 raft_consensus.cc:1240] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:11.547609 13071 raft_consensus.cc:3055] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:11.547992 13071 raft_consensus.cc:740] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:11.548801 13071 consensus_queue.cc:260] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.549921 13071 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.550297 12428 raft_consensus.cc:2410] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:11.550477 13273 raft_consensus.cc:2804] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.550858 13273 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.551194 13273 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.551738 12437 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:11.533532 13152 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:11.550313 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 68142.7us
I20260709 12:17:11.554143 11698 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.555347 13163 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:11.542702 13002 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.556149 11698 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.524780 13035 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.544312 12387 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:17:11.561362 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 88879.9us
I20260709 12:17:11.533362 13257 raft_consensus.cc:697] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:11.564316 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:11.565963 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:11.566582 11734 raft_consensus.cc:1240] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:11.568495 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.568768 13205 raft_consensus.cc:3055] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:11.569146 13205 raft_consensus.cc:740] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:11.536667 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:11.570209 11726 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:11.516072 13241 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.573972 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:11.574188 11807 raft_consensus.cc:1240] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:17:11.576436 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.577129 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:11.524936 13316 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.579746 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:11.552801 13152 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.581396 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.582149 11654 raft_consensus.cc:2393] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:11.492936 13218 consensus_queue.cc:260] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.583675 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.564533 13281 raft_consensus.cc:2749] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:11.557358 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.585700 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.587677 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:11.587795 11657 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:11.586030 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:11.535616 13371 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.594291 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:11.597165 13256 raft_consensus.cc:2804] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:11.598120 13281 consensus_queue.cc:1059] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:11.542562 13008 consensus_queue.cc:1048] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 12:17:11.596520 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 52258.8us
I20260709 12:17:11.612663 12387 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:11.600037 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.614349 11661 raft_consensus.cc:2410] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:11.616983 12387 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:11.600961 11624 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:11.573390 11728 raft_consensus.cc:2468] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:17:11.575237 13402 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:11.604805 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:11.605726 11808 raft_consensus.cc:2393] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 5: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:11.608868 11729 raft_consensus.cc:1275] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:11.607640 12431 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.638132 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:11.574249 13035 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:11.605726 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.598583 13205 consensus_queue.cc:260] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.595629 13400 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:11.638818 11733 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:11.649408 12431 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:11.649868 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:11.610549 13395 raft_consensus.cc:2749] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.609031 13256 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.650594 11733 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
W20260709 12:17:11.652395 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 112250us
I20260709 12:17:11.638811 11773 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:11.653487 11625 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.647511 12387 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.622766 12859 raft_consensus.cc:2804] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.638666 13218 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.663401 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.663864 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.669268 11807 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:11.664314 12387 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.637168 13396 raft_consensus.cc:2804] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:11.666254 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:11.670070 13396 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:11.659381 11625 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:11.669374 11808 raft_consensus.cc:2393] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 6: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:11.670657 12387 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.670522 13396 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.671519 13163 raft_consensus.cc:2749] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:11.673549 13163 consensus_queue.cc:1059] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:11.674088 11627 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.674427 13163 raft_consensus.cc:3055] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:11.674783 13163 raft_consensus.cc:740] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:11.679862 13396 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:11.682189 13396 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:11.683686 11660 raft_consensus.cc:1240] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:11.684617 13338 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:11.684679 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.685195 13338 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.686478 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.687026 11660 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:11.687402 13338 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:11.670277 11729 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:11.685220 11656 raft_consensus.cc:1240] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:11.670583 13158 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.689985 11656 raft_consensus.cc:1240] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:17:11.690102 13163 consensus_queue.cc:260] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.691246 13163 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.687754 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.693490 11660 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:11.641604 13078 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:11.636930 13401 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.694844 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:11.705302 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 175714us
I20260709 12:17:11.637406 13328 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.708019 11701 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:11.708763 11733 raft_consensus.cc:1240] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:17:11.709560 11701 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:11.658444 13256 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.651744 13241 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.718268 13274 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.712975 11652 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.719008 13274 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.719352 13274 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.719679 13274 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.720546 11652 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:11.721390 13305 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.721798 13305 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.722124 13305 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.725893 13341 raft_consensus.cc:2749] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:11.665383 12859 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.711584 13328 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.668515 13281 raft_consensus.cc:3055] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:11.667905 13115 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.665606 13071 raft_consensus.cc:2749] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.716004 13330 raft_consensus.cc:2804] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.739420 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:11.734133 13326 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:11.717774 13164 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.717149 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.740404 13115 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.649168 13402 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:11.737506 13337 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:11.737852 12859 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:11.765245 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 49920.7us
I20260709 12:17:11.740061 13281 raft_consensus.cc:740] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:11.656001 13400 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.774725 13400 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.775255 13402 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:11.760450 13071 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:11.782193 13071 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.784475 13071 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.711076 13257 consensus_queue.cc:237] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.785000 13336 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.747292 13398 consensus_queue.cc:1059] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:11.772358 13316 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.772478 13371 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:11.746317 13401 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
W20260709 12:17:11.758363 12387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.813388 12387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.763443 13115 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.815191 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:11.816018 11624 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:11.824008 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:11.824795 12435 raft_consensus.cc:2368] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4.
I20260709 12:17:11.826061 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:11.826656 13274 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.828042 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:11.828902 13274 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.829500 12437 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:11.820319 13401 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.832455 13401 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.819983 13396 consensus_queue.cc:1059] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:17:11.835611 13396 raft_consensus.cc:3055] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:11.835947 13396 raft_consensus.cc:740] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:11.836760 13396 consensus_queue.cc:260] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:11.768339 11803 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:11.838521 13281 consensus_queue.cc:260] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.839938 13281 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.841358 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.841499 13035 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.842248 12437 raft_consensus.cc:2410] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:11.842696 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:11.843571 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.844218 12430 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:11.845623 12428 raft_consensus.cc:1275] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:11.846443 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.846983 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.839046 13336 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:11.847631 12437 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:11.848923 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.851426 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.823527 13305 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.854411 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.856791 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.857473 12435 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:11.864682 11627 leader_election.cc:400] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4.
I20260709 12:17:11.865005 11627 leader_election.cc:403] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:11.865849 12387 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:11.864497 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.867069 11657 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:11.867722 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:11.868278 11654 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:11.862331 11625 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:11.868304 11657 raft_consensus.cc:1240] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:11.871201 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 315119us
W20260709 12:17:11.872404 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 342203us
W20260709 12:17:11.873142 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 163639us
W20260709 12:17:11.873272 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 153732us
I20260709 12:17:11.874414 11773 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:11.874778 11701 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.875819 11773 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:11.876063 11698 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.876609 13316 raft_consensus.cc:2749] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:11.876932 13421 raft_consensus.cc:2749] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:11.877910 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:11.878319 11773 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:11.879069 13421 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:11.879784 12435 raft_consensus.cc:1275] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:11.879592 13316 consensus_queue.cc:1048] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.880138 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.880859 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:11.870579 11627 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.883103 11627 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.811635 13152 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.858376 13396 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:11.891638 11627 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.888267 11773 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:11.890422 12387 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:11.843005 13273 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:11.870280 13163 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:11.869343 13144 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:11.888010 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.906296 12386 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.871023 13342 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4.
I20260709 12:17:11.889590 13241 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.889704 13336 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.893129 13133 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:11.932753 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:11.911592 12432 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:11.888550 13416 raft_consensus.cc:2804] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:11.942616 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:11.944047 12432 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:11.907577 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:11.892881 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:11.950878 13273 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:11.895987 13161 raft_consensus.cc:2749] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:11.942539 11732 raft_consensus.cc:2393] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:11.898114 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:11.898423 13008 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:11.913116 13163 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.912640 13144 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.911590 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:11.940068 13421 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.965233 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:11.933689 11654 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
I20260709 12:17:11.938230 13336 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:11.970306 11729 raft_consensus.cc:3055] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:11.973631 11729 raft_consensus.cc:740] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:11.941526 13417 raft_consensus.cc:493] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:11.948266 13133 raft_consensus.cc:697] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:11.966392 13163 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:11.936967 11773 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:11.956645 13206 consensus_queue.cc:1059] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:17:11.968365 12428 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.966617 13144 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.958954 13416 raft_consensus.cc:697] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:12.006371 11775 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:11.979135 11729 consensus_queue.cc:260] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:11.976049 13336 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.969622 13421 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
W20260709 12:17:11.998160 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 62234.5us
W20260709 12:17:12.015856 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 124252us
I20260709 12:17:12.016538 11773 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:11.998214 13133 consensus_queue.cc:237] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:11.998777 13415 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.998456 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:12.004244 13315 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:12.006045 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:11.956929 13303 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:12.012044 12432 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
I20260709 12:17:12.013206 11729 raft_consensus.cc:3060] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.017084 11627 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:11.967119 13008 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:12.017870 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 132967us
I20260709 12:17:12.035126 11735 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:12.038420 12432 raft_consensus.cc:1240] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:12.013339 13316 raft_consensus.cc:2749] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.047674 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:12.052323 11701 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:12.053989 11627 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:12.055174 12432 raft_consensus.cc:1240] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:12.052640 12387 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:12.055202 11627 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:12.057772 12435 raft_consensus.cc:1240] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:12.017904 13421 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.018497 13361 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.981477 13417 raft_consensus.cc:515] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:12.061028 13424 log.cc:927] Time spent T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:17:12.039074 13415 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:12.071441 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:12.044566 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:12.071238 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:12.125339 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:12.018551 13241 consensus_queue.cc:1048] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
W20260709 12:17:12.126649 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 79343.3us
I20260709 12:17:12.127126 11699 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:12.066260 13326 raft_consensus.cc:2804] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:12.162650 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 107511us
I20260709 12:17:12.168617 11627 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:12.070459 13316 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.050521 13002 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.067385 13371 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:12.207373 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:12.120236 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:12.070824 13361 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:12.210790  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:12.122200 13342 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:12.124205 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.213274 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:12.126328 13410 log.cc:927] Time spent T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:17:12.123117 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:12.067190 13305 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:12.066576 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:12.066797 13035 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:12.241987 13035 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:12.242455 13035 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:12.245399 13008 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:12.246093 12428 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:12.234726 13002 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:12.240515 13422 log.cc:927] Time spent T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:17:12.248322 13002 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:12.216843 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 164573us
I20260709 12:17:12.124536 13415 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.070854 13206 consensus_queue.cc:1048] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.144s
I20260709 12:17:12.214439 13152 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:12.224128 13371 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:12.236240 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:12.212492 13327 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:12.214594 13423 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:12.223037 13437 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:12.240437 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:17:12.249975 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 122960us
I20260709 12:17:12.233547 11729 raft_consensus.cc:2468] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:17:12.249028 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:12.234323 13361 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.254168 11809 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
I20260709 12:17:12.234884 13342 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:12.261214 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:12.255131 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:12.276983 11729 raft_consensus.cc:3055] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:12.277333 11729 raft_consensus.cc:740] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:12.262514 11727 raft_consensus.cc:1240] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:12.246764 13417 leader_election.cc:290] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:12.253700 13283 raft_consensus.cc:2804] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:12.224349 13316 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:12.249788 13436 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.281998 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:12.320182 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 113678us
W20260709 12:17:12.326110 12386 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.256273 13371 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:12.253504 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:12.350804 11698 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:12.262818 13406 raft_consensus.cc:3055] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:12.330823 13283 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.280213 13342 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:12.351126 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 48780.8us
I20260709 12:17:12.210762 13416 consensus_queue.cc:237] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:12.339493 13423 raft_consensus.cc:697] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:12.368474 11729 consensus_queue.cc:260] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:12.369268 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 107344us
I20260709 12:17:12.279911 13437 raft_consensus.cc:697] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:12.365821 13303 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:12.370810 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 109441us
I20260709 12:17:12.371678 11775 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:12.277513 13425 consensus_queue.cc:1059] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 12:17:12.364341 13283 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.383652 11729 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.361394 13406 raft_consensus.cc:740] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:12.260918 13327 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:12.382463 11803 raft_consensus.cc:2393] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 5: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
W20260709 12:17:12.382509 13115 consensus_meta.cc:287] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.013s
I20260709 12:17:12.407295 11625 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
W20260709 12:17:12.410777 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 60045.6us
I20260709 12:17:12.382337 13273 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:12.413045 11698 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:12.415608 11701 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
W20260709 12:17:12.408921 13434 log.cc:927] Time spent T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:17:12.399940 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:12.431115 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 59548us
I20260709 12:17:12.429584 11729 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:12.410323 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:12.438721 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:12.439306 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:12.383814 13163 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:12.441299 13163 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:12.379251 13008 consensus_queue.cc:1175] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ce38e95b93a640c1a7b16f37868b30fc" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:12.409838 13435 raft_consensus.cc:2749] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:12.446125 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:12.447593 11804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56490 (request call id 630) took 1088 ms. Trace:
I20260709 12:17:12.436364 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:12.405519 13206 consensus_queue.cc:1059] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:17:12.447932 11804 rpcz_store.cc:276] 0709 12:17:11.359079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.368412 (+  9333us) service_pool.cc:224] Handling call
0709 12:17:12.447434 (+1079022us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54002b43d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:12.447539 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232276864}
W20260709 12:17:12.444921 11701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.411540 13115 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:12.430143 13436 consensus_queue.cc:1059] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:17:12.434720 13281 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:12.439306 11800 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.444517 13308 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:12.441747 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:12.469177 12431 raft_consensus.cc:1275] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:17:12.471101 12431 pending_rounds.cc:85] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Aborting all ops after (but not including) 3
I20260709 12:17:12.471371 12431 pending_rounds.cc:107] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:17:12.471602 12431 raft_consensus.cc:2889] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:12.446184 13442 raft_consensus.cc:2804] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:12.474677 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:12.475585 11804 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.456611 13437 consensus_queue.cc:237] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:12.482368 11808 raft_consensus.cc:2393] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 5: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:12.455360 13425 raft_consensus.cc:2749] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:12.457026 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:12.441671 13336 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:12.458958 12429 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.579617 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:12.580651 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.449383 13406 consensus_queue.cc:260] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:12.481938 13281 raft_consensus.cc:697] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:12.607686 11729 raft_consensus.cc:1240] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:12.609117 13443 log.cc:927] Time spent T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 12:17:12.609278 13327 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:12.610811 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:12.612242 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:12.612812 11803 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:12.449035 13423 consensus_queue.cc:237] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:12.621062 13336 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:12.623030 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:12.624512 11806 raft_consensus.cc:1240] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:12.499089 13442 raft_consensus.cc:697] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:12.607776 13316 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:12.638840 13115 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:12.639919 13281 consensus_queue.cc:237] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:12.641345 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:12.643299 13442 consensus_queue.cc:237] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:12.644939 13371 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:12.602630 12820 consensus_queue.cc:1059] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:17:12.648829 12387 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:12.650427 12859 consensus_meta.cc:287] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef: Time spent flushing consensus metadata: real 0.843s	user 0.009s	sys 0.000s
I20260709 12:17:12.650702 11807 raft_consensus.cc:1275] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:12.650842 12859 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:12.652094 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:12.664424 13415 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:12.671289 13415 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:12.671983 13218 consensus_meta.cc:287] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Time spent flushing consensus metadata: real 0.967s	user 0.005s	sys 0.004s
I20260709 12:17:12.672472 13411 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.632570 13035 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:12.672933 13411 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:12.674517 13035 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:12.675475 13421 consensus_meta.cc:287] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.000s
I20260709 12:17:12.677919 13290 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:12.702378 11699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:12.654235 13256 consensus_meta.cc:287] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Time spent flushing consensus metadata: real 0.917s	user 0.007s	sys 0.004s
I20260709 12:17:12.653057 12859 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:12.669489 12429 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:12.675638 13371 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:12.680657 13149 raft_consensus.cc:2749] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:12.684623 11653 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:12.713918 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:12.716418 12387 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:12.703513 13035 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:12.706902 11727 raft_consensus.cc:1240] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:12.686057 13426 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.701589 11800 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
W20260709 12:17:12.726445 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 340034us
I20260709 12:17:12.679301 13342 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:12.717693 13290 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:12.749475 11698 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:12.675928 13421 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:12.708575 13256 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:12.753298 13421 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:12.754001 12434 raft_consensus.cc:2368] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3.
I20260709 12:17:12.753446 13256 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:12.756109 13256 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:12.756538 13256 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:12.735353 13035 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:12.759692 13035 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:12.760239 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:12.761050 11802 raft_consensus.cc:2393] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 5: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:12.735628 13371 raft_consensus.cc:2804] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:12.761788 13371 raft_consensus.cc:697] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:12.762326 13256 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:12.762733 13371 consensus_queue.cc:237] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:12.771587 13361 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:12.773362 13144 consensus_meta.cc:287] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03: Time spent flushing consensus metadata: real 0.757s	user 0.000s	sys 0.006s
I20260709 12:17:12.773952 11809 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:12.774483 12820 raft_consensus.cc:2804] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:12.775216 11652 raft_consensus.cc:1275] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:12.771792 11804 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:12.776795 13361 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:12.779970 13290 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:12.783156 11803 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 7.
I20260709 12:17:12.784740 13342 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:12.739254 13426 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:12.794732 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:12.799437 12820 raft_consensus.cc:697] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:12.804771 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:12.806524 13133 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:12.811398 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:12.813088 13406 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.817937 13149 consensus_queue.cc:1048] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:12.818832 13411 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:12.799295 13283 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:12.823071 11732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 768) took 1257 ms (client timeout 1617 ms). Trace:
W20260709 12:17:12.827394 11732 rpcz_store.cc:269] 0709 12:17:11.565593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.565720 (+   127us) service_pool.cc:224] Handling call
0709 12:17:12.822885 (+1257165us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54000654d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:12.823018 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856953600}
I20260709 12:17:12.800432 13144 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:12.833170 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:12.833689 11732 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:12.809792 12436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57354 (request call id 646) took 1288 ms. Trace:
I20260709 12:17:12.849650 11732 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
I20260709 12:17:12.851547 11735 raft_consensus.cc:2393] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:12.827193 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:12.820055 13343 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:12.827536 11801 raft_consensus.cc:1240] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:12.854826 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:12.854228 13308 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:12.858366 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:12.858593 12820 consensus_queue.cc:237] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:12.858981 13426 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:12.859692 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:12.860816 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:12.861593 11726 raft_consensus.cc:2393] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 2: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:12.811769 13133 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:12.869393 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:12.870059 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:12.852825 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:12.852438 13361 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:12.886053 13361 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:12.888338 13361 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:12.856256 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:12.870175 11732 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:12.876278 11774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.876289 12429 raft_consensus.cc:2393] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 7: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:12.858372 13308 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:12.878762 13283 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:12.882521 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:12.883313 13144 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:12.871873 12387 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:12.870913 11806 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:12.896526 12387 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:12.890723 11775 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.65:36331 timed out after 1.589s (SENT) [suppressed 10 similar messages]
I20260709 12:17:12.898325 11698 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:12.899219 13256 raft_consensus.cc:2749] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:12.899374 13281 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:12.899785 13281 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.900141 13281 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:12.907579 12386 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.909221 11734 raft_consensus.cc:1240] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:12.910847 12386 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:12.912317 12386 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:12.915774 11732 raft_consensus.cc:2468] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:12.918210 13071 raft_consensus.cc:2749] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:12.919801 13308 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:12.922730 11653 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 7.
I20260709 12:17:12.850461 12436 rpcz_store.cc:276] 0709 12:17:11.522943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.534084 (+ 11141us) service_pool.cc:224] Handling call
0709 12:17:12.370560 (+836476us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b5800004598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:17:12.387634 (+ 17074us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:12.426203 (+ 38569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:12.431113 (+  4910us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:12.479959 (+ 48846us) log.cc:844] Serialized 52 byte log entry
0709 12:17:12.706714 (+226755us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:12.717267 (+ 10553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.726243 (+  8976us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:12.798544 (+ 72301us) raft_consensus.cc:1685] finished
0709 12:17:12.798570 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:12.808577 (+ 10007us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1994,"raft.queue_time_us":2585,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":12232,"spinlock_wait_cycles":17861888,"thread_start_us":153848,"threads_started":1,"wal-append.queue_time_us":229873}
I20260709 12:17:12.928130 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:12.929306 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:12.895800 13337 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:12.931983 13337 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:12.934913 12437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57338 (request call id 814) took 1049 ms. Trace:
I20260709 12:17:12.916920 12387 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:12.936167 12436 raft_consensus.cc:2410] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:17:12.935853 12386 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:12.937335 12386 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:12.935425 12437 rpcz_store.cc:276] 0709 12:17:11.885054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.885673 (+   619us) service_pool.cc:224] Handling call
0709 12:17:11.885969 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:11.886295 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.886322 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:11.889830 (+  3508us) log.cc:844] Serialized 26 byte log entry
0709 12:17:12.815946 (+926116us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b1800389800. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:17:12.891269 (+ 75323us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:12.891296 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.891342 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:12.934641 (+ 43299us) raft_consensus.cc:1685] finished
0709 12:17:12.934662 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:12.934846 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":422,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6637,"spinlock_wait_cycles":9041792,"thread_start_us":75166,"threads_started":1,"wal-append.queue_time_us":1026302}
I20260709 12:17:12.939265 12387 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:12.939868 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:12.906697 13411 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:12.896605 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:12.946918 11726 raft_consensus.cc:1240] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:12.940174 13071 raft_consensus.cc:2749] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:12.947369 13152 raft_consensus.cc:3060] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.948050 13148 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:12.947753 13462 log.cc:927] Time spent T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:17:12.934530 13256 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.948958 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:12.949697 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:12.959375 12436 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
W20260709 12:17:12.955209 11701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:12.947091 13461 log.cc:927] Time spent T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:17:12.940029 13218 raft_consensus.cc:2749] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:12.953887 11652 raft_consensus.cc:2393] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 5: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:12.944633 13163 raft_consensus.cc:2804] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:12.961772 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 64820.1us
I20260709 12:17:12.963395 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:17:12.964399 13463 log.cc:927] Time spent T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:17:12.966351 13133 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:12.967417 12434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57346 (request call id 460) took 1152 ms. Trace:
I20260709 12:17:12.965392 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:12.968269 12437 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.967783 12434 rpcz_store.cc:276] 0709 12:17:11.815055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.816097 (+  1042us) service_pool.cc:224] Handling call
0709 12:17:12.967242 (+1151145us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b540000a5d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:12.967364 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2132107136}
I20260709 12:17:12.955636 13411 raft_consensus.cc:697] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:12.968321 11807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56490 (request call id 637) took 1033 ms. Trace:
I20260709 12:17:12.970647 11807 rpcz_store.cc:276] 0709 12:17:11.934444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.651774 (+717330us) service_pool.cc:224] Handling call
0709 12:17:12.652043 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:12.652238 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:12.652263 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:12.652722 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:17:12.734573 (+ 81851us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:12.734610 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.734681 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:12.968134 (+233453us) raft_consensus.cc:1685] finished
0709 12:17:12.968151 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:12.968270 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":81514,"threads_started":1,"wal-append.queue_time_us":155558}
W20260709 12:17:12.974196 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 83497.7us
I20260709 12:17:12.976042 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:12.976290 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:12.972618 12429 raft_consensus.cc:2410] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:12.976971 11807 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:12.973568 13163 raft_consensus.cc:697] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:12.977589 11775 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:12.969966 11728 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:12.962963 13256 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:12.973042 13290 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:12.976289 13133 consensus_queue.cc:1059] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:17:12.987510 11804 raft_consensus.cc:1240] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:12.985401 11808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56474 (request call id 667) took 1291 ms (client timeout 1698 ms). Trace:
I20260709 12:17:12.988888 11773 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:12.989100 11775 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:12.988497 11808 rpcz_store.cc:269] 0709 12:17:11.694474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.694605 (+   131us) service_pool.cc:224] Handling call
0709 12:17:12.985208 (+1290603us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54001b7954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:12.985347 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1781527424}
I20260709 12:17:12.982203 12437 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:12.989898 13341 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:13.025920 11656 raft_consensus.cc:1275] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:13.000106 11652 raft_consensus.cc:1240] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:12.998265 13290 raft_consensus.cc:2749] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.005393 12386 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.001575 13337 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:12.998660 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:13.002628 13308 raft_consensus.cc:2749] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.013198 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.032924 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.018010 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:13.018671 11801 raft_consensus.cc:1275] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:13.022454 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:12.980473 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.022804 11658 raft_consensus.cc:1275] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:13.033927 11653 raft_consensus.cc:1240] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:13.034343 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:13.034705 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:13.034972 11801 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.033937 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:13.024850 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.035580 12429 raft_consensus.cc:2368] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:13.035908 11660 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:13.025681 13341 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.036500 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:13.037657 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:13.038373 12429 raft_consensus.cc:2368] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 6. Current term is 7.
I20260709 12:17:13.038566 13341 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.039178 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:13.040328 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:13.040395 12387 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:13.040875 12429 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.026021 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:13.006071 11775 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.042685 11808 raft_consensus.cc:2368] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 6. Current term is 7.
I20260709 12:17:13.028556 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:13.043876 13308 raft_consensus.cc:2749] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:13.028898 11624 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.029471 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:13.044620 13341 raft_consensus.cc:2749] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.029662 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:13.032039 12434 raft_consensus.cc:2368] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:13.023252 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:12.989715 13449 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:13.041989 13148 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:13.039366 13414 log.cc:927] Time spent T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 1.161s	user 0.005s	sys 0.015s
I20260709 12:17:13.046219 13148 raft_consensus.cc:697] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 7 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
W20260709 12:17:13.046448 13456 log.cc:927] Time spent T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:17:13.045572 13449 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.047963 11726 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:13.048106 12431 raft_consensus.cc:1240] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.049222 13449 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.045010 11624 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:13.051110 13313 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:13.051782 13341 raft_consensus.cc:2804] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:13.052168 13341 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:13.052515 13341 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.052811 13199 consensus_queue.cc:1048] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.054009 11733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 781) took 1397 ms. Trace:
I20260709 12:17:13.054365 11733 rpcz_store.cc:276] 0709 12:17:11.656416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.659792 (+  3376us) service_pool.cc:224] Handling call
0709 12:17:11.660153 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:11.709148 (+ 48995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.053650 (+1344502us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b540028b4d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:13.053953 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111229184}
I20260709 12:17:13.055612 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.056625 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:13.056712 13402 raft_consensus.cc:3055] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.057121 13402 raft_consensus.cc:740] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:13.042773 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.057955 13402 consensus_queue.cc:260] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.057672 11627 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.040802 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:13.059338 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:13.060484 11731 raft_consensus.cc:2368] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:13.059994 11627 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.061043 13313 consensus_queue.cc:1059] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:13.061478 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.061980 11627 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.062250 13133 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.053117 13439 raft_consensus.cc:3055] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:13.059278 13402 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.059957 12438 raft_consensus.cc:2393] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
W20260709 12:17:13.063782 12438 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57354 (request call id 649) took 1535 ms (client timeout 1589 ms). Trace:
I20260709 12:17:13.063905 13342 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:13.064172 12438 rpcz_store.cc:269] 0709 12:17:11.529727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.533358 (+  3631us) service_pool.cc:224] Handling call
0709 12:17:13.040659 (+1507301us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800004598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:17:13.063725 (+ 23066us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29048192}
I20260709 12:17:13.062739 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:13.066082 13313 raft_consensus.cc:3055] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:13.066561 13439 raft_consensus.cc:740] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:13.066354 13342 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.067425 13439 consensus_queue.cc:260] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.068447 13342 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.068792 13439 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.063249 13133 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.063035 13343 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.070459 13313 raft_consensus.cc:740] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:13.071257 13313 consensus_queue.cc:260] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:13.072359 13313 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:13.072611 13330 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:13.073083 13330 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.060684 13148 consensus_queue.cc:237] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:13.067178 11731 raft_consensus.cc:1240] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:13.075103 11733 raft_consensus.cc:1240] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:13.076115 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:13.076650 11731 raft_consensus.cc:1240] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.076964 12428 raft_consensus.cc:2368] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:13.076901 12438 raft_consensus.cc:1240] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.081682 11729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36424 (request call id 199) took 1221 ms. Trace:
I20260709 12:17:13.082134 11729 rpcz_store.cc:276] 0709 12:17:11.860276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.447780 (+587504us) service_pool.cc:224] Handling call
0709 12:17:12.469184 (+ 21404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.608166 (+138982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.081462 (+473296us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54003aa054. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:13.081620 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318100224}
I20260709 12:17:13.083590 11627 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:13.084712 11627 leader_election.cc:400] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 6. Current term is 7.
I20260709 12:17:13.085031 11627 leader_election.cc:403] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:17:12.982666 13450 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.071720 11735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36424 (request call id 200) took 1211 ms. Trace:
I20260709 12:17:13.083452 13396 raft_consensus.cc:3055] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.097401 11735 rpcz_store.cc:276] 0709 12:17:11.860518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.254899 (+394381us) service_pool.cc:224] Handling call
0709 12:17:13.071514 (+816615us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54004b2154. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:13.071657 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308936064}
I20260709 12:17:13.095444 11773 leader_election.cc:400] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:13.099087 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.101464 11773 leader_election.cc:403] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:17:13.103457 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 98102.1us
I20260709 12:17:13.083683 11726 raft_consensus.cc:2410] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:17:13.101908 11808 raft_consensus.cc:2393] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 6: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:13.085590 11800 raft_consensus.cc:1240] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:13.107620 11774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.084790 13436 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.096937 13329 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:13.138115 13476 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:13.138288 13329 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.138769 13476 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:13.140681 13329 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.140889 13476 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:12.982637 13411 consensus_queue.cc:237] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.051162 11801 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:13.102319 13342 raft_consensus.cc:2749] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 6. Current term is 7.
I20260709 12:17:13.150154 13256 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:13.150763 13256 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.151383 13256 consensus_queue.cc:1059] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.152801 13343 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.159274 12429 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:13.143630 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.057642 11624 leader_election.cc:304] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.148659 13337 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.099248 13199 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:13.100431 13396 raft_consensus.cc:740] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:13.111728 13290 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.146692 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.161267 12386 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:13.162359 11699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.030228 13163 consensus_queue.cc:237] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.177820 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.178459 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:13.168767 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 111180us
I20260709 12:17:13.179280 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:13.179850 11624 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.142727 13035 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:13.181583 13035 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:13.183996 13035 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:13.186775 11730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59512 (request call id 525) took 1674 ms (client timeout 1741 ms). Trace:
W20260709 12:17:13.187233 11730 rpcz_store.cc:269] 0709 12:17:11.512655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.512792 (+   137us) service_pool.cc:224] Handling call
0709 12:17:13.146418 (+1633626us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b58005e4798. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:17:13.186716 (+ 40298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8204032}
I20260709 12:17:13.110831 13281 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.166347 13476 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:13.191154 11624 leader_election.cc:400] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Vote denied by peer cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845) with higher term. Message: Invalid argument: T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 6. Current term is 7.
I20260709 12:17:13.196529 12386 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:13.197149 11624 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:13.194125 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.175643 13416 raft_consensus.cc:2749] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.189962 13442 raft_consensus.cc:2749] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.201304 11625 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.203436 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:13.204250 12429 raft_consensus.cc:2393] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:13.193431 13148 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.174062 13329 consensus_queue.cc:1059] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:17:13.222596 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 76206.1us
W20260709 12:17:13.205200 13471 log.cc:927] Time spent T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:17:13.224223 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.224725 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.225932 11654 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:13.176512 13199 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:13.235811 13393 log.cc:927] Time spent T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 1.258s	user 0.021s	sys 0.025s
I20260709 12:17:13.236018 13329 raft_consensus.cc:2749] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.228121 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:13.238086 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:13.238862 12428 raft_consensus.cc:2368] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:13.239573 13343 raft_consensus.cc:3055] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:13.240012 13343 raft_consensus.cc:740] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:13.240813 13343 consensus_queue.cc:260] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.199010 13341 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:13.266728 13477 log.cc:927] Time spent T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:17:13.209410 13342 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:13.246516 13449 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.268436 13449 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.271066 11801 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.274290 13449 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.208410 13473 raft_consensus.cc:2764] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:13.222203 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:13.198875 13149 consensus_queue.cc:1059] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:13.197563 13337 consensus_queue.cc:1048] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:17:13.277311 13149 raft_consensus.cc:3055] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:13.277500 13281 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.277866 13149 raft_consensus.cc:740] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:13.278704 13149 consensus_queue.cc:260] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:13.279844 13149 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.258607 13343 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.258612 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.259371 13320 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:13.202132 13476 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.226111 13396 consensus_queue.cc:260] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.260943 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.294094 12387 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:13.263142 11732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 785) took 1213 ms. Trace:
I20260709 12:17:13.265352 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:13.293084 11775 leader_election.cc:400] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:13.295171 12429 raft_consensus.cc:2393] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:13.296698 11775 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.294806 11732 rpcz_store.cc:276] 0709 12:17:12.049278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.938020 (+888742us) service_pool.cc:224] Handling call
0709 12:17:12.938333 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:12.940706 (+  2373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:12.940740 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:12.954431 (+ 13691us) log.cc:844] Serialized 26 byte log entry
0709 12:17:13.098025 (+143594us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:13.098066 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.098136 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.262935 (+164799us) raft_consensus.cc:1685] finished
0709 12:17:13.262956 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.263087 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2024,"raft.queue_time_us":7089,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":132479,"threads_started":1,"wal-append.queue_time_us":239566}
I20260709 12:17:13.268384 13342 raft_consensus.cc:697] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:13.303732 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.306275 11654 raft_consensus.cc:2410] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:17:13.292824 13481 log.cc:927] Time spent T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.135s	user 0.002s	sys 0.000s
I20260709 12:17:13.308514 11775 leader_election.cc:400] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:13.308894 11775 leader_election.cc:403] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:13.310544 11775 leader_election.cc:400] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:13.311375 11775 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.298803 13439 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.302506 13320 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.300455 13148 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:13.318332 11773 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:13.316689 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.328248 13290 raft_consensus.cc:2749] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:13.320148 13148 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.329246 13148 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:13.306576 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.312947 13457 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.312520 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:13.314409 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.335865 11805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56490 (request call id 632) took 1942 ms. Trace:
I20260709 12:17:13.296834 13473 consensus_queue.cc:1059] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:17:13.350172 13473 raft_consensus.cc:3055] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:13.350535 13473 raft_consensus.cc:740] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:13.351266 13473 consensus_queue.cc:260] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:13.352375 13473 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.352581 13342 consensus_queue.cc:237] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:13.355840 13476 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.356406 11654 raft_consensus.cc:1240] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.357914 11727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36424 (request call id 207) took 1491 ms. Trace:
I20260709 12:17:13.358355 11727 rpcz_store.cc:276] 0709 12:17:11.867827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.481594 (+613767us) service_pool.cc:224] Handling call
0709 12:17:12.578908 (+ 97314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:12.740650 (+161742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.357659 (+617009us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b540082a854. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:13.357855 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170737024}
I20260709 12:17:13.361202 11728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36424 (request call id 204) took 1499 ms. Trace:
I20260709 12:17:13.362898 13396 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.366149 13416 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:13.366489 13148 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.366915 13416 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.340576 13152 raft_consensus.cc:2749] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:13.314276 13002 consensus_queue.cc:1059] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:17:13.368932 13416 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.339596 13320 raft_consensus.cc:2749] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.314664 13361 consensus_queue.cc:1059] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:13.319228 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:13.370918 13361 raft_consensus.cc:3055] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.371268 13361 raft_consensus.cc:740] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:13.372017 13361 consensus_queue.cc:260] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:13.372520 13205 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.342399 11800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 261) took 1348 ms. Trace:
I20260709 12:17:13.367295 11803 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.369711 11728 rpcz_store.cc:276] 0709 12:17:11.861426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.248735 (+387309us) service_pool.cc:224] Handling call
0709 12:17:13.360952 (+1112217us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54001f5254. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:13.361125 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489232256}
I20260709 12:17:13.374593 12436 raft_consensus.cc:2468] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:17:13.338258 11805 rpcz_store.cc:276] 0709 12:17:11.394489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.573669 (+179180us) service_pool.cc:224] Handling call
0709 12:17:11.577415 (+  3746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.595187 (+ 17772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.595220 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.595279 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:11.595310 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.335633 (+1740323us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b5400322dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:13.335685 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.335809 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40399232}
I20260709 12:17:13.347467 13341 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:13.383414 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.390945 11654 raft_consensus.cc:1240] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:13.367075 11802 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:13.373898 11800 rpcz_store.cc:276] 0709 12:17:11.993817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.751444 (+757627us) service_pool.cc:224] Handling call
0709 12:17:13.085388 (+333944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.110588 (+ 25200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.342167 (+231579us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54005bc050. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:13.342324 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767122304}
I20260709 12:17:13.393553 12387 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.394429 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:13.394953 13152 raft_consensus.cc:2804] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:13.395469 13152 raft_consensus.cc:697] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:13.396289 13152 consensus_queue.cc:237] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:13.345263 11484 catalog_manager.cc:5697] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 3, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 3 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.403715 11660 raft_consensus.cc:1240] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:13.412192 11773 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:13.418402 11774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.420938 13326 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:13.421454 13326 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.422060 13257 consensus_queue.cc:1059] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:13.423194 13257 raft_consensus.cc:3055] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:13.423517 13257 raft_consensus.cc:740] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:13.424800 13257 consensus_queue.cc:260] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:13.428761 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 227509us
I20260709 12:17:13.373075 13361 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:13.393604 13482 log.cc:927] Time spent T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:17:13.393657 13486 log.cc:927] Time spent T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:17:13.431500 11773 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.432513 13329 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:13.432542 13450 raft_consensus.cc:2749] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.438104 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.320987 13439 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:13.442047 11484 catalog_manager.cc:5697] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:13.442984 11801 raft_consensus.cc:1275] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:13.444278 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.445079 13199 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.445636 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.447781 11773 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.448489 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.451447 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:13.452414 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.449505 13308 raft_consensus.cc:2749] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:13.453260 13329 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.457324 11484 catalog_manager.cc:5697] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 3, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 3 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:13.496476 11484 catalog_manager.cc:5697] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 2 to 3, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 3 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.498049 11484 catalog_manager.cc:5697] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 2 to 3, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:13.499145 11658 raft_consensus.cc:1275] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:13.499368 11775 leader_election.cc:400] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:13.483696 11699 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.390249 13483 consensus_queue.cc:1059] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:17:13.487208 11654 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.450745 13257 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.505264 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.515174 11805 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:13.488780 11773 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:13.490438 13371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.003s	sys 0.010s
I20260709 12:17:13.450577 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.542583 11657 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:13.544064 11699 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:13.500427 11775 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.500257 11484 catalog_manager.cc:5697] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.487623 11660 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
I20260709 12:17:13.505344 11728 raft_consensus.cc:1275] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:13.508189 11658 raft_consensus.cc:1240] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:13.511044 13329 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.546063 11484 catalog_manager.cc:5697] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.517014 11654 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:13.486364 13402 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
W20260709 12:17:13.548978 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 48650.2us
I20260709 12:17:13.548498 11484 catalog_manager.cc:5697] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:13.550086 11775 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.550381 11484 catalog_manager.cc:5697] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 2, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:13.533476 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.553833 11484 catalog_manager.cc:5697] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 3 to 4, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 4 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:13.520944 11773 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.450366 13304 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:17:13.495229 13450 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:13.454434 13427 consensus_queue.cc:1048] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:17:13.517686 12430 raft_consensus.cc:1240] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:13.518366 12859 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:13.684448 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 163597us
I20260709 12:17:13.541105 11732 raft_consensus.cc:1240] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:13.525483 13308 raft_consensus.cc:2749] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.543645 13423 consensus_queue.cc:1048] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:17:13.557283 13489 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:13.548398 13330 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.577579 11699 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.577229 11484 catalog_manager.cc:5697] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 2, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:13.556094 11801 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:13.546729 13371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.004s	sys 0.010s
I20260709 12:17:13.558751 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:13.684201 13492 consensus_queue.cc:1059] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:13.696808 11655 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:13.557011 13398 raft_consensus.cc:2749] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:13.700907 11656 raft_consensus.cc:1240] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.701967 13330 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:13.702744 13064 consensus_queue.cc:1059] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.703631 13313 raft_consensus.cc:3055] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:13.702755 13489 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.704921 13313 raft_consensus.cc:740] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:13.705778 13313 consensus_queue.cc:260] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.678846 11658 raft_consensus.cc:1275] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:13.705823 13489 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:13.684696 13163 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:13.708954 13163 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:13.714030 13483 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.625698 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.714594 13483 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:13.714906 13498 raft_consensus.cc:3055] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:13.594066 13148 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:13.715327 13498 raft_consensus.cc:740] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
W20260709 12:17:13.718673 13495 log.cc:927] Time spent T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:17:13.718845 13326 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:13.685454 13002 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.720824 13326 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:13.693040 13281 raft_consensus.cc:2764] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:17:13.628044 13449 raft_consensus.cc:2804] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:13.705478 11655 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
W20260709 12:17:13.692107 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 114613us
I20260709 12:17:13.726043 11699 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:13.692166 11484 catalog_manager.cc:5697] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 3 to 4, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 4 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:13.730371 11484 catalog_manager.cc:5697] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:13.731707 11484 catalog_manager.cc:5697] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 4 to 8, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 8 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.687896 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:13.706346 13491 log.cc:927] Time spent T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:17:13.629743 13329 consensus_queue.cc:1048] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:17:13.733135 11484 catalog_manager.cc:5697] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 2, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:13.736855 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:13.746115 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:13.752446 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 64859.6us
I20260709 12:17:13.755412 11773 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.756969 11661 raft_consensus.cc:1240] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:13.686694 13152 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:13.725569 13449 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.744185 13281 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:13.769490 11698 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.770198 12387 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:13.766193 13501 consensus_queue.cc:1059] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:17:13.760397 13371 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:13.774631 13497 log.cc:927] Time spent T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 12:17:13.802662 11775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.760846 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:13.824096 11726 raft_consensus.cc:2393] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 4: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
W20260709 12:17:13.825030 13458 log.cc:927] Time spent T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 1.067s	user 0.003s	sys 0.000s
I20260709 12:17:13.760288 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.830287 13281 raft_consensus.cc:697] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:13.831337 13281 consensus_queue.cc:237] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.832688 13483 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:13.834334 13144 raft_consensus.cc:3055] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:13.834797 13144 raft_consensus.cc:740] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:13.835659 13144 consensus_queue.cc:260] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.836210 13423 consensus_queue.cc:1048] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:13.836854 13071 raft_consensus.cc:3055] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.837303 13071 raft_consensus.cc:740] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:13.837864 13419 consensus_queue.cc:1059] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:13.838147 13071 consensus_queue.cc:260] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.839031 13419 raft_consensus.cc:3055] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:13.839452 13071 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.839845 13457 raft_consensus.cc:2749] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.822863 13490 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:13.841262 13490 raft_consensus.cc:697] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:13.843259 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:13.843160 13490 consensus_queue.cc:237] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.758395 11803 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:13.760411 13450 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.763188 13438 raft_consensus.cc:3055] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:13.847596 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.848187 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.760193 13449 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.853327 12387 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:13.857280 11661 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:13.849454 11806 raft_consensus.cc:1240] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:13.850696 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 69073.1us
W20260709 12:17:13.849200 11809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56490 (request call id 634) took 1918 ms (client timeout 2093 ms). Trace:
W20260709 12:17:13.858186 11809 rpcz_store.cc:269] 0709 12:17:11.930892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.281616 (+350724us) service_pool.cc:224] Handling call
0709 12:17:13.849043 (+1567427us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54005717d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:13.849145 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011549056}
I20260709 12:17:13.775275 13161 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.859426 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:13.870416 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:13.870949 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.871119 11624 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.860782 12387 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:13.860517 11805 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:13.872531 11624 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:13.839432 13419 raft_consensus.cc:740] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:13.873345 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.834818 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:13.875358 11624 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.878509 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:13.766997 13152 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.879069 11624 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:13.777810 13473 consensus_queue.cc:1048] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 12:17:13.883502 11661 raft_consensus.cc:1240] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.856909 13438 raft_consensus.cc:740] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:13.866464 13218 raft_consensus.cc:2749] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:13.874964 13343 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.879848 13330 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:13.881556 13396 raft_consensus.cc:2749] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.882347 13144 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:13.850165 13371 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:13.877678 13501 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:13.884662 13416 raft_consensus.cc:2804] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:13.892637 13503 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.884915 11800 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:13.895042 13330 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.903492 13507 consensus_queue.cc:1059] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:17:13.904276 13330 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:13.904574 13507 raft_consensus.cc:3055] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.904994 13507 raft_consensus.cc:740] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:13.899650 13419 consensus_queue.cc:260] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:13.909091 13439 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:13.909448 13419 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:13.899165 13416 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:13.910936 13416 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.912225 13503 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:13.914342 11801 raft_consensus.cc:1275] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:13.895295 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:13.918284 11656 raft_consensus.cc:1240] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:13.919109 12438 raft_consensus.cc:1240] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:13.921960 13218 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:13.922508 13218 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:13.923040 13371 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.923578 13371 consensus_queue.cc:1059] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:13.898339 13501 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.924634 13218 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:13.924839 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.924880 13501 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.927786 13457 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.915580 13473 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.950639 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:13.949575 11773 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:13.929304 11701 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:13.929569 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:13.931193 12435 raft_consensus.cc:1240] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:13.925571 11732 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:13.941247 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:13.960228 13396 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:13.910740 13494 log.cc:927] Time spent T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.316s	user 0.000s	sys 0.000s
I20260709 12:17:13.961606 11661 raft_consensus.cc:1275] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:13.966123 11624 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:13.969524 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:13.918403 13320 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.961750 13002 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.979461 13002 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:13.981462 13002 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:13.971418 13144 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:13.982132 13144 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:13.982498 13144 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.974465 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.914376 13503 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:13.975680 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 46457.2us
I20260709 12:17:13.987850 11701 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:13.976833 12437 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:13.974733 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:13.984689 12387 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:13.986614 12859 raft_consensus.cc:2749] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.995743 13412 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:14.001017 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:13.960960 13396 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:13.961665 13457 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.007555 12437 raft_consensus.cc:1275] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:13.986785 13450 raft_consensus.cc:2749] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:14.025110 12431 raft_consensus.cc:1275] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:14.010159 12429 raft_consensus.cc:1275] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:13.963984 13473 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:14.015262 13412 raft_consensus.cc:697] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:14.015759 12432 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:14.016450 11728 raft_consensus.cc:1240] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:13.928238 13507 consensus_queue.cc:260] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:14.001740 13503 raft_consensus.cc:2804] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:14.018368 11732 raft_consensus.cc:1275] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:14.044134 13503 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:14.044560 13503 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.020442 13457 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:14.021066 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:14.022567 13161 consensus_queue.cc:1059] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:13.964007 13329 consensus_queue.cc:1048] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:17:13.983435 13218 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:14.027411 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:14.048614 11732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:14.024389 13330 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:13.967499 13438 consensus_queue.cc:260] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:14.059948 12438 raft_consensus.cc:2410] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:14.060217 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:14.061326 13412 consensus_queue.cc:237] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.062835 13473 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:14.067062 13396 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:14.069523 13416 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:14.055498 13218 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:14.072364 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:14.072788 13152 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:14.073135 13144 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:14.076880 11655 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 7.
I20260709 12:17:14.075609 13161 consensus_queue.cc:1059] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:17:14.090384 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:14.080318 13313 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.080556 13416 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:14.108996 11627 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:14.082754 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:14.111819 13396 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.084129 13498 consensus_queue.cc:260] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:14.143882 13498 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.145741 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:14.158715 11802 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:14.159808 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:14.160565 11802 raft_consensus.cc:2393] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:14.162613 11698 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:14.163750 13283 raft_consensus.cc:2804] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:14.164170 13283 raft_consensus.cc:493] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.164489 13283 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:14.165426 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.149173 11807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56490 (request call id 652) took 1144 ms. Trace:
I20260709 12:17:14.167055 11807 rpcz_store.cc:276] 0709 12:17:13.005208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.005368 (+   160us) service_pool.cc:224] Handling call
0709 12:17:13.005648 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.143411 (+137763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.143440 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:13.143480 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:13.143506 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.148904 (+1005398us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400288cd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:14.148953 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:14.149112 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316413312}
I20260709 12:17:14.168651 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:14.172658 13071 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:14.173324 13071 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:14.175561 13071 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:14.151070 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:14.178788 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:14.179440 11806 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 7.
I20260709 12:17:14.152621 12820 consensus_queue.cc:1059] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:17:14.152738 13473 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.182369 13473 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:14.184648 13473 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:14.190696 13449 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:14.084672 13218 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:14.192939 11727 raft_consensus.cc:2368] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5.
I20260709 12:17:14.090102 12387 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:14.099589 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:14.193744 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 103746us
I20260709 12:17:14.085893 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:14.100178 13500 raft_consensus.cc:3055] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:14.194481 13500 raft_consensus.cc:740] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:14.195304 13500 consensus_queue.cc:260] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:14.196293 13500 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.196398 13071 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:14.197301 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:14.196893 13071 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.199445 13071 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:14.199066 12429 raft_consensus.cc:1275] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:14.200420 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:14.201049 11655 raft_consensus.cc:1275] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:14.201475 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:14.201704 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:14.202682 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:14.203059 13218 consensus_queue.cc:1048] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:14.203603 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:14.205667 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:14.207455 11729 raft_consensus.cc:1275] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:14.212081 13144 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:14.213616 11654 raft_consensus.cc:1240] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:14.214962 13501 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:14.216595 12434 raft_consensus.cc:2393] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:14.217931 13501 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:14.222158 12387 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:14.223290 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:14.223935 11656 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.219197 13330 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:14.235595 13503 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.237416 12437 raft_consensus.cc:1275] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:14.237898 12436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57346 (request call id 474) took 1413 ms (client timeout 1738 ms). Trace:
I20260709 12:17:14.238230 12820 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.295687 12820 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.296572 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:14.241318 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:14.297904 11726 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:14.242105 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
W20260709 12:17:14.294721 12436 rpcz_store.cc:269] 0709 12:17:12.824890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.963123 (+138233us) service_pool.cc:224] Handling call
0709 12:17:14.236954 (+1273831us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540000b4d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:14.237833 (+   879us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927666432}
I20260709 12:17:14.303799 12820 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:14.304039 13283 raft_consensus.cc:515] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.253885 12386 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:14.256810 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:14.318089 11805 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.270586 11804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 263) took 2274 ms. Trace:
I20260709 12:17:14.322714 11804 rpcz_store.cc:276] 0709 12:17:11.996441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.800371 (+803930us) service_pool.cc:224] Handling call
0709 12:17:12.987343 (+186972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.987922 (+   579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.270417 (+1282495us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54001b7950. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:14.270531 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429112576}
I20260709 12:17:14.323935 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:14.324805 11804 raft_consensus.cc:2410] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:14.272392 11627 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:14.326062 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 53763.6us
I20260709 12:17:14.327229 11627 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:14.273041 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:14.270447 12430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57346 (request call id 479) took 1416 ms. Trace:
I20260709 12:17:14.282157 11625 leader_election.cc:400] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5.
W20260709 12:17:14.328749 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 46766.8us
I20260709 12:17:14.282925 12431 raft_consensus.cc:1275] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:14.283890 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:14.161580 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:14.288611 11806 raft_consensus.cc:1275] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:17:14.289028 13518 log.cc:927] Time spent T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.174s	user 0.002s	sys 0.005s
W20260709 12:17:14.289639 13511 log.cc:927] Time spent T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.230s	user 0.000s	sys 0.006s
I20260709 12:17:14.269240 13071 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:14.334127 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 80340.1us
I20260709 12:17:14.334931 12386 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:14.242726 13519 log.cc:927] Time spent T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.177s	user 0.005s	sys 0.000s
I20260709 12:17:14.305534 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:14.306197 13507 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:14.303929 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:14.306983 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.309725 13425 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:14.315187 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 93090.3us
I20260709 12:17:14.346834 12387 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:14.307072 11734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36424 (request call id 198) took 2447 ms. Trace:
I20260709 12:17:14.347494 11734 rpcz_store.cc:276] 0709 12:17:11.860015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.440205 (+580190us) service_pool.cc:224] Handling call
0709 12:17:12.823028 (+382823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.909658 (+ 86630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.991688 (+1082030us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b54000654d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:14.306899 (+315211us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54000654d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4a8ad 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:14.307023 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077607424}
I20260709 12:17:14.348448 11802 raft_consensus.cc:1275] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:14.348764 13416 consensus_queue.cc:1048] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:14.349139 13513 log.cc:927] Time spent T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
I20260709 12:17:14.346910 13498 raft_consensus.cc:2749] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.258069 12859 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.350471 12859 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:14.351061 13503 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:14.347393 12428 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:14.352490 12859 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:14.355170 12386 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:14.332587 12430 rpcz_store.cc:276] 0709 12:17:12.853654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.055883 (+202229us) service_pool.cc:224] Handling call
0709 12:17:13.056169 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.687114 (+630945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.270163 (+583049us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54002b1bd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:14.270378 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003041664}
I20260709 12:17:14.331102 11809 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:14.357267 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:14.357946 11809 raft_consensus.cc:2393] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:14.358394 13449 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:14.360129 13152 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.362628 13152 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:14.363029 12387 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:14.363759 13152 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.364363 13152 consensus_queue.cc:1048] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.364161 11808 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:14.367726 13341 raft_consensus.cc:2749] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:14.368188 12387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.374095 11735 raft_consensus.cc:2393] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:14.374334 13133 consensus_queue.cc:1048] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.375054 13283 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:14.375465 13498 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:14.338610 11726 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
I20260709 12:17:14.377600 13133 consensus_queue.cc:1048] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:14.378093 11625 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:14.373944 11658 raft_consensus.cc:1275] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:14.378835 11658 pending_rounds.cc:85] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03: Aborting all ops after (but not including) 1
I20260709 12:17:14.379146 11658 pending_rounds.cc:107] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:14.379429 11658 raft_consensus.cc:2889] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:14.368372 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:14.381536 11661 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.381570 12386 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
W20260709 12:17:14.369385 13520 log.cc:927] Time spent T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 12:17:14.370366 11727 raft_consensus.cc:1275] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:14.370409 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:14.371764 11773 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:14.372833 11800 raft_consensus.cc:1275] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:14.384577 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:14.350247 11807 raft_consensus.cc:1275] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:14.335603 13144 raft_consensus.cc:2749] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.368453 11656 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:14.389286 11661 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:14.322001 13473 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:14.397013 12429 raft_consensus.cc:2393] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 8: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:14.400944 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:17:14.429045 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 47567.4us
I20260709 12:17:14.429205 11809 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:14.429955 12386 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:14.431110 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 59426.5us
W20260709 12:17:14.432315 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.345233 13320 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.428733 11699 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:14.381778 13371 raft_consensus.cc:2749] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:14.435824 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:14.438077 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:14.438829 11807 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.397858 13341 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:14.444555 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 391593us
I20260709 12:17:14.445519 11701 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:14.400395 13500 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:14.436546 13436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.287s	user 0.006s	sys 0.021s
I20260709 12:17:14.437593 13411 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:14.468482 12387 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:14.427172 13313 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:14.447402 11701 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:14.470391 11732 raft_consensus.cc:606] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:14.398602 13498 consensus_queue.cc:1048] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:17:14.438359 13218 raft_consensus.cc:2749] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.399065 13283 consensus_queue.cc:1048] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:17:14.442325 13183 raft_consensus.cc:2804] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:14.469744 13436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.006s	sys 0.021s
I20260709 12:17:14.467202 13423 raft_consensus.cc:2749] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:14.471975 13341 raft_consensus.cc:697] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:14.438545 13320 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.472210 13411 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.446699 13400 consensus_queue.cc:1048] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:17:14.475926 13501 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:14.489740 12432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57346 (request call id 470) took 1665 ms (client timeout 1505 ms). Trace:
W20260709 12:17:14.490180 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 61657.3us
I20260709 12:17:14.482187 13328 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:14.471930 13144 consensus_queue.cc:1048] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:17:14.484989 11728 raft_consensus.cc:1275] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.483031 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:14.444633 13490 consensus_queue.cc:1048] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 12:17:14.497705 12432 rpcz_store.cc:269] 0709 12:17:12.823969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.825829 (+  1860us) service_pool.cc:224] Handling call
0709 12:17:13.687704 (+861875us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800004598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:17:14.489545 (+801841us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54001e0354. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:14.489667 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649669888}
I20260709 12:17:14.518002 13490 consensus_queue.cc:1243] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer cfe9bf206bb14951ba7615683809d178 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:14.518626 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:14.519524 13328 raft_consensus.cc:697] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:14.519846 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:14.520037 13402 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:14.472148 13500 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.485409 13473 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:14.485265 13436 raft_consensus.cc:697] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:14.475922 13313 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:14.481963 13274 consensus_queue.cc:1048] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:17:14.495926 13411 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.675699 11809 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
W20260709 12:17:14.517231 13514 log.cc:927] Time spent T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.469s	user 0.000s	sys 0.007s
I20260709 12:17:14.496590 13183 raft_consensus.cc:697] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:14.525399 11624 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:14.676784 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:17:14.688851 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 163533us
I20260709 12:17:14.689270 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:14.520484 11800 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:14.496006 13412 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.180s
I20260709 12:17:14.496066 12859 consensus_queue.cc:1048] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.179s
I20260709 12:17:14.528172 13144 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.682736 13205 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.675156 13337 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:14.685271 13489 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:14.690193 13473 raft_consensus.cc:697] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:14.503252 13501 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.688405 13371 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:14.699977 13329 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.713093 13341 consensus_queue.cc:237] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:14.520519 13402 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:14.756976 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 264417us
I20260709 12:17:14.768585 11701 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:14.730618 13396 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.783670 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:14.785041 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:14.788462 12436 raft_consensus.cc:1240] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:14.788681 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:14.741098 13071 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:14.799129 13525 log.cc:927] Time spent T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:17:14.805025 13438 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.808393 13450 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.808717 11808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56474 (request call id 685) took 1051 ms. Trace:
I20260709 12:17:14.809087 11808 rpcz_store.cc:276] 0709 12:17:13.757508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.763899 (+  6391us) service_pool.cc:224] Handling call
0709 12:17:13.843100 (+ 79201us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b5800202b98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:17:14.808551 (+965451us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54007f12d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:14.808658 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184048896}
W20260709 12:17:14.810258 13524 log.cc:927] Time spent T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:17:14.810487 11808 raft_consensus.cc:1240] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:14.814221 11624 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:14.817603 13522 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:14.818147 13522 raft_consensus.cc:697] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:14.819013 13522 consensus_queue.cc:237] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:14.823352 13402 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:14.823978 13402 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:14.824391 13402 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.729866 13144 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:14.833751 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:14.834823 11807 raft_consensus.cc:2468] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
W20260709 12:17:14.840687 11805 consensus_meta.cc:287] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.002s
I20260709 12:17:14.841463 11805 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:14.739569 13205 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:14.847404 13205 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:14.850349 13517 raft_consensus.cc:3055] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:14.766701 13371 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.850801 13517 raft_consensus.cc:740] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:14.851632 13517 consensus_queue.cc:260] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.852591 13517 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.853029 12434 raft_consensus.cc:2410] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:14.843639 13064 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.845024 11807 pending_rounds.cc:85] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178: Aborting all ops after (but not including) 2
W20260709 12:17:14.856638 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.857753 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:14.746487 13489 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:14.808947 13450 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.746179 13337 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:14.858642 11807 pending_rounds.cc:107] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:14.861853 11807 raft_consensus.cc:2889] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:14.796234 13283 raft_consensus.cc:2749] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.796993 13183 consensus_queue.cc:237] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:14.852490 13371 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:14.886445 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:14.853070 11802 raft_consensus.cc:2468] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:14.794814 13396 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:14.901880 11660 raft_consensus.cc:2393] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 3: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:14.776271 13328 consensus_queue.cc:237] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:14.879781 13071 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:14.793665 13436 consensus_queue.cc:237] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:14.922909 11624 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
W20260709 12:17:14.919319 13512 log.cc:927] Time spent T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:14.948329 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:14.953333 12434 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
W20260709 12:17:14.932837 13516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.004s	sys 0.026s
W20260709 12:17:14.961776 13326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.007s	sys 0.017s
W20260709 12:17:14.962217 13326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.007s	sys 0.017s
I20260709 12:17:14.948596 13371 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.954697 13402 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:14.964278 13528 log.cc:927] Time spent T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:17:14.957664 13313 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:14.966022 13516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.005s	sys 0.027s
I20260709 12:17:14.890771 13473 consensus_queue.cc:237] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:14.951592 13540 raft_consensus.cc:2764] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:17:15.009366 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:14.949234 13071 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.050688 13163 leader_election.cc:290] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:15.052287 13530 log.cc:927] Time spent T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:17:15.054075 11654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 833) took 1070 ms. Trace:
I20260709 12:17:15.054553 11654 rpcz_store.cc:276] 0709 12:17:13.983812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.985893 (+  2081us) service_pool.cc:224] Handling call
0709 12:17:13.986174 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.214298 (+228124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.053787 (+839489us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54006a1dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:15.054003 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522580864}
I20260709 12:17:15.056294 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.060488 11733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 788) took 2060 ms. Trace:
I20260709 12:17:15.062202 13218 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.062522 13450 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:15.062726 13218 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.063869 13337 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.044406 13148 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.065691 11698 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:15.066119 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.066736 11809 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 8.
I20260709 12:17:15.067636 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.067857 12386 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:15.047832 12434 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:15.003748 13330 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.069484 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.071147 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.071972 11809 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:15.083993 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:15.009790 13507 consensus_meta.cc:287] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
I20260709 12:17:14.960558 13500 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.065347 13148 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.064770 13218 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.025964 13313 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:15.003530 13371 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.060953 11733 rpcz_store.cc:276] 0709 12:17:12.999969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.075854 (+ 75885us) service_pool.cc:224] Handling call
0709 12:17:14.345208 (+1269354us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b58005e4798. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:17:14.345380 (+   172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.345577 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:14.478108 (+132531us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.791567 (+313459us) log.cc:844] Serialized 14 byte log entry
0709 12:17:15.059887 (+268320us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18002139a0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa8d8c0a 00007f4504018219 00007f44fa960a40 00007f44fa95b4e4 00007f44fa95b455 00007f44fda43060 00007f44fda55716 00007f44fda66287 00007f44fda66208
0709 12:17:15.060092 (+   205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:15.060155 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:15.060204 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.060276 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.060417 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63034,"prepare.queue_time_us":174237,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":40556,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":33902,"spinlock_wait_cycles":31974656,"thread_start_us":394244,"threads_started":2,"wal-append.queue_time_us":402363}
I20260709 12:17:15.037567 13492 raft_consensus.cc:493] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:15.070858 12859 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.073328 12386 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:15.013180 13501 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.139884 13144 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.140085 13401 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:15.174456 13548 log.cc:927] Time spent T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:17:15.178284 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.178637 13071 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:15.180706 11732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36418 (request call id 18) took 1136 ms. Trace:
I20260709 12:17:15.182646 11803 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
W20260709 12:17:15.165742 13539 log.cc:927] Time spent T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:17:15.216259 11732 rpcz_store.cc:276] 0709 12:17:14.044586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.048483 (+  3897us) service_pool.cc:224] Handling call
0709 12:17:15.180539 (+1132056us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400072954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda45853 00007f4502a1360a 00007f44fbf997d4 00007f44fbf99762 00007f44fbf99691 00007f44fbf9960c 00007f44fbf988c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:15.180627 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958228864}
I20260709 12:17:15.077246 13330 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.201179 12434 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:15.168630 13489 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.216784 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:15.193737 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 120497us
I20260709 12:17:15.251092 12429 raft_consensus.cc:2393] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:15.192369 13540 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.200996 13218 raft_consensus.cc:2804] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:15.250582 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 184951us
I20260709 12:17:15.255218 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.257246 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.203173 13401 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:15.258553 11659 raft_consensus.cc:1240] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:15.259737 11773 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:15.191252 12859 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:15.207475 13542 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:15.248008 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.192888 13313 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:15.193065 13492 raft_consensus.cc:515] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.251590 13274 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:15.250639 13396 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:15.253103 13144 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:15.253983 13532 raft_consensus.cc:2804] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:15.258185 13218 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:15.279286 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.263594 13401 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:15.285573 13541 log.cc:927] Time spent T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:17:15.311524 13330 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.312757 13218 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.289949 13144 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:15.292759 13533 log.cc:927] Time spent T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.443s	user 0.001s	sys 0.001s
I20260709 12:17:15.329455 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.263247 13546 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.259462 13540 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:15.263360 11801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56474 (request call id 694) took 1297 ms. Trace:
I20260709 12:17:15.295843 12435 raft_consensus.cc:2468] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 8.
I20260709 12:17:15.308107 11773 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:15.309727 13402 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.310034 12859 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.310287 13532 raft_consensus.cc:697] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:15.352249 13402 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.352698 13532 consensus_queue.cc:237] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.320657 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.354048 11807 raft_consensus.cc:2468] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:15.354530 13402 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:15.356268 13144 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.349414 13546 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.322702 13492 leader_election.cc:290] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.284399 13274 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.362839 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.363492 12429 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:15.363550 13274 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:15.364502 11775 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:15.365003 11698 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:15.366338 12429 raft_consensus.cc:1275] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:17:15.367278 13561 log.cc:927] Time spent T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:17:15.321573 13148 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:15.323402 11728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
W20260709 12:17:15.324517 13438 consensus_meta.cc:287] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.005s
I20260709 12:17:15.407286 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:15.324672 12428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57338 (request call id 845) took 1305 ms. Trace:
I20260709 12:17:15.325349 11806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 280) took 1237 ms. Trace:
I20260709 12:17:15.329319 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.414527 11808 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:15.415477 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.416069 11808 raft_consensus.cc:2468] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 2.
I20260709 12:17:15.275960 13071 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.337476 11701 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:15.362002 11800 consensus_meta.cc:287] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.001s
I20260709 12:17:15.343787 13313 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.368366 13371 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.365309 13546 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:15.334414 13501 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.346694 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.276264 13542 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.369104 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.370996 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.384759 11809 raft_consensus.cc:1275] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:15.417557 11624 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:15.343266 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.418783 12386 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:15.426131 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:15.427616 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 56283.2us
W20260709 12:17:15.429908 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 92509us
I20260709 12:17:15.460232 11701 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:15.344926 13540 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.413193 11806 rpcz_store.cc:276] 0709 12:17:14.087977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.358064 (+270087us) service_pool.cc:224] Handling call
0709 12:17:14.358336 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.358525 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.358548 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:15.182998 (+824450us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b2c001e70f8. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fc344a11 00007f44fc354372 00007f44fda86a01 00007f44fda4b43a 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2
0709 12:17:15.183362 (+   364us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.262272 (+ 78910us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:15.262299 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.262349 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.325050 (+ 62701us) raft_consensus.cc:1685] finished
0709 12:17:15.325085 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.325296 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88211712,"thread_start_us":78579,"threads_started":1,"wal-append.queue_time_us":105628}
W20260709 12:17:15.373937 13411 consensus_meta.cc:287] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.001s
I20260709 12:17:15.430501 13425 raft_consensus.cc:2804] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:15.426012 11728 raft_consensus.cc:606] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:15.438012 13343 raft_consensus.cc:2804] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:15.441149 11809 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:15.441593 13326 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:15.424726 12428 rpcz_store.cc:276] 0709 12:17:14.018835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.020800 (+  1965us) service_pool.cc:224] Handling call
0709 12:17:15.324485 (+1303685us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400176bd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:15.324595 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678945152}
W20260709 12:17:15.431278 13341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.004s	sys 0.002s
W20260709 12:17:15.449334 11699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.453414 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:15.465211 11625 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:15.465392 11802 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:15.469594 13425 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.470125 13425 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.470345 11655 raft_consensus.cc:1275] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:17:15.469485 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 50777.9us
I20260709 12:17:15.431995 13546 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.473956 11809 raft_consensus.cc:3060] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.426925 11800 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 8.
I20260709 12:17:15.433046 13438 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:15.473150 12438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57346 (request call id 497) took 1092 ms. Trace:
I20260709 12:17:15.476635 12438 rpcz_store.cc:276] 0709 12:17:14.380704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.380813 (+   109us) service_pool.cc:224] Handling call
0709 12:17:14.381134 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.385700 (+  4566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.385729 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:14.428559 (+ 42830us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.323644 (+895085us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b18002c2ea0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:17:15.337300 (+ 13656us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:15.337334 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.337396 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.455432 (+118036us) raft_consensus.cc:1685] finished
0709 12:17:15.455453 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.473089 (+ 17636us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37077,"raft.queue_time_us":18172,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":33160,"spinlock_wait_cycles":6671104,"thread_start_us":13488,"threads_started":1,"wal-append.queue_time_us":972624}
I20260709 12:17:15.423749 13218 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:15.471541 13341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.004s	sys 0.003s
W20260709 12:17:15.471778 13522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.004s	sys 0.011s
I20260709 12:17:15.429601 13071 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.470794 11728 raft_consensus.cc:614] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:15.502445 11699 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.471880 11624 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:15.470970 13343 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.481138 13412 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:15.481002 13489 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.467471 13163 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:17:15.481527 13546 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.475921 13423 consensus_queue.cc:1048] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 12:17:15.498127 13522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.004s	sys 0.011s
I20260709 12:17:15.501690 13286 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:15.475324 13400 consensus_queue.cc:1048] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:17:15.492129 13531 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.469650 13326 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.454142 13501 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.525566 11809 raft_consensus.cc:1275] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:15.471705 13411 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.475821 13487 raft_consensus.cc:2749] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:15.582327 13572 log.cc:927] Time spent T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:17:15.582979 12437 raft_consensus.cc:1240] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:15.510949 13343 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.583444 13401 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.506124 13544 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:15.511937 13489 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:15.574270 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 102581us
I20260709 12:17:15.502032 13427 consensus_queue.cc:1048] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:15.578650 13542 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:15.579140 13326 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.339504 11801 rpcz_store.cc:276] 0709 12:17:13.965545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.069986 (+104441us) service_pool.cc:224] Handling call
0709 12:17:14.070324 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.070592 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:14.918716 (+848124us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b1800488740. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fd5f34bc 00007f44fa94148b 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95b455 00007f45014433c7 00007f44fda559a7 00007f44fda650bf
0709 12:17:14.949441 (+ 30725us) log.cc:844] Serialized 14 byte log entry
0709 12:17:15.206274 (+256833us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:15.216172 (+  9898us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:15.250528 (+ 34356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.254045 (+  3517us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.260989 (+  6944us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":578,"prepare.queue_time_us":326000,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":6257,"raft.queue_time_us":10455,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":43516,"spinlock_wait_cycles":42737408,"thread_start_us":553524,"threads_started":2,"wal-append.queue_time_us":309765}
I20260709 12:17:15.580997 13411 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:15.584213 13569 log.cc:927] Time spent T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 12:17:15.563529 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 44257.1us
I20260709 12:17:15.527797 13274 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.527747 13205 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:15.592604 13341 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:15.585803 13412 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:15.575556 13286 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.603443 13489 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.577045 13403 consensus_queue.cc:1059] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:17:15.605839 11728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a70076f56284eafba1df611decc3929"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:15.606838 13532 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.586722 13531 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.608565 13542 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:15.610930 13582 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:15.619966 13341 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.597482 13183 consensus_queue.cc:1048] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:17:15.621445 13163 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:15.608421 13342 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:17:15.626008 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:15.627279 13412 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:15.624420 13205 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:15.624191 13274 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.602970 13544 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:15.671778 13341 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.670459 11728 raft_consensus.cc:606] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:15.686362 13578 log.cc:927] Time spent T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:17:15.687075 13544 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.690369 13501 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.696837 12437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57346 (request call id 499) took 1197 ms. Trace:
I20260709 12:17:15.715893 12437 rpcz_store.cc:276] 0709 12:17:14.499115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.499249 (+   134us) service_pool.cc:224] Handling call
0709 12:17:14.499502 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.583392 (+1083890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.696573 (+113181us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000055d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:15.696768 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2491324800}
I20260709 12:17:15.678674 13163 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.712363 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.683632 13218 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.669234 13532 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:15.718679 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 113641us
W20260709 12:17:15.722003 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 238839us
I20260709 12:17:15.723275 13199 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:15.723887 13199 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.726208 13199 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:15.726796 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.702244 13411 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.727470 13411 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:15.730580 13576 log.cc:927] Time spent T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:17:15.710609 11652 raft_consensus.cc:2393] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:15.732694 11807 raft_consensus.cc:2393] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 6: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:15.672384 13542 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.753795 13604 consensus_queue.cc:1048] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:15.713579 13427 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.673316 13582 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.729503 13411 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.760914 12386 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:15.761130 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.761840 11733 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:15.762926 13501 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:15.763279 11733 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.763427 13501 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.765239 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.765928 12437 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:15.766815 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.769831 13589 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:15.770344 13589 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.770722 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.771893 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.772356 13589 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:15.772671 11734 raft_consensus.cc:2393] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:15.773619 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.765475 13501 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.762494 13148 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:15.775136 11625 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:15.776152 13342 raft_consensus.cc:2804] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.776517 13342 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.776837 13342 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.777031 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:15.770211 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:15.796747 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 82171.7us
W20260709 12:17:15.796830 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 80916.3us
I20260709 12:17:15.718541 13544 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:15.773561 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.748360 13071 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.814545 13144 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
W20260709 12:17:15.816186 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 93249.1us
I20260709 12:17:15.815021 13396 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:15.796255 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.759656 13401 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.794342 13148 raft_consensus.cc:697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 8 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:15.814817 13423 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:15.823045 11698 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:15.818987 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:15.820104 11775 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:15.827664 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.812340 13501 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.835299 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:15.795847 13427 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.855412 11808 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 8.
I20260709 12:17:15.849619 13286 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:15.828110 11726 raft_consensus.cc:2468] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:15.820932 13544 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.876781 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.882790 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:15.886507 13600 raft_consensus.cc:2804] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.886979 13600 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:15.887185 13218 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:15.865868 13597 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.887718 13218 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.888060 13597 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.870784 13582 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.821542 13144 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.892197 13144 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:15.892444 12435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57338 (request call id 841) took 1927 ms (client timeout 2024 ms). Trace:
I20260709 12:17:15.892763 13148 consensus_queue.cc:237] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.893281 13341 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.899325 13531 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:15.899963 13581 log.cc:927] Time spent T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:17:15.901046 13274 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:15.902004 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:15.902472 13563 log.cc:927] Time spent T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:15.903138 13205 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.896637 13489 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.897914 13439 raft_consensus.cc:3055] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:15.875721 13585 log.cc:927] Time spent T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:17:15.898434 13425 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:15.823204 13396 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.869588 13412 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.905827 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:17:15.892846 12435 rpcz_store.cc:269] 0709 12:17:13.964782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.964892 (+   110us) service_pool.cc:224] Handling call
0709 12:17:15.056111 (+1091219us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b5800004598. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a110a0 00007f4502a10984 00007f44fbf8b6d4 00007f44fbf8b662
0709 12:17:15.892280 (+836169us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b540000a0d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:15.892390 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556547200}
I20260709 12:17:15.936188 11808 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.867095 13133 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:15.936721 13396 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.874963 13071 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:15.937085 13133 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:15.937717 13071 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.939144 13133 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.939815 13071 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:15.876425 13587 log.cc:927] Time spent T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:17:15.927821 13439 raft_consensus.cc:740] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:15.835570 13343 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:15.942801 13439 consensus_queue.cc:260] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:15.943306 11808 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
I20260709 12:17:15.943871 13343 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.944132 13439 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.834754 13423 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:15.945667 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.856503 13594 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:15.946377 11661 raft_consensus.cc:2393] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:15.871019 13161 raft_consensus.cc:2749] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:15.883338 11806 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:15.927937 13546 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.947198 13205 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.947681 13205 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.948616 13546 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:15.949216 11805 raft_consensus.cc:1240] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:15.890209 13597 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.933055 11625 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:15.843218 13501 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.947962 11806 raft_consensus.cc:1275] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:15.870275 13163 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.910658 13600 raft_consensus.cc:3060] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.968530 13330 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:15.969177 13330 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:15.889746 13218 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.945957 13423 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.957614 13501 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:15.957978 13326 raft_consensus.cc:2804] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:15.970690 13326 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:15.971086 13326 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:15.971325 13330 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:15.946377 13594 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:15.975651 13594 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:15.977963 13342 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:15.978901 11803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56474 (request call id 693) took 2110 ms (client timeout 2219 ms). Trace:
W20260709 12:17:15.979341 11803 rpcz_store.cc:269] 0709 12:17:13.868978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.881745 (+ 12767us) service_pool.cc:224] Handling call
0709 12:17:15.978693 (+2096948us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540074a254. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:15.978807 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2888166144}
I20260709 12:17:15.980672 13342 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:15.982168 11733 raft_consensus.cc:2393] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 4: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:15.984392 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.985483 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.986714 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:15.987553 11733 raft_consensus.cc:2393] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 4: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:15.988194 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.988283 12436 raft_consensus.cc:1240] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:15.989100 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:15.989235 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:15.990048 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.990506 13320 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:15.991189 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.991406 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.991762 13425 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:15.992174 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.992471 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.992898 13610 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:15.993429 13610 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:15.993603 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.994153 12436 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.994302 12432 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:15.996094 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:15.997686 13489 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:16.001298 12436 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:15.993682 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.003361 12435 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:16.004273 11730 raft_consensus.cc:2410] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:16.006927 13002 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.007441 13002 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:16.008116 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.008735 11728 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 2.
I20260709 12:17:16.013481 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:16.014218 11733 raft_consensus.cc:3060] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.028198 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:15.996110 13610 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:16.037698 11733 raft_consensus.cc:2468] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:16.009557 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.041481 11625 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:16.015558 13144 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:16.009581 13002 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:16.015364 13400 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:16.029350 13489 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:16.030097 13522 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.048030 11804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9aacd4a8780042e792f4c4c8566c7649"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:51054
I20260709 12:17:16.054077 11804 raft_consensus.cc:606] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:16.054433 11804 raft_consensus.cc:614] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:16.055838 11701 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:16.060123 11701 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:16.063602 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.064198 12436 raft_consensus.cc:2468] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:16.064576 12435 raft_consensus.cc:1275] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:16.048517 13133 raft_consensus.cc:2804] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:16.067009 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.067662 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.069835 12436 raft_consensus.cc:2393] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 5: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:16.069098 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:16.070708 12430 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:16.059199 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 236228us
I20260709 12:17:16.071772 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.072039 12429 raft_consensus.cc:3060] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.072122 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.072584 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.049309 11728 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 8.
I20260709 12:17:16.057375 13341 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:16.058760 13404 raft_consensus.cc:2749] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:16.065883 13423 raft_consensus.cc:2749] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.057677 13489 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:16.084452 13489 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:16.050171 13144 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:16.088428 11701 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:17:16.091117 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.097050 12429 raft_consensus.cc:1275] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:16.051990 13400 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.108157 13326 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.112438 13326 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:16.113905 13590 log.cc:927] Time spent T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.499s	user 0.001s	sys 0.002s
I20260709 12:17:16.117190 13542 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:16.125555 13425 consensus_queue.cc:1048] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:16.080961 13133 raft_consensus.cc:697] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:16.127414 13425 consensus_queue.cc:1048] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:16.128222 13133 consensus_queue.cc:237] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.131083 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:16.134135 13144 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:16.135110 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.107059 13412 raft_consensus.cc:2804] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:16.135943 13412 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:16.136329 13412 raft_consensus.cc:3060] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.059165 13522 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.150342 11659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60060 (request call id 714) took 2858 ms. Trace:
I20260709 12:17:16.150756 11659 rpcz_store.cc:276] 0709 12:17:13.291689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.291815 (+   126us) service_pool.cc:224] Handling call
0709 12:17:13.299769 (+  7954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.262946 (+1963177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.150114 (+887168us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54001d9f54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:16.150281 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4504339200}
I20260709 12:17:16.152137 12435 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
W20260709 12:17:16.154139 11735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 800) took 1849 ms (client timeout 1855 ms). Trace:
W20260709 12:17:16.154515 11735 rpcz_store.cc:269] 0709 12:17:14.305143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.305284 (+   141us) service_pool.cc:224] Handling call
0709 12:17:16.153944 (+1848660us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b54002f5dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:16.154075 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74093440}
I20260709 12:17:16.147218 13600 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:16.149349 13400 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:16.156047 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.163446 12432 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:16.156899 12430 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:16.156985 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.159198 11701 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:17:16.160180 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 88094.5us
I20260709 12:17:16.165050 11735 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:16.157969 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:16.154328 13144 raft_consensus.cc:493] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.167285 11625 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:16.167537 12429 raft_consensus.cc:2393] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:16.151247 13522 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:16.170775 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:16.176964 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:16.179216 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:16.181329 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:16.182015 11803 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.167726 13206 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:16.195125 11730 raft_consensus.cc:2468] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:16.198091 11625 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:16.199092 13600 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:16.201416 13522 raft_consensus.cc:2804] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:16.201992 13522 raft_consensus.cc:697] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:16.195740 13436 raft_consensus.cc:2804] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:16.202679 13206 raft_consensus.cc:493] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
W20260709 12:17:16.213202 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 393137us
I20260709 12:17:16.216194 11803 raft_consensus.cc:2468] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:16.217301 12386 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:16.219775 12386 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:16.221129 12386 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:16.185119 13144 raft_consensus.cc:515] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:16.224033 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:16.214349 13436 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.229460 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:16.227789 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.215999 13206 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:16.249962 13522 consensus_queue.cc:237] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.246110 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.254014 13614 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.254333 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.254627 13614 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.229341 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.233214 13532 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:16.222371 13148 raft_consensus.cc:2804] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:16.240527 13183 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:16.221824 13400 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:16.243991 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.244943 13144 leader_election.cc:290] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:16.230581 13501 consensus_queue.cc:1048] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:17:16.240581 13205 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:16.263625 12438 raft_consensus.cc:2468] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:16.273190 11701 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:16.267109 12435 raft_consensus.cc:2468] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:16.256479 13341 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:16.275794 11731 raft_consensus.cc:1275] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:16.276350 13400 raft_consensus.cc:697] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 8 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:16.276671 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:16.277062 13148 raft_consensus.cc:697] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:16.270627 13183 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.258989 13438 raft_consensus.cc:993] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:16.287024 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.287679 11627 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:16.231464 13436 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.299674 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:16.300413 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:16.336002 13596 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:16.301676 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.272195 11698 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:16.328871 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.420231 11733 raft_consensus.cc:2368] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5.
I20260709 12:17:16.295089 13412 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.421003 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:16.421708 11733 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 8: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:16.330037 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:16.337422 11731 pending_rounds.cc:85] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef: Aborting all ops after (but not including) 3
I20260709 12:17:16.334311 11775 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:16.335076 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:16.425613 11803 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
W20260709 12:17:16.425733 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 91517us
I20260709 12:17:16.347834 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.349246 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.346834 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.345561 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.295372 13439 raft_consensus.cc:2804] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.351826 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:16.341668 13492 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:16.396095 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63eff9adc00b4c7f8245454c066123ed" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.299762 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.403731 13476 raft_consensus.cc:1081] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:16.340596 13341 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.460068 13341 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:16.461123 12428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:17:16.433305 13439 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.428877 13411 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:16.406484 11652 raft_consensus.cc:1275] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:16.462126 13411 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:16.408967 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.463717 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.464465 13411 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:16.464937 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:16.466404 13439 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:16.396600 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 43541.7us
I20260709 12:17:16.470809 13281 raft_consensus.cc:993] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:16.414417 11659 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:16.471351 13281 raft_consensus.cc:1081] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:16.471922 13218 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:16.300510 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.473620 11730 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 8: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:16.473747 12438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a70076f56284eafba1df611decc3929"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:17:16.466084 12428 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:16.474300 12438 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:16.474671 12438 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.408228 13183 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:16.474438 12428 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.331802 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:16.427433 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:16.415804 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 128225us
I20260709 12:17:16.433630 13621 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:16.478018 13621 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.478369 13621 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.426642 11658 raft_consensus.cc:2393] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
W20260709 12:17:16.429522 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 273834us
I20260709 12:17:16.396863 11726 raft_consensus.cc:606] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:16.475137 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.480069 11730 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:16.482131 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.481333 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.483553 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.484629 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.438431 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:16.440665 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:17:16.430125 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 157985us
I20260709 12:17:16.486438 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.444875 13412 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:16.445503 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:16.487470 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.487839 12430 raft_consensus.cc:3060] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.488472 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.441407 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.450862 13427 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:16.440871 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.452538 13614 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:16.492954 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.493341 11698 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:16.494493 11653 raft_consensus.cc:1275] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:16.453243 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.495941 12436 raft_consensus.cc:2410] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:16.442425 13492 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.405135 13148 consensus_queue.cc:237] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:16.461593 12431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57338 (request call id 857) took 1096 ms. Trace:
W20260709 12:17:16.499270 11773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.432271 11775 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:16.448117 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:16.500085 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 67895.5us
I20260709 12:17:16.500092 11654 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:16.502122 11773 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:16.503329 11773 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:16.484727 13544 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:16.503090 12386 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:16.497853 12387 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:16.489542 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.504403 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.456840 13206 raft_consensus.cc:515] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.515930 13623 raft_consensus.cc:2749] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:16.499181 12431 rpcz_store.cc:276] 0709 12:17:15.365381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.454797 (+ 89416us) service_pool.cc:224] Handling call
0709 12:17:15.455138 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:15.614081 (+158943us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:15.614373 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 12:17:15.674880 (+ 60507us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:15.678845 (+  3965us) log.cc:844] Serialized 52 byte log entry
0709 12:17:15.678988 (+   143us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:15.679021 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.461155 (+782134us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54000735d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4be01 00007f44fda4a83e 00007f4502a0f419 00007f44fbf86bd4 00007f44fbf86b62 00007f44fbf86a91 00007f44fbf86a0c 00007f44fbf85cc2 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:16.461207 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:16.461254 (+    47us) raft_consensus.cc:1685] finished
0709 12:17:16.461353 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:16.461533 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44797,"prepare.queue_time_us":837,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":33645,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":5326,"spinlock_wait_cycles":340857472,"thread_start_us":60913,"threads_started":2,"wal-append.queue_time_us":97043}
I20260709 12:17:16.439613 11731 pending_rounds.cc:107] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:16.517644 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.505353 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:16.518738 11807 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:16.520145 12387 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:16.521406 12387 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:16.522101 11660 raft_consensus.cc:2393] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 6: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:16.480345 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.528003 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.443007 13403 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.533413 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.533946 11773 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:16.442348 13532 raft_consensus.cc:2749] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.525151 12387 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:16.526667 11627 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:16.552137 11627 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:16.552956 13343 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.553330 11627 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:16.555195 13343 raft_consensus.cc:2804] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:16.429646 13596 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.517262 13320 raft_consensus.cc:2804] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:16.556114 13320 raft_consensus.cc:697] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:16.557339 13596 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:16.511364 12438 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:16.523773 11731 raft_consensus.cc:2889] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:16.518533 13498 raft_consensus.cc:2764] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:17:16.534056 11732 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:16.538064 12386 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:16.528419 13501 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.555572 13343 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:16.555533 11627 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:16.531777 13427 raft_consensus.cc:2804] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:16.561731 13199 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.556981 13320 consensus_queue.cc:237] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:16.537214 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.560746 13343 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.565838 13498 raft_consensus.cc:2749] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.566632 13498 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:16.566978 13498 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:16.567333 13498 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.545984 11807 raft_consensus.cc:1275] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:16.573484 12438 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:16.574723 13402 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:16.575305 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:16.575939 11807 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.575275 13402 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:16.579969 13402 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:16.536463 12428 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:16.529847 13163 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.528182 13371 raft_consensus.cc:2749] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.534673 13403 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:16.580339 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 46183.5us
I20260709 12:17:16.598628 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:16.599361 11803 raft_consensus.cc:2393] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 6: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:16.599303 11773 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:16.585412 12387 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:16.512799 12430 raft_consensus.cc:2468] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:16.589613 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.538719 13623 raft_consensus.cc:2749] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.583829 11627 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:16.597543 12428 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:16.601902 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:16.604718 11660 raft_consensus.cc:2468] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:16.534789 13544 consensus_queue.cc:1059] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:17:16.532351 13329 consensus_queue.cc:1059] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:17:16.535343 13326 consensus_queue.cc:1059] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:17:16.626609 11773 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:16.628907 11733 raft_consensus.cc:1240] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:16.635089 11773 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:16.591454 13427 raft_consensus.cc:697] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:16.644481 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:16.650466 12432 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:16.646798 13623 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:16.652743 13623 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.653090 13623 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:16.647063 11727 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:16.654028 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.654187 13313 raft_consensus.cc:2749] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.655284 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:16.611690 13489 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:16.527980 13400 consensus_queue.cc:237] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:16.666383 11659 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 8.
I20260709 12:17:16.674214 11654 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:16.612534 11800 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:16.613547 13218 raft_consensus.cc:2804] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.590695 13596 consensus_queue.cc:1048] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:17:16.616021 13450 raft_consensus.cc:2749] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.631850 13600 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:16.620364 13487 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:16.702677 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:16.619076 13144 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.708638 11733 raft_consensus.cc:3055] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:16.708982 11733 raft_consensus.cc:740] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:16.709745 11733 consensus_queue.cc:260] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:16.641865 13330 raft_consensus.cc:2749] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.644798 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.714385 11733 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.615821 11807 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
W20260709 12:17:16.709738 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 449263us
I20260709 12:17:16.717262 12386 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:16.688347 13133 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:16.700676 13218 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.732403 13218 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.732753 11482 catalog_manager.cc:5697] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 4 to 5, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 5 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:16.734902 13152 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:16.725456 13206 leader_election.cc:290] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:16.726853 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:16.717685 13487 raft_consensus.cc:697] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:16.738188 13487 consensus_queue.cc:237] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:16.735369 13403 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:16.701277 13623 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:16.743320 11701 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:16.744714 13608 raft_consensus.cc:2804] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:16.745231 13608 raft_consensus.cc:697] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:16.731155 13621 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:16.712482 13600 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:16.747253 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:16.748955 13600 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:16.751895 12387 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:16.757670 12387 leader_election.cc:400] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5.
I20260709 12:17:16.758134 12387 leader_election.cc:403] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:16.772603 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:16.744544 13489 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:16.780093 11808 raft_consensus.cc:2393] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 5: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:16.781324 12430 raft_consensus.cc:1240] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.752547 13371 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:16.747020 13623 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:16.717962 13144 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:16.780064 13411 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:16.796980 13489 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.815533 13623 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:16.834321 12432 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
I20260709 12:17:16.842082 11701 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:16.852519 13439 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:16.796411 13427 consensus_queue.cc:237] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:16.840888 13596 raft_consensus.cc:2749] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 4. Current term is 5.
I20260709 12:17:16.921180 11805 raft_consensus.cc:1240] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.909363 11733 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
I20260709 12:17:16.825038 13411 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:16.824273 13623 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:16.861644 13206 raft_consensus.cc:2804] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:16.849452 13425 consensus_queue.cc:1059] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:17:16.938428 12386 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:16.945699 11804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.003s	sys 0.026s
W20260709 12:17:16.946064 11804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.003s	sys 0.026s
I20260709 12:17:16.938851 11728 raft_consensus.cc:2393] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
W20260709 12:17:16.934551 13436 consensus_meta.cc:287] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03: Time spent flushing consensus metadata: real 0.513s	user 0.017s	sys 0.002s
I20260709 12:17:16.987389 11808 raft_consensus.cc:1240] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:16.986816 11482 catalog_manager.cc:5697] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 3 to 4, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 4 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
W20260709 12:17:16.945227 13035 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.015s	sys 0.011s
I20260709 12:17:16.989466 13537 raft_consensus.cc:2804] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:16.966542 13152 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.991977 13343 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:17.000947 13492 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:17.002753 13343 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:17.003298 13343 consensus_queue.cc:1059] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:17.004122 11733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:17.011754 13600 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:17.012377 13600 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:17.014464 13600 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:17.030467 13626 log.cc:927] Time spent T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:17:17.033829 13419 consensus_queue.cc:1048] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:17.034495 13411 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:17.050905 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 96631.6us
I20260709 12:17:16.864107 13608 consensus_queue.cc:237] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:17.065196 11734 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.008s	sys 0.018s
W20260709 12:17:17.065680 11734 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.009s	sys 0.018s
I20260709 12:17:16.965097 13206 raft_consensus.cc:697] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:17.080848 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:17.082005 11808 raft_consensus.cc:2393] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 6: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
W20260709 12:17:17.086005 13633 log.cc:927] Time spent T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:17:17.087800 13537 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:17.088268 13537 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.092717 13623 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:17.093613 13144 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:17.094177 13144 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:17.094666 11808 raft_consensus.cc:1275] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:17.100420 11733 raft_consensus.cc:606] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:17.101027 11733 raft_consensus.cc:614] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:17.064090 13035 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.016s	sys 0.011s
W20260709 12:17:17.067247 13501 consensus_meta.cc:287] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.003s
I20260709 12:17:17.105552 11698 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:16.988976 13436 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:17.122869 11735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.034s	sys 0.058s
W20260709 12:17:17.140280 11735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.034s	sys 0.058s
W20260709 12:17:17.109365 11802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.016s	sys 0.013s
W20260709 12:17:17.146375 11802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.016s	sys 0.013s
I20260709 12:17:17.146464 13609 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.112077 13357 consensus_queue.cc:1059] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:17:17.107388 13621 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:17.094640 13144 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:17.111007 13501 raft_consensus.cc:2749] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:17.153707 13438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.016s	sys 0.014s
I20260709 12:17:17.157649 11658 raft_consensus.cc:2393] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 5: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
W20260709 12:17:17.154314 13498 consensus_meta.cc:287] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.000s
I20260709 12:17:17.136806 13450 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:17.167495 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:17.168149 12434 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.157179 13035 raft_consensus.cc:3055] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:17:17.161214 13438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.017s	sys 0.014s
W20260709 12:17:17.163944 12859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.007s	sys 0.043s
I20260709 12:17:17.170828 13450 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:17.185442 13450 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:17.196882 13611 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:17.198751 13144 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:17.172240 13439 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:17.218376 12434 raft_consensus.cc:2468] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:17.182019 13035 raft_consensus.cc:740] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:17.235148 11730 raft_consensus.cc:3055] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:17.165963 13498 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:17.236312 11730 raft_consensus.cc:740] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
W20260709 12:17:17.204918 12859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.007s	sys 0.043s
I20260709 12:17:17.231894 11701 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:17:17.235698 11657 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.018s	sys 0.037s
I20260709 12:17:17.241691 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:17.256793 12428 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:17.242223 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:17.258225 12438 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:17.258831 11807 raft_consensus.cc:1240] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:17.239971 11732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.001s	sys 0.034s
I20260709 12:17:17.255710 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:17.235244 13320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.020s	sys 0.078s
I20260709 12:17:17.257548 13621 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
W20260709 12:17:17.261323 11732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.001s	sys 0.034s
W20260709 12:17:17.261056 13320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.020s	sys 0.078s
W20260709 12:17:17.256454 11657 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.018s	sys 0.037s
I20260709 12:17:17.249454 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:17.264585 12434 raft_consensus.cc:2393] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:17.260783 11804 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:17.261348 11730 consensus_queue.cc:260] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:17.269676 12386 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:17:17.299441 11626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.002s	sys 0.017s
W20260709 12:17:17.299945 11626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.002s	sys 0.017s
I20260709 12:17:17.173456 13206 consensus_queue.cc:237] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:17.277413 13492 consensus_queue.cc:1059] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:17:17.261878 13439 raft_consensus.cc:2804] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:17.262851 13621 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:17.311257 11652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.062s	sys 0.090s
I20260709 12:17:17.301857 13596 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:17.228444 13611 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:17.342070 11652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.062s	sys 0.090s
I20260709 12:17:17.305253 13537 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:17.344525 13629 log.cc:927] Time spent T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:17:17.345288 13621 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:17.357007 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:17.392143 11661 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:17.349606 11728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36424 (request call id 237) took 1062 ms. Trace:
W20260709 12:17:17.396027 13341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.010s	sys 0.013s
I20260709 12:17:17.350978 13436 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:17.354949 13329 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.008s	sys 0.013s
I20260709 12:17:17.343690 13596 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:17.308812 13035 consensus_queue.cc:260] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:17.353083 13439 raft_consensus.cc:697] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
W20260709 12:17:17.399773 11624 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.015s	sys 0.026s
W20260709 12:17:17.404027 11624 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.015s	sys 0.026s
W20260709 12:17:17.404414 11729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.008s	sys 0.033s
W20260709 12:17:17.401722 13341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.010s	sys 0.013s
W20260709 12:17:17.398058 13487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.006s	sys 0.032s
I20260709 12:17:17.409373 11656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 856) took 1601 ms. Trace:
W20260709 12:17:17.404443 13329 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.008s	sys 0.013s
I20260709 12:17:17.411795 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:17.412736 11661 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:17.409960 11656 rpcz_store.cc:276] 0709 12:17:15.808022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.811418 (+  3396us) service_pool.cc:224] Handling call
0709 12:17:15.848699 (+ 37281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:15.932227 (+ 83528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:15.933887 (+  1660us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:15.935885 (+  1998us) log.cc:844] Serialized 26 byte log entry
0709 12:17:16.243446 (+307561us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b1800396fa0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa940e07 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b 00007f44fd5ead23 00007f44fd5eb0d1 00007f44fda06a0f
0709 12:17:16.724014 (+480568us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:16.751018 (+ 27004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.754781 (+  3763us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.406826 (+652045us) raft_consensus.cc:1685] finished
0709 12:17:17.406848 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.409304 (+  2456us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":332,"raft.queue_time_us":18539,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3210,"spinlock_wait_cycles":31205760,"thread_start_us":344390,"threads_started":1,"wal-append.queue_time_us":1297502}
I20260709 12:17:17.403383 13596 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.421468 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:17.406616 13326 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.007s	sys 0.019s
I20260709 12:17:17.424986 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:17.394992 11728 rpcz_store.cc:276] 0709 12:17:16.287202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.293214 (+  6012us) service_pool.cc:224] Handling call
0709 12:17:17.349365 (+1056151us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b540015d454. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:17.349541 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993874688}
W20260709 12:17:17.408846 11729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.009s	sys 0.034s
W20260709 12:17:17.411343 13487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.006s	sys 0.033s
W20260709 12:17:17.454766 12430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.005s	sys 0.020s
W20260709 12:17:17.455291 12430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.006s	sys 0.020s
I20260709 12:17:17.455653 11658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34104 (request call id 307) took 1009 ms. Trace:
I20260709 12:17:17.456080 11658 rpcz_store.cc:276] 0709 12:17:16.445987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.481895 (+ 35908us) service_pool.cc:224] Handling call
0709 12:17:17.455435 (+973540us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b5400263254. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:17.455593 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550020992}
I20260709 12:17:17.460414 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:17.461249 11656 raft_consensus.cc:2393] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:17.427387 13035 raft_consensus.cc:3060] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:17.467602 13634 log.cc:927] Time spent T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:17:17.424861 13329 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:17.425176 13326 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.007s	sys 0.020s
W20260709 12:17:17.474943 11625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.016s	sys 0.016s
W20260709 12:17:17.477942 11625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.016s	sys 0.016s
W20260709 12:17:17.478334 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 699791us
W20260709 12:17:17.457433 11800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.014s	sys 0.027s
I20260709 12:17:17.431602 11624 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:17.491117 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 59597us
I20260709 12:17:17.474833 13487 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.474319 13436 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
W20260709 12:17:17.500363 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 336768us
I20260709 12:17:17.473477 13498 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:17.485365 11800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.014s	sys 0.027s
W20260709 12:17:17.489916 13641 log.cc:927] Time spent T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 12:17:17.500864 11627 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.012s	sys 0.018s
W20260709 12:17:17.507659 11627 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.012s	sys 0.018s
W20260709 12:17:17.477074 13371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.000s	sys 0.031s
W20260709 12:17:17.495777 11773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.018s	sys 0.021s
I20260709 12:17:17.481719 13329 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:17.497372 13611 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:17.516377 11773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.019s	sys 0.022s
W20260709 12:17:17.530242 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 886423us
I20260709 12:17:17.478219 13439 consensus_queue.cc:237] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:17.532459 11773 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:17.531239 13517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.013s	sys 0.006s
W20260709 12:17:17.616614 13517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.014s	sys 0.006s
W20260709 12:17:17.515981 13371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.000s	sys 0.032s
W20260709 12:17:17.628389 11700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.021s	sys 0.020s
W20260709 12:17:17.628901 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 96541.5us
W20260709 12:17:17.517215 13342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.007s	sys 0.030s
W20260709 12:17:17.630069 11700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.021s	sys 0.020s
I20260709 12:17:17.501367 13487 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:17.502655 13436 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:17.533587 13148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.004s	sys 0.017s
I20260709 12:17:17.635340 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:17.515547 13537 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:17.644769 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:17.529641 13400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.011s	sys 0.052s
W20260709 12:17:17.634258 13342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.008s	sys 0.031s
I20260709 12:17:17.630307 13647 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.629994 13371 raft_consensus.cc:697] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:17.633052 13611 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:17.642427 13148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.004s	sys 0.017s
W20260709 12:17:17.661360 13400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.011s	sys 0.052s
W20260709 12:17:17.665258 13638 log.cc:927] Time spent T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:17:17.677580 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:17.660823 13652 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.731792 11807 raft_consensus.cc:1275] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:17.748106 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:17.751425 11808 raft_consensus.cc:2393] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 4: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:17.749305 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:17.751888 11803 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.753381 11807 raft_consensus.cc:1240] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:17.737828 13604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.046s	sys 0.071s
I20260709 12:17:17.759550 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a49e8e4114f8baf86d7c29f4635d5" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:17.766714 12387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.014s	sys 0.009s
W20260709 12:17:17.768183 12387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.014s	sys 0.009s
W20260709 12:17:17.751884 13425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.058s	sys 0.099s
W20260709 12:17:17.756392 13639 log.cc:927] Time spent T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 12:17:17.769964 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 1.01235e+06us
W20260709 12:17:17.758773 13604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.046s	sys 0.071s
W20260709 12:17:17.770586 13425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.058s	sys 0.099s
I20260709 12:17:17.785924 12387 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:17.754724 13400 raft_consensus.cc:493] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:17.791543 12387 leader_election.cc:304] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:17.671423 13647 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:17.786924 13642 log.cc:927] Time spent T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 12:17:17.771226 13611 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:17.788529 13218 consensus_meta.cc:287] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc: Time spent flushing consensus metadata: real 1.056s	user 0.019s	sys 0.003s
I20260709 12:17:17.791543 13400 raft_consensus.cc:515] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:17.796150 13660 raft_consensus.cc:2749] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:17.805050 13609 consensus_meta.cc:287] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef: Time spent flushing consensus metadata: real 0.657s	user 0.005s	sys 0.005s
I20260709 12:17:17.812620 13647 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:17.817746 13400 leader_election.cc:290] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:17.797668 13611 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:17.809652 13645 log.cc:927] Time spent T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 12:17:17.821494 13611 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:17.822626 13436 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:17.823668 13487 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:17.788925 13371 consensus_queue.cc:237] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:17.825098 13596 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:17.805617 13609 raft_consensus.cc:2749] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.827369 13596 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:17.824354 13489 consensus_meta.cc:287] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Time spent flushing consensus metadata: real 0.999s	user 0.008s	sys 0.003s
I20260709 12:17:17.828610 13489 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:17.828871 13396 raft_consensus.cc:3055] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:17.830998 13396 raft_consensus.cc:740] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:17.831888 13396 consensus_queue.cc:260] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:17.833083 13396 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:17.833611 13643 log.cc:927] Time spent T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.317s	user 0.001s	sys 0.001s
I20260709 12:17:17.834830 13411 raft_consensus.cc:3055] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:17.835297 13411 raft_consensus.cc:740] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:17.836256 13411 consensus_queue.cc:260] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:17.837392 13411 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:17.830720 13489 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:17.842481 13656 log.cc:927] Time spent T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:17:17.830755 13522 raft_consensus.cc:3055] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:17.854739 13522 raft_consensus.cc:740] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:17.855767 13522 consensus_queue.cc:260] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:17.857169 13522 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.892684 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:17.894981 11652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34104 (request call id 316) took 1393 ms. Trace:
I20260709 12:17:17.898785 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:17.776132 11803 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
W20260709 12:17:17.905203 11657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.006s	sys 0.013s
W20260709 12:17:17.912276 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 120675us
W20260709 12:17:17.912843 11657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.007s	sys 0.013s
I20260709 12:17:17.914471 11657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34104 (request call id 299) took 1516 ms. Trace:
W20260709 12:17:17.897751 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.914947 11657 rpcz_store.cc:276] 0709 12:17:16.398197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.398339 (+   142us) service_pool.cc:224] Handling call
0709 12:17:16.398670 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.398896 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:17.277314 (+878418us) log.cc:844] Serialized 14 byte log entry
0709 12:17:17.913641 (+636327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:17.913789 (+   148us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:17.913982 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.914122 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.914377 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13033,"prepare.queue_time_us":42673,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"thread_start_us":1487075,"threads_started":2,"wal-append.queue_time_us":540633}
W20260709 12:17:17.894997 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:17.917619 11773 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.78.66:39117 timed out after 1.550s (SENT) [suppressed 6 similar messages]
I20260709 12:17:17.925091 12387 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:17.906140 11775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.006s	sys 0.012s
I20260709 12:17:17.906781 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:17.907454 11802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 318) took 1574 ms. Trace:
I20260709 12:17:17.908660 12437 raft_consensus.cc:1240] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:17.911638 11804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.044s	sys 0.053s
I20260709 12:17:17.927177 12438 raft_consensus.cc:1240] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:17.928365 11728 raft_consensus.cc:1240] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:17.929073 13273 raft_consensus.cc:493] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:17.799417 13218 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:17.933004 11698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.014s	sys 0.030s
I20260709 12:17:17.777227 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:17.934904 11732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36424 (request call id 254) took 1319 ms. Trace:
W20260709 12:17:18.028968 11775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.007s	sys 0.012s
I20260709 12:17:17.935302 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:17.936760 11730 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:17.938282 12429 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57354 (request call id 690) took 1711 ms (client timeout 2046 ms). Trace:
I20260709 12:17:17.939603 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:17.942301 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:17.967726 13144 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:17.972115 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:17.974179 13403 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:17.974928 12859 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.978540 11726 raft_consensus.cc:1275] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:17:18.030890 11804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.045s	sys 0.053s
I20260709 12:17:17.895931 11652 rpcz_store.cc:276] 0709 12:17:16.500831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.522990 (+ 22159us) service_pool.cc:224] Handling call
0709 12:17:16.523325 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:16.524563 (+  1238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:16.524591 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:16.543756 (+ 19165us) log.cc:844] Serialized 26 byte log entry
0709 12:17:17.350613 (+806857us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:17.350655 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.350731 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.894134 (+543403us) raft_consensus.cc:1685] finished
0709 12:17:17.894231 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.894644 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4573,"thread_start_us":719102,"threads_started":1,"wal-append.queue_time_us":1027653}
I20260709 12:17:17.986692 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:18.032989 11698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.016s	sys 0.032s
I20260709 12:17:18.042619 13273 raft_consensus.cc:515] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:18.029937 12429 rpcz_store.cc:269] 0709 12:17:16.226969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.227121 (+   152us) service_pool.cc:224] Handling call
0709 12:17:17.937751 (+1710630us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540000b9d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:17.938026 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3430873984}
W20260709 12:17:18.040187 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 772354us
I20260709 12:17:18.057427 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:18.056321 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 138935us
W20260709 12:17:18.066299 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 141496us
I20260709 12:17:18.067427 11735 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.069957 12859 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:18.069435 12387 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:18.073740 11729 raft_consensus.cc:2393] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 3: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:18.074846 13487 raft_consensus.cc:493] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:18.075336 12859 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:18.075974 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.077059 13489 raft_consensus.cc:2749] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:18.078383 13672 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:18.078569 13320 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:18.079591 13672 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:18.079969 13320 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.081045 13218 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:18.082365 13540 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:18.083407 13540 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:18.072134 11733 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:17.810474 13329 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:18.029307 11732 rpcz_store.cc:276] 0709 12:17:16.582482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.582619 (+   137us) service_pool.cc:224] Handling call
0709 12:17:16.583002 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:16.591777 (+  8775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:16.591811 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:16.592294 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:17:17.262482 (+670188us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:17.262521 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.262587 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.901322 (+638735us) raft_consensus.cc:1685] finished
0709 12:17:17.901381 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.901792 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64644,"raft.queue_time_us":20860,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6009,"thread_start_us":619342,"threads_started":1,"wal-append.queue_time_us":881038}
I20260709 12:17:18.116092 11656 raft_consensus.cc:1275] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:18.098253 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.109402 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.070076 13652 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:18.111285 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:17:18.103686 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 998143us
I20260709 12:17:18.109830 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.120436 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.125934 11654 raft_consensus.cc:2393] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:18.086323 11775 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.114523 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.096597 13540 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:18.014067 11802 rpcz_store.cc:276] 0709 12:17:16.333249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.336013 (+  2764us) service_pool.cc:224] Handling call
0709 12:17:16.445726 (+109713us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b5800202b98. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa926b71 00007f44fa926a22 00007f450383f8d9 00007f4502999ee0 00007f4502a630ab 00007f4502a63131 00007f4502a24fc0 00007f4502a0f929 00007f4502a0f3d2 00007f44fbf86bd4
0709 12:17:16.445967 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:16.446336 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:16.446370 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:16.446852 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:17:17.146850 (+699998us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:17.146893 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.146961 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.906769 (+759808us) raft_consensus.cc:1685] finished
0709 12:17:17.906809 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.907194 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":116184320,"thread_start_us":699701,"threads_started":1,"wal-append.queue_time_us":952984}
I20260709 12:17:18.130267 13540 consensus_queue.cc:1048] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:18.131137 13436 consensus_queue.cc:1059] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:18.086170 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.132045 13436 consensus_queue.cc:1243] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer 264376c764c64dc78c4cef6031c15eef log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:18.132294 11728 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:18.129842 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:18.102065 12430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.015s	sys 0.024s
W20260709 12:17:18.142838 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.097645 13658 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
W20260709 12:17:18.149176 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 63055.2us
I20260709 12:17:18.150341 11775 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.151484 13611 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:18.151901 13611 raft_consensus.cc:493] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:18.152318 13611 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.154096 13450 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:18.154561 13450 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:18.154939 13450 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.155900 13199 raft_consensus.cc:3055] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:18.156353 13199 raft_consensus.cc:740] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:18.146421 13218 raft_consensus.cc:2749] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:18.158620 13487 raft_consensus.cc:515] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:18.161089 13487 leader_election.cc:290] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:18.171449 13218 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:18.172256 13218 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:18.103494 11482 catalog_manager.cc:5697] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 4 to 5, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 5 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:18.174265 13273 leader_election.cc:290] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:18.174718 11661 raft_consensus.cc:2410] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:17:18.175583 13341 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:18.176173 13341 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:18.147878 12430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.017s	sys 0.026s
I20260709 12:17:18.094399 13403 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:18.182508 13205 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.183355 13205 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.157698 13199 consensus_queue.cc:260] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:18.186764 13206 consensus_queue.cc:1048] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:18.190434 13199 raft_consensus.cc:3060] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.190197 13658 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:18.122282 13652 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:18.179196 11656 raft_consensus.cc:2468] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:18.135586 13320 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:18.195013 11735 raft_consensus.cc:2468] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:18.113920 13144 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:18.207098 13218 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:18.210064 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:18.211411 13163 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:18.212280 11800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51068 (request call id 325) took 1475 ms. Trace:
W20260709 12:17:18.212584 13678 log.cc:927] Time spent T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.124s	user 0.002s	sys 0.002s
I20260709 12:17:18.213728 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:18.213956 13672 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:18.214550 12437 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
W20260709 12:17:18.215067 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 72071.7us
I20260709 12:17:18.216849 11482 catalog_manager.cc:5697] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 4 to 5, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 5 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:18.219234 11484 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42134 (request call id 151) took 8410 ms. Trace:
I20260709 12:17:18.208317 13403 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:18.217298 11802 raft_consensus.cc:1240] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:18.216322 13652 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:18.216504 11800 rpcz_store.cc:276] 0709 12:17:16.737245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.737396 (+   151us) service_pool.cc:224] Handling call
0709 12:17:16.737782 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:16.738136 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:16.738172 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:16.738832 (+   660us) log.cc:844] Serialized 52 byte log entry
0709 12:17:17.507240 (+768408us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:17.844615 (+337375us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fd5e686e 00007f44fd5e5bb6 00007f44fd5e57d8 00007f44fd5ef221 00007f44fd5ef1d9 00007f44fd5ef169
0709 12:17:18.154868 (+310253us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b180021fa60. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f4503826ab1 00007f4503833281 00007f44fa95e3f3 00007f44fa9607c1 00007f44fa960779 00007f44fa960709 00007f44fa9606d1 00007f44fa95f9cd 0000000000388634 0000000000388479 00007f44fa94183a
0709 12:17:18.177405 (+ 22537us) log.cc:844] Serialized 14 byte log entry
0709 12:17:18.211709 (+ 34304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.211824 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:18.211884 (+    60us) raft_consensus.cc:1685] finished
0709 12:17:18.211903 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:18.212083 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":570720,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":4722,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":10451712,"thread_start_us":1199964,"threads_started":2,"wal-append.queue_time_us":1032575}
I20260709 12:17:18.231858 13205 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:18.233987 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.219561 11482 catalog_manager.cc:5697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 5 to 6, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 6 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:18.222844 11625 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
W20260709 12:17:18.222296 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 153051us
I20260709 12:17:18.230633 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.238695 12387 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:18.236725 11625 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:18.239481 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.243402  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:17:18.245254 13672 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:18.216303 13144 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:18.245880 11700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.266981 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.267685 11729 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:18.242126 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.250128 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:18.251317 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:18.269237 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54188b47043494b8e7d633bcfbcab11" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.269793 11803 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
W20260709 12:17:18.253805 13035 consensus_meta.cc:287] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03: Time spent flushing consensus metadata: real 0.778s	user 0.007s	sys 0.020s
I20260709 12:17:18.254065 13342 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:18.255353 13341 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:18.222740 13658 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:18.258230 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.262316 11727 raft_consensus.cc:1240] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:18.271680 13342 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:18.272220 13342 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.273789 11658 raft_consensus.cc:2410] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:18.235549 11482 catalog_manager.cc:5697] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 3 to 6, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 6 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:18.275619 11482 catalog_manager.cc:5697] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 2 to 3, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 3 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:18.274077 11657 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
I20260709 12:17:18.263365 11730 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
W20260709 12:17:18.278725 11730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36424 (request call id 259) took 1648 ms (client timeout 1763 ms). Trace:
I20260709 12:17:18.279181 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:18.279155 11730 rpcz_store.cc:269] 0709 12:17:16.630441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.655041 (+ 24600us) service_pool.cc:224] Handling call
0709 12:17:17.935963 (+1280922us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b58004b71d0. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fd9a70aa 00007f44fda29447 00007f44fda41fe7 00007f44fda437de 00007f44fda4f27c 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c
0709 12:17:18.278498 (+342535us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b5400072954. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:18.278640 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1930153600}
I20260709 12:17:18.280146 11804 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
I20260709 12:17:18.282248 11804 raft_consensus.cc:1275] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:18.282882 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.285965 11482 catalog_manager.cc:5697] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 2 to 5, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 5 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:18.288223 13342 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:18.290298 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:18.327545 11734 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:18.293797 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.294337 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:18.295964 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.296777 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.331350 11652 raft_consensus.cc:1275] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:18.332132 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:18.332907 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.333137 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.334077 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:18.335194 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:18.335438 13450 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:18.338125 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.338559 13403 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:18.338963 11653 raft_consensus.cc:2393] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:18.339197 13403 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.340051 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:18.339936 13611 raft_consensus.cc:515] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:18.298739 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.300361 11698 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.308724 13672 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:18.314126 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 110096us
I20260709 12:17:18.314284 11804 raft_consensus.cc:1240] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:18.219769 11484 rpcz_store.cc:276] 0709 12:17:09.808784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.814359 (+  5575us) service_pool.cc:224] Handling call
0709 12:17:18.218961 (+8404602us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:14.058231 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:14.062198 (+  3967us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:14.062250 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:17:14.062269 (+    19us) tablet.cc:662] Decoding operations
0709 12:17:14.063571 (+  1302us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:14.063677 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:14.063702 (+    25us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:17:14.064939 (+  1237us) tablet.cc:701] Row locks acquired
0709 12:17:14.065141 (+   202us) write_op.cc:260] PREPARE: finished
0709 12:17:14.065308 (+   167us) write_op.cc:270] Start()
0709 12:17:14.065452 (+   144us) write_op.cc:276] Timestamp: P: 1783599434065242 usec, L: 0
0709 12:17:14.065486 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:17:14.066307 (+   821us) log.cc:844] Serialized 5883 byte log entry
0709 12:17:14.807632 (+741325us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b4400022b4c. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fa7e6db1 00007f44fa884c85 00007f44fa8856a2 00007f44fd5f71db 00007f44fd5f2aaf 00007f44fa9410ac 00007f450379b9a9 00007f44fa95d69b 00007f44fa95b93f 00007f44fa95dc02 00007f44fd5e520b
0709 12:17:15.523464 (+715832us) op_driver.cc:464] REPLICATION: finished
0709 12:17:15.748664 (+225200us) write_op.cc:301] APPLY: starting
0709 12:17:15.780696 (+ 32032us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:15.865988 (+ 85292us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:15.866042 (+    54us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:15.867808 (+  1766us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:15.868157 (+   349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:17:15.868211 (+    54us) write_op.cc:312] APPLY: finished
0709 12:17:15.868632 (+   421us) log.cc:844] Serialized 106 byte log entry
0709 12:17:15.868816 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:15.868969 (+   153us) write_op.cc:454] Released schema lock
0709 12:17:15.869030 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:15.869430 (+   400us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:15.869460 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5232,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":161341,"apply.run_cpu_time_us":4225,"apply.run_wall_time_us":156041,"num_ops":15,"prepare.queue_time_us":75034,"prepare.run_cpu_time_us":59202,"prepare.run_wall_time_us":990218,"raft.queue_time_us":232244,"raft.run_cpu_time_us":24137,"raft.run_wall_time_us":108174,"replication_time_us":1457818,"spinlock_wait_cycles":15296384,"thread_start_us":1272474,"threads_started":4,"wal-append.queue_time_us":893954,"wal-append.run_cpu_time_us":38050,"wal-append.run_wall_time_us":1927220}]]}
I20260709 12:17:18.316388 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:17:18.318475 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 79903.9us
I20260709 12:17:18.318934 13400 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:18.319312 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 82761.3us
I20260709 12:17:18.319932 13144 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.346395 13144 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.322064 13371 raft_consensus.cc:2749] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:18.323117 13498 raft_consensus.cc:2749] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:18.321651 11775 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.323091 12430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57338 (request call id 900) took 1493 ms. Trace:
I20260709 12:17:18.330399 11805 raft_consensus.cc:1240] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:18.330264 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:18.330650 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:18.318485 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:18.345337 13439 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:18.344370 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 44116.5us
I20260709 12:17:18.347996 13144 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.348461 11625 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:18.337598 13450 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:18.355891 11809 raft_consensus.cc:2393] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 6: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:18.352794 11698 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.348052 13400 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.361887 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.363639 11803 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.364003 12859 consensus_queue.cc:1048] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.362799  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:18.352524 13439 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.369992 12429 raft_consensus.cc:1275] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:18.367110 12387 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:18.372884 12428 raft_consensus.cc:1275] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:18.365971 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:18.369133 13205 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:18.374056 13205 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.374691 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:18.375887 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:18.376698 12436 raft_consensus.cc:2393] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 6: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:18.377032 13281 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:18.377532 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:18.378034 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:18.378234 13681 consensus_queue.cc:1059] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:18.377534 13281 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:18.349699 12430 rpcz_store.cc:276] 0709 12:17:16.829955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.830080 (+   125us) service_pool.cc:224] Handling call
0709 12:17:16.830367 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.830574 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:17.466965 (+636391us) log.cc:844] Serialized 14 byte log entry
0709 12:17:18.255249 (+788284us) log.cc:844] Serialized 14 byte log entry
0709 12:17:18.322590 (+ 67341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:18.322661 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:18.322764 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.322882 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:18.323026 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67063,"prepare.queue_time_us":926144,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":2027,"raft.queue_time_us":70230,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":4780,"thread_start_us":1335528,"threads_started":2,"wal-append.queue_time_us":627510}
I20260709 12:17:18.380039 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.380972 11655 raft_consensus.cc:2410] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:17:18.381278 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.382244 13400 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:18.385192 13341 consensus_queue.cc:1059] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.386082 13341 consensus_queue.cc:1243] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer 264376c764c64dc78c4cef6031c15eef log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:18.386296 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:18.386660 13341 raft_consensus.cc:3055] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:18.370735 13439 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.385536 13672 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:18.387145 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.377537 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:18.379568 13281 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:18.394143 11729 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:18.395496 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:18.395972 13218 consensus_queue.cc:1059] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:18.397110 13206 raft_consensus.cc:3055] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:18.397553 13206 raft_consensus.cc:740] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:18.387069 13341 raft_consensus.cc:740] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:18.400221 12432 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:18.364180 13403 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:18.405390 11773 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.396257 11730 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:18.406363 12436 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.388965 11657 raft_consensus.cc:2468] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
I20260709 12:17:18.401508 11735 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:18.407264 11625 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:18.392757 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.401276 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:18.405052 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ff7b5bd9f340839cbde90d6b7259c7" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:18.391026 13035 raft_consensus.cc:2804] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:18.397122 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:18.370344 13611 leader_election.cc:290] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:18.409261 11734 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 9.
I20260709 12:17:18.416503 11809 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:18.406411 13320 raft_consensus.cc:2804] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.422405 11807 raft_consensus.cc:1275] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:17:18.421864 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 64351us
I20260709 12:17:18.405647 13205 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:18.420423 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:18.424337 13342 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:18.413446 13498 raft_consensus.cc:2749] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:18.425016 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.450143 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:18.450194 13498 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:18.418251 13658 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:18.452822 13658 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:18.453233 13658 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:18.453588 13498 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.454175 13498 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:18.426101 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:18.456423 11653 raft_consensus.cc:2393] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:18.427126 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.425326  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:18.420228 13672 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:18.429149 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.409063 13400 raft_consensus.cc:3055] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:18.432219 13035 raft_consensus.cc:697] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:18.460348 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:18.459824 13672 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:18.460680 13035 consensus_queue.cc:237] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:18.422767 13320 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:18.462020 13320 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.434619 12387 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:18.463267 12387 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:18.464715 12387 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:18.466739 12387 leader_election.cc:304] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:18.451300 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.456283 13206 consensus_queue.cc:260] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.428144 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.401016 13341 consensus_queue.cc:260] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:18.465247 13400 raft_consensus.cc:740] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:18.423302 11625 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:18.467820 11809 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
I20260709 12:17:18.461264 13672 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.474145 11701 leader_election.cc:304] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:18.477427 13400 consensus_queue.cc:260] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:18.467837 12859 consensus_queue.cc:1048] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:18.467772 11656 raft_consensus.cc:2468] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:18.469734 11698 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.473095 13403 consensus_queue.cc:1048] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:18.479382 11803 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:18.478152 13425 raft_consensus.cc:2749] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.472819 11652 raft_consensus.cc:2410] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:17:18.476600 13685 log.cc:927] Time spent T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:17:18.483255 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 60047us
I20260709 12:17:18.482770 11775 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.456303 13498 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:18.488986 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.491930 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:18.494199 13206 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.494403 13450 raft_consensus.cc:2804] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.494870 13450 raft_consensus.cc:493] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.495219 13450 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.489988 11773 leader_election.cc:304] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:18.497859 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.497977 13671 raft_consensus.cc:2749] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.500545 13425 raft_consensus.cc:2804] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:18.500980 13425 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:18.501304 13425 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.502440 11655 raft_consensus.cc:1275] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:18.488406 13342 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:18.506055 13342 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
W20260709 12:17:18.506218 11700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.506623 13498 raft_consensus.cc:2804] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.507067 13498 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.507375 13498 raft_consensus.cc:3060] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.509720 13342 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:18.512887 13144 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:18.519307 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:18.527658 11661 raft_consensus.cc:2393] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 5: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:18.538213 12436 raft_consensus.cc:2468] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:18.480053 13281 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:18.535027 13400 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.538568 13371 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:18.553187 11734 raft_consensus.cc:1240] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:18.563855 11660 raft_consensus.cc:1275] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:18.556593 13341 raft_consensus.cc:3060] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.548286 13342 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:18.572031 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 73973.5us
I20260709 12:17:18.561699 13489 raft_consensus.cc:2749] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.578977 11773 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:18.554957 13439 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:18.585877 13688 log.cc:927] Time spent T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:17:18.570521 13371 consensus_queue.cc:1048] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:17:18.600818 11773 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:18.605116 13691 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.605711 13691 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:18.607899 13691 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:18.610074 13411 raft_consensus.cc:2749] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:18.613372 13671 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:18.614223 13671 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:18.614713 13342 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:18.599551 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:18.635496 11732 raft_consensus.cc:2393] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:18.650553 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:18.651225 11729 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:18.654446 13436 consensus_queue.cc:1059] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:18.655507 13436 raft_consensus.cc:3055] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:18.655889 13436 raft_consensus.cc:740] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:18.656715 13436 consensus_queue.cc:260] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:18.585644 13425 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.659857 13425 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:18.661569 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:18.662252 11803 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.668332 13281 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:18.670053 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:18.670727 11802 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:18.671420 13450 raft_consensus.cc:515] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:18.693059 13439 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:18.653149 13144 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:18.698082 13436 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:18.673522 13450 leader_election.cc:290] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:18.655393 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 71315.4us
I20260709 12:17:18.704885 11803 raft_consensus.cc:2468] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
I20260709 12:17:18.697621 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:18.706137 11775 leader_election.cc:304] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.706291 11698 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.707909 12386 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:17:18.705796 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 128121us
I20260709 12:17:18.715793 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:18.716501 12436 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:18.721939 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:18.720121 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.689405 13658 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:18.717432 13206 raft_consensus.cc:2804] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:18.726269 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:18.718430 13450 raft_consensus.cc:2804] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:18.737869 13682 consensus_queue.cc:1048] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:17:18.720525 13371 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.738880 13694 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:18.740733 13206 raft_consensus.cc:697] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:18.754400 12437 raft_consensus.cc:1275] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:18.758185 12386 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.763154 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.764024 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.762858 13371 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:18.765901 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:18.767223 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 46347.4us
I20260709 12:17:18.761894 13694 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.764344 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.771008 11661 raft_consensus.cc:2368] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:18.772109 13694 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:18.780730 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.781723 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.782486 11653 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:18.783459 13707 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:18.784083 13707 raft_consensus.cc:697] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:18.784583 13652 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:18.787151 13652 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:18.798535 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.769424 13411 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.800567 13411 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:18.801349 13183 consensus_queue.cc:1048] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:18.801548 13694 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.803437 13652 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:18.805365 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.764988 13450 raft_consensus.cc:697] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:18.807412 13694 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:18.807962 13450 consensus_queue.cc:237] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:18.812052 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:18.814692 11658 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 8.
W20260709 12:17:18.815647 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 216165us
I20260709 12:17:18.816589 12436 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:18.764067 13206 consensus_queue.cc:237] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.820871 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.821735 11654 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
I20260709 12:17:18.803048 13411 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:18.823534 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:18.824128 11809 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:18.755075 13320 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:18.830124 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:18.830719 12435 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.831280 11807 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
W20260709 12:17:18.832955 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 366305us
I20260709 12:17:18.838999 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:18.843585 11802 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 8.
I20260709 12:17:18.847939 12435 raft_consensus.cc:2468] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:18.857653 11655 raft_consensus.cc:2410] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:18.835094 11699 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:18.851248 13658 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:18.838570 12386 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.859920 11729 raft_consensus.cc:2468] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
I20260709 12:17:18.859512 11698 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.871862 11775 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.785192 13707 consensus_queue.cc:237] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.875275 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.877063 11775 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.883193 13498 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:18.884106 13701 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:18.884514 13701 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.884857 13701 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:18.885401 13498 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:18.886444 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.887503 11624 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:18.888945 11624 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:18.889720 13436 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.890115 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:18.890450 13436 raft_consensus.cc:2749] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.881191 13671 raft_consensus.cc:2804] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:18.897059 13671 raft_consensus.cc:697] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:18.898132 13671 consensus_queue.cc:237] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:18.902571 13371 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:18.903909 13281 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:18.911182 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:18.914256 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:18.918401 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.889989 13320 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:18.937263 11807 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
W20260709 12:17:18.940392 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 58110.2us
I20260709 12:17:18.952118 11809 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 7.
I20260709 12:17:18.941603 12386 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.918509 13281 raft_consensus.cc:697] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 8 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:18.880105 13672 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:18.960614 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.957437 12386 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:18.947125 13403 raft_consensus.cc:2749] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.978704 11659 raft_consensus.cc:2410] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:17:18.979692 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:18.980266 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 215105us
I20260709 12:17:18.970561 13371 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:18.992991 13371 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.993436 13371 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.975816 13498 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:18.994475 13498 raft_consensus.cc:697] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 7 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:18.995543 13498 consensus_queue.cc:237] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.998713 11773 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:19.000108 11773 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:19.005730 13611 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:19.006347 13611 raft_consensus.cc:697] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 9 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:19.007462 13611 consensus_queue.cc:237] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:18.985072 11800 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.019697 11624 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.021860 11624 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:19.026028 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 69216.1us
I20260709 12:17:19.028662 12387 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:19.029520 13678 log.cc:927] Time spent T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:19.025421 13672 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:18.990180 13281 consensus_queue.cc:237] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:18.985281 13706 raft_consensus.cc:2804] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:19.044914 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:19.043025 13652 raft_consensus.cc:2749] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:19.065061 13703 raft_consensus.cc:2749] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:19.068329 12387 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.037334 13701 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:19.045444 13144 consensus_queue.cc:1048] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:17:19.050789 13658 raft_consensus.cc:2749] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:19.051090 13706 raft_consensus.cc:697] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
W20260709 12:17:19.088671 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 66783.1us
W20260709 12:17:19.093958 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 121315us
I20260709 12:17:19.099994 13700 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:19.109196 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:19.109485 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:19.122617 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:19.122996 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 119946us
I20260709 12:17:19.126247 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:19.127697 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:19.123770 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:19.130896 11624 leader_election.cc:304] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.134131 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:19.136969 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.090318 13706 consensus_queue.cc:237] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:19.160728 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:19.161530 12436 raft_consensus.cc:2368] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4.
I20260709 12:17:19.163239 11805 raft_consensus.cc:1240] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:19.143342 13342 raft_consensus.cc:2749] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:19.171880 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:19.141783 13144 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.182816 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:19.185421 11803 raft_consensus.cc:1275] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:19.194613 12436 raft_consensus.cc:2393] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 5: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:19.172317 13707 raft_consensus.cc:2764] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 7 LEADER]: Leader election decision vote started in defunct term 6: won
I20260709 12:17:19.202014 12432 raft_consensus.cc:1240] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:19.202746 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 90043.7us
I20260709 12:17:19.204335 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f44d8dd328e49b0b41e9345b6c2fb85" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:19.213841 12436 raft_consensus.cc:1240] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:19.215976 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 192394us
I20260709 12:17:19.217434 11807 raft_consensus.cc:1240] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:19.208016 13700 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:19.209329 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:19.198496 13144 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:19.239114 12436 raft_consensus.cc:1240] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:19.225564 13700 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:19.255033 11801 raft_consensus.cc:1240] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:19.259012 13144 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:19.265856 13718 log.cc:927] Time spent T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 12:17:19.268424 13714 log.cc:927] Time spent T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:17:19.269140 12430 raft_consensus.cc:1240] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:19.270056 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 57878.5us
I20260709 12:17:19.270964 11624 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.273726 13144 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:19.274679 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:19.280669 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:19.281428 11732 raft_consensus.cc:2368] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:19.242157 11802 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:19.289649 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:19.289989 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:19.290517 12435 raft_consensus.cc:1240] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:19.290947 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:19.291656 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:19.291839 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:19.292240 12432 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
I20260709 12:17:19.292665 12437 raft_consensus.cc:1275] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:19.292933 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:19.293287 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:19.294304 12435 raft_consensus.cc:1275] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:19.294407 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:19.291181 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:19.295030 13371 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:19.295049 12432 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:19.297185 13371 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:19.297967 13726 log.cc:927] Time spent T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:17:19.300868 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:19.307741 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:19.308362 11803 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:19.293478 12387 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:19.311419 12436 raft_consensus.cc:1240] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:19.313028 11699 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:19.350812 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:19.353263 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 111371us
I20260709 12:17:19.351629 11773 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:19.349980 11800 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:19.379528 13713 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:19.380193 13713 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:19.320462 13320 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:19.373571 11699 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:19.392940 11803 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
W20260709 12:17:19.374607 13721 log.cc:927] Time spent T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 12:17:19.370543 13716 log.cc:927] Time spent T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:19.370424 13729 raft_consensus.cc:2749] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:19.401342 11773 leader_election.cc:400] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:19.402912 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:19.378460 13400 raft_consensus.cc:2804] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:19.404969 12386 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:19.389915 13450 raft_consensus.cc:2749] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:19.408615 11657 raft_consensus.cc:2393] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 5: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
W20260709 12:17:19.410109 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 116728us
I20260709 12:17:19.408125 11773 leader_election.cc:403] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:19.412678 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:19.413539 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:19.414194 11660 raft_consensus.cc:2468] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:19.416793 11773 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:19.417078 11800 raft_consensus.cc:1275] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:19.417070 13742 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:19.418627 13742 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.419858 11773 leader_election.cc:400] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117) with higher term. Message: Invalid argument: T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:19.422832 11773 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:19.424008 11773 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:19.425210 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:19.426014 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:19.426743 12436 raft_consensus.cc:2393] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 6: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:19.427139 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d2242d216849e096e87b165c9d6778" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:19.427654 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6924fe8aeff4ed699be088221835654" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:19.427999 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b741f1d144afab8c37ecc3be587b1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:19.428201 11655 raft_consensus.cc:2376] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7. Re-sending same reply.
I20260709 12:17:19.428507 11661 raft_consensus.cc:3060] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.403564 13371 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.430341 11654 raft_consensus.cc:1275] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:17:19.430696 11654 pending_rounds.cc:85] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03: Aborting all ops after (but not including) 2
I20260709 12:17:19.374274 13206 consensus_queue.cc:1048] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:17:19.435611 12436 raft_consensus.cc:1275] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:19.407382 13403 raft_consensus.cc:2749] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:19.433907 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 82512.9us
I20260709 12:17:19.434782 11624 leader_election.cc:304] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.440428 11624 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.441062 13341 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:19.441570 13341 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:19.442126 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:19.442893 11660 raft_consensus.cc:2368] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:19.430892 11654 pending_rounds.cc:107] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:17:19.444263 11654 raft_consensus.cc:2889] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:19.414906 13400 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:19.434396 11699 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.437500 13742 raft_consensus.cc:2749] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.453732 13498 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:19.462644 11658 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 8.
I20260709 12:17:19.471786 11624 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.436129 13671 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:19.408093 13320 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:19.429280 13371 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:19.468173 13400 raft_consensus.cc:3060] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:19.477613 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 53713.5us
I20260709 12:17:19.479487 13696 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:19.491230 13696 raft_consensus.cc:697] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:19.468540 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:19.492121 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 57800.9us
I20260709 12:17:19.492652 11653 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 8.
I20260709 12:17:19.492182 13696 consensus_queue.cc:237] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:19.494684 11699 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.495844 13722 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:19.496156 11661 raft_consensus.cc:2468] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:19.496668 13342 raft_consensus.cc:2749] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:19.479676 11624 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.437935 13411 consensus_queue.cc:1048] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:17:19.498504 13652 raft_consensus.cc:2749] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:19.499966 11624 leader_election.cc:304] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.459582 13341 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:19.469799 13144 raft_consensus.cc:2749] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:19.482697 13731 log.cc:927] Time spent T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:17:19.478294 13658 raft_consensus.cc:2749] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.475538 13487 consensus_queue.cc:1059] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:17:19.490121 13701 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:19.492415 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.472954 13682 raft_consensus.cc:2749] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:19.546293 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.551803 13144 raft_consensus.cc:3055] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:19.543498 13371 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:19.510008 13652 consensus_queue.cc:1048] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:17:19.475447 13671 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:19.556764 13671 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:19.557116 11802 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 7.
I20260709 12:17:19.558522 13487 consensus_queue.cc:1059] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:19.559629 13487 raft_consensus.cc:3055] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:19.559966 13487 raft_consensus.cc:740] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:19.505728 13742 consensus_queue.cc:1048] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:17:19.561321 11698 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:19.562764 13682 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:19.563234 13682 raft_consensus.cc:697] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:19.564028 13682 consensus_queue.cc:237] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:19.540680 13700 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:19.535487 13320 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:19.569144 12387 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:19.566789 11773 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:19.545974 13341 raft_consensus.cc:2749] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:19.570789 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 98023.2us
W20260709 12:17:19.568454 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 66341us
I20260709 12:17:19.552393 13144 raft_consensus.cc:740] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:19.572892 12386 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:19.554993 11624 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.574031 13144 consensus_queue.cc:260] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:19.578363 13144 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.579125 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:19.579484 12430 raft_consensus.cc:1275] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:19.581108 13320 consensus_queue.cc:1048] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:19.582235 13745 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:19.582767 13745 raft_consensus.cc:697] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 7 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:19.583197 13700 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:19.583647 13745 consensus_queue.cc:237] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:19.584205 13652 raft_consensus.cc:2749] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:19.586825 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:19.590787 11657 raft_consensus.cc:1240] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:19.592602 11661 raft_consensus.cc:1275] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:17:19.593884 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 48320.8us
W20260709 12:17:19.596767 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 66098.8us
I20260709 12:17:19.597540 13701 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:19.598533 13701 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:19.598914 13701 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.591521 13436 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.594560 13206 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.604990 11773 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:19.607825 11699 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:19.595177 13747 raft_consensus.cc:2764] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:17:19.604252 13436 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:19.615546 13436 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:19.608994 13450 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.616231 13436 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:19.612797 12438 raft_consensus.cc:3055] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:19.616748 12438 raft_consensus.cc:740] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:19.617404 13722 raft_consensus.cc:2749] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:19.617915 13425 consensus_queue.cc:1048] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:19.607002 13206 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:19.618177 13722 consensus_queue.cc:1048] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:19.619552 13436 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:19.621117 11699 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:19.620271 13206 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:19.621982 13722 raft_consensus.cc:2804] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:19.622372 13722 raft_consensus.cc:493] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:19.623847 13722 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.617590 12438 consensus_queue.cc:260] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:19.626273 12438 raft_consensus.cc:3060] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:19.608388 13671 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:19.631893 13671 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:19.635371 13436 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:19.640170 11773 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:19.646628 12859 consensus_queue.cc:1048] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:17:19.647432 11803 raft_consensus.cc:1275] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:19.604722 13400 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:19.647781 11625 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:19.670271 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:19.664485 12438 raft_consensus.cc:1275] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:17:19.674508 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 68243.3us
W20260709 12:17:19.683821 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 52346.6us
I20260709 12:17:19.689172 13144 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:19.689838 13144 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:19.690711 12434 raft_consensus.cc:1240] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:19.692080 13144 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:19.692305 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 52245.5us
I20260709 12:17:19.693112 11773 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:19.694375 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 46671us
I20260709 12:17:19.712636 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:19.713371 12436 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
I20260709 12:17:19.719161 11701 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:19.693338 13722 raft_consensus.cc:515] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:19.710963 13706 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.712201 13436 raft_consensus.cc:2804] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:19.733882 13400 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:19.758196 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 65164us
I20260709 12:17:19.759122 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:19.716781 13729 consensus_queue.cc:1059] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:19.720196 13742 raft_consensus.cc:2749] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.723268 13696 consensus_queue.cc:1048] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 12:17:19.768270 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 49198.4us
I20260709 12:17:19.779198 13671 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:19.784250 13671 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:19.779659 13450 raft_consensus.cc:2749] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:19.769150 13436 raft_consensus.cc:697] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:19.787592 13671 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:19.784559 13729 raft_consensus.cc:3055] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:19.788722 13729 raft_consensus.cc:740] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:19.788420 13436 consensus_queue.cc:237] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:19.789702 13729 consensus_queue.cc:260] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:19.778223 13757 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:19.787415 11773 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:19.791153 13757 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.791167 13729 raft_consensus.cc:3060] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:19.792508 13747 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:19.792943 13487 consensus_queue.cc:260] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:19.793988 13487 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:19.794433 13713 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:19.795564 13722 leader_election.cc:290] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:19.797623 11801 raft_consensus.cc:1275] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:17:19.799135 13751 log.cc:927] Time spent T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:17:19.777663 13701 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:19.798842 11773 leader_election.cc:400] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Vote denied by peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117) with higher term. Message: Invalid argument: T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5.
I20260709 12:17:19.801106 11773 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:19.801383 13701 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:19.813920 13403 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:19.816161 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:19.858840 11729 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:19.824703 11627 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.821580 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:19.807595 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:19.815171 13671 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:19.860877 13671 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:19.861330 13671 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:19.829461 11482 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42110 (request call id 150) took 9840 ms. Trace:
I20260709 12:17:19.866353 11729 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
I20260709 12:17:19.820614 13713 consensus_queue.cc:1048] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:19.831692 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:19.800240 13757 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:19.801932 12432 raft_consensus.cc:1240] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:19.833032 13450 consensus_queue.cc:1059] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:19.833441 11735 raft_consensus.cc:1275] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:19.832934 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:19.835942 11658 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:19.827216 13183 consensus_queue.cc:1048] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:19.836751 11807 raft_consensus.cc:1240] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:19.836969 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:19.837919 13411 raft_consensus.cc:476] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 12:17:19.838162 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:19.963593 11802 raft_consensus.cc:2393] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:19.964947 11802 raft_consensus.cc:1240] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:17:19.826726 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 55778.1us
I20260709 12:17:19.966620 13759 consensus_queue.cc:1048] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:17:19.967608 13742 raft_consensus.cc:3055] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:19.968008 13742 raft_consensus.cc:740] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:19.887445 11801 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:19.844225 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:19.968792 13742 consensus_queue.cc:260] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:19.970641 11806 raft_consensus.cc:1240] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:19.970832 13742 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.971859 11806 raft_consensus.cc:1275] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:17:19.845772 11804 raft_consensus.cc:1240] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:19.972450 13707 consensus_queue.cc:1059] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:19.846278 11800 raft_consensus.cc:1240] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:19.973234 13707 raft_consensus.cc:3055] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:19.813866 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:19.857612 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:19.876389 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.878286 12431 raft_consensus.cc:2393] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 6: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:19.886204 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:19.887625 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:19.865948 11482 rpcz_store.cc:276] 0709 12:17:09.989080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.046735 (+ 57655us) service_pool.cc:224] Handling call
0709 12:17:19.829401 (+9782666us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:18.407544 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:18.438788 (+ 31244us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:18.438835 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:17:18.438852 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:18.439707 (+   855us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:18.439793 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:18.439825 (+    32us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:17:18.441854 (+  2029us) tablet.cc:701] Row locks acquired
0709 12:17:18.441903 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:17:18.442068 (+   165us) write_op.cc:270] Start()
0709 12:17:18.442204 (+   136us) write_op.cc:276] Timestamp: P: 1783599438442009 usec, L: 0
0709 12:17:18.442240 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:17:18.442942 (+   702us) log.cc:844] Serialized 3209 byte log entry
0709 12:17:19.065390 (+622448us) op_driver.cc:464] REPLICATION: finished
0709 12:17:19.218729 (+153339us) write_op.cc:301] APPLY: starting
0709 12:17:19.224625 (+  5896us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:19.244819 (+ 20194us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:19.285943 (+ 41124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:19.287040 (+  1097us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:19.287377 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:17:19.287439 (+    62us) write_op.cc:312] APPLY: finished
0709 12:17:19.287765 (+   326us) log.cc:844] Serialized 64 byte log entry
0709 12:17:19.287985 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:19.288125 (+   140us) write_op.cc:454] Released schema lock
0709 12:17:19.288196 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:19.288633 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:19.288661 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1564472,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":132857,"apply.run_cpu_time_us":3459,"apply.run_wall_time_us":79316,"num_ops":8,"prepare.queue_time_us":56998,"prepare.run_cpu_time_us":28142,"prepare.run_wall_time_us":213984,"raft.queue_time_us":359653,"raft.run_cpu_time_us":20757,"raft.run_wall_time_us":86730,"replication_time_us":622981,"thread_start_us":413180,"threads_started":4,"wal-append.queue_time_us":170808}]]}
I20260709 12:17:19.985971 11729 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:19.985653 11809 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:19.979789 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf30a4f63934c8fa1fb80a2aa7df9ee" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:19.946375 11659 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:19.948045 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 58587.7us
I20260709 12:17:19.953508 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:19.947330 11625 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:19.954041 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:19.958299 11483 catalog_manager.cc:5697] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 3 to 4, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 4 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.959589 13757 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:19.962787 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:19.987424 11624 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:19.888900 13745 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.999926 11733 raft_consensus.cc:1275] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:20.002779 11807 raft_consensus.cc:2393] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 6: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:20.002550 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:19.973558 13707 raft_consensus.cc:740] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:20.013696 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
W20260709 12:17:20.015436 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 68182.6us
I20260709 12:17:20.019973 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:20.020671 11734 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.024598 12430 raft_consensus.cc:1275] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:20.025188 11732 raft_consensus.cc:1240] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:20.027510 13144 raft_consensus.cc:2804] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:20.031121 11730 raft_consensus.cc:1240] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:20.032446 13144 raft_consensus.cc:697] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:20.035207 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:20.036213 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:20.037695 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:20.041272  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:19.957566 13671 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:20.039115 11733 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
I20260709 12:17:20.049255 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:20.051843 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:20.052417 11652 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.052140 11728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:20.053292 11728 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:20.054435 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:20.001740 13371 consensus_queue.cc:1048] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:17:20.058876 13757 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:20.024665 13341 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:20.012590 13745 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.060585 11731 raft_consensus.cc:2368] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 6. Current term is 7.
I20260709 12:17:20.061069 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fdac8111fe4c49bccd7e22a650cccc" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:20.033550 13652 consensus_queue.cc:1059] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:17:19.948295 13403 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.062422 13341 raft_consensus.cc:3055] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:20.062892 13341 raft_consensus.cc:740] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:20.063684 13341 consensus_queue.cc:260] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:20.064831 13341 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:20.065644 13671 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:20.068013 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 55923.2us
I20260709 12:17:20.069147 11652 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:20.064126 13403 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:20.071020 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 45350.3us
I20260709 12:17:20.072191 11624 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:20.073829 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:20.073249 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:20.074906 11652 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
W20260709 12:17:20.075344 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.076521 11734 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:20.077832 11734 raft_consensus.cc:1240] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:20.078575 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:20.080422 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:20.080618 11729 raft_consensus.cc:2468] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
I20260709 12:17:20.081094 11661 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:20.083889 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:20.084065 13652 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:20.084434 13652 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.053282 13342 consensus_queue.cc:1059] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:17:20.084556 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:20.085104 13342 consensus_queue.cc:1243] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer cfe9bf206bb14951ba7615683809d178 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:20.085309 11804 raft_consensus.cc:2393] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:20.085605 13342 raft_consensus.cc:3055] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:20.085963 13342 raft_consensus.cc:740] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:20.086673 13342 consensus_queue.cc:260] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:20.087786 13342 raft_consensus.cc:3060] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.088016 11735 raft_consensus.cc:1240] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:20.077996 13281 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.090404 13281 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.091617 11726 raft_consensus.cc:2393] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 5: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:20.095676 13281 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:20.100737 11809 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:20.100873 11803 raft_consensus.cc:1275] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:20.103303 11483 catalog_manager.cc:5697] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 4, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 4 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:20.105536 11654 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:20.106726 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:20.107695 11627 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:20.108871 13707 consensus_queue.cc:260] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:20.105885 13652 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:20.109043 11660 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
W20260709 12:17:20.116430 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 100343us
I20260709 12:17:20.104981 11483 catalog_manager.cc:5697] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 3, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 3 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:20.121630 11734 raft_consensus.cc:1240] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:20.118641 11627 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:20.119400 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:20.123497 11661 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:20.125723 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:20.044870 13436 consensus_queue.cc:1048] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:17:20.082443 13658 consensus_queue.cc:1059] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:17:20.125278 11483 catalog_manager.cc:5697] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 3 to 4, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 4 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:20.120868 11809 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
I20260709 12:17:20.083190 13144 consensus_queue.cc:237] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.127852 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:20.138857 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:20.143031 11661 raft_consensus.cc:2468] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 8.
I20260709 12:17:20.144172 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:20.144767 11661 raft_consensus.cc:3060] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:20.149853 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:20.152740 11625 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:20.166136 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:20.167325 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:20.168316 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:20.169030 11660 raft_consensus.cc:2410] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:20.169711 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:20.170276 11660 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.171536 11729 raft_consensus.cc:2468] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:20.163241 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:20.176913 11734 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 9.
I20260709 12:17:20.182453 11734 raft_consensus.cc:1275] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:17:20.183383 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.185043 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:20.187152 11698 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:20.187503 13206 consensus_queue.cc:1048] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:20.190371 13757 consensus_queue.cc:1059] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:20.153088 13707 raft_consensus.cc:3060] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:20.191403 13723 raft_consensus.cc:3055] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:20.185668 12435 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:20.190559 11728 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 7.
I20260709 12:17:20.201865 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:20.202711 12435 raft_consensus.cc:2410] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:20.214067 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:20.217866 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:20.220626 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7004b9d11647433b94b3d6a7c3e247f6" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:20.221361 12432 raft_consensus.cc:3060] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:20.232220 11660 raft_consensus.cc:2410] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:20.232874 12435 raft_consensus.cc:1275] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:17:20.241425 11803 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:20.191819 13723 raft_consensus.cc:740] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:20.241549 12435 pending_rounds.cc:85] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Aborting all ops after (but not including) 4
I20260709 12:17:20.241319 11773 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:20.201751 13206 raft_consensus.cc:2804] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:20.243525 11727 raft_consensus.cc:1275] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:20.248644 13487 raft_consensus.cc:2749] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:20.249778 13743 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.251775 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:20.254436 13283 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.266682 13723 consensus_queue.cc:260] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.266877 13743 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.239463 13750 consensus_queue.cc:1048] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:17:20.236457 11729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:20.262075 12435 pending_rounds.cc:107] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:20.268663 13206 raft_consensus.cc:697] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:20.269058 13743 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:20.266494 13283 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:20.271729 13283 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:20.266454 13487 raft_consensus.cc:2749] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:20.272881 11659 raft_consensus.cc:2468] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:20.264605 11701 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:20.268803 12435 raft_consensus.cc:2889] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:20.264140 11773 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:20.274536 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:20.271939 11729 raft_consensus.cc:606] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:20.280260 11729 raft_consensus.cc:614] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:20.264518 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51181cd84fab48ffb41a532d72daf42d" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:20.282716 11773 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:20.223657 11661 raft_consensus.cc:2468] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:20.280215 12432 raft_consensus.cc:2468] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
W20260709 12:17:20.286710 11626 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.300231 11809 raft_consensus.cc:1275] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:17:20.303422 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.276646 11801 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:20.303742 11773 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:20.283324 13743 raft_consensus.cc:2749] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:20.306625 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:20.307147 13700 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:20.270264 13652 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:20.341144 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 222574us
I20260709 12:17:20.277220 13742 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:20.308552 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
W20260709 12:17:20.337148 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 187170us
I20260709 12:17:20.301469 13283 raft_consensus.cc:2804] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:20.309088 13750 raft_consensus.cc:2804] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:20.269645 13206 consensus_queue.cc:237] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:20.405751 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:20.422202 11652 raft_consensus.cc:2393] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 7: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:20.407294 11627 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:20.334782 13436 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:20.428300 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:20.428712 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:20.429643 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:20.429677 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:20.432276 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:20.419912 13671 raft_consensus.cc:2804] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:20.438199 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:20.440483 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:20.441212 12438 raft_consensus.cc:2368] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4.
I20260709 12:17:20.441349 12434 raft_consensus.cc:1240] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:20.418377 13283 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:20.448895 12387 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:20.426162 13658 consensus_queue.cc:1243] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer cfe9bf206bb14951ba7615683809d178 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:20.475630 11654 raft_consensus.cc:2410] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:20.487142 11807 raft_consensus.cc:1240] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:20.488930 11660 raft_consensus.cc:1240] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:20.442343 13750 raft_consensus.cc:697] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 8 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:20.455040 13283 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:20.506088 13773 log.cc:927] Time spent T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:17:20.492821 13411 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:20.496872 13703 consensus_queue.cc:1059] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:17:20.501179 13777 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:20.455256 13671 raft_consensus.cc:697] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
W20260709 12:17:20.512850 11627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 88342.5us
I20260709 12:17:20.521371 11627 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:20.512243 11775 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:20.526371 11660 raft_consensus.cc:1240] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:20.531714 13750 consensus_queue.cc:237] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:20.532038 13450 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:20.532771 11658 raft_consensus.cc:1275] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:20.533195 13652 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:20.534152 13671 consensus_queue.cc:237] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:20.527227 13205 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:20.536469 13745 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:20.496215 13771 consensus_queue.cc:1059] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:17:20.531513 13371 raft_consensus.cc:3055] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:20.528357 13681 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:17:20.544580 13371 raft_consensus.cc:740] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
W20260709 12:17:20.546162 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.545858 13371 consensus_queue.cc:260] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.541435 11657 raft_consensus.cc:1275] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:20.554170 13283 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.556295 13283 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:20.557825 13782 log.cc:927] Time spent T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:17:20.558528 13778 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:20.515331 13777 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:20.560170 11726 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:20.571722 13722 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:20.576450 11627 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:20.526238 13658 consensus_queue.cc:1048] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:17:20.577927 13785 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:20.578931 11627 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:20.583715 11627 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:20.562794 13777 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:20.587489 13742 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:20.565970 13775 consensus_queue.cc:1048] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:17:20.589177 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:20.591645 11807 raft_consensus.cc:2393] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 3: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:20.590833 11627 leader_election.cc:400] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4.
I20260709 12:17:20.592170 11627 leader_election.cc:403] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:17:20.594491 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 103324us
I20260709 12:17:20.586920 13487 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:20.592533 13742 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.588676 13658 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:20.607903 12387 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:17:20.619381 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 117285us
W20260709 12:17:20.622605 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 98013.8us
I20260709 12:17:20.626746 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:20.629957 12386 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:20.632993 13745 raft_consensus.cc:2804] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:20.605418 13787 raft_consensus.cc:2749] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331) with higher term. Message: Invalid argument: T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 for earlier term 3. Current term is 4.
I20260709 12:17:20.636462 13788 consensus_queue.cc:1059] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:20.632400 12387 leader_election.cc:304] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:20.646023 12387 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:20.648228 13701 raft_consensus.cc:2749] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:20.648933 13701 consensus_queue.cc:1059] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:20.649794 13701 raft_consensus.cc:2804] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:20.650221 13701 raft_consensus.cc:697] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:20.651106 13701 consensus_queue.cc:237] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.654065 13400 raft_consensus.cc:3055] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:20.654548 13400 raft_consensus.cc:740] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:20.655084 11653 raft_consensus.cc:3055] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:20.655506 11653 raft_consensus.cc:740] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:20.655294 13400 consensus_queue.cc:260] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.656244 11653 consensus_queue.cc:260] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:20.656538 13400 raft_consensus.cc:3060] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.657315 11653 raft_consensus.cc:3060] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.638237 13696 consensus_queue.cc:1048] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:17:20.670104 13371 raft_consensus.cc:3060] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:20.670341 13696 consensus_queue.cc:1059] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:20.672081 12431 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:20.675660 11701 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:20.643024 13745 raft_consensus.cc:697] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:20.676826 13703 raft_consensus.cc:2804] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:20.671669 13788 raft_consensus.cc:3055] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:20.692421 13788 raft_consensus.cc:740] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:20.693259 13788 consensus_queue.cc:260] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.694514 13788 raft_consensus.cc:3060] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:20.695135 11660 raft_consensus.cc:1275] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:17:20.695617 12859 raft_consensus.cc:2749] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:20.695945 11701 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:20.698836 12859 raft_consensus.cc:2804] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:20.699363 12859 raft_consensus.cc:697] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:20.700572 12859 consensus_queue.cc:237] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.689231 13745 consensus_queue.cc:237] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.680739 13696 raft_consensus.cc:3055] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:20.702091 13696 raft_consensus.cc:740] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:20.702906 13696 consensus_queue.cc:260] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:20.695585 11660 pending_rounds.cc:85] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03: Aborting all ops after (but not including) 3
I20260709 12:17:20.704241 11660 pending_rounds.cc:107] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:17:20.704481 11660 raft_consensus.cc:2889] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:20.708197 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 148439us
I20260709 12:17:20.711349 11653 raft_consensus.cc:1275] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:17:20.712188 13770 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:17:20.719368 11731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:20.720109 11731 raft_consensus.cc:606] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:20.726423 11699 leader_election.cc:304] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:20.735632 13425 raft_consensus.cc:2804] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:20.734824 13742 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:20.736249 13425 raft_consensus.cc:697] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:20.728030 13696 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:20.737149 13425 consensus_queue.cc:237] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.738440 13742 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:20.734704 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 88748.7us
I20260709 12:17:20.741741 12387 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:20.742574 13790 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:20.742959 13790 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.743280 13790 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:20.744767 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.745790 11731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:20.751947 13790 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:20.757261 11699 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:20.764825 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.771871 11653 raft_consensus.cc:1275] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:20.785326 12429 raft_consensus.cc:1240] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:20.790855 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:20.785526 12387 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
I20260709 12:17:20.754310 13790 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 10 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:20.794880 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 131583us
I20260709 12:17:20.756291 13371 consensus_queue.cc:1048] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:17:20.804265 13425 consensus_queue.cc:1048] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:20.808851 13720 raft_consensus.cc:2749] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:20.820117 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:20.820812 12428 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 3.
I20260709 12:17:20.821630 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:20.756330 13777 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:20.826754 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:20.827876 12434 raft_consensus.cc:2393] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 6: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:20.830240 11654 raft_consensus.cc:2368] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 6. Current term is 7.
I20260709 12:17:20.798866 13788 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:20.834900 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:20.839743 11804 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:20.838704 12387 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: cfe9bf206bb14951ba7615683809d178
W20260709 12:17:20.844591 12386 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.844849 11775 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:20.846400 11802 raft_consensus.cc:1240] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 8 LEADER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:20.847620 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:20.849226 13750 raft_consensus.cc:2804] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:20.849673 13750 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.850025 13750 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.865720 11773 leader_election.cc:400] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 6. Current term is 7.
I20260709 12:17:20.866155 11773 leader_election.cc:403] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:20.864070 12434 raft_consensus.cc:1240] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:20.872109 11773 leader_election.cc:400] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Vote denied by peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117) with higher term. Message: Invalid argument: T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 6. Current term is 7.
I20260709 12:17:20.873471 11773 leader_election.cc:403] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:17:20.839386 13788 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:20.879611 13777 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:20.880270 12387 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:20.887244 13758 raft_consensus.cc:993] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower b0f903ca23da45e594b2850337751f03 to start an election
W20260709 12:17:20.982776 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 81176us
I20260709 12:17:20.984567 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:20.887847 13758 raft_consensus.cc:1081] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Signalling peer b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:17:20.871896 13742 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145) with higher term. Message: Invalid argument: T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 6. Current term is 7.
I20260709 12:17:20.839368 13671 consensus_queue.cc:1048] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:17:20.990443 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 110227us
I20260709 12:17:20.888615 13788 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.892776 13400 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:20.870368 13791 consensus_queue.cc:1048] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.154s
I20260709 12:17:21.038827 13400 raft_consensus.cc:697] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:21.042745 13750 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:21.044274 12389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:21.044790 13799 log.cc:927] Time spent T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:17:21.048985 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
W20260709 12:17:21.055089 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 176866us
I20260709 12:17:20.987926 13743 consensus_queue.cc:1059] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:17:21.040024 13400 consensus_queue.cc:237] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:21.070711 12387 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:21.072093 11701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.078688 11627 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:21.056568 13750 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:21.081110 11657 raft_consensus.cc:1240] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:21.081717 13800 log.cc:927] Time spent T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:17:21.082214 11627 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:21.082994 13144 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.083639 13801 consensus_queue.cc:1048] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:17:21.084997 11658 raft_consensus.cc:1275] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:17:21.104591 11658 pending_rounds.cc:85] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03: Aborting all ops after (but not including) 2
I20260709 12:17:21.104913 11658 pending_rounds.cc:107] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:21.105190 11658 raft_consensus.cc:2889] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:21.085021 11804 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
I20260709 12:17:21.087122 11652 raft_consensus.cc:1240] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:21.088855 12387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.106781 11624 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:21.107700 13775 raft_consensus.cc:2804] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:21.108209 13775 raft_consensus.cc:697] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:21.109099 13775 consensus_queue.cc:237] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:21.110083 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:21.110425 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841068979f35457ca7200408e6d522a9" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:21.110108 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f2b34efd194430a04442a394ce05c1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:21.111661 12432 raft_consensus.cc:2468] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
I20260709 12:17:21.111681 12387 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:21.094297 13703 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.112398 12436 raft_consensus.cc:1275] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:21.112748 13703 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.112879 12387 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:21.113813 12435 raft_consensus.cc:1275] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:21.082054 13806 raft_consensus.cc:2749] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:21.090582 13696 raft_consensus.cc:3060] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.105358 13777 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:21.124074 13806 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.124822 13806 consensus_queue.cc:1048] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:21.133476 13703 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:21.136437 13703 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:21.144817 13450 raft_consensus.cc:3055] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:21.145401 13450 raft_consensus.cc:740] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:21.115254 13713 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117) with higher term. Message: Invalid argument: T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for earlier term 6. Current term is 7.
I20260709 12:17:21.146315 13450 consensus_queue.cc:260] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:21.147607 13450 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:21.072428 13701 consensus_queue.cc:1059] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:17:21.154490 13701 consensus_queue.cc:1243] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer cfe9bf206bb14951ba7615683809d178 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:21.155022 13701 raft_consensus.cc:3055] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:21.162999 13701 raft_consensus.cc:740] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:21.163892 13701 consensus_queue.cc:260] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:21.168027 11652 raft_consensus.cc:1275] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:21.169879 13776 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:21.170485 13776 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:21.182161 12431 raft_consensus.cc:1275] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:21.173382 13701 raft_consensus.cc:3060] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:21.175042 13777 raft_consensus.cc:493] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:21.170980 13706 consensus_queue.cc:1048] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:17:21.215600 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:21.187461 13792 consensus_queue.cc:1048] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:17:21.213490 13776 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:21.195398 13777 raft_consensus.cc:515] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:21.244058 13790 raft_consensus.cc:2749] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:21.269277 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 154555us
I20260709 12:17:21.276643 11661 raft_consensus.cc:1275] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:21.286861 12430 raft_consensus.cc:1240] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:21.291292 13788 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:21.292598 12438 raft_consensus.cc:1240] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:21.294601 13788 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:21.276448 13776 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:17:21.314937 11700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.337203 13144 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:21.337904 13144 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:21.281739 13775 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:17:21.282581 13703 consensus_queue.cc:1048] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:17:21.282429 13400 consensus_queue.cc:1048] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:17:21.282790 13801 consensus_queue.cc:1048] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 12:17:21.341801 13774 log.cc:927] Time spent T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:17:21.341589 13787 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.348752 13144 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:21.358525 13777 leader_election.cc:290] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:21.360029 13787 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:21.362291 13787 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:21.363755 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:21.364212 13696 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:21.311538 13720 consensus_queue.cc:1059] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 12:17:21.368076 13827 log.cc:927] Time spent T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.138s	user 0.001s	sys 0.001s
I20260709 12:17:21.370186 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:21.375723 12428 raft_consensus.cc:2468] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
W20260709 12:17:21.404726 13823 log.cc:927] Time spent T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.135s	user 0.000s	sys 0.002s
I20260709 12:17:21.420571 12435 raft_consensus.cc:1275] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:21.421152 11625 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:21.420642 12438 raft_consensus.cc:1275] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:21.432718 11729 raft_consensus.cc:1275] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:21.433152 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:21.455236 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:21.458146 13273 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:21.458732 13273 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:21.460757 13273 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:21.462174 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:21.466434 11734 raft_consensus.cc:1275] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:21.467128 12429 raft_consensus.cc:2393] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 4: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:21.468180 11730 raft_consensus.cc:1275] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:21.469125 11730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:21.469297 12387 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:21.471091 13696 consensus_queue.cc:1048] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:21.472720 13400 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:21.473511 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:21.475016 13776 consensus_queue.cc:1048] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:21.432665 13681 consensus_queue.cc:1048] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:17:21.476637 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:21.477349 11806 raft_consensus.cc:2393] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 4: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:21.475126 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:21.479200 12386 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:21.479314 11625 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:21.480516 13775 raft_consensus.cc:2749] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.482522 13741 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.483026 13741 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:21.486356 11733 raft_consensus.cc:1275] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:21.438678 13742 consensus_queue.cc:1059] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:17:21.488508 13742 raft_consensus.cc:3055] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:21.488854 13742 raft_consensus.cc:740] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:21.489667 13742 consensus_queue.cc:260] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:21.490928 13742 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.438512 13671 consensus_queue.cc:1048] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:17:21.492906 13700 consensus_queue.cc:1048] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:21.469674 11730 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:21.426244 13777 raft_consensus.cc:2749] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:21.541699 13144 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.562180 12435 raft_consensus.cc:1275] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:21.562247 13144 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:21.575084 11625 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:21.578362 11653 raft_consensus.cc:1240] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:21.581900 11775 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:21.537832 13814 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:21.518548 11656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:17:21.595443 11652 raft_consensus.cc:1275] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:21.589385 13144 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:21.599005 11656 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:21.600903 11656 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.601848 11660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:21.603281 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:21.585074 13775 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.585906 13791 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:21.607800 11660 raft_consensus.cc:2393] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 4: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:21.584717 13788 consensus_queue.cc:1048] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 12:17:21.633507 11701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.615935 13775 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.660558 11656 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:21.661796 13775 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.669008 11656 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:21.677641 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:21.679874 11733 raft_consensus.cc:3055] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:21.680154 11733 raft_consensus.cc:740] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:21.680797 11733 consensus_queue.cc:260] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:21.681615 11733 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:21.700084 11698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.699497 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:21.702754 11807 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:21.707518 11800 raft_consensus.cc:1275] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:21.697916 13723 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.737985 11733 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
W20260709 12:17:21.739428 11774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.739676 11625 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:21.740480 13144 raft_consensus.cc:2804] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:21.740914 13144 raft_consensus.cc:697] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:21.741793 13144 consensus_queue.cc:237] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:21.719120 11802 raft_consensus.cc:1240] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:21.768617 13840 log.cc:927] Time spent T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.095s	user 0.003s	sys 0.000s
I20260709 12:17:21.771941 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:21.776386 13844 log.cc:927] Time spent T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:17:21.779101 11625 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:21.787727 13776 raft_consensus.cc:2749] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.855212 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
W20260709 12:17:21.859315 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 123355us
I20260709 12:17:21.881850 11657 raft_consensus.cc:1275] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:21.882603 12387 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:21.930514 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 68907.2us
W20260709 12:17:21.936758 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 54247.8us
W20260709 12:17:22.010399 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 70339.3us
I20260709 12:17:22.012570 11655 raft_consensus.cc:1275] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:17:21.930410 13852 log.cc:927] Time spent T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:17:21.860206 13750 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:22.061607 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 127181us
I20260709 12:17:22.031191 13790 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:22.049523 13411 consensus_queue.cc:1048] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:17:22.086167 13851 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.080269 13857 raft_consensus.cc:493] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.068025 13750 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:22.103435 11735 raft_consensus.cc:1275] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:22.077473 13788 consensus_queue.cc:1048] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:22.101982 13791 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.108115 13791 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:22.108630 13806 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.109263 13806 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:22.110448 13791 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.111938 13806 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:22.112867 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.096599 13818 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.106071 13857 raft_consensus.cc:515] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:22.138486 13857 leader_election.cc:290] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:22.140501 13750 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:22.140599 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.141314 13400 raft_consensus.cc:493] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.141855 13400 raft_consensus.cc:515] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:22.143900 13400 leader_election.cc:290] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.105278 11731 raft_consensus.cc:606] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:22.149751 11731 raft_consensus.cc:614] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:22.141855 13818 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:22.154723 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.087873 13775 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:22.157218 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:22.153193 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 89344.1us
I20260709 12:17:22.106510 13742 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:22.162804 11774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.165215 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.167042 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b1feee36a2425db32953f79a0b0c0a" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.094503 13851 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:22.155975 13750 raft_consensus.cc:493] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.185420 12387 leader_election.cc:304] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:22.189601 13864 consensus_queue.cc:1048] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:22.196120 11652 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:22.168394 13742 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:22.205976 13788 raft_consensus.cc:2749] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:22.213124 13845 log.cc:927] Time spent T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef: Append to log took a long time: real 0.509s	user 0.002s	sys 0.000s
I20260709 12:17:22.185272 13750 raft_consensus.cc:515] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:22.219911 13750 leader_election.cc:290] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:22.224274 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:22.227582 11731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36418 (request call id 25) took 1482 ms. Trace:
I20260709 12:17:22.228015 11731 rpcz_store.cc:276] 0709 12:17:20.745396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.745618 (+   222us) service_pool.cc:224] Handling call
0709 12:17:22.227400 (+1481782us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400976dd4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda45853 00007f4502a1360a 00007f44fbf997d4 00007f44fbf99762 00007f44fbf99691 00007f44fbf9960c 00007f44fbf988c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:22.227501 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3124913024}
I20260709 12:17:22.223095 13851 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:22.210779 13745 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.234293 11731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:22.235023 11731 raft_consensus.cc:606] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:22.234194 13745 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:22.248260 11731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:22.248888 11731 raft_consensus.cc:606] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Received request to transfer leadership to TS ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:22.251708 13742 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:22.252699 13745 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:22.253938 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.254657 11656 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 8.
I20260709 12:17:22.251561 13403 raft_consensus.cc:3055] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:22.255899 13403 raft_consensus.cc:740] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:22.256829 13403 consensus_queue.cc:260] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:22.258559 13403 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.260293 13775 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:22.265172 13742 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:22.265813 13742 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:22.266049 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca6d1536f234395afd9bcbfe398e689" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.268159 13742 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.270368 11698 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:22.271564 12428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57346 (request call id 551) took 1163 ms. Trace:
I20260709 12:17:22.271950 12428 rpcz_store.cc:276] 0709 12:17:21.108240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.110192 (+  1952us) service_pool.cc:224] Handling call
0709 12:17:22.271387 (+1161195us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54000055d4. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b4571 00007f44fda4f2fa 00007f4502a10b17 00007f44fbf8b6d4 00007f44fbf8b662 00007f44fbf8b591 00007f44fbf8b50c 00007f44fbf8a7c2 00007f44fbd8648c 00007f44fbd858c6 00007f44fbd8526f
0709 12:17:22.271501 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584327040}
I20260709 12:17:22.272680 13860 consensus_queue.cc:1048] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:22.272423 13856 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:22.277630 13856 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:22.278048 13856 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.280244 13788 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.280798 13788 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:22.281819 13741 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:22.282863 13788 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.287588 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:22.288313 11803 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 9.
I20260709 12:17:22.289247 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:22.289842 12387 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:22.290596 13700 consensus_queue.cc:1048] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:22.292148  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:22.292392 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.293071 11656 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:22.295976 13818 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.296792 12387 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:22.278151 12434 raft_consensus.cc:1275] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:22.288548 11804 raft_consensus.cc:1275] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:22.297513 13400 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.310170 12386 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:22.318907 13856 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:22.321188 13856 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:22.319132 13411 consensus_queue.cc:1048] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:22.322497 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:22.308053 13825 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:22.309399 13788 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:22.337435 11804 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:22.316779 13814 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:22.342814 11698 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:22.345916 13849 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:22.346498 13849 raft_consensus.cc:697] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:22.347473 13849 consensus_queue.cc:237] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:22.340328 13787 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.350298 13787 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:22.352576 13787 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:22.354000  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:22.335094 13825 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.314460 13400 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:22.337903 13788 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.364987 13825 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:22.380584 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 116347us
I20260709 12:17:22.374619 13788 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.374174 13814 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
W20260709 12:17:22.396481 13867 log.cc:927] Time spent T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:17:22.402904 13857 consensus_queue.cc:1048] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:17:22.417378 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.422148 11625 leader_election.cc:304] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:22.426880 13777 raft_consensus.cc:2749] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:22.430198 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.433537 13400 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.419013 13856 consensus_queue.cc:1059] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:17:22.440587 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:22.398631 13814 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:22.443794 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.444590 11652 raft_consensus.cc:2393] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 8: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:22.449868 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:22.455044 11652 raft_consensus.cc:2368] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5.
W20260709 12:17:22.458562 12386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 142924us
I20260709 12:17:22.461419 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12f3af68cd84f68b5137c6abe65e63e" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:22.461897 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:22.465183 12432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:22.470126 12429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:22.445147 13814 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:22.475983 13439 raft_consensus.cc:993] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:22.486948 13273 raft_consensus.cc:1081] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:22.478312 13777 consensus_queue.cc:1048] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:17:22.475521 13403 raft_consensus.cc:3055] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:22.493216 13403 raft_consensus.cc:740] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:22.494071 13403 consensus_queue.cc:260] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:22.495217 13403 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:22.508101 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.509665 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.516764 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.521456 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.527984 11773 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:22.529420 11773 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:22.531798 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:22.532399 11804 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:22.533826 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:22.534360 11807 raft_consensus.cc:1275] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:22.534502 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:22.537467 11806 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.548311 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:22.550957 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.534795 13671 raft_consensus.cc:2749] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:22.540217 13750 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:22.574443 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0df0d2cb8774fe0b3479eeb8e30027d" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.575389 12430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:17:22.576013 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.576159 12430 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:22.576650 12430 raft_consensus.cc:3060] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:22.568645 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:22.579164 11800 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:22.558662 13776 raft_consensus.cc:493] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:22.582803 11624 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:22.573532 13750 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.592060 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a70076f56284eafba1df611decc3929" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
W20260709 12:17:22.600235 13871 log.cc:927] Time spent T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 12:17:22.601064 13777 consensus_queue.cc:1048] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:22.607858 11773 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:22.614111 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.620839 11624 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:17:22.616173 13835 log.cc:927] Time spent T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:22.618721 13750 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:22.624544 13863 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:22.628718 13791 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:22.628822 13787 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:22.671831 13818 raft_consensus.cc:493] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.672463 13818 raft_consensus.cc:515] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:22.673385 13791 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.674486 13818 leader_election.cc:290] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:22.678376 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.621394 13776 raft_consensus.cc:515] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:22.717995 13745 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.722658 13745 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:22.724923 13745 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.735312 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.736050 11652 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:22.738186 12387 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:22.655009 13787 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.744947 11699 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:22.749225 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 68951.7us
I20260709 12:17:22.742898 13860 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.746475 13745 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:22.756091 11699 leader_election.cc:400] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Vote denied by peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117) with higher term. Message: Invalid argument: T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5.
I20260709 12:17:22.747044 13787 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.764147 11802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:22.764892 11802 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:22.768173 13788 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:22.744854 13865 raft_consensus.cc:493] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:22.770063 13865 raft_consensus.cc:515] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:22.771178 12428 raft_consensus.cc:1240] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:22.772883 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.777922 13700 raft_consensus.cc:493] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.778476 13700 raft_consensus.cc:515] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:22.779143 13750 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:22.780241 13696 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:22.781101 13750 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:22.752010 13889 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:22.782075 13889 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:22.749856 13792 raft_consensus.cc:2749] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:22.772457 13825 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:22.787575 13825 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 10 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:22.790871 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:22.791664 12437 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 10: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:22.780833 13696 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:22.364492  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:22.801376 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:22.802047 11652 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:17:22.793867 11806 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:22.794262 11803 raft_consensus.cc:1240] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:22.821620 11808 raft_consensus.cc:1275] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:22.780483 13700 leader_election.cc:290] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.823658 13205 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.791693 13889 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:22.827667 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 68242us
I20260709 12:17:22.761237 13745 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.834569 11775 leader_election.cc:304] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:22.837822 11775 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:22.821599 11698 leader_election.cc:304] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:22.743145 13791 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:22.831459 11773 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:22.839778 12859 raft_consensus.cc:993] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:22.840279 12859 raft_consensus.cc:1081] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Signalling peer ce38e95b93a640c1a7b16f37868b30fc to start an election
I20260709 12:17:22.848481 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:22.849123 11809 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 10.
I20260709 12:17:22.851398 11661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.852591 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896664897f42444796f0be51911c9ec7" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.840997 13745 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.858592 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:22.866379 13788 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.842754 13818 raft_consensus.cc:2749] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:22.847859 13439 raft_consensus.cc:2749] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:22.868336 13750 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.858013 13671 raft_consensus.cc:2749] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:22.872056 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.844442 13700 raft_consensus.cc:2749] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:22.872865 13750 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:22.874217 13770 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:22.875001 13750 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.876436 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.876998 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.871172 13791 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:22.879753 13696 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.883478 12386 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:22.884296 13745 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:22.837024 13205 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:22.885337 13788 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:22.886370 13745 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.886745 13788 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:22.887218 13205 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.888598 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:22.856813 11652 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 10.
W20260709 12:17:22.889501 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 67571.5us
I20260709 12:17:22.891654 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.891777 11732 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 8.
I20260709 12:17:22.892584 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c076143e0f4e3cb04896d3f733461b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:22.894506 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:22.895226 13792 consensus_queue.cc:1059] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:22.874717 13770 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:22.897672 13770 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:22.900655 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:22.901340 11804 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.880959 12430 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:22.907517 12438 raft_consensus.cc:1240] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:22.792595 13860 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:22.910200 11483 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33118 (request call id 109) took 11234 ms. Trace:
I20260709 12:17:22.887168 13788 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:22.922838 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 66368.9us
I20260709 12:17:22.925352 11698 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:22.937462 11734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:22.938601 12430 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:22.944160 11657 raft_consensus.cc:1240] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:22.946888 11804 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:22.947626 11808 raft_consensus.cc:1240] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:22.948367 11624 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:22.948693 11726 raft_consensus.cc:1275] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:22.941111 11734 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:22.875041 13787 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:22.911288 11483 rpcz_store.cc:276] 0709 12:17:11.675949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.676221 (+   272us) service_pool.cc:224] Handling call
0709 12:17:22.910143 (+11233922us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:20.486312 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:20.491142 (+  4830us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:20.491177 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:17:20.491194 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:20.491807 (+   613us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:20.491859 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:20.491886 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:17:20.492262 (+   376us) tablet.cc:701] Row locks acquired
0709 12:17:20.492276 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:17:20.495840 (+  3564us) write_op.cc:270] Start()
0709 12:17:20.512359 (+ 16519us) write_op.cc:276] Timestamp: P: 1783599440492378 usec, L: 0
0709 12:17:20.512395 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:17:20.539100 (+ 26705us) log.cc:844] Serialized 1681 byte log entry
0709 12:17:20.871629 (+332529us) op_driver.cc:464] REPLICATION: finished
0709 12:17:21.228863 (+357234us) write_op.cc:301] APPLY: starting
0709 12:17:21.228975 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:21.229125 (+   150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:21.229242 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:21.229783 (+   541us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:21.229989 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:17:21.230036 (+    47us) write_op.cc:312] APPLY: finished
0709 12:17:21.242268 (+ 12232us) log.cc:844] Serialized 40 byte log entry
0709 12:17:21.254550 (+ 12282us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:21.256858 (+  2308us) write_op.cc:454] Released schema lock
0709 12:17:21.257253 (+   395us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:21.282074 (+ 24821us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:21.283776 (+  1702us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16915,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":354599,"apply.run_cpu_time_us":3493,"apply.run_wall_time_us":40344,"num_ops":4,"prepare.queue_time_us":199216,"prepare.run_cpu_time_us":18493,"prepare.run_wall_time_us":142041,"raft.queue_time_us":130636,"raft.run_cpu_time_us":19403,"raft.run_wall_time_us":393819,"replication_time_us":318923,"thread_start_us":640186,"threads_started":4,"wal-append.queue_time_us":130052,"wal-append.run_cpu_time_us":23021,"wal-append.run_wall_time_us":1589388}]]}
I20260709 12:17:22.919593 13770 consensus_queue.cc:1048] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:17:22.993690 11652 raft_consensus.cc:1240] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:22.967147 13864 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:23.005717 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:23.006492 11804 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:23.014526 11775 leader_election.cc:304] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:23.000543 13273 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:23.027067 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:23.027967 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a236cb878f1e49098e43b2733a84eb5c" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:23.030882 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:23.031574 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:23.031452 11654 raft_consensus.cc:3060] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:23.031910 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:23.032332 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:23.033313 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
W20260709 12:17:23.032653 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 141695us
I20260709 12:17:23.032932 11729 raft_consensus.cc:3055] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:23.035467 11729 raft_consensus.cc:740] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:23.037663 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:23.038234 11659 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.018308 13750 raft_consensus.cc:2749] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.018561 13273 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:23.042870 13273 raft_consensus.cc:3060] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:22.999737 13864 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:23.047048 13864 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:23.016892 13901 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:23.053990 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:23.054759 12428 raft_consensus.cc:2393] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 6: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
W20260709 12:17:23.041801 13891 log.cc:927] Time spent T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:17:23.057246 12434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
 from {username='slave'} at 127.0.0.1:57338
I20260709 12:17:23.059916 12387 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:23.060921 12434 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:23.061373 12434 raft_consensus.cc:3060] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:23.060010 13787 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:23.060230 13894 log.cc:927] Time spent T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:17:23.064255 13901 raft_consensus.cc:697] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:23.064774 13893 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:23.059893 13892 log.cc:927] Time spent T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:17:23.069631 11659 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
I20260709 12:17:23.070974 11804 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 10.
I20260709 12:17:23.104115 11654 raft_consensus.cc:2468] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:23.072700 11729 consensus_queue.cc:260] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.121320 11729 raft_consensus.cc:3060] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:23.111380 12387 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:23.152046 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:23.068548 13903 consensus_queue.cc:1048] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.145s
W20260709 12:17:23.176014 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 250727us
I20260709 12:17:23.182286 11805 raft_consensus.cc:2393] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 7: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:23.124955 12387 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
W20260709 12:17:23.184804 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 59948.9us
W20260709 12:17:23.032889 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 68374.2us
I20260709 12:17:23.188508 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:23.189258 12430 raft_consensus.cc:2393] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 5: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:23.113090 13893 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:23.185235 13745 raft_consensus.cc:2749] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.168365 13814 raft_consensus.cc:493] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:23.122627 13759 consensus_queue.cc:1175] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ce38e95b93a640c1a7b16f37868b30fc" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:23.142494 13901 consensus_queue.cc:237] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:23.213989 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:23.163491 12434 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.215677 11729 raft_consensus.cc:2468] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 3.
I20260709 12:17:23.216441 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:23.125141 13400 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:23.176219 13273 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:23.215842 13893 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:23.225967 12434 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:23.227533 13400 raft_consensus.cc:697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 10 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:23.229485 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:23.230435 11658 raft_consensus.cc:3060] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:23.228106 13902 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.220633 13814 raft_consensus.cc:515] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:23.238511 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:23.239050 11733 raft_consensus.cc:3055] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:23.239324 11733 raft_consensus.cc:740] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:23.239930 11733 consensus_queue.cc:260] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.235459 13902 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.244445 13902 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:23.245029 13273 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 10 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:23.245476 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:23.248035 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:23.249275 11729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:23.249934 11729 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 8.
I20260709 12:17:23.254686 13825 consensus_queue.cc:1059] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:23.255493 13825 raft_consensus.cc:3055] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:23.255789 13825 raft_consensus.cc:740] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:23.256537 13825 consensus_queue.cc:260] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:23.258641 13788 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:23.263073 13814 leader_election.cc:290] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:23.266206 12430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633993d8d3341eeaddce5c93752db1e" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:23.269901 13865 leader_election.cc:290] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:23.270862 13776 leader_election.cc:290] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:23.289891 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:23.312476 13723 raft_consensus.cc:3055] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:23.316152 13723 raft_consensus.cc:740] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:23.316957 13723 consensus_queue.cc:260] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.317914 13723 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.319459 11624 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:23.320978 13144 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.286183 11658 raft_consensus.cc:2468] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:23.288619 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:23.290027 12434 raft_consensus.cc:2393] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 10: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:23.279618 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:23.294744 13273 consensus_queue.cc:1059] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:23.295832 13720 consensus_queue.cc:1059] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:23.296103 11773 leader_election.cc:304] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:23.297416 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:23.298480 12438 raft_consensus.cc:1240] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:23.344233 11732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:23.298923 13400 consensus_queue.cc:237] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:23.299582 13788 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:23.310664 12437 raft_consensus.cc:1240] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:23.311132 13860 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:23.313369 11775 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:23.313736 13775 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:23.366123 13775 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:23.368279 13775 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:23.315284 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
W20260709 12:17:23.329274 13906 consensus_queue.cc:1175] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b0f903ca23da45e594b2850337751f03" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:17:23.332821 12431 raft_consensus.cc:1240] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:23.336922 11657 raft_consensus.cc:1240] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:23.372227 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 58763.3us
I20260709 12:17:23.337015 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:23.339445 13825 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.341408 11803 raft_consensus.cc:2410] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:23.373929 11653 raft_consensus.cc:2393] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 6: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
W20260709 12:17:23.352950 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 56924.6us
I20260709 12:17:23.355572 13144 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:23.356859 11625 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:23.355350 12387 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:23.375571 11773 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:23.377135 13896 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.377646 13896 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.379684 13896 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:23.380179 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:23.380708 12438 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:23.381420 11775 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:23.373271 13742 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:23.383587 13723 raft_consensus.cc:3055] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:23.383973 13723 raft_consensus.cc:740] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
W20260709 12:17:23.386613 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 62981.7us
I20260709 12:17:23.387521 11658 raft_consensus.cc:1240] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:23.389381 11773 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:23.370015 13450 raft_consensus.cc:2749] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.391223 13890 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:23.391378 11727 raft_consensus.cc:2410] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:23.398708 12859 consensus_queue.cc:1059] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:23.384730 13723 consensus_queue.cc:260] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:23.400991 12387 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:23.402707 11698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.401044 11773 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:23.397924 13788 raft_consensus.cc:2804] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:23.423578 12859 raft_consensus.cc:3055] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:23.423985 12859 raft_consensus.cc:740] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:23.424798 12859 consensus_queue.cc:260] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:23.425899 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77633186a3bc4fbe82ee020cad674e30" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:23.426728 11733 raft_consensus.cc:3060] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:23.427973 13834 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:23.428398 13834 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.428701 13834 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:23.425091 13890 raft_consensus.cc:2749] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:23.439182 12387 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:23.394240 13742 raft_consensus.cc:2804] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:23.441200 12859 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:23.446743 11699 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:23.448097 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac74a4093c34756a969a33ff35146ad" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:23.445535 13696 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.449607 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869a40a36ae44ac9af963b7e09384543" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:23.453087 11733 raft_consensus.cc:2468] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 2.
I20260709 12:17:23.448519 12387 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:23.395023 13720 consensus_queue.cc:1059] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:17:23.461792 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:23.462220 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:23.463047 11804 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:23.440872 13890 raft_consensus.cc:2749] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:23.443768 13400 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:23.440270 13788 raft_consensus.cc:697] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:23.446208 13742 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.443338 13893 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.470288 13788 consensus_queue.cc:237] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.462821 13703 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:23.457798 13849 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.494638 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:23.495555 11624 leader_election.cc:304] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:23.496871 11624 leader_election.cc:304] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:23.497104 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:23.482079 13742 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.482559 11481 catalog_manager.cc:5697] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:23.498097 11733 raft_consensus.cc:2410] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:23.499673 11481 catalog_manager.cc:5697] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 4 to 5, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 5 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } }
I20260709 12:17:23.506141 11481 catalog_manager.cc:5697] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:23.507841 11481 catalog_manager.cc:5697] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 4 to 5, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 5 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:23.487417 11801 raft_consensus.cc:2468] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 10.
I20260709 12:17:23.489862 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:23.494051 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:23.514285 11481 catalog_manager.cc:5697] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 3 to 5, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 5 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:23.510658 11624 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:23.517019 13144 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:23.517402 13144 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:23.517705 13144 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.515947 11481 catalog_manager.cc:5697] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 4 to 5, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 5 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:23.523826 11481 catalog_manager.cc:5697] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:23.530575 13723 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.501039 13865 raft_consensus.cc:2749] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.501207 13776 raft_consensus.cc:2749] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:23.544474 12388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.533910 11481 catalog_manager.cc:5697] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:23.547067 11481 catalog_manager.cc:5697] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:23.529619 13915 log.cc:927] Time spent T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:23.550891 11481 catalog_manager.cc:5697] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 5 to 6, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 6 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:23.535158 11624 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:23.505429 13703 raft_consensus.cc:697] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:23.539748 13893 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:23.564335 11624 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:23.528306 13144 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:23.558112 11481 catalog_manager.cc:5697] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } }
I20260709 12:17:23.567598 11481 catalog_manager.cc:5697] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 5, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 5 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:23.578862 11481 catalog_manager.cc:5697] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 1 to 3, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:23.580762 13144 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:23.577680 13901 raft_consensus.cc:2749] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.577943 13776 raft_consensus.cc:2749] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.586449 13425 raft_consensus.cc:3055] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:23.586889 13425 raft_consensus.cc:740] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:23.587636 13425 consensus_queue.cc:260] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:23.581285 11481 catalog_manager.cc:5697] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 4 to 5, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 5 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:23.598714 13703 consensus_queue.cc:237] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.607858 11698 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:23.608644 13273 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.609198 13273 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.611225 13273 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:23.616285 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:23.616887 12438 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:23.617924 13759 raft_consensus.cc:2804] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:23.619408 13759 raft_consensus.cc:697] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 10 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:23.620276 13759 consensus_queue.cc:237] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:23.624150 11658 raft_consensus.cc:1240] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:23.628114 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:23.632457 13425 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.632993 11701 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:23.633846 13889 raft_consensus.cc:2804] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:23.634213 13889 raft_consensus.cc:493] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.634528 13889 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.637629 13849 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.641364 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:23.642392 11624 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:23.659192 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 195404us
I20260709 12:17:23.660501 11806 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:23.660147 12387 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:23.621344 13834 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.681787 11624 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:23.617477 13742 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.680907 13911 raft_consensus.cc:2749] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:23.683647 13893 raft_consensus.cc:2804] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:23.699512 11809 raft_consensus.cc:2393] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 5: Already voted for candidate cfe9bf206bb14951ba7615683809d178 in this term.
I20260709 12:17:23.690438 13904 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:23.702987 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:23.709293 12431 raft_consensus.cc:2393] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 5: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:23.711716 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:23.713452 11652 raft_consensus.cc:2368] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 8. Current term is 9.
I20260709 12:17:23.713517 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:23.725733 11733 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 8.
I20260709 12:17:23.728463 12387 leader_election.cc:304] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:23.706211 13893 raft_consensus.cc:697] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:23.735112 12387 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
W20260709 12:17:23.737903 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 47813.7us
I20260709 12:17:23.723973 13904 raft_consensus.cc:697] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:23.732208 13874 raft_consensus.cc:2749] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:23.741967 13411 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:23.754514 13411 raft_consensus.cc:697] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 8 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:23.755420 13411 consensus_queue.cc:237] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.758589 13742 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:23.759892 13834 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 9 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:23.759778 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:23.763688 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:23.764323 12431 raft_consensus.cc:3060] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.760998 13889 raft_consensus.cc:515] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.775878 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:23.777567 12387 leader_election.cc:400] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 election: Vote denied by peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117) with higher term. Message: Invalid argument: T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc for earlier term 8. Current term is 9.
I20260709 12:17:23.777729 11733 raft_consensus.cc:2393] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 5: Already voted for candidate 264376c764c64dc78c4cef6031c15eef in this term.
I20260709 12:17:23.780035 12431 raft_consensus.cc:2468] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:23.781136 11775 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:23.785926 13893 consensus_queue.cc:237] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.790140 13888 raft_consensus.cc:2804] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:23.790673 13888 raft_consensus.cc:697] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:23.791447 13888 consensus_queue.cc:237] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:23.805428 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
W20260709 12:17:23.828956 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 57979.9us
I20260709 12:17:23.789253 13904 consensus_queue.cc:237] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:23.847487 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e58426365f4050aa2b97643be55ad4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:23.850045 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a80694829ab40a8b9b84840d8c384ff" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:23.840071 13889 leader_election.cc:290] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:23.853446 11727 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:23.856931 11698 leader_election.cc:304] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:23.861212 13889 raft_consensus.cc:2749] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:23.878450 11808 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:17:23.883383 13920 log.cc:927] Time spent T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:17:23.882609 13400 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:17:23.899747 11808 raft_consensus.cc:1275] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:23.914886 11726 raft_consensus.cc:1275] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:23.915311 11726 pending_rounds.cc:85] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef: Aborting all ops after (but not including) 2
I20260709 12:17:23.915524 11726 pending_rounds.cc:107] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:23.915755 11726 raft_consensus.cc:2889] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:23.906775 13788 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.918481 13788 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:23.920528 13788 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:23.922106 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:23.923715 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:23.924355 11808 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 5.
I20260709 12:17:23.925750 12386 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:23.937923 13893 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:23.967856 13927 log.cc:927] Time spent T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:17:23.923945 13851 consensus_queue.cc:1048] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:17:23.974330 11726 raft_consensus.cc:1275] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:23.979597 13834 consensus_queue.cc:1048] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:23.989941 13411 consensus_queue.cc:1048] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:23.965289 13893 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.996569 13893 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.036791 11727 raft_consensus.cc:2468] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 9.
I20260709 12:17:24.049997 11625 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:24.056509 11658 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 10 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:24.057487 13834 raft_consensus.cc:2804] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:24.058122 13834 raft_consensus.cc:697] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 9 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:24.059053 13834 consensus_queue.cc:237] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:24.062702 13814 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:24.070941 13893 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:24.074131 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:24.074622 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:24.076615 13893 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:24.074735 11804 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.086390 11804 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 6.
I20260709 12:17:24.087639 12386 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:24.092835 13806 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:24.101549 13806 raft_consensus.cc:697] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:24.102859 11653 raft_consensus.cc:1275] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:24.102512 13806 consensus_queue.cc:237] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:24.105167 13788 consensus_queue.cc:1048] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:24.184948 11804 raft_consensus.cc:1275] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:24.188004 13720 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:24.191051 11735 raft_consensus.cc:1275] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:24.191640 11657 raft_consensus.cc:1275] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:24.200822 11735 raft_consensus.cc:1275] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:24.202994 13806 consensus_queue.cc:1048] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:24.195175 13788 consensus_queue.cc:1048] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:17:24.204746 12438 raft_consensus.cc:1275] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:24.206324 13889 consensus_queue.cc:1048] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:24.204591 13411 consensus_queue.cc:1048] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:24.234328 11653 raft_consensus.cc:1275] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:24.236310 13806 consensus_queue.cc:1048] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:24.289038 11484 catalog_manager.cc:5697] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 5 to 7, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 7 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:24.294618 11726 raft_consensus.cc:1240] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:24.297315 11804 raft_consensus.cc:1240] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer b0f903ca23da45e594b2850337751f03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:24.298797 13834 consensus_queue.cc:1059] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.299584 13834 raft_consensus.cc:3055] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:24.299887 13834 raft_consensus.cc:740] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:24.300606 13834 consensus_queue.cc:260] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:24.303824 11657 raft_consensus.cc:1240] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 9 LEADER]: Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:24.302943 11484 catalog_manager.cc:5697] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:24.307427 13400 consensus_queue.cc:1059] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:17:24.317000 13400 raft_consensus.cc:3055] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:24.317332 13400 raft_consensus.cc:740] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:24.318128 13400 consensus_queue.cc:260] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:24.318236 11484 catalog_manager.cc:5697] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 3 to 5, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 5 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:24.319223 13400 raft_consensus.cc:3060] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:24.319684 11484 catalog_manager.cc:5697] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } }
W20260709 12:17:24.324103 13893 consensus_queue.cc:1175] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b0f903ca23da45e594b2850337751f03" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ce38e95b93a640c1a7b16f37868b30fc for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:24.330720 12431 raft_consensus.cc:1275] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:24.332517 13791 consensus_queue.cc:1048] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.334487 13750 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:24.335142 13750 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:24.324298 11484 catalog_manager.cc:5697] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 2 to 3, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 3 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } }
I20260709 12:17:24.341899 11484 catalog_manager.cc:5697] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } }
I20260709 12:17:24.301700 13834 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.343138 11484 catalog_manager.cc:5697] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 7 to 8, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 8 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:24.344105 11481 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42126 (request call id 162) took 6088 ms. Trace:
I20260709 12:17:24.346092 11484 catalog_manager.cc:5697] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 1 to 5, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 5 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } }
I20260709 12:17:24.347379 11484 catalog_manager.cc:5697] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 4 to 6, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 6 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:24.348603 11484 catalog_manager.cc:5697] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:24.350170 11484 catalog_manager.cc:5697] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:24.352010 11484 catalog_manager.cc:5697] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:24.354120 11484 catalog_manager.cc:5697] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 6 to 7, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 7 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } }
I20260709 12:17:24.354938 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:24.355569 11735 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:24.345278 11481 rpcz_store.cc:276] 0709 12:17:18.221124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.221421 (+   297us) service_pool.cc:224] Handling call
0709 12:17:24.309135 (+6087714us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:23.852572 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:23.938258 (+ 85686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:23.959350 (+ 21092us) write_op.cc:435] Acquired schema lock
0709 12:17:23.960161 (+   811us) tablet.cc:662] Decoding operations
0709 12:17:24.002773 (+ 42612us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:24.002861 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:24.002891 (+    30us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:17:24.004384 (+  1493us) tablet.cc:701] Row locks acquired
0709 12:17:24.004400 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:17:24.004555 (+   155us) write_op.cc:270] Start()
0709 12:17:24.004697 (+   142us) write_op.cc:276] Timestamp: P: 1783599444004508 usec, L: 0
0709 12:17:24.004718 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:17:24.006173 (+  1455us) log.cc:844] Serialized 5501 byte log entry
0709 12:17:24.206225 (+200052us) op_driver.cc:464] REPLICATION: finished
0709 12:17:24.256407 (+ 50182us) write_op.cc:301] APPLY: starting
0709 12:17:24.256506 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:24.256745 (+   239us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:24.256847 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:24.259570 (+  2723us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:24.259789 (+   219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:17:24.259829 (+    40us) write_op.cc:312] APPLY: finished
0709 12:17:24.260100 (+   271us) log.cc:844] Serialized 100 byte log entry
0709 12:17:24.262546 (+  2446us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:24.262697 (+   151us) write_op.cc:454] Released schema lock
0709 12:17:24.262744 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:24.263095 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:24.263124 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":481,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":49435,"apply.run_cpu_time_us":3031,"apply.run_wall_time_us":6661,"num_ops":14,"prepare.queue_time_us":125316,"prepare.run_cpu_time_us":10170,"prepare.run_wall_time_us":178908,"raft.queue_time_us":120883,"raft.run_cpu_time_us":22739,"raft.run_wall_time_us":49687,"replication_time_us":201352,"thread_start_us":225528,"threads_started":4,"wal-append.queue_time_us":38340}]]}
I20260709 12:17:24.355580 11484 catalog_manager.cc:5697] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 4 to 7, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 7 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:24.358433 11484 catalog_manager.cc:5697] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:24.359386 11484 catalog_manager.cc:5697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:24.360572 11484 catalog_manager.cc:5697] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 4 to 5, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 5 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:24.359540 11773 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:24.368121 11735 raft_consensus.cc:1275] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:24.368558 11735 pending_rounds.cc:85] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef: Aborting all ops after (but not including) 2
I20260709 12:17:24.368762 11735 pending_rounds.cc:107] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:17:24.368966 11735 raft_consensus.cc:2889] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:24.360908 13890 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:24.371023 13890 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:24.371887 13888 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:24.372334 13888 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:24.372697 13888 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:24.372977 13890 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:24.373531 13890 consensus_queue.cc:1048] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:24.367045 11484 catalog_manager.cc:5697] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 3 to 5, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 5 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:24.387485 13750 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:24.382282 11484 catalog_manager.cc:5697] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 5 to 6, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 6 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:24.389034 11484 catalog_manager.cc:5697] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 3 to 6, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 6 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:24.389482 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:24.390904 11484 catalog_manager.cc:5697] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:24.394461  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:24.391842 12431 raft_consensus.cc:2393] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 4: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:24.428622 13888 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:24.436959 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:24.437716 12437 raft_consensus.cc:2393] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 4: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:24.438163 13888 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:24.437177 11484 catalog_manager.cc:5697] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 5 to 8, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 8 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:24.446557 11484 catalog_manager.cc:5697] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:24.454118 11484 catalog_manager.cc:5697] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 2 to 5, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 5 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:24.456784 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 86491.6us
I20260709 12:17:24.459787 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:24.460000 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:24.466463 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:24.469916 11658 raft_consensus.cc:2393] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 6: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:24.460559 11735 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:24.480665 11727 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:24.479827 11484 catalog_manager.cc:5697] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 4 to 5, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 5 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:24.484980 11484 catalog_manager.cc:5697] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 4 to 5, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 5 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:24.486603 11484 catalog_manager.cc:5697] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 1 to 4, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 4 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } }
I20260709 12:17:24.485647 11773 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:24.488610 11773 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:24.494227 13952 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:24.494752 13952 raft_consensus.cc:493] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:24.494827 13750 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:24.495616 13750 raft_consensus.cc:697] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 4 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:24.495224 13952 raft_consensus.cc:3060] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.536819 13952 raft_consensus.cc:515] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:24.539076 13952 leader_election.cc:290] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:24.497749 13750 consensus_queue.cc:237] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:24.543862 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:24.547456 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f145e4b384244aaaae76147c5ee135ec" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:24.548175 11658 raft_consensus.cc:2393] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cfe9bf206bb14951ba7615683809d178 in current term 6: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
I20260709 12:17:24.554365 11727 raft_consensus.cc:2468] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:24.572492 11773 leader_election.cc:304] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:24.573554 13890 raft_consensus.cc:2804] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:24.574150 13890 raft_consensus.cc:697] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:24.575011 13890 consensus_queue.cc:237] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:24.579706 12437 raft_consensus.cc:1275] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:17:24.580097 12437 pending_rounds.cc:85] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Aborting all ops after (but not including) 5
I20260709 12:17:24.580303 12437 pending_rounds.cc:107] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:17:24.580529 12437 raft_consensus.cc:2889] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:24.582942 13904 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:24.608367 13949 log.cc:927] Time spent T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 12:17:24.620829 11727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:24.626199 11727 raft_consensus.cc:606] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Received request to transfer leadership to TS cfe9bf206bb14951ba7615683809d178
I20260709 12:17:24.627838 11727 raft_consensus.cc:614] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:24.628170 11484 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42110 (request call id 151) took 1865 ms. Trace:
I20260709 12:17:24.624020 11482 catalog_manager.cc:5697] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 3 to 9, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 9 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:24.628594 11484 rpcz_store.cc:276] 0709 12:17:22.762300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.762590 (+   290us) service_pool.cc:224] Handling call
0709 12:17:24.628090 (+1865500us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:24.530448 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:24.530970 (+   522us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:24.530999 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:17:24.531016 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:24.532893 (+  1877us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:24.532946 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:24.532977 (+    31us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:17:24.536330 (+  3353us) tablet.cc:701] Row locks acquired
0709 12:17:24.536349 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:17:24.536483 (+   134us) write_op.cc:270] Start()
0709 12:17:24.536609 (+   126us) write_op.cc:276] Timestamp: P: 1783599444536443 usec, L: 0
0709 12:17:24.536636 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:17:24.537326 (+   690us) log.cc:844] Serialized 10467 byte log entry
0709 12:17:24.552385 (+ 15059us) op_driver.cc:464] REPLICATION: finished
0709 12:17:24.552737 (+   352us) write_op.cc:301] APPLY: starting
0709 12:17:24.552816 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:24.553251 (+   435us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:24.553338 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:24.555600 (+  2262us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:24.555900 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=27
0709 12:17:24.555942 (+    42us) write_op.cc:312] APPLY: finished
0709 12:17:24.556358 (+   416us) log.cc:844] Serialized 181 byte log entry
0709 12:17:24.556509 (+   151us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:24.556728 (+   219us) write_op.cc:454] Released schema lock
0709 12:17:24.556786 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:24.560629 (+  3843us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:24.560658 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35039,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":118,"apply.run_cpu_time_us":6552,"apply.run_wall_time_us":7862,"num_ops":27,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":5987,"prepare.run_wall_time_us":24357,"replication_time_us":15616}]]}
I20260709 12:17:24.633837 11727 raft_consensus.cc:1275] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:24.633455 11482 catalog_manager.cc:5697] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 5, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 5 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } }
I20260709 12:17:24.634843 11482 catalog_manager.cc:5697] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 3 to 7, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 7 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } }
I20260709 12:17:24.636266 11482 catalog_manager.cc:5697] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 4 to 6, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 6 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } }
I20260709 12:17:24.636910 11727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a70076f56284eafba1df611decc3929"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:24.637614 11727 raft_consensus.cc:606] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Received request to transfer leadership to TS cfe9bf206bb14951ba7615683809d178
I20260709 12:17:24.639258 11727 raft_consensus.cc:614] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:24.643801 13776 consensus_queue.cc:1048] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:24.661537 11808 raft_consensus.cc:1275] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:17:24.674602 13801 consensus_queue.cc:1048] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.703831 11727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:24.704866 11727 raft_consensus.cc:606] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:24.704231 11658 raft_consensus.cc:1275] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:17:24.712694 11658 pending_rounds.cc:85] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03: Aborting all ops after (but not including) 2
I20260709 12:17:24.713177 11658 pending_rounds.cc:107] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:17:24.713578 11658 raft_consensus.cc:2889] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:24.715775 13801 consensus_queue.cc:1048] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.742584 11483 catalog_manager.cc:5697] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 5 to 6, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 6 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } }
I20260709 12:17:24.741616 11733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baf220366c63486c90e96d1db47de716"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:24.744796 11733 raft_consensus.cc:606] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Received request to transfer leadership to TS cfe9bf206bb14951ba7615683809d178
I20260709 12:17:24.745138 11733 raft_consensus.cc:614] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:24.750075 11483 catalog_manager.cc:5697] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 7 to 8, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 8 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:24.752395 11483 catalog_manager.cc:5697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:24.755530 11733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:24.753857 11483 catalog_manager.cc:5697] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } }
I20260709 12:17:24.766301 11733 raft_consensus.cc:606] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:24.769701 11733 raft_consensus.cc:614] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:24.770840  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:24.789873  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:24.790723  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:24.797549 11483 catalog_manager.cc:5697] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 2 to 3, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 3 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:24.798650 11482 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42134 (request call id 152) took 3983 ms. Trace:
I20260709 12:17:24.799021 13759 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.799248 11483 catalog_manager.cc:5697] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } }
I20260709 12:17:24.799157 11482 rpcz_store.cc:276] 0709 12:17:20.813186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.814814 (+  1628us) service_pool.cc:224] Handling call
0709 12:17:22.268754 (+1453940us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400701a54. stack: 00007f44fa92c343 00007f44fa92c240 00007f44fa2bb1d4 00007f4503ff9304 00007f4503ff9299 00007f44fd9b5090 00007f44fda53f3a 00007f4503809e9c 00007f450390804e 00007f4501dc92a4 00007f4501dc9232 00007f4501dc9161 00007f4501dc90dc 00007f4501dc8392 00007f44fbd8648c 00007f44fbd858c6
0709 12:17:24.647660 (+2378906us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:24.647690 (+    30us) write_op.cc:454] Released schema lock
0709 12:17:24.796550 (+148860us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:24.639845 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:24.640349 (+   504us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:24.640378 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:17:24.640389 (+    11us) tablet.cc:662] Decoding operations
0709 12:17:24.640894 (+   505us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:24.640947 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:24.640974 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:17:24.641361 (+   387us) tablet.cc:701] Row locks acquired
0709 12:17:24.641381 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:17:24.641508 (+   127us) write_op.cc:270] Start()
0709 12:17:24.641605 (+    97us) write_op.cc:276] Timestamp: P: 1783599444641465 usec, L: 0
0709 12:17:24.641621 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:17:24.642220 (+   599us) log.cc:844] Serialized 1677 byte log entry
0709 12:17:24.644463 (+  2243us) op_driver.cc:464] REPLICATION: finished
0709 12:17:24.644930 (+   467us) write_op.cc:301] APPLY: starting
0709 12:17:24.645010 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:24.645156 (+   146us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:24.645252 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:24.645750 (+   498us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:24.645948 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:17:24.645994 (+    46us) write_op.cc:312] APPLY: finished
0709 12:17:24.646227 (+   233us) log.cc:844] Serialized 40 byte log entry
0709 12:17:24.646398 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:24.646499 (+   101us) write_op.cc:454] Released schema lock
0709 12:17:24.646541 (+    42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":131263,"reported_tablets":36,"spinlock_wait_cycles":743515392,"child_traces":[["op",{"apply.queue_time_us":255,"apply.run_cpu_time_us":1900,"apply.run_wall_time_us":1900,"num_ops":4,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":2621,"prepare.run_wall_time_us":2620,"replication_time_us":2704}]]}
I20260709 12:17:24.800609 13759 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:24.801731 11483 catalog_manager.cc:5697] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 4 to 6, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 6 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:24.804101 13759 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:24.803972 11483 catalog_manager.cc:5697] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 1 to 2, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 2 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:24.807699 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:24.808329 12437 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
I20260709 12:17:24.808051 11483 catalog_manager.cc:5697] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 3 to 7, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 7 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } }
I20260709 12:17:24.808329 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:24.810411 11701 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:24.811169 13857 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:24.811514 13857 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.811839 13857 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.831168 13857 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:24.847282 13857 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:24.847882 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:24.851866 12437 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.855566 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:24.856213 11658 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.859050 12437 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
I20260709 12:17:24.860500 11701 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:24.865934 13857 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:24.866669 13857 raft_consensus.cc:697] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:24.868245 11658 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
I20260709 12:17:24.868729 13954 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.869151 13954 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:24.873581 13857 consensus_queue.cc:237] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:24.880404 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:24.883162 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:24.883821 12437 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
I20260709 12:17:24.886054 11627 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef
I20260709 12:17:24.886818 13851 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:24.887174 13851 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.887472 13851 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:24.897627 13851 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:24.897876 13954 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:24.901058 12437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:24.901613 12437 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:24.920375 12437 raft_consensus.cc:2468] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 8.
I20260709 12:17:24.924635 11627 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:24.926086 13776 raft_consensus.cc:2804] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:24.926544 13776 raft_consensus.cc:697] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 8 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:24.927342 13776 consensus_queue.cc:237] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:24.939646 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95dddd4031d4b029df099f3324d5574" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:24.941668 13851 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:24.964039 11481 catalog_manager.cc:5697] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 9 to 10, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 10 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:24.967967 11481 catalog_manager.cc:5697] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 3 to 5, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 5 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } }
I20260709 12:17:25.037906 11484 catalog_manager.cc:5697] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 8 to 9, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 9 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:25.050220 13801 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.050742 13801 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:25.052995 13801 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:25.055333 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:25.055667 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:25.056242 11733 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 4.
I20260709 12:17:25.058655 12387 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc; no voters: 
I20260709 12:17:25.059500 13411 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:25.059866 13411 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.060196 13411 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.082268 13411 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:25.084357 13801 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.087385 13801 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:25.086813 11733 raft_consensus.cc:1275] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:25.089423 13952 consensus_queue.cc:1048] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:25.095170 11482 catalog_manager.cc:5697] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 5 to 6, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 6 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.101085 11482 catalog_manager.cc:5697] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 4 to 6, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65). New cstate: current_term: 6 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } }
I20260709 12:17:25.115872 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:25.116550 11808 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 7.
I20260709 12:17:25.119580 11733 raft_consensus.cc:1275] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:25.112037 11482 catalog_manager.cc:5697] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 1 to 5, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 5 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.120807 12386 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:25.120977 13890 consensus_queue.cc:1048] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:25.121071 11482 catalog_manager.cc:5697] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 3 to 4, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 4 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:25.129472 13776 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.130177 13776 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:25.132225 13776 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:25.134002 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:25.121623 13788 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:25.134760 13788 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.135085 13788 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:25.135748 11809 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
I20260709 12:17:25.138229 12434 raft_consensus.cc:1240] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Rejecting Update request from peer cfe9bf206bb14951ba7615683809d178 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:25.141394 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:25.142743 13890 consensus_queue.cc:1059] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:25.143613 11624 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:25.144332 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:25.144694 11658 raft_consensus.cc:1275] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:25.147106 11484 catalog_manager.cc:5697] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 5 to 8, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 8 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:25.146270 13952 consensus_queue.cc:1048] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:25.143622 13890 raft_consensus.cc:3055] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:25.151463 13776 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:25.151551 13411 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
W20260709 12:17:25.186949 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 45667.3us
I20260709 12:17:25.188656 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:25.178553 13776 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.177865 13890 raft_consensus.cc:740] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:25.190986 13801 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:25.192895 13776 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:25.215653 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:25.216418 13890 consensus_queue.cc:260] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:25.217667 13890 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.226222 13788 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:25.227507 12438 raft_consensus.cc:2393] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 8: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:25.231773 13788 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:25.237213 13776 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:25.280795 12386 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc; no voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:25.284228 11653 raft_consensus.cc:2393] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce38e95b93a640c1a7b16f37868b30fc in current term 8: Already voted for candidate b0f903ca23da45e594b2850337751f03 in this term.
W20260709 12:17:25.285852 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 66842.1us
I20260709 12:17:25.287235 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:25.287254 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "ce38e95b93a640c1a7b16f37868b30fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:25.284197 13963 raft_consensus.cc:2749] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:25.289011 11809 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:25.307572 11809 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce38e95b93a640c1a7b16f37868b30fc in term 8.
I20260709 12:17:25.312611 13776 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:25.319527 12386 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:25.320497 13965 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:25.321017 13965 raft_consensus.cc:697] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 8 LEADER]: Becoming Leader. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:25.321913 13965 consensus_queue.cc:237] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:25.333422 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:25.335078 11809 raft_consensus.cc:2393] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f903ca23da45e594b2850337751f03 in current term 8: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:25.339349 12431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:25.354154 13759 raft_consensus.cc:993] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:17:25.356003 11733 raft_consensus.cc:3055] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:25.356415 11733 raft_consensus.cc:740] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:25.374234 13979 raft_consensus.cc:1081] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Signalling peer b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:17:25.377337 12438 raft_consensus.cc:1240] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:25.388147 13980 consensus_queue.cc:1059] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.389431 11627 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:25.395646 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 59730.1us
I20260709 12:17:25.400738 11657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:17:25.401299 11657 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:25.401669 11657 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.392817 13851 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:25.405409 12431 raft_consensus.cc:1275] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:25.409399 11657 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:25.415037 11733 consensus_queue.cc:260] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:25.416316 11733 raft_consensus.cc:3060] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:25.422420 11653 raft_consensus.cc:1240] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 8 LEADER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:25.427855 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:25.428390 11808 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.436305 11808 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:25.438870 11624 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:25.436748 11657 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:25.439568 13777 consensus_queue.cc:1048] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.441120 13851 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:25.441576 13851 raft_consensus.cc:697] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:25.442353 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:25.442421 13851 consensus_queue.cc:237] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:25.444463 11726 raft_consensus.cc:3055] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:25.444860 11726 raft_consensus.cc:740] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:25.447751 11808 raft_consensus.cc:1240] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Rejecting Update request from peer 264376c764c64dc78c4cef6031c15eef for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:25.445544 11726 consensus_queue.cc:260] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:25.459216 11726 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.461133 11733 raft_consensus.cc:1275] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:17:25.461571 11733 pending_rounds.cc:85] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef: Aborting all ops after (but not including) 3
I20260709 12:17:25.461824 11733 pending_rounds.cc:107] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:17:25.462049 11733 raft_consensus.cc:2889] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:25.461277 11482 catalog_manager.cc:5697] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ce38e95b93a640c1a7b16f37868b30fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:25.469040 13980 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:17:25.470768 13777 consensus_queue.cc:1048] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.528360 11726 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:25.554486 11483 catalog_manager.cc:5697] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 5 to 6, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 6 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:25.832002 11808 raft_consensus.cc:1275] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:25.833686 13965 consensus_queue.cc:1048] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.848606 11804 raft_consensus.cc:1275] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:25.852177 13776 consensus_queue.cc:1048] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.878630 11657 raft_consensus.cc:1275] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Refusing update from remote peer ce38e95b93a640c1a7b16f37868b30fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:25.884929 13965 consensus_queue.cc:1048] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:25.901602 11733 raft_consensus.cc:1275] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:25.903564 13851 consensus_queue.cc:1048] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.963068  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:26.063920 11733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:26.064527 11733 raft_consensus.cc:606] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 8 LEADER]: Received request to transfer leadership to TS cfe9bf206bb14951ba7615683809d178
I20260709 12:17:26.109041 12438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baf220366c63486c90e96d1db47de716"
dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
mode: GRACEFUL
new_leader_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:33334
I20260709 12:17:26.109628 12438 raft_consensus.cc:606] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Received request to transfer leadership to TS cfe9bf206bb14951ba7615683809d178
I20260709 12:17:26.112488 11727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:26.113049 11727 raft_consensus.cc:606] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Received request to transfer leadership to TS cfe9bf206bb14951ba7615683809d178
I20260709 12:17:26.122416 11727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:26.122972 11727 raft_consensus.cc:606] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Received request to transfer leadership to TS cfe9bf206bb14951ba7615683809d178
I20260709 12:17:26.133926 11727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:26.134073 13400 raft_consensus.cc:993] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc: : Instructing follower cfe9bf206bb14951ba7615683809d178 to start an election
I20260709 12:17:26.134616 11727 raft_consensus.cc:606] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Received request to transfer leadership to TS b0f903ca23da45e594b2850337751f03
I20260709 12:17:26.134714 13400 raft_consensus.cc:1081] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Signalling peer cfe9bf206bb14951ba7615683809d178 to start an election
I20260709 12:17:26.135744  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:26.137468  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:26.138264  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:26.147316 11805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "baf220366c63486c90e96d1db47de716"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:51068
I20260709 12:17:26.151857 11805 raft_consensus.cc:493] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:26.153031 11805 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.162880 13977 raft_consensus.cc:993] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower cfe9bf206bb14951ba7615683809d178 to start an election
I20260709 12:17:26.164661 13977 raft_consensus.cc:1081] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Signalling peer cfe9bf206bb14951ba7615683809d178 to start an election
I20260709 12:17:26.167760 11804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:56490
I20260709 12:17:26.168270 11804 raft_consensus.cc:493] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:26.168579 11804 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.195730 11805 raft_consensus.cc:515] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:26.241009 13984 raft_consensus.cc:993] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef: : Instructing follower cfe9bf206bb14951ba7615683809d178 to start an election
I20260709 12:17:26.242170 13984 raft_consensus.cc:1081] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 8 LEADER]: Signalling peer cfe9bf206bb14951ba7615683809d178 to start an election
I20260709 12:17:26.244000 11808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:56490
I20260709 12:17:26.244493 11808 raft_consensus.cc:493] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:26.244822 11808 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:26.187330 11804 raft_consensus.cc:515] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.255918 11808 raft_consensus.cc:515] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.259258 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:26.259924 11657 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.262542 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:26.261631 11808 leader_election.cc:290] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:26.263103 11654 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:26.266580 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8968bb0a7df844fd868c906fb62847ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:26.267059 11727 raft_consensus.cc:3055] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:26.267284 11727 raft_consensus.cc:740] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:26.272125 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c43c72411f483a8d001721079be3d1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:26.272737 11733 raft_consensus.cc:3055] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:26.272996 11733 raft_consensus.cc:740] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:26.273684 11733 consensus_queue.cc:260] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.274694 11733 raft_consensus.cc:3060] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.267881 11727 consensus_queue.cc:260] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.293381 11727 raft_consensus.cc:3060] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:26.295958 11654 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 9.
I20260709 12:17:26.269829 11804 leader_election.cc:290] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:26.298638 11773 leader_election.cc:304] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:26.299015 11657 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
I20260709 12:17:26.305190 13978 raft_consensus.cc:2804] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:26.305799 13978 raft_consensus.cc:697] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 9 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:26.311046 11733 raft_consensus.cc:2468] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
I20260709 12:17:26.314852 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:26.315512 11735 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.317631 11805 leader_election.cc:290] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:26.319597 13978 consensus_queue.cc:237] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.334321 11735 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
I20260709 12:17:26.333743 11773 leader_election.cc:304] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:26.336951 11727 raft_consensus.cc:2468] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 9.
I20260709 12:17:26.339201 12434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf220366c63486c90e96d1db47de716" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:26.339797 12434 raft_consensus.cc:3055] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:26.340081 12434 raft_consensus.cc:740] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce38e95b93a640c1a7b16f37868b30fc, State: Running, Role: LEADER
I20260709 12:17:26.340785 12434 consensus_queue.cc:260] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:26.346712 13997 raft_consensus.cc:2804] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:26.347440 13997 raft_consensus.cc:697] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:26.348291 13997 consensus_queue.cc:237] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.350276 12434 raft_consensus.cc:3060] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.372103 11773 leader_election.cc:304] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:26.372953 13952 raft_consensus.cc:2804] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:26.373448 13952 raft_consensus.cc:697] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:26.374357 13952 consensus_queue.cc:237] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:26.376226 12434 raft_consensus.cc:2468] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
I20260709 12:17:26.392910 11482 catalog_manager.cc:5697] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 8 to 9, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 9 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:26.489343 13977 raft_consensus.cc:993] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:17:26.489830 13977 raft_consensus.cc:1081] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Signalling peer b0f903ca23da45e594b2850337751f03 to start an election
I20260709 12:17:26.493515 11657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461"
dest_uuid: "b0f903ca23da45e594b2850337751f03"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:17:26.494107 11657 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:26.494417 11657 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.506784 11657 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.510142 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:26.510819 11735 raft_consensus.cc:3055] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:26.511142 11735 raft_consensus.cc:740] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:26.511875 11735 consensus_queue.cc:260] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.513135 11735 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.533812 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:26.534557 11808 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.549139 11482 catalog_manager.cc:5697] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 6 to 7, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 7 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:26.554353 11482 catalog_manager.cc:5697] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 6 to 7, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 7 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:26.565825 11808 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:26.573153 11624 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:26.574321 13954 raft_consensus.cc:2804] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.568347 11735 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:26.571872 11657 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:26.574774 13954 raft_consensus.cc:697] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:26.575696 13954 consensus_queue.cc:237] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.603012 11482 catalog_manager.cc:5697] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 4 to 5, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 5 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:26.624804 13980 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:26.625316 13980 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:26.627444 13980 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:26.629841 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc" is_pre_election: true
I20260709 12:17:26.630654 12438 raft_consensus.cc:2393] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 5: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:26.632292 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:26.632956 11808 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:26.634326 11698 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:26.635528 13980 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:26.635879 13980 raft_consensus.cc:493] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election (detected failure of leader cfe9bf206bb14951ba7615683809d178)
I20260709 12:17:26.636155 13980 raft_consensus.cc:3060] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.657936 13980 raft_consensus.cc:515] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:26.661791 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:26.662580 12438 raft_consensus.cc:2393] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 264376c764c64dc78c4cef6031c15eef in current term 5: Already voted for candidate ce38e95b93a640c1a7b16f37868b30fc in this term.
I20260709 12:17:26.663733 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cd6fe5b3471e94399825d62e6646" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:26.663827 13980 leader_election.cc:290] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:26.671375 11805 raft_consensus.cc:2468] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:26.672467 11698 leader_election.cc:304] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:26.673471 13980 raft_consensus.cc:2804] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.674145 13980 raft_consensus.cc:697] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:26.674932 13980 consensus_queue.cc:237] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:26.700410 13984 raft_consensus.cc:993] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef: : Instructing follower cfe9bf206bb14951ba7615683809d178 to start an election
I20260709 12:17:26.700894 13977 raft_consensus.cc:1081] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Signalling peer cfe9bf206bb14951ba7615683809d178 to start an election
I20260709 12:17:26.704351 11805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:56490
I20260709 12:17:26.704916 11805 raft_consensus.cc:493] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:26.705250 11805 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.712405 11805 raft_consensus.cc:515] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.716522 11482 catalog_manager.cc:5697] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 4 to 5, leader changed from cfe9bf206bb14951ba7615683809d178 (127.4.78.68) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 5 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:26.720702 11735 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:26.722414 13952 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:26.742627 11805 leader_election.cc:290] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:26.753067 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:26.753657 11735 raft_consensus.cc:3055] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:26.753950 11735 raft_consensus.cc:740] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:26.754644 11735 consensus_queue.cc:260] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.755787 11735 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.768242 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da144a8884c1479980762ec9a874ec7f" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:26.769734 11654 raft_consensus.cc:3060] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.790699 11657 raft_consensus.cc:1275] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:26.802557 13996 consensus_queue.cc:1048] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:26.824013 12434 raft_consensus.cc:1275] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:26.828568 13978 consensus_queue.cc:1048] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:26.858873 11733 raft_consensus.cc:1275] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:26.862921 11735 raft_consensus.cc:2468] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:26.863607 13997 consensus_queue.cc:1048] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:26.864799 11773 leader_election.cc:304] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:26.865486 11733 raft_consensus.cc:1275] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:26.866024 13997 raft_consensus.cc:2804] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.866592 13997 raft_consensus.cc:697] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:26.867607 13997 consensus_queue.cc:237] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:26.870613 13996 consensus_queue.cc:1048] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:26.928400 11482 catalog_manager.cc:5697] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 4 to 5, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 5 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:26.944103 11654 raft_consensus.cc:2468] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:26.952533 11654 raft_consensus.cc:1275] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:26.955262 13997 consensus_queue.cc:1048] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:27.078169 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 77127.8us
I20260709 12:17:27.086385 11805 raft_consensus.cc:1275] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:27.093161 11735 raft_consensus.cc:1275] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:17:27.134943 14017 log.cc:927] Time spent T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:27.092336 13954 consensus_queue.cc:1048] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:17:27.151060 14019 consensus_queue.cc:1048] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:27.202515 11808 raft_consensus.cc:1275] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:27.211324 14028 consensus_queue.cc:1048] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:27.263836 12438 raft_consensus.cc:1275] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:27.308291 14031 consensus_queue.cc:1048] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:27.320968  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:27.344475 11727 raft_consensus.cc:1275] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:27.345922 13978 consensus_queue.cc:1048] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:27.389930 11657 raft_consensus.cc:1275] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:27.391378 13978 consensus_queue.cc:1048] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:27.483544 11727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "001b8afd665e4f66a4529aec50993495"
dest_uuid: "264376c764c64dc78c4cef6031c15eef"
mode: GRACEFUL
new_leader_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:17:27.484125 11727 raft_consensus.cc:606] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Received request to transfer leadership to TS cfe9bf206bb14951ba7615683809d178
I20260709 12:17:27.501317  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:17:27.504168 14028 raft_consensus.cc:993] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef: : Instructing follower cfe9bf206bb14951ba7615683809d178 to start an election
I20260709 12:17:27.504714 14028 raft_consensus.cc:1081] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Signalling peer cfe9bf206bb14951ba7615683809d178 to start an election
I20260709 12:17:27.504938  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:27.505782  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:27.507730 11804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "001b8afd665e4f66a4529aec50993495"
dest_uuid: "cfe9bf206bb14951ba7615683809d178"
 from {username='slave'} at 127.0.0.1:56490
I20260709 12:17:27.508289 11804 raft_consensus.cc:493] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:27.508606 11804 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.515540 11804 raft_consensus.cc:515] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:27.518113 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:27.518692 11727 raft_consensus.cc:3055] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:27.518970 11727 raft_consensus.cc:740] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:27.521041 11727 consensus_queue.cc:260] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:27.522096 11727 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.530014 11727 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:27.535033 11804 leader_election.cc:290] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:27.538535 11773 leader_election.cc:304] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:27.539002 12438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001b8afd665e4f66a4529aec50993495" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "ce38e95b93a640c1a7b16f37868b30fc"
I20260709 12:17:27.539570 12438 raft_consensus.cc:3060] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.541939 14036 raft_consensus.cc:2804] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:27.542475 14036 raft_consensus.cc:697] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:27.543272 14036 consensus_queue.cc:237] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:27.546506 12438 raft_consensus.cc:2468] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:27.594063 11482 catalog_manager.cc:5697] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 5 to 6, leader changed from 264376c764c64dc78c4cef6031c15eef (127.4.78.67) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 6 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:28.038197 12438 raft_consensus.cc:1275] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:28.040079 14029 consensus_queue.cc:1048] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:28.132103 11726 raft_consensus.cc:1275] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:28.178751 14036 consensus_queue.cc:1048] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:17:28.391989 12387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 104838us
W20260709 12:17:28.415741 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 62729.5us
I20260709 12:17:28.607221  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:28.947500  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:28.949182  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:28.950384  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:29.490533  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:29.975309  4409 tablet_server.cc:179] TabletServer@127.4.78.65:36331 shutting down...
W20260709 12:17:29.988782 11775 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 18 similar messages]
W20260709 12:17:30.018126 11775 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.022331 11627 consensus_peers.cc:597] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.042549 11701 consensus_peers.cc:597] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.047062 11701 consensus_peers.cc:597] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.049327 11701 consensus_peers.cc:597] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.047878 11775 consensus_peers.cc:597] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.051422 11775 consensus_peers.cc:597] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.055341 11775 consensus_peers.cc:597] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.051483 11701 consensus_peers.cc:597] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.101853 11627 consensus_peers.cc:597] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.106259 11701 consensus_peers.cc:597] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.139777 11775 consensus_peers.cc:597] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.156335  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:30.157691  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.159080  4409 raft_consensus.cc:2243] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.159817  4409 raft_consensus.cc:2272] T e0df0d2cb8774fe0b3479eeb8e30027d P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:30.161360 11627 consensus_peers.cc:597] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.163733  4409 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:30.165918 11627 consensus_peers.cc:597] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.170718  4409 raft_consensus.cc:2243] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.172155  4409 raft_consensus.cc:2272] T bc6434e787264f388930e3ed1add578a P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.176035  4409 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:30.186302 11775 consensus_peers.cc:597] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.186594  4409 raft_consensus.cc:2243] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.192394  4409 raft_consensus.cc:2272] T 13f2b34efd194430a04442a394ce05c1 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.196084  4409 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:30.200866 11775 consensus_peers.cc:597] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.206033  4409 raft_consensus.cc:2243] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.206869  4409 raft_consensus.cc:2272] T 195b741f1d144afab8c37ecc3be587b1 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:30.209133 11701 consensus_peers.cc:597] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.209892 11775 consensus_peers.cc:597] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.213585  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.214622  4409 raft_consensus.cc:2243] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:30.218398 11627 consensus_peers.cc:597] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.229096  4409 raft_consensus.cc:2272] T f1b1feee36a2425db32953f79a0b0c0a P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.232802  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.240715  4409 raft_consensus.cc:2243] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.241492  4409 raft_consensus.cc:2272] T a236cb878f1e49098e43b2733a84eb5c P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.244670  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.245702  4409 raft_consensus.cc:2243] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.246470  4409 raft_consensus.cc:2272] T 79d2242d216849e096e87b165c9d6778 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:30.250625 11775 consensus_peers.cc:597] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.262707  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.264029  4409 raft_consensus.cc:2243] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.264773  4409 raft_consensus.cc:2272] T 869a40a36ae44ac9af963b7e09384543 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.268185  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.278491  4409 raft_consensus.cc:2243] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.279351  4409 raft_consensus.cc:2272] T 7004b9d11647433b94b3d6a7c3e247f6 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.282724  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.283725  4409 raft_consensus.cc:2243] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:17:30.284595 11701 consensus_peers.cc:597] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.287277 11701 consensus_peers.cc:597] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.284897  4409 raft_consensus.cc:2272] T a6b7ee7fe2c64c44901ea84bd330b073 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:30.289952 11701 consensus_peers.cc:597] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.291875  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.292901  4409 raft_consensus.cc:2243] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.293537  4409 raft_consensus.cc:2272] T d95dddd4031d4b029df099f3324d5574 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.296715  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.303638  4409 raft_consensus.cc:2243] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.304381  4409 raft_consensus.cc:2272] T c6ff7b5bd9f340839cbde90d6b7259c7 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.307760  4409 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:30.318205 11775 consensus_peers.cc:597] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.318502  4409 raft_consensus.cc:2243] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.319394  4409 raft_consensus.cc:2272] T 51181cd84fab48ffb41a532d72daf42d P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.322827  4409 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:30.323573 11701 consensus_peers.cc:597] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.323835  4409 raft_consensus.cc:2243] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.324564  4409 raft_consensus.cc:2272] T 25e58426365f4050aa2b97643be55ad4 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.327669  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.332803  4409 raft_consensus.cc:2243] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.333521  4409 raft_consensus.cc:2272] T a0fdac8111fe4c49bccd7e22a650cccc P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.336915  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.343921  4409 raft_consensus.cc:2243] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.344650  4409 raft_consensus.cc:2272] T 001b8afd665e4f66a4529aec50993495 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.347960  4409 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:30.354385 11627 consensus_peers.cc:597] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.358861  4409 raft_consensus.cc:2243] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.360186  4409 raft_consensus.cc:2272] T d70373b1ffec4647a2eb32b5cb550542 P ce38e95b93a640c1a7b16f37868b30fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.363415  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.364292  4409 raft_consensus.cc:2243] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.365605  4409 raft_consensus.cc:2272] T d3c499278cbd4f3094888a0d7373a5dc P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:30.384493 11627 consensus_peers.cc:597] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.385069  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.386109  4409 raft_consensus.cc:2243] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.386921  4409 raft_consensus.cc:2272] T 63eff9adc00b4c7f8245454c066123ed P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.390329  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.391207  4409 raft_consensus.cc:2243] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.391996  4409 raft_consensus.cc:2272] T 7a70076f56284eafba1df611decc3929 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.396629  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.397470  4409 raft_consensus.cc:2243] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.404599  4409 raft_consensus.cc:2272] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.410761  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.414368  4409 raft_consensus.cc:2243] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.415556  4409 raft_consensus.cc:2272] T 46a96b7da08f479dbbc7413cdacfa720 P ce38e95b93a640c1a7b16f37868b30fc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.421006  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.430531  4409 raft_consensus.cc:2243] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.431725  4409 raft_consensus.cc:2272] T a7852dc16ba7411fa9eadde150e3dcaa P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.434677  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.435547  4409 raft_consensus.cc:2243] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.436133  4409 raft_consensus.cc:2272] T d12f3af68cd84f68b5137c6abe65e63e P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.443879  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.444669  4409 raft_consensus.cc:2243] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.445333  4409 raft_consensus.cc:2272] T bca6d1536f234395afd9bcbfe398e689 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.448321  4409 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:30.454026 11701 consensus_peers.cc:597] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.462416  4409 raft_consensus.cc:2243] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.463783  4409 raft_consensus.cc:2272] T 09f4699c530a4e4fb165983ca95e4a6b P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.466979  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.467815  4409 raft_consensus.cc:2243] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.468498  4409 raft_consensus.cc:2272] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:30.473367 11775 consensus_peers.cc:597] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.486574  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.489431  4409 raft_consensus.cc:2243] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.490598  4409 raft_consensus.cc:2272] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.496636  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.502606  4409 raft_consensus.cc:2243] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.503947  4409 raft_consensus.cc:2272] T f5b9e8af33874d1da7a3fa1b4fc455f0 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.519388  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.520288  4409 raft_consensus.cc:2243] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.521528  4409 raft_consensus.cc:2272] T cf073dc4ac2044dfadb5f017646c8101 P ce38e95b93a640c1a7b16f37868b30fc [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.524890  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.525857  4409 raft_consensus.cc:2243] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.546330  4409 raft_consensus.cc:2272] T a81f5cf331ca4fb7bc00211769a655b4 P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.549386  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.550199  4409 raft_consensus.cc:2243] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.550921  4409 raft_consensus.cc:2272] T 841068979f35457ca7200408e6d522a9 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:30.563001 11701 consensus_peers.cc:597] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.576596  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.577507  4409 raft_consensus.cc:2243] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.578286  4409 raft_consensus.cc:2272] T f6924fe8aeff4ed699be088221835654 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.600384  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.601186  4409 raft_consensus.cc:2243] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.601838  4409 raft_consensus.cc:2272] T 225a49e8e4114f8baf86d7c29f4635d5 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.604667  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.605382  4409 raft_consensus.cc:2243] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.630841  4409 raft_consensus.cc:2272] T 77633186a3bc4fbe82ee020cad674e30 P ce38e95b93a640c1a7b16f37868b30fc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.640803  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.641701  4409 raft_consensus.cc:2243] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.642940  4409 raft_consensus.cc:2272] T 1e219590d128498d88773c090b1fc4f3 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.652362  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.670410  4409 raft_consensus.cc:2243] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.671216  4409 raft_consensus.cc:2272] T a54188b47043494b8e7d633bcfbcab11 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.674283  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.677213  4409 raft_consensus.cc:2243] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.682896  4409 raft_consensus.cc:2272] T ee0cd617dac6426780fb32e90db31859 P ce38e95b93a640c1a7b16f37868b30fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.686409  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.710387  4409 raft_consensus.cc:2243] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.711138  4409 raft_consensus.cc:2272] T 60c076143e0f4e3cb04896d3f733461b P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.714392  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.726437  4409 raft_consensus.cc:2243] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.727397  4409 raft_consensus.cc:2272] T 4ac74a4093c34756a969a33ff35146ad P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.730832  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.741214  4409 raft_consensus.cc:2243] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.743337  4409 raft_consensus.cc:2272] T baf220366c63486c90e96d1db47de716 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.746757  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.764386  4409 raft_consensus.cc:2243] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.765139  4409 raft_consensus.cc:2272] T a633993d8d3341eeaddce5c93752db1e P ce38e95b93a640c1a7b16f37868b30fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.776758  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.782372  4409 raft_consensus.cc:2243] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.783178  4409 raft_consensus.cc:2272] T b748cd6fe5b3471e94399825d62e6646 P ce38e95b93a640c1a7b16f37868b30fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.786156  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.799257  4409 raft_consensus.cc:2243] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:30.806723  4409 raft_consensus.cc:2272] T 2e4a55c602a24e9aa3bd55a9fef99c18 P ce38e95b93a640c1a7b16f37868b30fc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:30.809998  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:30.826370  4409 raft_consensus.cc:2243] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:30.827203  4409 raft_consensus.cc:2272] T 6a80694829ab40a8b9b84840d8c384ff P ce38e95b93a640c1a7b16f37868b30fc [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:31.000811 11775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 46573us
I20260709 12:17:31.260934 14065 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.261555 14065 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.271700 14065 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.275033 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:31.276299 11775 leader_election.cc:336] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.277798 11773 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.278560 14065 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:31.310127 14061 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.310691 14061 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.312901 14061 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:31.315006 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:31.315775 11808 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:31.317466 11624 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:31.321429 14061 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:31.322412 14061 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
W20260709 12:17:31.321929 11627 leader_election.cc:336] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.322866 14061 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.333668 14061 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:31.356959 11627 leader_election.cc:336] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.357838 14061 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:31.358132 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6434e787264f388930e3ed1add578a" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:31.369701 11808 raft_consensus.cc:3060] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.380075 11808 raft_consensus.cc:2468] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
I20260709 12:17:31.390729 11624 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.392473 14061 raft_consensus.cc:2804] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:31.393056 14061 raft_consensus.cc:697] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:31.395143 14061 consensus_queue.cc:237] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.409238 14065 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.410017 14065 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.415556 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:31.421262 11775 leader_election.cc:336] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.421703 11775 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.422546 14065 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.423301 14071 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:31.434352 11482 catalog_manager.cc:5697] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 6 to 7, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 7 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:31.492058 14031 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.492702 14031 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:31.494844 14031 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.498821 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:31.499466 11658 raft_consensus.cc:2468] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:31.500880 11699 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:31.501888 14069 raft_consensus.cc:2804] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:31.502255 14069 raft_consensus.cc:493] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.502578 14069 raft_consensus.cc:3060] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:31.506199 11701 leader_election.cc:336] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.522413 14069 raft_consensus.cc:515] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:31.524531 14065 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.534085 14065 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.536058 14065 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.537503 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
W20260709 12:17:31.544231 11701 leader_election.cc:336] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:31.544612 11775 leader_election.cc:336] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.545693 14069 leader_election.cc:290] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.546319 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70373b1ffec4647a2eb32b5cb550542" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:31.546886 11658 raft_consensus.cc:3060] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:31.556093 11658 raft_consensus.cc:2468] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:31.545174 11775 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.562541 11699 leader_election.cc:304] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.562821 14065 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:31.563652 14069 raft_consensus.cc:2804] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:31.564122 14069 raft_consensus.cc:697] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:31.564942 14069 consensus_queue.cc:237] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:31.577098 14061 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.577724 14061 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.580390 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:31.581000 11808 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:31.582146 11624 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:31.583065 14062 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:31.583423 14062 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.583768 14062 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.594033 14065 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.580607 14061 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:31.594596 14065 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.596966 14065 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:31.591552 11627 leader_election.cc:336] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.601384 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:31.596630 14062 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:31.602588 11775 leader_election.cc:336] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.611873 11773 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.612815 14055 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:31.615386 14061 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.616006 14061 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:31.619329 11627 leader_election.cc:336] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.621290 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:31.623447 14061 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:31.625645 14055 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.626312 14055 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
W20260709 12:17:31.627079 11627 leader_election.cc:336] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.627612 11627 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.628391 14055 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:31.628831 14061 raft_consensus.cc:2749] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:31.630295 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:31.612116 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4155ea2d0cb34a1b9bd7f3d44b6285f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:31.631773 11808 raft_consensus.cc:3060] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.633123 14033 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.633621 14033 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.635684 14033 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:31.629681 14062 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:31.637279 11775 leader_election.cc:336] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.637532 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:31.637851 11775 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.638289 11804 raft_consensus.cc:2468] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
I20260709 12:17:31.639411 11624 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:31.640461 11808 raft_consensus.cc:2468] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
I20260709 12:17:31.641690 11624 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.642500 14033 raft_consensus.cc:2804] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:31.642769 14065 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.643532 14055 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:31.643015 14033 raft_consensus.cc:697] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:31.644481 14065 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.644737 14033 consensus_queue.cc:237] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.646615 14065 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.648157 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:31.648509 14062 raft_consensus.cc:2804] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:31.648957 14062 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.649361 14062 raft_consensus.cc:3060] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:31.654719 11775 leader_election.cc:336] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:31.655287 11627 leader_election.cc:336] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.658001 11775 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.670275 14055 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:31.679344 14033 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.680053 14033 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.682269 14033 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:31.683159 14033 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.683713 14033 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.686221 14061 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.686784 14061 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:31.688771 14061 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:31.690936 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:31.691658 11808 raft_consensus.cc:2468] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 3.
W20260709 12:17:31.693130 11627 leader_election.cc:336] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.695741 11483 catalog_manager.cc:5697] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 3, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:31.699213 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:31.698871 11627 leader_election.cc:336] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.702407 11624 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.703610 14061 raft_consensus.cc:2804] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:31.703809 11625 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.704052 14061 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.681602 11482 catalog_manager.cc:5697] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 6 to 7, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 7 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:31.704458 14061 raft_consensus.cc:3060] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:31.717713 14062 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.734545 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c499278cbd4f3094888a0d7373a5dc" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:31.735441 11808 raft_consensus.cc:3060] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:31.736840 14062 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:31.737632 14062 raft_consensus.cc:2749] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:31.743134 14065 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.743786 14065 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.749334 14061 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.749749 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:31.750502 11804 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:31.751261 14033 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:31.751593 11624 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:31.752741 11808 raft_consensus.cc:2468] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
W20260709 12:17:31.753171 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 49552.9us
I20260709 12:17:31.754226 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7852dc16ba7411fa9eadde150e3dcaa" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:31.754789 11805 raft_consensus.cc:3060] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:31.755110 14082 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:31.755498 14082 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.755841 14082 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:31.757126 11775 leader_election.cc:336] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.753650 11624 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:31.760507 14065 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.766422 14083 raft_consensus.cc:2804] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:31.768909 11805 raft_consensus.cc:2468] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:31.769744 14061 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:31.769793 11627 leader_election.cc:336] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.778846 14065 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.779449 14065 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.781536 14065 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.767181 14084 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.786564 14084 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:31.788753 14084 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:31.792402 11775 leader_election.cc:336] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.804145 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:31.807453 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:31.808097 11805 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:31.809970 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:31.810808 11624 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:31.811882 11624 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:31.812299 14087 raft_consensus.cc:2804] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:31.812706 14033 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:31.813217 14033 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.813625 14033 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:31.813602 11773 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.815846 11773 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.816061 14055 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:31.816363 11804 raft_consensus.cc:1275] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:31.817116 14065 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:31.812810 14087 raft_consensus.cc:697] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:31.818516 14087 consensus_queue.cc:237] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.824618 14062 consensus_queue.cc:1048] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:31.828166 14070 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.828768 14070 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:31.804132 14082 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.834399 14070 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.842365 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:31.841586 14070 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.839784 14033 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:31.845567 14070 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:31.849439 14070 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.851329 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:31.852839 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e219590d128498d88773c090b1fc4f3" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:31.853367 11805 raft_consensus.cc:3060] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:31.851830 11653 raft_consensus.cc:2468] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
W20260709 12:17:31.856832 11701 leader_election.cc:336] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.857434 11701 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.861153 11805 raft_consensus.cc:2468] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:31.861953 11699 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
W20260709 12:17:31.863873 11701 leader_election.cc:336] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.844954 14083 raft_consensus.cc:697] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:31.867169 11624 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:31.867403 14031 raft_consensus.cc:2749] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:31.870087 14070 raft_consensus.cc:2804] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:31.870618 14070 raft_consensus.cc:493] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.871028 14070 raft_consensus.cc:3060] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:31.871712 14082 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:31.874177 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 70683.9us
I20260709 12:17:31.862044 14084 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.878583 14086 raft_consensus.cc:2804] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:31.878736 14083 consensus_queue.cc:237] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.879215 14086 raft_consensus.cc:697] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:31.880471 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b7ee7fe2c64c44901ea84bd330b073" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:31.881325 14069 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.881793 11805 raft_consensus.cc:3060] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:31.877808 14033 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:31.881968 14069 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:31.883576 11627 leader_election.cc:336] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.882123 14086 consensus_queue.cc:237] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:31.886551 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:31.889899 11653 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
I20260709 12:17:31.884981 14069 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.888347 11805 raft_consensus.cc:2468] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 6.
I20260709 12:17:31.890666 11699 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:31.893882 14069 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:31.879784 14084 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:31.885119 14062 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.894274 14069 raft_consensus.cc:493] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.896644 14069 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.896430 14062 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.897481 14084 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:31.898522 11701 leader_election.cc:336] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.899106 11624 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:31.898572 14062 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:31.905992 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:31.908617 14089 raft_consensus.cc:2804] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:31.909257 14089 raft_consensus.cc:697] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:31.909709 14087 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.910211 14089 consensus_queue.cc:237] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.910612 14087 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.916074 11808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:31.916730 11808 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 10.
I20260709 12:17:31.921259 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:31.925221 14087 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:31.934823 11624 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:31.938547 14084 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:31.938928 14084 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.939285 14084 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:31.949680 11627 leader_election.cc:336] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:31.950618 11627 leader_election.cc:336] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:31.951493 11627 leader_election.cc:336] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.946429 14069 raft_consensus.cc:515] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:31.959492 11627 leader_election.cc:336] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.959631 14031 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.959964 11627 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:31.960299 14031 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:31.960876 14091 raft_consensus.cc:2749] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:31.961751 14091 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.962199 14091 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.962464 14031 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.964159 14091 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:31.964962 11627 leader_election.cc:336] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.965416 11627 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:31.966110 14091 raft_consensus.cc:2749] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:31.967033 11627 leader_election.cc:336] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.967543 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:31.968161 11804 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 7.
W20260709 12:17:31.968678 11627 consensus_peers.cc:597] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:31.970045 11701 leader_election.cc:336] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.970999 11624 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
W20260709 12:17:31.974699 11627 leader_election.cc:336] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:31.983217 14071 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:31.985984 14071 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:31.988163 14071 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:31.990007 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:31.990658 11653 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 8.
W20260709 12:17:31.993280 11701 consensus_peers.cc:597] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:31.994391 11773 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:32.000207 11483 catalog_manager.cc:5697] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 3 to 4, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 4 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.003163 14069 leader_election.cc:290] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:32.006224 14065 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:32.006816 14065 raft_consensus.cc:493] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:32.006309 14084 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:32.007234 14065 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:32.008749 14084 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 11 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:32.009413 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1489fa6b6f4aa59c527ec8a7f1c37b" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:32.010025 11805 raft_consensus.cc:3060] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:32.012722 11483 catalog_manager.cc:5697] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 3 to 4, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 4 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:31.983506 14091 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:32.022464 14091 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:32.022926 14091 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:32.025961 11701 leader_election.cc:336] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:32.006624 14070 raft_consensus.cc:515] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:32.019260 11627 leader_election.cc:336] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:32.021148 11805 raft_consensus.cc:2468] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 11.
W20260709 12:17:32.037678 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 76577.5us
I20260709 12:17:32.039659 11624 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:32.041153 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03" is_pre_election: true
I20260709 12:17:32.041786 11653 raft_consensus.cc:2468] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:32.042812 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a96b7da08f479dbbc7413cdacfa720" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:32.043413 11657 raft_consensus.cc:3060] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.041368 14084 raft_consensus.cc:2804] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:32.044220 14084 raft_consensus.cc:697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 11 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:32.045193 14084 consensus_queue.cc:237] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:32.046103 14070 leader_election.cc:290] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:32.050705 11657 raft_consensus.cc:2468] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 7.
I20260709 12:17:32.051931 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4699c530a4e4fb165983ca95e4a6b" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:32.053406 11653 raft_consensus.cc:3060] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:32.051496 11699 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:32.054206 14070 raft_consensus.cc:2804] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:32.054803 14070 raft_consensus.cc:493] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:32.055181 14070 raft_consensus.cc:3060] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:32.062157 14070 raft_consensus.cc:515] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:32.063377 11627 leader_election.cc:336] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:32.064929 11699 leader_election.cc:304] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:32.067302 14031 raft_consensus.cc:2804] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:32.067773 14031 raft_consensus.cc:697] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:32.068542 14031 consensus_queue.cc:237] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:32.070600 11701 leader_election.cc:336] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:32.071552 11653 raft_consensus.cc:2468] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
W20260709 12:17:32.072656 11627 consensus_peers.cc:597] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:32.071594 14091 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:32.072701 11483 catalog_manager.cc:5697] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 5 to 6, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 6 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:32.074291 11483 catalog_manager.cc:5697] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 5 to 6, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 6 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.079851 14089 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:32.080502 14089 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:32.081319 11699 leader_election.cc:304] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:32.082568 14089 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:32.089560 14098 raft_consensus.cc:2804] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:32.090919 14098 raft_consensus.cc:697] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:32.090976 14070 leader_election.cc:290] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:32.092024 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9e8af33874d1da7a3fa1b4fc455f0" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:32.092027 14098 consensus_queue.cc:237] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:32.092932 11805 raft_consensus.cc:3060] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.097091 11653 raft_consensus.cc:1275] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:32.097357 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81f5cf331ca4fb7bc00211769a655b4" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:32.097795 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:32.101892 11727 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 4.
I20260709 12:17:32.102687 11657 raft_consensus.cc:3060] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:32.101291 11805 raft_consensus.cc:2468] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 8.
I20260709 12:17:32.106999 11624 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:32.107579 11625 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: 
I20260709 12:17:32.108583 14083 raft_consensus.cc:2804] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:32.109081 14083 raft_consensus.cc:697] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 8 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:32.110023 14083 consensus_queue.cc:237] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:32.110664 14089 raft_consensus.cc:2804] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:32.096807 14091 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 election: Requested vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:32.114802 14069 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
W20260709 12:17:32.122496 11627 leader_election.cc:336] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:32.122828 11775 leader_election.cc:336] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:32.123762 14096 consensus_queue.cc:1048] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 12:17:32.125994 11627 leader_election.cc:336] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:32.111148 14089 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:32.131208 14089 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.136516 11805 raft_consensus.cc:1275] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:32.120393 14069 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:32.138953 14069 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:32.144851 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:32.147665 14085 consensus_queue.cc:1048] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:32.150414 14065 raft_consensus.cc:515] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:32.130266 11657 raft_consensus.cc:2468] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 4.
I20260709 12:17:32.153741 14065 leader_election.cc:290] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:32.145128 14089 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:32.159683 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf073dc4ac2044dfadb5f017646c8101" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f903ca23da45e594b2850337751f03"
I20260709 12:17:32.160223 11658 raft_consensus.cc:3060] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:32.160343 11701 leader_election.cc:336] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:32.167946 11658 raft_consensus.cc:2468] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 9.
I20260709 12:17:32.169659 11773 leader_election.cc:304] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:32.175015 14089 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Requested vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:32.176919 11701 leader_election.cc:336] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:32.177244  4409 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:32.177464 11627 leader_election.cc:336] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:32.181866 11701 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: ce38e95b93a640c1a7b16f37868b30fc, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:32.182819 14098 raft_consensus.cc:2749] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:32.186717 14071 raft_consensus.cc:2804] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:32.187381 14071 raft_consensus.cc:697] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 9 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:32.188326 14071 consensus_queue.cc:237] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:32.191044 11775 leader_election.cc:336] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:32.196293 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 67046.1us
I20260709 12:17:32.198042 11699 leader_election.cc:304] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:32.198820 14096 raft_consensus.cc:2804] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:32.199258 14096 raft_consensus.cc:697] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:32.200048 14096 consensus_queue.cc:237] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:32.228592 11735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0cd617dac6426780fb32e90db31859" candidate_uuid: "b0f903ca23da45e594b2850337751f03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:32.229136 11735 raft_consensus.cc:3060] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.234369 14065 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:32.234978 14065 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:32.239236 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:32.239885 11727 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
I20260709 12:17:32.245025 11483 catalog_manager.cc:5697] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 6 to 7, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 7 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.247536 11735 raft_consensus.cc:2468] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f903ca23da45e594b2850337751f03 in term 5.
I20260709 12:17:32.248732 11625 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03; no voters: ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:32.250327 11773 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:32.250384 14085 raft_consensus.cc:2804] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:32.252526 14085 raft_consensus.cc:697] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Becoming Leader. State: Replica: b0f903ca23da45e594b2850337751f03, State: Running, Role: LEADER
I20260709 12:17:32.253458 14085 consensus_queue.cc:237] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:32.255694 14102 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:32.256103 14102 raft_consensus.cc:493] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce38e95b93a640c1a7b16f37868b30fc)
I20260709 12:17:32.257891 11482 catalog_manager.cc:5697] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 10 to 11, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 11 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.257108 14102 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.269997 11484 catalog_manager.cc:5697] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 8 to 9, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 9 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:32.273706 11775 leader_election.cc:336] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:32.270046 14065 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:32.280112 11804 raft_consensus.cc:1275] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:32.281493 11482 catalog_manager.cc:5697] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 7 to 8, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 8 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.283648 14091 consensus_queue.cc:1048] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.306696 14102 raft_consensus.cc:515] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:32.335001 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a55c602a24e9aa3bd55a9fef99c18" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:32.335644 11727 raft_consensus.cc:3060] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:32.343035 11775 consensus_peers.cc:597] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:32.352555 11727 raft_consensus.cc:2468] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 8.
I20260709 12:17:32.362608 11482 catalog_manager.cc:5697] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 3 to 4, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.364283 11482 catalog_manager.cc:5697] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 3 to 4, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 4 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.365850 11773 leader_election.cc:304] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:32.370177 14065 raft_consensus.cc:2804] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:32.371780 14065 raft_consensus.cc:697] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 8 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:32.374496 14065 consensus_queue.cc:237] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:32.387392 14102 leader_election.cc:290] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 election: Requested vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:32.411979 11775 leader_election.cc:336] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:32.402647 11627 consensus_peers.cc:597] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:32.400981 11483 catalog_manager.cc:5697] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 reported cstate change: term changed from 4 to 5, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to b0f903ca23da45e594b2850337751f03 (127.4.78.66). New cstate: current_term: 5 leader_uuid: "b0f903ca23da45e594b2850337751f03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:32.430553 11775 consensus_peers.cc:597] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:32.441136 11805 raft_consensus.cc:1275] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:32.442804 14091 consensus_queue.cc:1048] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.443562 11484 catalog_manager.cc:5697] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 7 to 8, leader changed from ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 8 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:32.458069 11627 consensus_peers.cc:597] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:32.461406 11701 consensus_peers.cc:597] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.461611 11627 consensus_peers.cc:597] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.462118 11627 consensus_peers.cc:597] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:32.462430 11627 consensus_peers.cc:597] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:32.493808 11804 raft_consensus.cc:1275] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:32.495244 14091 consensus_queue.cc:1048] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:32.505137 11627 consensus_peers.cc:597] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.506111 11775 consensus_peers.cc:597] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:32.515201 11808 raft_consensus.cc:1275] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:32.519452 11658 raft_consensus.cc:1275] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:17:32.522848 11701 consensus_peers.cc:597] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:32.522737 14031 consensus_queue.cc:1048] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:32.528301 11808 raft_consensus.cc:1275] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 11 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:32.532838 14085 consensus_queue.cc:1048] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:32.534749 14091 consensus_queue.cc:1048] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
W20260709 12:17:32.570046 11701 consensus_peers.cc:597] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.572793 11701 consensus_peers.cc:597] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:32.574937 11804 raft_consensus.cc:1275] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:17:32.576571 11627 consensus_peers.cc:597] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:32.577395 14086 consensus_queue.cc:1048] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:32.610663 11701 consensus_peers.cc:597] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:32.651667 11627 consensus_peers.cc:597] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:32.660039 11701 consensus_peers.cc:597] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.669672 11701 consensus_peers.cc:597] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:32.672271 11775 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.674149 11775 consensus_peers.cc:597] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.694038 11701 consensus_peers.cc:597] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.700708 11775 consensus_peers.cc:597] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.716177 11701 consensus_peers.cc:597] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:32.723820 11658 raft_consensus.cc:1275] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:17:32.738926 11701 consensus_peers.cc:597] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:32.745921 14069 consensus_queue.cc:1048] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:17:32.748342 11775 consensus_peers.cc:597] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:32.762769 11658 raft_consensus.cc:1275] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:32.764241 14031 consensus_queue.cc:1048] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:32.782894 11627 consensus_peers.cc:597] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.788008 11627 consensus_peers.cc:597] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:32.810482 11727 raft_consensus.cc:1275] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Refusing update from remote peer b0f903ca23da45e594b2850337751f03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:32.811295 11653 raft_consensus.cc:1275] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:32.812203 14091 consensus_queue.cc:1048] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.813912 14065 consensus_queue.cc:1048] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:32.817963 11701 consensus_peers.cc:597] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.818917 11775 consensus_peers.cc:597] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:32.819398 11775 consensus_peers.cc:597] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.832729 11627 consensus_peers.cc:597] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.855942 11627 consensus_peers.cc:597] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.863739 11701 consensus_peers.cc:597] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.865084 11627 consensus_peers.cc:597] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.868727 11775 consensus_peers.cc:597] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:32.874678 11735 raft_consensus.cc:1275] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:32.877187 14055 consensus_queue.cc:1048] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:32.923189 11775 consensus_peers.cc:597] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.986624 11775 consensus_peers.cc:597] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:33.009907 11627 consensus_peers.cc:597] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:33.011133 11701 consensus_peers.cc:597] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:33.017211 11701 consensus_peers.cc:597] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:33.077696 11775 consensus_peers.cc:597] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:33.177641  4409 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:33.218415 11701 consensus_peers.cc:597] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:34.178215  4409 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:34.417029 11627 consensus_peers.cc:597] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:34.574766 11701 consensus_peers.cc:597] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:34.768409 11775 consensus_peers.cc:597] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:34.785115 11627 consensus_peers.cc:597] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:34.867031 11627 consensus_peers.cc:597] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:34.871430 11775 consensus_peers.cc:597] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:34.899392 11627 consensus_peers.cc:597] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:34.920683 11627 consensus_peers.cc:597] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:34.952930 11627 consensus_peers.cc:597] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:34.973964 11775 consensus_peers.cc:597] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:34.989365 11775 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111) [suppressed 425 similar messages]
W20260709 12:17:34.990060 11701 consensus_peers.cc:597] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.014737 11701 consensus_peers.cc:597] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:35.021340 11627 consensus_peers.cc:597] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:35.022017 11627 consensus_peers.cc:597] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:35.038393 11701 consensus_peers.cc:597] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.075525 11627 consensus_peers.cc:597] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:35.095708 11701 consensus_peers.cc:597] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.134130 11701 consensus_peers.cc:597] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.157862 11775 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.178714  4409 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:35.187469 11701 consensus_peers.cc:597] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.189282 11775 consensus_peers.cc:597] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.221418 11775 consensus_peers.cc:597] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.228026 11627 consensus_peers.cc:597] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.228942 11701 consensus_peers.cc:597] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.238270 11627 consensus_peers.cc:597] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.241070 11701 consensus_peers.cc:597] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.241698 11701 consensus_peers.cc:597] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.251312 11627 consensus_peers.cc:597] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.273351 11701 consensus_peers.cc:597] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:35.279198 11775 consensus_peers.cc:597] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.279768 11775 consensus_peers.cc:597] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.308437 11627 consensus_peers.cc:597] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:35.323002 11701 consensus_peers.cc:597] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:35.328531 11775 consensus_peers.cc:597] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.359301 11701 consensus_peers.cc:597] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.375182 11775 consensus_peers.cc:597] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.391062 11627 consensus_peers.cc:597] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.409519 11775 consensus_peers.cc:597] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:35.452538 11775 consensus_peers.cc:597] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:35.450809 11627 consensus_peers.cc:597] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.491592 11627 consensus_peers.cc:597] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.498246 11701 consensus_peers.cc:597] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.675956 11701 consensus_peers.cc:597] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.706923 11775 consensus_peers.cc:597] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.715389 11701 consensus_peers.cc:597] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:36.179250  4409 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:37.007179 11627 consensus_peers.cc:597] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:37.047745 11701 consensus_peers.cc:597] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:37.129429 11775 consensus_peers.cc:597] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:37.143743 11775 consensus_peers.cc:597] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:37.145897 11627 consensus_peers.cc:597] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:37.179800  4409 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:37.182168 11627 consensus_peers.cc:597] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:37.385941 11775 consensus_peers.cc:597] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:37.899015 11775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.005s
W20260709 12:17:37.899371 11775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.011s	sys 0.005s
W20260709 12:17:37.915957 11773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.006s	sys 0.024s
W20260709 12:17:37.916422 11773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.006s	sys 0.024s
W20260709 12:17:37.916689 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 525399us
W20260709 12:17:37.949353 11701 consensus_peers.cc:597] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:37.950443 11701 consensus_peers.cc:597] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:37.951028 11701 consensus_peers.cc:597] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:37.951730 11701 consensus_peers.cc:597] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:37.952167 11701 consensus_peers.cc:597] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:37.952623 11701 consensus_peers.cc:597] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:37.979691 11627 consensus_peers.cc:597] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:37.982409 11627 consensus_peers.cc:597] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:37.982800 11627 consensus_peers.cc:597] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:37.983081 11627 consensus_peers.cc:597] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:37.983402 11627 consensus_peers.cc:597] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:37.983686 11627 consensus_peers.cc:597] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:37.984001 11627 consensus_peers.cc:597] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:37.984266 11627 consensus_peers.cc:597] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:38.000453 11775 consensus_peers.cc:597] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.001127 11775 consensus_peers.cc:597] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.001649 11775 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.002403 11775 consensus_peers.cc:597] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.032330 11775 consensus_peers.cc:597] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.091728 11701 consensus_peers.cc:597] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:38.165694 11701 consensus_peers.cc:597] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.172757 11701 consensus_peers.cc:597] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.180285  4409 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:38.212026 11701 consensus_peers.cc:597] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.216424 11701 consensus_peers.cc:597] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.304229 11701 consensus_peers.cc:597] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.359167 11627 consensus_peers.cc:597] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.359959 11627 consensus_peers.cc:597] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.360419 11627 consensus_peers.cc:597] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.382508 11627 consensus_peers.cc:597] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.400601 11627 consensus_peers.cc:597] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.405244 11701 consensus_peers.cc:597] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.412637 11756 debug-util.cc:398] Leaking SignalData structure 0x7b08003744c0 after lost signal to thread 4412
W20260709 12:17:38.414763 11756 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3800 after lost signal to thread 11518
W20260709 12:17:38.417315 11756 debug-util.cc:398] Leaking SignalData structure 0x7b0800110e00 after lost signal to thread 11685
W20260709 12:17:38.419050 11756 debug-util.cc:398] Leaking SignalData structure 0x7b08001dfa40 after lost signal to thread 11759
W20260709 12:17:38.425042 11756 debug-util.cc:398] Leaking SignalData structure 0x7b08002b1240 after lost signal to thread 11833
W20260709 12:17:38.465164 11701 consensus_peers.cc:597] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.510936 11775 consensus_peers.cc:597] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.518714 11775 consensus_peers.cc:597] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.569581 11775 consensus_peers.cc:597] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:38.570165 11775 consensus_peers.cc:597] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:38.630607 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 47983.3us
W20260709 12:17:38.783870 11775 consensus_peers.cc:597] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.881960 11701 consensus_peers.cc:597] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:39.176807 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 47658.5us
W20260709 12:17:39.181792  4409 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:39.537431 11701 consensus_peers.cc:597] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:39.695290 11627 consensus_peers.cc:597] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:39.869089 11701 consensus_peers.cc:597] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:39.957985 11775 consensus_peers.cc:597] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:39.992659 11627 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111) [suppressed 415 similar messages]
W20260709 12:17:39.995656 11627 consensus_peers.cc:597] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.005879 11627 consensus_peers.cc:597] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.033931 11775 consensus_peers.cc:597] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.039464 11701 consensus_peers.cc:597] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.046988 11627 consensus_peers.cc:597] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.093847 11775 consensus_peers.cc:597] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.115026 11701 consensus_peers.cc:597] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.167608 11701 consensus_peers.cc:597] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.174883 11627 consensus_peers.cc:597] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.183509  4409 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:40.213599 11701 consensus_peers.cc:597] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.240018 11627 consensus_peers.cc:597] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.315788 11627 consensus_peers.cc:597] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.349035 11627 consensus_peers.cc:597] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.360971 11775 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.367523 11775 consensus_peers.cc:597] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.374972 11775 consensus_peers.cc:597] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.458165 11701 consensus_peers.cc:597] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.497188 11627 consensus_peers.cc:597] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.551896 11701 consensus_peers.cc:597] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.597402 11775 consensus_peers.cc:597] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.612466 11627 consensus_peers.cc:597] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.624706 11775 consensus_peers.cc:597] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.629210 11627 consensus_peers.cc:597] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.629832 11701 consensus_peers.cc:597] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.694813 11627 consensus_peers.cc:597] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.723794 11701 consensus_peers.cc:597] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.748068 11627 consensus_peers.cc:597] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.753408 11701 consensus_peers.cc:597] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.771623 11701 consensus_peers.cc:597] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.780434 11627 consensus_peers.cc:597] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.819520 11627 consensus_peers.cc:597] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.927702 11775 consensus_peers.cc:597] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.939105 11701 consensus_peers.cc:597] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.976642 11775 consensus_peers.cc:597] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:40.987289 11701 consensus_peers.cc:597] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:41.061297 11775 consensus_peers.cc:597] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:41.076177 11627 consensus_peers.cc:597] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:41.183594 11701 consensus_peers.cc:597] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:41.184029  4409 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:41.245394 11775 consensus_peers.cc:597] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:41.473915 11698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.68:40845, user_credentials={real_user=slave}} blocked reactor thread for 147027us
W20260709 12:17:41.503764 11701 consensus_peers.cc:597] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:41.567898 11775 consensus_peers.cc:597] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:41.861460 11701 consensus_peers.cc:597] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:42.126279 11775 consensus_peers.cc:597] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:42.185134  4409 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:42.290246 11627 consensus_peers.cc:597] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:42.559053 11775 consensus_peers.cc:597] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:42.603524 11627 consensus_peers.cc:597] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:42.632347 11627 consensus_peers.cc:597] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:42.638012 11627 consensus_peers.cc:597] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:42.693691 11775 consensus_peers.cc:597] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:42.699891 11627 consensus_peers.cc:597] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:42.709229 11627 consensus_peers.cc:597] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:42.713594 11775 consensus_peers.cc:597] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:42.744043 11775 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:42.777624 11775 consensus_peers.cc:597] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:42.848618 11627 consensus_peers.cc:597] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:42.884145 11627 consensus_peers.cc:597] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:42.893361 11627 consensus_peers.cc:597] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:43.022115 11627 consensus_peers.cc:597] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:43.034739 11627 consensus_peers.cc:597] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.048419 11627 consensus_peers.cc:597] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.111079 11775 consensus_peers.cc:597] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.116328 11627 consensus_peers.cc:597] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.185688  4409 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 12460)
W20260709 12:17:43.238801 11627 consensus_peers.cc:597] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.280064 11701 consensus_peers.cc:597] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.305490 11775 consensus_peers.cc:597] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:43.322826 11701 consensus_peers.cc:597] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.323876 11701 consensus_peers.cc:597] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:43.353082 11627 consensus_peers.cc:597] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.358108 11701 consensus_peers.cc:597] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.389170 11775 consensus_peers.cc:597] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:43.402570 11701 consensus_peers.cc:597] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.409046 11775 consensus_peers.cc:597] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.415488 11701 consensus_peers.cc:597] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.483817 11701 consensus_peers.cc:597] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.522286 11775 consensus_peers.cc:597] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.535130 11627 consensus_peers.cc:597] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:17:43.566604  4409 tablet_server.cc:196] TabletServer@127.4.78.65:36331 shutdown complete.
W20260709 12:17:43.634405 11701 consensus_peers.cc:597] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.673722 11701 consensus_peers.cc:597] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.683372 11701 consensus_peers.cc:597] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:43.788352 11775 consensus_peers.cc:597] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.921343 11775 consensus_peers.cc:597] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.968833 11701 consensus_peers.cc:597] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:17:44.181609  4409 tablet_server.cc:179] TabletServer@127.4.78.66:0 shutting down...
W20260709 12:17:44.191908 11773 consensus_peers.cc:597] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.192932 11701 consensus_peers.cc:597] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:44.210945 11699 consensus_peers.cc:597] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.254029 11699 consensus_peers.cc:597] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.255179 11773 consensus_peers.cc:597] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.268481 11773 consensus_peers.cc:597] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.284773 11699 consensus_peers.cc:597] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.300516 11773 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.319276 11699 consensus_peers.cc:597] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.330483 11701 consensus_peers.cc:597] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:44.341326 11699 consensus_peers.cc:597] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.342919  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:44.356097  4409 tablet_replica.cc:333] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.357034  4409 raft_consensus.cc:2243] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.358521  4409 raft_consensus.cc:2272] T ee0cd617dac6426780fb32e90db31859 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.361640  4409 tablet_replica.cc:333] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.362494  4409 raft_consensus.cc:2243] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.363554  4409 raft_consensus.cc:2272] T 7195b55fe02f4056bfc2b0e22978a3ff P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.366325  4409 tablet_replica.cc:333] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.367162  4409 raft_consensus.cc:2243] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.368263  4409 raft_consensus.cc:2272] T 13f2b34efd194430a04442a394ce05c1 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.371033  4409 tablet_replica.cc:333] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.371826  4409 raft_consensus.cc:2243] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.373127  4409 raft_consensus.cc:2272] T bc6434e787264f388930e3ed1add578a P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.376089  4409 tablet_replica.cc:333] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.376935  4409 raft_consensus.cc:2243] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.377579  4409 raft_consensus.cc:2272] T 9aacd4a8780042e792f4c4c8566c7649 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.380695  4409 tablet_replica.cc:333] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.381520  4409 raft_consensus.cc:2243] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.382931  4409 raft_consensus.cc:2272] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P b0f903ca23da45e594b2850337751f03 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.386447  4409 tablet_replica.cc:333] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.387310  4409 raft_consensus.cc:2243] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.388027  4409 raft_consensus.cc:2272] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.390400 11699 consensus_peers.cc:597] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.391184  4409 tablet_replica.cc:333] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.392287  4409 raft_consensus.cc:2243] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.392971  4409 raft_consensus.cc:2272] T 4ac74a4093c34756a969a33ff35146ad P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.396231  4409 tablet_replica.cc:333] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.397097  4409 raft_consensus.cc:2243] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.398398  4409 raft_consensus.cc:2272] T efb370bb0e99488f947f70704fee6e53 P b0f903ca23da45e594b2850337751f03 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.400758 11699 consensus_peers.cc:597] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.401547  4409 tablet_replica.cc:333] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.402522  4409 raft_consensus.cc:2243] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.403257  4409 raft_consensus.cc:2272] T 3f44d8dd328e49b0b41e9345b6c2fb85 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.406383  4409 tablet_replica.cc:333] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.407176  4409 raft_consensus.cc:2243] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.408329  4409 raft_consensus.cc:2272] T f5b9e8af33874d1da7a3fa1b4fc455f0 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.411371  4409 tablet_replica.cc:333] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.412230  4409 raft_consensus.cc:2243] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.413348  4409 raft_consensus.cc:2272] T 51181cd84fab48ffb41a532d72daf42d P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.415118 11699 consensus_peers.cc:597] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.419741  4409 tablet_replica.cc:333] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.438079  4409 raft_consensus.cc:2243] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.439319  4409 raft_consensus.cc:2272] T 6a80694829ab40a8b9b84840d8c384ff P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.442327  4409 tablet_replica.cc:333] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.443163  4409 raft_consensus.cc:2243] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.443934  4409 raft_consensus.cc:2272] T 869a40a36ae44ac9af963b7e09384543 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.446936  4409 tablet_replica.cc:333] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.447716  4409 raft_consensus.cc:2243] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.448369  4409 raft_consensus.cc:2272] T da144a8884c1479980762ec9a874ec7f P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.451336  4409 tablet_replica.cc:333] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.452232  4409 raft_consensus.cc:2243] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.453680  4409 raft_consensus.cc:2272] T d3c499278cbd4f3094888a0d7373a5dc P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.456696  4409 tablet_replica.cc:333] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.457623  4409 raft_consensus.cc:2243] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.458338  4409 raft_consensus.cc:2272] T d70373b1ffec4647a2eb32b5cb550542 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.461361  4409 tablet_replica.cc:333] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.462160  4409 raft_consensus.cc:2243] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.463356  4409 raft_consensus.cc:2272] T d12f3af68cd84f68b5137c6abe65e63e P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.466285  4409 tablet_replica.cc:333] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.467060  4409 raft_consensus.cc:2243] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.468412  4409 raft_consensus.cc:2272] T a7852dc16ba7411fa9eadde150e3dcaa P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.469534 11699 consensus_peers.cc:597] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.471099  4409 tablet_replica.cc:333] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.472039  4409 raft_consensus.cc:2243] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.473279  4409 raft_consensus.cc:2272] T a236cb878f1e49098e43b2733a84eb5c P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.476042  4409 tablet_replica.cc:333] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.476858  4409 raft_consensus.cc:2243] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.478051  4409 raft_consensus.cc:2272] T e35e8ccf015d4658b6383cb7a76a1461 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.480885  4409 tablet_replica.cc:333] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.481681  4409 raft_consensus.cc:2243] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.482872  4409 raft_consensus.cc:2272] T 2ec5984b3c05404884debeee7f5192a1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.489244  4409 tablet_replica.cc:333] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.490079  4409 raft_consensus.cc:2243] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.490682  4409 raft_consensus.cc:2272] T 46a96b7da08f479dbbc7413cdacfa720 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.494040  4409 tablet_replica.cc:333] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.494839  4409 raft_consensus.cc:2243] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.496129  4409 raft_consensus.cc:2272] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.499034  4409 tablet_replica.cc:333] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.499890  4409 raft_consensus.cc:2243] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.501024  4409 raft_consensus.cc:2272] T 98be08057b9a47a1abcefa3753fcaf70 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.503757 11701 consensus_peers.cc:597] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:44.496289 11773 consensus_peers.cc:597] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.514475  4409 tablet_replica.cc:333] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.516286  4409 raft_consensus.cc:2243] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.516937  4409 raft_consensus.cc:2272] T a81f5cf331ca4fb7bc00211769a655b4 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.519726  4409 tablet_replica.cc:333] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.520845  4409 raft_consensus.cc:2243] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.521782  4409 raft_consensus.cc:2272] T 841068979f35457ca7200408e6d522a9 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.524427  4409 tablet_replica.cc:333] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.525161  4409 raft_consensus.cc:2243] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.525802  4409 raft_consensus.cc:2272] T f145e4b384244aaaae76147c5ee135ec P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.540519  4409 tablet_replica.cc:333] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.541369  4409 raft_consensus.cc:2243] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.542317  4409 raft_consensus.cc:2272] T d714468af62e4ab3bb4affae7ab03619 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.545099  4409 tablet_replica.cc:333] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.545914  4409 raft_consensus.cc:2243] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.547050  4409 raft_consensus.cc:2272] T d95dddd4031d4b029df099f3324d5574 P b0f903ca23da45e594b2850337751f03 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.549683  4409 tablet_replica.cc:333] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.556449  4409 raft_consensus.cc:2243] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.557686  4409 raft_consensus.cc:2272] T a6b7ee7fe2c64c44901ea84bd330b073 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.560585  4409 tablet_replica.cc:333] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.564812  4409 raft_consensus.cc:2243] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.565625  4409 raft_consensus.cc:2272] T cf073dc4ac2044dfadb5f017646c8101 P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.568627  4409 tablet_replica.cc:333] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.573428  4409 raft_consensus.cc:2243] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.574211  4409 raft_consensus.cc:2272] T 896664897f42444796f0be51911c9ec7 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.579849 11699 consensus_peers.cc:597] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.582741  4409 tablet_replica.cc:333] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.583581  4409 raft_consensus.cc:2243] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.584160  4409 raft_consensus.cc:2272] T 09f4699c530a4e4fb165983ca95e4a6b P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.587281 11773 consensus_peers.cc:597] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.592507  4409 tablet_replica.cc:333] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.593374  4409 raft_consensus.cc:2243] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.594022  4409 raft_consensus.cc:2272] T bca6d1536f234395afd9bcbfe398e689 P b0f903ca23da45e594b2850337751f03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.643949  4409 tablet_replica.cc:333] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.646934  4409 raft_consensus.cc:2243] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.648073  4409 raft_consensus.cc:2272] T c11a101e9d54454db77b4a2f2d9489e6 P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.650734  4409 tablet_replica.cc:333] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
W20260709 12:17:44.645812 11773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:40145, user_credentials={real_user=slave}} blocked reactor thread for 49932.1us
I20260709 12:17:44.654433  4409 raft_consensus.cc:2243] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.666297  4409 raft_consensus.cc:2272] T f6924fe8aeff4ed699be088221835654 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.670404 11775 consensus_peers.cc:597] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:44.672259 11773 consensus_peers.cc:597] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.680828  4409 tablet_replica.cc:333] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
W20260709 12:17:44.685196 11699 consensus_peers.cc:597] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.690891  4409 raft_consensus.cc:2243] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.691545  4409 raft_consensus.cc:2272] T 225a49e8e4114f8baf86d7c29f4635d5 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.694535  4409 tablet_replica.cc:333] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.695309  4409 raft_consensus.cc:2243] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.695940  4409 raft_consensus.cc:2272] T 195b741f1d144afab8c37ecc3be587b1 P b0f903ca23da45e594b2850337751f03 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.698791  4409 tablet_replica.cc:333] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.699514  4409 raft_consensus.cc:2243] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.702419  4409 raft_consensus.cc:2272] T 79d2242d216849e096e87b165c9d6778 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.710927  4409 tablet_replica.cc:333] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03: stopping tablet replica
W20260709 12:17:44.711604 11701 consensus_peers.cc:597] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:44.722097 11773 consensus_peers.cc:597] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.728118  4409 raft_consensus.cc:2243] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.734946  4409 raft_consensus.cc:2272] T f1b1feee36a2425db32953f79a0b0c0a P b0f903ca23da45e594b2850337751f03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.739615  4409 tablet_replica.cc:333] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.754437  4409 raft_consensus.cc:2243] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.756704  4409 raft_consensus.cc:2272] T 1e219590d128498d88773c090b1fc4f3 P b0f903ca23da45e594b2850337751f03 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.764681  4409 tablet_replica.cc:333] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03: stopping tablet replica
W20260709 12:17:44.751911 11773 consensus_peers.cc:597] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.768455 11773 consensus_peers.cc:597] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.770089  4409 raft_consensus.cc:2243] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.770821  4409 raft_consensus.cc:2272] T 8968bb0a7df844fd868c906fb62847ff P b0f903ca23da45e594b2850337751f03 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.777957  4409 tablet_replica.cc:333] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03: stopping tablet replica
I20260709 12:17:44.788592  4409 raft_consensus.cc:2243] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.794341  4409 raft_consensus.cc:2272] T c7c43c72411f483a8d001721079be3d1 P b0f903ca23da45e594b2850337751f03 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.938705 11701 consensus_peers.cc:597] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:44.994626 11773 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 452 similar messages]
W20260709 12:17:45.010685 11624 connection.cc:466] server connection from 127.0.0.1:60030 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 1445) could send its response
W20260709 12:17:45.018482 11699 connection.cc:573] client connection to 127.4.78.66:39117 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:17:45.030333  4409 connection.cc:466] server connection from 127.0.0.1:60060 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60060 (request call id 1209) could send its response
W20260709 12:17:45.121156 11775 consensus_peers.cc:597] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:45.197209 11775 consensus_peers.cc:597] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:45.309865 11701 consensus_peers.cc:597] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:45.317693 11775 consensus_peers.cc:597] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:45.339222 11775 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:45.343921 11775 consensus_peers.cc:597] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:45.383646 11701 consensus_peers.cc:597] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:45.447960 11701 consensus_peers.cc:597] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:17:45.461499 14161 raft_consensus.cc:493] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.462278 14161 raft_consensus.cc:515] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:45.470351 11701 leader_election.cc:336] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:45.471168 11699 leader_election.cc:336] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.471566 11699 leader_election.cc:304] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:45.472375 14167 raft_consensus.cc:2749] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.473364 14161 leader_election.cc:290] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:45.474174 14169 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.474707 14169 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.476797 14169 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:45.479410 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:45.483572 11773 leader_election.cc:336] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.484091 11773 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:45.485301 14169 raft_consensus.cc:2749] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.505132 14169 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.505836 14169 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:45.511828 11775 leader_election.cc:336] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.517056 14169 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:45.522004 11773 leader_election.cc:336] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.522440 11773 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:45.523011 14169 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:45.525240 14169 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.525801 14169 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:45.529500 14161 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.530241 14161 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:45.532651 11775 leader_election.cc:336] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.535830 14169 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:45.538978 11699 leader_election.cc:336] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.541844 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:45.543606 11698 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
I20260709 12:17:45.544369 14167 raft_consensus.cc:2749] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.546737 14161 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:45.550448 14167 raft_consensus.cc:493] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.550967 14167 raft_consensus.cc:515] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:45.554136 14167 leader_election.cc:290] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:45.559347 11699 leader_election.cc:336] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:45.575918 11773 leader_election.cc:336] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:45.565932 11701 leader_election.cc:336] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.581674 11701 leader_election.cc:304] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:45.582569 14161 raft_consensus.cc:2749] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:45.584034 14161 raft_consensus.cc:493] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.584645 14161 raft_consensus.cc:515] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:45.586879 14161 leader_election.cc:290] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:45.581486 11773 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:45.595583 14152 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:45.594744 11699 leader_election.cc:336] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.620091 14167 raft_consensus.cc:493] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.621248 14167 raft_consensus.cc:515] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:45.623441 14172 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.627070 14172 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.629010 14172 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:45.631101 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
W20260709 12:17:45.633901 11773 leader_election.cc:336] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.634245 11773 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, b0f903ca23da45e594b2850337751f03
I20260709 12:17:45.634797 14172 raft_consensus.cc:2749] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.635994 14167 leader_election.cc:290] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:45.653188 11699 leader_election.cc:336] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:45.654767 11775 consensus_peers.cc:597] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:17:45.656452 14167 raft_consensus.cc:493] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.657109 14167 raft_consensus.cc:515] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
W20260709 12:17:45.656602 11701 leader_election.cc:336] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.658878 11701 leader_election.cc:304] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:45.659334 14167 leader_election.cc:290] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:45.659847 14167 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.660295 14167 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.661731 14161 raft_consensus.cc:2749] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.661998 14144 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.662495 14144 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.663847 14167 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:45.664261 14144 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:45.666855 11805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:45.668268 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:45.669018 11809 raft_consensus.cc:2468] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 2.
I20260709 12:17:45.669855 14152 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.670425 14152 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:45.672480 14152 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:45.672914 14152 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.676941 11698 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:45.679791 14167 raft_consensus.cc:2804] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:45.680177 14167 raft_consensus.cc:493] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.680505 14167 raft_consensus.cc:3060] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.682057 14169 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.682605 14169 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.684687 14169 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:45.674955 14152 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:45.685734 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:45.686399 11726 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:45.687745 11773 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:45.692322 14172 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:45.692760 14172 raft_consensus.cc:493] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.693132 14172 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.709950 14152 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:45.717962 11773 leader_election.cc:336] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:45.718636 11773 leader_election.cc:336] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:45.719391 11773 leader_election.cc:336] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.724131 14172 raft_consensus.cc:515] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:45.732213 11701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:36331, user_credentials={real_user=slave}} blocked reactor thread for 72467.1us
W20260709 12:17:45.733834 11699 leader_election.cc:336] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:45.746045 11699 leader_election.cc:336] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.746474 11699 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, cfe9bf206bb14951ba7615683809d178
W20260709 12:17:45.747391 11699 leader_election.cc:336] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.748611 14152 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.749114 14144 raft_consensus.cc:2749] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:45.736207 11775 leader_election.cc:336] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.750830 11775 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:45.751987 11775 leader_election.cc:336] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.741703 14169 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.772929 14169 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:45.749181 14152 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:45.770602 14177 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:45.775134 14169 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:45.738427 14167 raft_consensus.cc:515] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.776571 14152 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:45.778136 14167 leader_election.cc:290] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:45.772073 14175 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.781347 14175 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.783665 14175 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:45.784267 11775 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:45.788929 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb370bb0e99488f947f70704fee6e53" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:45.789558 11809 raft_consensus.cc:3060] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.790146 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:45.790750 11726 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:45.792027 11773 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:45.793025 14176 raft_consensus.cc:2804] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:45.793382 14176 raft_consensus.cc:493] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.793701 14176 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.786927 14178 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.797605 11809 raft_consensus.cc:2468] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 3.
I20260709 12:17:45.806414 11698 leader_election.cc:304] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:45.807318 14161 raft_consensus.cc:2804] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:45.807791 14161 raft_consensus.cc:697] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:45.808554 14161 consensus_queue.cc:237] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.801353 14176 raft_consensus.cc:515] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.811925 14176 leader_election.cc:290] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
W20260709 12:17:45.814025 11701 leader_election.cc:336] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.818080 11701 leader_election.cc:304] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:45.821838 11773 leader_election.cc:336] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.815577 14172 leader_election.cc:290] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:45.823454 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be08057b9a47a1abcefa3753fcaf70" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:45.823338 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35e8ccf015d4658b6383cb7a76a1461" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:45.829356 11733 raft_consensus.cc:3060] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.829367 11726 raft_consensus.cc:3060] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:45.828943 11773 leader_election.cc:336] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:45.831386 11773 leader_election.cc:336] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.838112 11733 raft_consensus.cc:2468] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
I20260709 12:17:45.839526 14167 raft_consensus.cc:2749] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:45.824298 11699 leader_election.cc:336] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.845316 11726 raft_consensus.cc:2468] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:45.855906 14161 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.856622 14161 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.858956 14161 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:45.863191 11483 catalog_manager.cc:5697] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 2 to 3, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:45.869259 11773 leader_election.cc:336] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:45.869891 11773 leader_election.cc:336] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.870930 11773 leader_election.cc:304] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:45.871292 14177 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.871922 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178" is_pre_election: true
I20260709 12:17:45.871826 14177 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:45.872129 14178 raft_consensus.cc:2804] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:45.872644 11809 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 5.
I20260709 12:17:45.872933 14178 raft_consensus.cc:697] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:45.873818 11698 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:45.874020 14177 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:45.874183 14178 consensus_queue.cc:237] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.875016 14172 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.877271 14172 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.871958 11773 leader_election.cc:304] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:45.879263 14172 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:45.879809 14172 raft_consensus.cc:2804] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:45.880318 14172 raft_consensus.cc:697] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:45.881099 14167 raft_consensus.cc:2804] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:45.909624 14167 raft_consensus.cc:493] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.910017 14167 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.881300 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:45.897096 14178 raft_consensus.cc:493] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
W20260709 12:17:45.898566 11775 consensus_peers.cc:597] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:45.903074 11773 leader_election.cc:336] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:45.914316 11773 leader_election.cc:336] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:45.904445 11701 leader_election.cc:336] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.903818 11484 catalog_manager.cc:5697] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 6 to 7, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 7 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.924779 11701 leader_election.cc:304] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:45.913130 11726 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:45.913151 14178 raft_consensus.cc:515] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:45.928301 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:45.928892 14178 leader_election.cc:290] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:45.929447 14178 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:45.929824 14178 raft_consensus.cc:493] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.930193 14178 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:45.926759 11775 leader_election.cc:336] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.934049 11775 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:45.935956 11775 leader_election.cc:336] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.934856 14169 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
W20260709 12:17:45.934221 11773 leader_election.cc:336] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.939015 14144 raft_consensus.cc:2749] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:45.941751 11775 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:45.942622 14169 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:45.943789 14177 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:45.944464 14177 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:45.952409 11773 leader_election.cc:336] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.953547 14172 consensus_queue.cc:237] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:45.956568 11775 consensus_peers.cc:597] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:45.909080 11699 leader_election.cc:336] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.940956 14178 raft_consensus.cc:515] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:45.957703 11699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:39117, user_credentials={real_user=slave}} blocked reactor thread for 48646.3us
W20260709 12:17:45.957090 11775 leader_election.cc:336] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.959540 11775 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:45.961604 14144 raft_consensus.cc:493] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.962181 14144 raft_consensus.cc:515] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:45.962903 14178 leader_election.cc:290] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:45.963546 14178 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:45.964596 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7195b55fe02f4056bfc2b0e22978a3ff" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:45.965166 11726 raft_consensus.cc:3060] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:45.967576 11775 leader_election.cc:336] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:45.975586 11775 leader_election.cc:304] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:45.976850 14178 raft_consensus.cc:2749] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:45.964007 14144 leader_election.cc:290] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:45.925864 14167 raft_consensus.cc:515] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:45.981211 11773 leader_election.cc:336] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:45.982883 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:45.983523 11733 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 4.
I20260709 12:17:45.984580 11773 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:45.985782 14175 raft_consensus.cc:2804] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:45.986167 14175 raft_consensus.cc:493] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.986549 14175 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:45.981657 14169 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:45.994586 14178 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:45.995175 14178 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:45.997298 14178 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:45.997016 11809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec5984b3c05404884debeee7f5192a1" candidate_uuid: "264376c764c64dc78c4cef6031c15eef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cfe9bf206bb14951ba7615683809d178"
I20260709 12:17:45.998781 11809 raft_consensus.cc:3060] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:46.002511 11773 leader_election.cc:336] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:46.008878 11775 leader_election.cc:336] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:46.009306 11775 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:45.977078 11726 raft_consensus.cc:2468] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 7.
I20260709 12:17:46.010695 14178 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.010775 11773 leader_election.cc:304] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:46.011611 14177 raft_consensus.cc:2804] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:46.014925 11809 raft_consensus.cc:2468] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 264376c764c64dc78c4cef6031c15eef in term 6.
I20260709 12:17:46.016039 11698 leader_election.cc:304] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:46.017027 14144 raft_consensus.cc:2804] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:46.016669 14161 raft_consensus.cc:493] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:46.012559 14177 raft_consensus.cc:697] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:46.012629 14167 leader_election.cc:290] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), cfe9bf206bb14951ba7615683809d178 (127.4.78.68:40845)
I20260709 12:17:46.017964 14161 raft_consensus.cc:515] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } }
I20260709 12:17:46.019393 14177 consensus_queue.cc:237] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:46.020357 14161 leader_election.cc:290] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:46.028268 11699 leader_election.cc:336] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:46.028918 11699 leader_election.cc:336] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:46.035307 14144 raft_consensus.cc:697] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Becoming Leader. State: Replica: 264376c764c64dc78c4cef6031c15eef, State: Running, Role: LEADER
I20260709 12:17:46.036212 14144 consensus_queue.cc:237] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:46.040364 11699 leader_election.cc:336] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:46.041095 11484 catalog_manager.cc:5697] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 5 to 6, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 6 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:46.046880 11775 consensus_peers.cc:597] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:17:46.061476 14172 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:46.062165 14172 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:46.070451 14175 raft_consensus.cc:515] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:46.084685 11773 leader_election.cc:336] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:46.090512 11484 catalog_manager.cc:5697] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef reported cstate change: term changed from 5 to 6, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to 264376c764c64dc78c4cef6031c15eef (127.4.78.67). New cstate: current_term: 6 leader_uuid: "264376c764c64dc78c4cef6031c15eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:46.090857 11483 catalog_manager.cc:5697] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 6 to 7, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 7 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:46.093698 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef" is_pre_election: true
I20260709 12:17:46.094354 11726 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:46.097869 14172 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:46.104060 11773 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:46.105243 14175 leader_election.cc:290] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:46.106170 14169 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:46.106595 14169 raft_consensus.cc:493] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:46.106927 14169 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.107004 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11a101e9d54454db77b4a2f2d9489e6" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:46.107599 11726 raft_consensus.cc:3060] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:46.112741 11773 leader_election.cc:336] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:46.115150 14169 raft_consensus.cc:515] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
I20260709 12:17:46.119858 11726 raft_consensus.cc:2468] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 5.
I20260709 12:17:46.120401 14169 leader_election.cc:290] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Requested vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145)
I20260709 12:17:46.123844 11733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d714468af62e4ab3bb4affae7ab03619" candidate_uuid: "cfe9bf206bb14951ba7615683809d178" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "264376c764c64dc78c4cef6031c15eef"
I20260709 12:17:46.124490 11733 raft_consensus.cc:3060] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.131388 11733 raft_consensus.cc:2468] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe9bf206bb14951ba7615683809d178 in term 6.
I20260709 12:17:46.133003 11773 leader_election.cc:304] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03
I20260709 12:17:46.134079 11773 leader_election.cc:304] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef, cfe9bf206bb14951ba7615683809d178; no voters: 
I20260709 12:17:46.134584 14177 raft_consensus.cc:2804] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:46.136216 14177 raft_consensus.cc:697] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:46.137050 14177 consensus_queue.cc:237] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:46.137455 11773 leader_election.cc:336] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:46.135686 14175 raft_consensus.cc:2804] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:46.138271 14175 raft_consensus.cc:697] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Becoming Leader. State: Replica: cfe9bf206bb14951ba7615683809d178, State: Running, Role: LEADER
I20260709 12:17:46.139811 14175 consensus_queue.cc:237] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } }
W20260709 12:17:46.144145 11701 consensus_peers.cc:597] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:46.144678 11701 consensus_peers.cc:597] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:46.154685 11701 consensus_peers.cc:597] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:46.156108 11701 leader_election.cc:336] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:46.156543 11701 leader_election.cc:304] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:46.157259 14144 raft_consensus.cc:2749] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:46.158231 11701 leader_election.cc:336] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:46.158646 11701 leader_election.cc:304] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 264376c764c64dc78c4cef6031c15eef; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:46.159330 14144 raft_consensus.cc:2749] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:46.160261 11701 consensus_peers.cc:597] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:46.160698 11701 consensus_peers.cc:597] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:46.161098 11701 consensus_peers.cc:597] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:46.165776 11701 consensus_peers.cc:597] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:17:46.181377 11483 catalog_manager.cc:5697] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 4 to 5, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 5 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:46.187201 11483 catalog_manager.cc:5697] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 reported cstate change: term changed from 5 to 6, leader changed from b0f903ca23da45e594b2850337751f03 (127.4.78.66) to cfe9bf206bb14951ba7615683809d178 (127.4.78.68). New cstate: current_term: 6 leader_uuid: "cfe9bf206bb14951ba7615683809d178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:46.303938  4409 tablet_server.cc:196] TabletServer@127.4.78.66:0 shutdown complete.
W20260709 12:17:46.318279 11775 consensus_peers.cc:597] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:46.339915 11775 consensus_peers.cc:597] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:46.371197 11773 consensus_peers.cc:597] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.382966 11726 raft_consensus.cc:1275] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Refusing update from remote peer cfe9bf206bb14951ba7615683809d178: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:17:46.384889 11699 consensus_peers.cc:597] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.387822 11805 raft_consensus.cc:1275] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:46.390352 14190 consensus_queue.cc:1048] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:46.398663 14177 consensus_queue.cc:1048] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:46.486060 11775 consensus_peers.cc:597] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:17:46.497090  4409 tablet_server.cc:179] TabletServer@127.4.78.67:0 shutting down...
W20260709 12:17:46.511412 11773 consensus_peers.cc:597] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.783682 11773 consensus_peers.cc:597] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.784474 11699 consensus_peers.cc:597] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.789603 11773 consensus_peers.cc:597] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.790231 11773 consensus_peers.cc:597] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.790616 11773 consensus_peers.cc:597] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:46.799587 11804 raft_consensus.cc:1275] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Refusing update from remote peer 264376c764c64dc78c4cef6031c15eef: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:46.807855 14187 consensus_queue.cc:1048] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:46.822101 11699 consensus_peers.cc:597] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.825359 11699 consensus_peers.cc:597] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.825899 11699 consensus_peers.cc:597] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.838594 11773 consensus_peers.cc:597] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.839049 11773 consensus_peers.cc:597] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.840328 11773 consensus_peers.cc:597] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.844197 11773 consensus_peers.cc:597] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.845665 11773 consensus_peers.cc:597] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.853276 11699 consensus_peers.cc:597] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.858619 11773 consensus_peers.cc:597] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.868541 11773 consensus_peers.cc:597] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.869379 11773 consensus_peers.cc:597] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.869952 11773 consensus_peers.cc:597] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.871419 11773 consensus_peers.cc:597] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.871948 11773 consensus_peers.cc:597] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.869834 11699 consensus_peers.cc:597] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.872553 11773 consensus_peers.cc:597] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.874238 11701 consensus_peers.cc:597] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:46.874528 11773 consensus_peers.cc:597] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.876881 11773 consensus_peers.cc:597] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.879683 11773 consensus_peers.cc:597] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.880349 11773 consensus_peers.cc:597] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.881907 11773 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.885515 11701 consensus_peers.cc:597] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:46.886250 11701 consensus_peers.cc:597] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:17:46.914925  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:46.917591  4409 tablet_replica.cc:333] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.918552  4409 raft_consensus.cc:2243] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.919266  4409 raft_consensus.cc:2272] T 7195b55fe02f4056bfc2b0e22978a3ff P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.922086  4409 tablet_replica.cc:333] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.922955  4409 raft_consensus.cc:2243] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.923593  4409 raft_consensus.cc:2272] T ee0cd617dac6426780fb32e90db31859 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.926189  4409 tablet_replica.cc:333] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.926800  4409 raft_consensus.cc:2243] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.927657  4409 raft_consensus.cc:2272] T 9aacd4a8780042e792f4c4c8566c7649 P 264376c764c64dc78c4cef6031c15eef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.929684  4409 tablet_replica.cc:333] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.930272  4409 raft_consensus.cc:2243] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.931118  4409 raft_consensus.cc:2272] T 3f44d8dd328e49b0b41e9345b6c2fb85 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.933130  4409 tablet_replica.cc:333] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.933709  4409 raft_consensus.cc:2243] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.934530  4409 raft_consensus.cc:2272] T a54188b47043494b8e7d633bcfbcab11 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.936462  4409 tablet_replica.cc:333] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.936987  4409 raft_consensus.cc:2243] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.937903  4409 raft_consensus.cc:2272] T 7cf30a4f63934c8fa1fb80a2aa7df9ee P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.940068  4409 tablet_replica.cc:333] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.940646  4409 raft_consensus.cc:2243] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.941463  4409 raft_consensus.cc:2272] T efb370bb0e99488f947f70704fee6e53 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.944490  4409 tablet_replica.cc:333] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.945394  4409 raft_consensus.cc:2243] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.946138  4409 raft_consensus.cc:2272] T 13f2b34efd194430a04442a394ce05c1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.949959  4409 tablet_replica.cc:333] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.950897  4409 raft_consensus.cc:2243] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.951653  4409 raft_consensus.cc:2272] T 51181cd84fab48ffb41a532d72daf42d P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.958277  4409 tablet_replica.cc:333] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.959136  4409 raft_consensus.cc:2243] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.960251  4409 raft_consensus.cc:2272] T 60c076143e0f4e3cb04896d3f733461b P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.963406  4409 tablet_replica.cc:333] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.964210  4409 raft_consensus.cc:2243] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.965183  4409 raft_consensus.cc:2272] T a633993d8d3341eeaddce5c93752db1e P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.967272  4409 tablet_replica.cc:333] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.967861  4409 raft_consensus.cc:2243] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.968321  4409 raft_consensus.cc:2272] T 2e4a55c602a24e9aa3bd55a9fef99c18 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.970533  4409 tablet_replica.cc:333] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.971145  4409 raft_consensus.cc:2243] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.971603  4409 raft_consensus.cc:2272] T 6a80694829ab40a8b9b84840d8c384ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.974288  4409 tablet_replica.cc:333] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.975118  4409 raft_consensus.cc:2243] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.976222  4409 raft_consensus.cc:2272] T d70373b1ffec4647a2eb32b5cb550542 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.978979  4409 tablet_replica.cc:333] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.979691  4409 raft_consensus.cc:2243] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.980765  4409 raft_consensus.cc:2272] T 7004b9d11647433b94b3d6a7c3e247f6 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.983649  4409 tablet_replica.cc:333] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
W20260709 12:17:46.984625 11699 consensus_peers.cc:597] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:46.988243  4409 raft_consensus.cc:2243] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.988971  4409 raft_consensus.cc:2272] T d714468af62e4ab3bb4affae7ab03619 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.991668  4409 tablet_replica.cc:333] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.992601  4409 raft_consensus.cc:2243] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:46.992594 11773 consensus_peers.cc:597] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.993355  4409 raft_consensus.cc:2272] T d95dddd4031d4b029df099f3324d5574 P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.996107  4409 tablet_replica.cc:333] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.996650  4409 raft_consensus.cc:2243] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.997082  4409 raft_consensus.cc:2272] T 001b8afd665e4f66a4529aec50993495 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.999061  4409 tablet_replica.cc:333] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:46.999637  4409 raft_consensus.cc:2243] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.000363  4409 raft_consensus.cc:2272] T a0fdac8111fe4c49bccd7e22a650cccc P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.002449  4409 tablet_replica.cc:333] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.003006  4409 raft_consensus.cc:2243] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.003443  4409 raft_consensus.cc:2272] T da144a8884c1479980762ec9a874ec7f P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.005445  4409 tablet_replica.cc:333] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.006028  4409 raft_consensus.cc:2243] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.006485  4409 raft_consensus.cc:2272] T e35e8ccf015d4658b6383cb7a76a1461 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.008939  4409 tablet_replica.cc:333] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.009706  4409 raft_consensus.cc:2243] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.010270  4409 raft_consensus.cc:2272] T baf220366c63486c90e96d1db47de716 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.012697  4409 tablet_replica.cc:333] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.013424  4409 raft_consensus.cc:2243] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.014505  4409 raft_consensus.cc:2272] T 896664897f42444796f0be51911c9ec7 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.017376  4409 tablet_replica.cc:333] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.018190  4409 raft_consensus.cc:2243] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.019233  4409 raft_consensus.cc:2272] T 09f4699c530a4e4fb165983ca95e4a6b P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.021957  4409 tablet_replica.cc:333] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.022678  4409 raft_consensus.cc:2243] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.023651  4409 raft_consensus.cc:2272] T bca6d1536f234395afd9bcbfe398e689 P 264376c764c64dc78c4cef6031c15eef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.026489  4409 tablet_replica.cc:333] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.027076  4409 raft_consensus.cc:2243] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.027859  4409 raft_consensus.cc:2272] T 2ec5984b3c05404884debeee7f5192a1 P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.030668  4409 tablet_replica.cc:333] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.031303  4409 raft_consensus.cc:2243] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.031908  4409 raft_consensus.cc:2272] T a236cb878f1e49098e43b2733a84eb5c P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.034463  4409 tablet_replica.cc:333] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.035036  4409 raft_consensus.cc:2243] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.035864  4409 raft_consensus.cc:2272] T a81f5cf331ca4fb7bc00211769a655b4 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.038240  4409 tablet_replica.cc:333] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.038775  4409 raft_consensus.cc:2243] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.039220  4409 raft_consensus.cc:2272] T f145e4b384244aaaae76147c5ee135ec P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.041291  4409 tablet_replica.cc:333] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.041849  4409 raft_consensus.cc:2243] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.042670  4409 raft_consensus.cc:2272] T e0df0d2cb8774fe0b3479eeb8e30027d P 264376c764c64dc78c4cef6031c15eef [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.044687  4409 tablet_replica.cc:333] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.045199  4409 raft_consensus.cc:2243] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.045652  4409 raft_consensus.cc:2272] T d12f3af68cd84f68b5137c6abe65e63e P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:47.401234 11699 consensus_peers.cc:597] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:47.407455  4409 tablet_replica.cc:333] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.408529  4409 raft_consensus.cc:2243] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.409231  4409 raft_consensus.cc:2272] T c6ff7b5bd9f340839cbde90d6b7259c7 P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:47.415942 11773 consensus_peers.cc:597] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:47.420324 11773 consensus_peers.cc:597] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:47.423784 14177 raft_consensus.cc:493] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:47.424432 14177 raft_consensus.cc:515] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:47.426540 14177 leader_election.cc:290] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:47.432219  4409 tablet_replica.cc:333] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.433157  4409 raft_consensus.cc:2243] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.433826  4409 raft_consensus.cc:2272] T c7c43c72411f483a8d001721079be3d1 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.437407  4409 tablet_replica.cc:333] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.438215  4409 raft_consensus.cc:2243] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.438861  4409 raft_consensus.cc:2272] T 63eff9adc00b4c7f8245454c066123ed P 264376c764c64dc78c4cef6031c15eef [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:47.439205 11773 consensus_peers.cc:597] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:47.440264 11773 leader_election.cc:336] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:47.441823  4409 tablet_replica.cc:333] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
W20260709 12:17:47.442668 11773 consensus_peers.cc:597] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:47.442701  4409 raft_consensus.cc:2243] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.443608  4409 raft_consensus.cc:2272] T 7a70076f56284eafba1df611decc3929 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.446547  4409 tablet_replica.cc:333] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.447283  4409 raft_consensus.cc:2243] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.447863  4409 raft_consensus.cc:2272] T c11a101e9d54454db77b4a2f2d9489e6 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.450564  4409 tablet_replica.cc:333] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.451366  4409 raft_consensus.cc:2243] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.452296  4409 raft_consensus.cc:2272] T f6924fe8aeff4ed699be088221835654 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.454984  4409 tablet_replica.cc:333] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.455773  4409 raft_consensus.cc:2243] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.456696  4409 raft_consensus.cc:2272] T 77633186a3bc4fbe82ee020cad674e30 P 264376c764c64dc78c4cef6031c15eef [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.459460  4409 tablet_replica.cc:333] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.464208  4409 raft_consensus.cc:2243] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.464820  4409 raft_consensus.cc:2272] T 8968bb0a7df844fd868c906fb62847ff P 264376c764c64dc78c4cef6031c15eef [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.468400  4409 tablet_replica.cc:333] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.469153  4409 raft_consensus.cc:2243] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.470265  4409 raft_consensus.cc:2272] T f1b1feee36a2425db32953f79a0b0c0a P 264376c764c64dc78c4cef6031c15eef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.473281  4409 tablet_replica.cc:333] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.474135  4409 raft_consensus.cc:2243] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.475335  4409 raft_consensus.cc:2272] T b748cd6fe5b3471e94399825d62e6646 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.478269  4409 tablet_replica.cc:333] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.479004  4409 raft_consensus.cc:2243] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.480158  4409 raft_consensus.cc:2272] T 46a96b7da08f479dbbc7413cdacfa720 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.482863  4409 tablet_replica.cc:333] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.483588  4409 raft_consensus.cc:2243] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.484184  4409 raft_consensus.cc:2272] T 98be08057b9a47a1abcefa3753fcaf70 P 264376c764c64dc78c4cef6031c15eef [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:47.486783 11775 leader_election.cc:336] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:47.487251 11775 leader_election.cc:304] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:47.487428  4409 tablet_replica.cc:333] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef: stopping tablet replica
I20260709 12:17:47.487927 14177 raft_consensus.cc:2749] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:47.488330  4409 raft_consensus.cc:2243] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.489022  4409 raft_consensus.cc:2272] T 25e58426365f4050aa2b97643be55ad4 P 264376c764c64dc78c4cef6031c15eef [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:47.488139 11775 consensus_peers.cc:597] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:47.494268 11773 consensus_peers.cc:597] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 -> Peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Couldn't send request to peer 264376c764c64dc78c4cef6031c15eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:47.500829 11773 consensus_peers.cc:597] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:47.501492 11773 consensus_peers.cc:597] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 -> Peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Couldn't send request to peer b0f903ca23da45e594b2850337751f03. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:47.540874 14177 raft_consensus.cc:493] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:47.541501 14177 raft_consensus.cc:515] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:47.543855 14177 leader_election.cc:290] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:47.545086 14177 raft_consensus.cc:493] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:47.545625 14177 raft_consensus.cc:515] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:47.547766 14177 leader_election.cc:290] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:47.548811 11773 leader_election.cc:336] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:47.549489 11775 leader_election.cc:336] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:47.550417 11775 leader_election.cc:304] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
W20260709 12:17:47.551333 11773 leader_election.cc:336] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:47.551456 14177 raft_consensus.cc:2749] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:47.553912 11775 leader_election.cc:336] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:47.554198 11775 leader_election.cc:304] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:47.554677 14177 raft_consensus.cc:2749] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:47.564081 11515 debug-util.cc:398] Leaking SignalData structure 0x7b08003a12a0 after lost signal to thread 4412
W20260709 12:17:47.565073 11515 debug-util.cc:398] Leaking SignalData structure 0x7b0800225560 after lost signal to thread 11518
W20260709 12:17:47.566062 11515 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8c40 after lost signal to thread 11759
W20260709 12:17:47.567158 11515 debug-util.cc:398] Leaking SignalData structure 0x7b08003b47a0 after lost signal to thread 11833
I20260709 12:17:47.567195 14177 raft_consensus.cc:493] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:47.567766 14177 raft_consensus.cc:515] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:47.572501 14177 leader_election.cc:290] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:47.574844 11775 leader_election.cc:336] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:47.575392 11773 leader_election.cc:336] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:47.575811 11773 leader_election.cc:304] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:47.576501 14177 raft_consensus.cc:2749] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:47.618969 11775 consensus_peers.cc:597] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:47.740358 14177 raft_consensus.cc:493] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:47.740994 14177 raft_consensus.cc:515] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:47.743867 14177 leader_election.cc:290] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:47.747628 11773 leader_election.cc:336] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:47.748579 11775 leader_election.cc:336] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:47.749030 11775 leader_election.cc:304] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:47.749750 14177 raft_consensus.cc:2749] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:47.800420  4409 tablet_server.cc:196] TabletServer@127.4.78.67:0 shutdown complete.
I20260709 12:17:47.803546 14177 raft_consensus.cc:493] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:47.804147 14177 raft_consensus.cc:515] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
I20260709 12:17:47.808844 14177 leader_election.cc:290] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:47.811414 11773 leader_election.cc:336] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
W20260709 12:17:47.812464 11775 leader_election.cc:336] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:47.813966 11775 leader_election.cc:304] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:47.814738 14177 raft_consensus.cc:2749] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:47.871419 11775 consensus_peers.cc:597] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:47.899524  4409 tablet_server.cc:179] TabletServer@127.4.78.68:0 shutting down...
I20260709 12:17:47.928566 14203 raft_consensus.cc:493] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:47.929164 14203 raft_consensus.cc:515] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:47.933676 14203 leader_election.cc:290] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
W20260709 12:17:47.937173 11775 leader_election.cc:336] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:47.937345 14172 raft_consensus.cc:493] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:47.938091 14172 raft_consensus.cc:515] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:47.939354 11773 leader_election.cc:336] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Network error: Client connection negotiation failed: client connection to 127.4.78.67:40145: connect: Connection refused (error 111)
I20260709 12:17:47.941915 11773 leader_election.cc:304] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:47.942759 14178 raft_consensus.cc:2749] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:47.949712 11775 leader_election.cc:336] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:47.950416 11775 consensus_peers.cc:597] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:47.944945 14172 leader_election.cc:290] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
I20260709 12:17:47.952478 14203 raft_consensus.cc:493] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f903ca23da45e594b2850337751f03)
I20260709 12:17:47.952992 14203 raft_consensus.cc:515] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } } peers { permanent_uuid: "b0f903ca23da45e594b2850337751f03" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 39117 } }
W20260709 12:17:47.953730 11773 leader_election.cc:336] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:47.954174 11773 leader_election.cc:304] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:47.955391 14172 raft_consensus.cc:2749] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:47.956451 14203 leader_election.cc:290] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331), b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117)
W20260709 12:17:47.958362 11775 leader_election.cc:336] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
W20260709 12:17:47.963196 11773 leader_election.cc:336] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b0f903ca23da45e594b2850337751f03 (127.4.78.66:39117): Network error: Client connection negotiation failed: client connection to 127.4.78.66:39117: connect: Connection refused (error 111)
I20260709 12:17:47.963981 11773 leader_election.cc:304] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: b0f903ca23da45e594b2850337751f03, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:47.964993 14203 raft_consensus.cc:2749] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.986119  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:47.987495  4409 tablet_replica.cc:333] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:47.988392  4409 raft_consensus.cc:2243] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.988943  4409 raft_consensus.cc:2272] T a54188b47043494b8e7d633bcfbcab11 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.991395  4409 tablet_replica.cc:333] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:47.992105  4409 raft_consensus.cc:2243] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.992681  4409 raft_consensus.cc:2272] T bc6434e787264f388930e3ed1add578a P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.995126  4409 tablet_replica.cc:333] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:47.995798  4409 raft_consensus.cc:2243] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.996796  4409 pending_rounds.cc:70] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178: Trying to abort 1 pending ops.
I20260709 12:17:47.997071  4409 pending_rounds.cc:77] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178: Aborting op as it isn't in flight: id { term: 7 index: 5 } timestamp: 7305623412824379392 op_type: NO_OP noop_request { }
I20260709 12:17:47.997375  4409 raft_consensus.cc:2889] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:17:47.997650  4409 raft_consensus.cc:2272] T 7195b55fe02f4056bfc2b0e22978a3ff P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.000172  4409 tablet_replica.cc:333] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.000872  4409 raft_consensus.cc:2243] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.001331  4409 raft_consensus.cc:2272] T 9aacd4a8780042e792f4c4c8566c7649 P cfe9bf206bb14951ba7615683809d178 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.003400  4409 tablet_replica.cc:333] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.003930  4409 raft_consensus.cc:2243] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.004375  4409 raft_consensus.cc:2272] T d3c499278cbd4f3094888a0d7373a5dc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.006368  4409 tablet_replica.cc:333] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.006872  4409 raft_consensus.cc:2243] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.007722  4409 raft_consensus.cc:2272] T 2e4a55c602a24e9aa3bd55a9fef99c18 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.008157 14203 raft_consensus.cc:493] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 264376c764c64dc78c4cef6031c15eef)
I20260709 12:17:48.008630 14203 raft_consensus.cc:515] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264376c764c64dc78c4cef6031c15eef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 40145 } } peers { permanent_uuid: "cfe9bf206bb14951ba7615683809d178" member_type: VOTER last_known_addr { host: "127.4.78.68" port: 40845 } } peers { permanent_uuid: "ce38e95b93a640c1a7b16f37868b30fc" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36331 } }
I20260709 12:17:48.010447  4409 tablet_replica.cc:333] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.010685 14203 leader_election.cc:290] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145), ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331)
I20260709 12:17:48.011356  4409 raft_consensus.cc:2243] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.012184  4409 raft_consensus.cc:2272] T 9a1489fa6b6f4aa59c527ec8a7f1c37b P cfe9bf206bb14951ba7615683809d178 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.014798  4409 tablet_replica.cc:333] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
W20260709 12:17:48.015360 11773 leader_election.cc:336] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 264376c764c64dc78c4cef6031c15eef (127.4.78.67:40145): Network error: Client connection negotiation failed: client connection to 127.4.78.67:40145: connect: Connection refused (error 111)
I20260709 12:17:48.015487  4409 raft_consensus.cc:2243] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:48.016060 11775 consensus_peers.cc:597] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:48.016211  4409 raft_consensus.cc:2272] T efb370bb0e99488f947f70704fee6e53 P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:48.016539 11775 leader_election.cc:336] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111)
I20260709 12:17:48.016932 11775 leader_election.cc:304] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfe9bf206bb14951ba7615683809d178; no voters: 264376c764c64dc78c4cef6031c15eef, ce38e95b93a640c1a7b16f37868b30fc
I20260709 12:17:48.017606 14203 raft_consensus.cc:2749] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:48.018697  4409 tablet_replica.cc:333] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.019291  4409 raft_consensus.cc:2243] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.019695  4409 raft_consensus.cc:2272] T 3f44d8dd328e49b0b41e9345b6c2fb85 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.021584  4409 tablet_replica.cc:333] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.022145  4409 raft_consensus.cc:2243] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.022926  4409 raft_consensus.cc:2272] T 4ac74a4093c34756a969a33ff35146ad P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.024875  4409 tablet_replica.cc:333] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.025390  4409 raft_consensus.cc:2243] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.025883  4409 raft_consensus.cc:2272] T 60c076143e0f4e3cb04896d3f733461b P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.027725  4409 tablet_replica.cc:333] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.028246  4409 raft_consensus.cc:2243] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.028729  4409 raft_consensus.cc:2272] T f5b9e8af33874d1da7a3fa1b4fc455f0 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.030763  4409 tablet_replica.cc:333] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.031509  4409 raft_consensus.cc:2243] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.032795  4409 raft_consensus.cc:2272] T cf073dc4ac2044dfadb5f017646c8101 P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.035495  4409 tablet_replica.cc:333] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.036360  4409 raft_consensus.cc:2243] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.036964  4409 raft_consensus.cc:2272] T a633993d8d3341eeaddce5c93752db1e P cfe9bf206bb14951ba7615683809d178 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.039736  4409 tablet_replica.cc:333] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.040438  4409 raft_consensus.cc:2243] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.041493  4409 raft_consensus.cc:2272] T 869a40a36ae44ac9af963b7e09384543 P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.043473  4409 tablet_replica.cc:333] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.044026  4409 raft_consensus.cc:2243] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.044487  4409 raft_consensus.cc:2272] T 896664897f42444796f0be51911c9ec7 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.046612  4409 tablet_replica.cc:333] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.047160  4409 raft_consensus.cc:2243] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.048147  4409 raft_consensus.cc:2272] T da144a8884c1479980762ec9a874ec7f P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.050853  4409 tablet_replica.cc:333] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.051602  4409 raft_consensus.cc:2243] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.052286  4409 raft_consensus.cc:2272] T a7852dc16ba7411fa9eadde150e3dcaa P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.054637  4409 tablet_replica.cc:333] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.055286  4409 raft_consensus.cc:2243] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.055802  4409 raft_consensus.cc:2272] T b748cd6fe5b3471e94399825d62e6646 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.058207  4409 tablet_replica.cc:333] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.058966  4409 raft_consensus.cc:2243] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.059772  4409 pending_rounds.cc:70] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178: Trying to abort 1 pending ops.
I20260709 12:17:48.059981  4409 pending_rounds.cc:77] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178: Aborting op as it isn't in flight: id { term: 6 index: 5 } timestamp: 7305623412555743232 op_type: NO_OP noop_request { }
I20260709 12:17:48.060266  4409 raft_consensus.cc:2889] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:17:48.060523  4409 raft_consensus.cc:2272] T e35e8ccf015d4658b6383cb7a76a1461 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.062538  4409 tablet_replica.cc:333] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.063042  4409 raft_consensus.cc:2243] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.063762  4409 raft_consensus.cc:2272] T baf220366c63486c90e96d1db47de716 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.065619  4409 tablet_replica.cc:333] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.066149  4409 raft_consensus.cc:2243] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.066905  4409 raft_consensus.cc:2272] T 195b741f1d144afab8c37ecc3be587b1 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.068872  4409 tablet_replica.cc:333] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.069397  4409 raft_consensus.cc:2243] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.069865  4409 raft_consensus.cc:2272] T 7004b9d11647433b94b3d6a7c3e247f6 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.071686  4409 tablet_replica.cc:333] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.072194  4409 raft_consensus.cc:2243] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.072880  4409 pending_rounds.cc:70] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178: Trying to abort 1 pending ops.
I20260709 12:17:48.073033  4409 pending_rounds.cc:77] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178: Aborting op as it isn't in flight: id { term: 6 index: 4 } timestamp: 7305623413359030272 op_type: NO_OP noop_request { }
I20260709 12:17:48.073274  4409 raft_consensus.cc:2889] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:17:48.073518  4409 raft_consensus.cc:2272] T d714468af62e4ab3bb4affae7ab03619 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.075330  4409 tablet_replica.cc:333] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.075855  4409 raft_consensus.cc:2243] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.076272  4409 raft_consensus.cc:2272] T a6b7ee7fe2c64c44901ea84bd330b073 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.078336  4409 tablet_replica.cc:333] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.078919  4409 raft_consensus.cc:2243] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.079762  4409 raft_consensus.cc:2272] T 225a49e8e4114f8baf86d7c29f4635d5 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.082267  4409 tablet_replica.cc:333] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.082938  4409 raft_consensus.cc:2243] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.083467  4409 raft_consensus.cc:2272] T 77633186a3bc4fbe82ee020cad674e30 P cfe9bf206bb14951ba7615683809d178 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.085505  4409 tablet_replica.cc:333] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.086071  4409 raft_consensus.cc:2243] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.086472  4409 raft_consensus.cc:2272] T 1e219590d128498d88773c090b1fc4f3 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.088384  4409 tablet_replica.cc:333] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.088905  4409 raft_consensus.cc:2243] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.089677  4409 raft_consensus.cc:2272] T 8968bb0a7df844fd868c906fb62847ff P cfe9bf206bb14951ba7615683809d178 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.091674  4409 tablet_replica.cc:333] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.092190  4409 raft_consensus.cc:2243] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.092631  4409 raft_consensus.cc:2272] T 841068979f35457ca7200408e6d522a9 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.094578  4409 tablet_replica.cc:333] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.095062  4409 raft_consensus.cc:2243] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.095804  4409 raft_consensus.cc:2272] T f145e4b384244aaaae76147c5ee135ec P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.097522  4409 tablet_replica.cc:333] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.098145  4409 raft_consensus.cc:2243] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.098690  4409 raft_consensus.cc:2272] T a0fdac8111fe4c49bccd7e22a650cccc P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.100978  4409 tablet_replica.cc:333] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.101506  4409 raft_consensus.cc:2243] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.102344  4409 raft_consensus.cc:2272] T 001b8afd665e4f66a4529aec50993495 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:48.103917 11775 consensus_peers.cc:597] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 -> Peer ce38e95b93a640c1a7b16f37868b30fc (127.4.78.65:36331): Couldn't send request to peer ce38e95b93a640c1a7b16f37868b30fc. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36331: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:48.104820  4409 tablet_replica.cc:333] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.105413  4409 raft_consensus.cc:2243] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.105926  4409 raft_consensus.cc:2272] T e0df0d2cb8774fe0b3479eeb8e30027d P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.107862  4409 tablet_replica.cc:333] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.108343  4409 raft_consensus.cc:2243] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.109071  4409 raft_consensus.cc:2272] T 63eff9adc00b4c7f8245454c066123ed P cfe9bf206bb14951ba7615683809d178 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.110952  4409 tablet_replica.cc:333] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.111436  4409 raft_consensus.cc:2243] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.112130  4409 raft_consensus.cc:2272] T 7a70076f56284eafba1df611decc3929 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.114038  4409 tablet_replica.cc:333] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.114523  4409 raft_consensus.cc:2243] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.115234  4409 raft_consensus.cc:2272] T c6ff7b5bd9f340839cbde90d6b7259c7 P cfe9bf206bb14951ba7615683809d178 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.116999  4409 tablet_replica.cc:333] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.117475  4409 raft_consensus.cc:2243] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.118230  4409 raft_consensus.cc:2272] T c7c43c72411f483a8d001721079be3d1 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.120025  4409 tablet_replica.cc:333] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.120496  4409 raft_consensus.cc:2243] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.120916  4409 raft_consensus.cc:2272] T 4155ea2d0cb34a1b9bd7f3d44b6285f0 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.122781  4409 tablet_replica.cc:333] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.123236  4409 raft_consensus.cc:2243] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.123950  4409 raft_consensus.cc:2272] T 98be08057b9a47a1abcefa3753fcaf70 P cfe9bf206bb14951ba7615683809d178 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.125725  4409 tablet_replica.cc:333] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.126230  4409 raft_consensus.cc:2243] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.126981  4409 raft_consensus.cc:2272] T 25e58426365f4050aa2b97643be55ad4 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.129002  4409 tablet_replica.cc:333] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.129585  4409 raft_consensus.cc:2243] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.130501  4409 raft_consensus.cc:2272] T 79d2242d216849e096e87b165c9d6778 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.132339  4409 tablet_replica.cc:333] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.132827  4409 raft_consensus.cc:2243] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.133513  4409 pending_rounds.cc:70] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178: Trying to abort 1 pending ops.
I20260709 12:17:48.133666  4409 pending_rounds.cc:77] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178: Aborting op as it isn't in flight: id { term: 5 index: 4 } timestamp: 7305623413372084224 op_type: NO_OP noop_request { }
I20260709 12:17:48.133955  4409 raft_consensus.cc:2889] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:17:48.134213  4409 raft_consensus.cc:2272] T c11a101e9d54454db77b4a2f2d9489e6 P cfe9bf206bb14951ba7615683809d178 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.136077  4409 tablet_replica.cc:333] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178: stopping tablet replica
I20260709 12:17:48.136520  4409 raft_consensus.cc:2243] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.136893  4409 raft_consensus.cc:2272] T 2ec5984b3c05404884debeee7f5192a1 P cfe9bf206bb14951ba7615683809d178 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:48.465713 11830 debug-util.cc:398] Leaking SignalData structure 0x7b0800356fc0 after lost signal to thread 4412
W20260709 12:17:48.468469 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd280 after lost signal to thread 11518
W20260709 12:17:48.469244 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9c00 after lost signal to thread 11759
W20260709 12:17:48.471014 11830 debug-util.cc:398] Leaking SignalData structure 0x7b08000e2700 after lost signal to thread 11833
W20260709 12:17:49.201607  4409 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11830)
I20260709 12:17:49.494716  4409 tablet_server.cc:196] TabletServer@127.4.78.68:0 shutdown complete.
I20260709 12:17:49.594504  4409 master.cc:562] Master@127.4.78.126:38583 shutting down...
I20260709 12:17:49.627004  4409 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:49.627847  4409 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:49.628222  4409 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4d291926a64f478391c9d85c49057312: stopping tablet replica
I20260709 12:17:49.753086  4409 master.cc:584] Master@127.4.78.126:38583 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (86372 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:17:49.841159  4409 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.78.126:40833
I20260709 12:17:49.842314  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:49.847952 14216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:49.848208 14215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:49.848357 14218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:49.849186  4409 server_base.cc:1061] running on GCE node
I20260709 12:17:49.851197  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:49.851387  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:49.851529  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599469851513 us; error 0 us; skew 500 ppm
I20260709 12:17:49.852030  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:49.854341  4409 webserver.cc:533] Webserver started at http://127.4.78.126:34613/ using document root <none> and password file <none>
I20260709 12:17:49.854791  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:49.854957  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:49.855199  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:49.856362  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/master-0-root/instance:
uuid: "5d1cd54963d649f1b47cbfb2432d878f"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-9t7s"
I20260709 12:17:49.860634  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:17:49.863739 14223 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.864391  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:17:49.864658  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/master-0-root
uuid: "5d1cd54963d649f1b47cbfb2432d878f"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-9t7s"
I20260709 12:17:49.864923  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:49.883327  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:49.884610  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:49.922154  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.126:40833
I20260709 12:17:49.922279 14274 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.126:40833 every 8 connection(s)
I20260709 12:17:49.926347 14275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.937487 14275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f: Bootstrap starting.
I20260709 12:17:49.942579 14275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.946738 14275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f: No bootstrap required, opened a new log
I20260709 12:17:49.949002 14275 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d1cd54963d649f1b47cbfb2432d878f" member_type: VOTER }
I20260709 12:17:49.949451 14275 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.949679 14275 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1cd54963d649f1b47cbfb2432d878f, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.950285 14275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d1cd54963d649f1b47cbfb2432d878f" member_type: VOTER }
I20260709 12:17:49.950748 14275 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:49.950966 14275 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:49.951238 14275 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.955688 14275 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d1cd54963d649f1b47cbfb2432d878f" member_type: VOTER }
I20260709 12:17:49.956187 14275 leader_election.cc:304] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d1cd54963d649f1b47cbfb2432d878f; no voters: 
I20260709 12:17:49.957317 14275 leader_election.cc:290] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:49.957607 14278 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:49.958906 14278 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [term 1 LEADER]: Becoming Leader. State: Replica: 5d1cd54963d649f1b47cbfb2432d878f, State: Running, Role: LEADER
I20260709 12:17:49.959587 14278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d1cd54963d649f1b47cbfb2432d878f" member_type: VOTER }
I20260709 12:17:49.960222 14275 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:49.965210 14279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d1cd54963d649f1b47cbfb2432d878f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d1cd54963d649f1b47cbfb2432d878f" member_type: VOTER } }
I20260709 12:17:49.965468 14280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d1cd54963d649f1b47cbfb2432d878f. Latest consensus state: current_term: 1 leader_uuid: "5d1cd54963d649f1b47cbfb2432d878f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d1cd54963d649f1b47cbfb2432d878f" member_type: VOTER } }
I20260709 12:17:49.965988 14279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:49.966228 14280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:49.968336 14285 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:49.973049 14285 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:49.976611  4409 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:49.981901 14285 catalog_manager.cc:1383] Generated new cluster ID: d44449330d7b4c7db4e7cb9504833a94
I20260709 12:17:49.982147 14285 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:49.998951 14285 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:50.000224 14285 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:50.014223 14285 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f: Generated new TSK 0
I20260709 12:17:50.014793 14285 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:50.043587  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:50.049727 14296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:50.051133 14297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:50.052198 14299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:50.052776  4409 server_base.cc:1061] running on GCE node
I20260709 12:17:50.055122  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:50.055321  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:50.055445  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599470055433 us; error 0 us; skew 500 ppm
I20260709 12:17:50.055904  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:50.058117  4409 webserver.cc:533] Webserver started at http://127.4.78.65:36933/ using document root <none> and password file <none>
I20260709 12:17:50.058540  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:50.058703  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:50.058909  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:50.060011  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-0-root/instance:
uuid: "57020114ade14e34a03fc02b9c884bbd"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-9t7s"
I20260709 12:17:50.064209  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:17:50.067480 14304 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.068178  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:17:50.068455  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-0-root
uuid: "57020114ade14e34a03fc02b9c884bbd"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-9t7s"
I20260709 12:17:50.068723  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:50.087312  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:50.088515  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:50.089967  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:50.092203  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:50.092384  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.092615  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:50.092775  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.131461  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.65:32783
I20260709 12:17:50.131548 14366 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.65:32783 every 8 connection(s)
I20260709 12:17:50.136520  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:50.143487 14371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:50.144428 14372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:50.147337 14374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:50.147675  4409 server_base.cc:1061] running on GCE node
I20260709 12:17:50.149024  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:50.149228  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:50.149394  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599470149377 us; error 0 us; skew 500 ppm
I20260709 12:17:50.149968  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:50.152616  4409 webserver.cc:533] Webserver started at http://127.4.78.66:45465/ using document root <none> and password file <none>
I20260709 12:17:50.153157  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:50.153239 14367 heartbeater.cc:344] Connected to a master server at 127.4.78.126:40833
I20260709 12:17:50.153364  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:50.153725 14367 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:50.153817  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:50.154542 14367 heartbeater.cc:507] Master 127.4.78.126:40833 requested a full tablet report, sending...
I20260709 12:17:50.155172  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-1-root/instance:
uuid: "09fc724994854a6ea5feb9376b8bd4b0"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-9t7s"
I20260709 12:17:50.156747 14240 ts_manager.cc:194] Registered new tserver with Master: 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783)
I20260709 12:17:50.159201 14240 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43200
I20260709 12:17:50.160773  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:17:50.164129 14379 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.164777  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:17:50.165042  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-1-root
uuid: "09fc724994854a6ea5feb9376b8bd4b0"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-9t7s"
I20260709 12:17:50.165299  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:50.179575  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:50.180744  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:50.182169  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:50.184321  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:50.184507  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.184722  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:50.184883  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.223304  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.66:41115
I20260709 12:17:50.223402 14441 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.66:41115 every 8 connection(s)
I20260709 12:17:50.227877  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:50.234704 14445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:50.235832 14446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:50.237800 14448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:50.238739  4409 server_base.cc:1061] running on GCE node
I20260709 12:17:50.239684  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:50.239944  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:50.240160  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599470240136 us; error 0 us; skew 500 ppm
I20260709 12:17:50.240343 14442 heartbeater.cc:344] Connected to a master server at 127.4.78.126:40833
I20260709 12:17:50.240819 14442 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:50.240943  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:50.241806 14442 heartbeater.cc:507] Master 127.4.78.126:40833 requested a full tablet report, sending...
I20260709 12:17:50.243788  4409 webserver.cc:533] Webserver started at http://127.4.78.67:45195/ using document root <none> and password file <none>
I20260709 12:17:50.244194 14240 ts_manager.cc:194] Registered new tserver with Master: 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:50.244457  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:50.244755  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:50.245096  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:50.246086 14240 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43202
I20260709 12:17:50.246652  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-2-root/instance:
uuid: "3de321a572024870b2e77cca814df007"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-9t7s"
I20260709 12:17:50.251649  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:17:50.254944 14453 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.255662  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:17:50.255962  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-2-root
uuid: "3de321a572024870b2e77cca814df007"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-9t7s"
I20260709 12:17:50.256258  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:50.272470  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:50.273649  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:50.275143  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:50.277456  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:50.277659  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.277904  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:50.278061  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:50.316751  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.67:33019
I20260709 12:17:50.316849 14515 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.67:33019 every 8 connection(s)
I20260709 12:17:50.329912 14516 heartbeater.cc:344] Connected to a master server at 127.4.78.126:40833
I20260709 12:17:50.330344 14516 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:50.331079 14516 heartbeater.cc:507] Master 127.4.78.126:40833 requested a full tablet report, sending...
I20260709 12:17:50.333010 14240 ts_manager.cc:194] Registered new tserver with Master: 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:50.333171  4409 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013446847s
I20260709 12:17:50.334390 14240 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43204
I20260709 12:17:50.359898 14240 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43208:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:50.362926 14240 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:50.445871 14407 tablet_service.cc:1511] Processing CreateTablet for tablet 1c1515e01a4a4cd5a519eb207e92b92d (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:50.447355 14407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c1515e01a4a4cd5a519eb207e92b92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.448048 14481 tablet_service.cc:1511] Processing CreateTablet for tablet 1c1515e01a4a4cd5a519eb207e92b92d (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:50.448575 14405 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd51a1669ec44f88bf485256c140339 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:50.449997 14405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd51a1669ec44f88bf485256c140339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.449882 14332 tablet_service.cc:1511] Processing CreateTablet for tablet 1c1515e01a4a4cd5a519eb207e92b92d (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:50.451215 14332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c1515e01a4a4cd5a519eb207e92b92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.447219 14406 tablet_service.cc:1511] Processing CreateTablet for tablet e1478173e5634b808e376dffb51b9517 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:50.452886 14406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1478173e5634b808e376dffb51b9517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.456437 14481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c1515e01a4a4cd5a519eb207e92b92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.456674 14328 tablet_service.cc:1511] Processing CreateTablet for tablet e326c257307c4eeba83c7bbe1d14274b (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:50.458065 14328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e326c257307c4eeba83c7bbe1d14274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.457914 14330 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd51a1669ec44f88bf485256c140339 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:50.460335 14330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd51a1669ec44f88bf485256c140339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.463125 14331 tablet_service.cc:1511] Processing CreateTablet for tablet e1478173e5634b808e376dffb51b9517 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:50.464583 14331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1478173e5634b808e376dffb51b9517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.456728 14329 tablet_service.cc:1511] Processing CreateTablet for tablet ee0da15c46664f6f8088ac7761ec3237 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:50.456735 14403 tablet_service.cc:1511] Processing CreateTablet for tablet e326c257307c4eeba83c7bbe1d14274b (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:50.469702 14329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0da15c46664f6f8088ac7761ec3237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.474375 14480 tablet_service.cc:1511] Processing CreateTablet for tablet e1478173e5634b808e376dffb51b9517 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:50.476187 14480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1478173e5634b808e376dffb51b9517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.479290 14478 tablet_service.cc:1511] Processing CreateTablet for tablet ee0da15c46664f6f8088ac7761ec3237 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:50.480698 14478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0da15c46664f6f8088ac7761ec3237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.482280 14403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e326c257307c4eeba83c7bbe1d14274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.468202 14404 tablet_service.cc:1511] Processing CreateTablet for tablet ee0da15c46664f6f8088ac7761ec3237 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:50.484186 14404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0da15c46664f6f8088ac7761ec3237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.487332 14326 tablet_service.cc:1511] Processing CreateTablet for tablet b00ac41e1f5948a7bee8ca041288ede9 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:50.487794 14327 tablet_service.cc:1511] Processing CreateTablet for tablet a9ece67920cc454fa88c0e0f0a07ccb7 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:50.488754 14326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00ac41e1f5948a7bee8ca041288ede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.489043 14479 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd51a1669ec44f88bf485256c140339 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:50.490362 14479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd51a1669ec44f88bf485256c140339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.494180 14327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ece67920cc454fa88c0e0f0a07ccb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.504395 14325 tablet_service.cc:1511] Processing CreateTablet for tablet b7d992b49e1f4ce09e047515dc8fe865 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:50.506544 14477 tablet_service.cc:1511] Processing CreateTablet for tablet e326c257307c4eeba83c7bbe1d14274b (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:50.506949 14402 tablet_service.cc:1511] Processing CreateTablet for tablet b00ac41e1f5948a7bee8ca041288ede9 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:50.508040 14477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e326c257307c4eeba83c7bbe1d14274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.508381 14402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00ac41e1f5948a7bee8ca041288ede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.508142 14475 tablet_service.cc:1511] Processing CreateTablet for tablet b00ac41e1f5948a7bee8ca041288ede9 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:50.509460 14475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00ac41e1f5948a7bee8ca041288ede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.511644 14401 tablet_service.cc:1511] Processing CreateTablet for tablet b7d992b49e1f4ce09e047515dc8fe865 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:50.513180 14401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d992b49e1f4ce09e047515dc8fe865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.506559 14476 tablet_service.cc:1511] Processing CreateTablet for tablet a9ece67920cc454fa88c0e0f0a07ccb7 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:50.519408 14476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ece67920cc454fa88c0e0f0a07ccb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.519483 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d992b49e1f4ce09e047515dc8fe865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.530745 14407 tablet_service.cc:1511] Processing CreateTablet for tablet a9ece67920cc454fa88c0e0f0a07ccb7 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:50.532267 14407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ece67920cc454fa88c0e0f0a07ccb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.519460 14531 tablet_bootstrap.cc:492] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0: Bootstrap starting.
I20260709 12:17:50.558100 14474 tablet_service.cc:1511] Processing CreateTablet for tablet b7d992b49e1f4ce09e047515dc8fe865 (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:50.559643 14474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d992b49e1f4ce09e047515dc8fe865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.559456 14330 tablet_service.cc:1511] Processing CreateTablet for tablet 59b8e8720ec44504ab88a0a116325d9e (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:50.560745 14330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b8e8720ec44504ab88a0a116325d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.571177 14332 tablet_service.cc:1511] Processing CreateTablet for tablet 39436b3712f14a5791306727e430875f (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:50.574335 14531 tablet_bootstrap.cc:654] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.574393 14332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39436b3712f14a5791306727e430875f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.577418 14402 tablet_service.cc:1511] Processing CreateTablet for tablet 59b8e8720ec44504ab88a0a116325d9e (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:50.578583 14473 tablet_service.cc:1511] Processing CreateTablet for tablet 59b8e8720ec44504ab88a0a116325d9e (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:50.579043 14402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b8e8720ec44504ab88a0a116325d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.579895 14473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b8e8720ec44504ab88a0a116325d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.594741 14400 tablet_service.cc:1511] Processing CreateTablet for tablet 39436b3712f14a5791306727e430875f (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:50.599383 14400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39436b3712f14a5791306727e430875f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.599472 14532 tablet_bootstrap.cc:492] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:50.607427 14532 tablet_bootstrap.cc:654] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.605355 14475 tablet_service.cc:1511] Processing CreateTablet for tablet 39436b3712f14a5791306727e430875f (DEFAULT_TABLE table=test-workload [id=394c8364bda9459fb69c879ac18de5a2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:50.616844 14475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39436b3712f14a5791306727e430875f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.634763 14533 tablet_bootstrap.cc:492] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007: Bootstrap starting.
I20260709 12:17:50.642659 14531 tablet_bootstrap.cc:492] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0: No bootstrap required, opened a new log
I20260709 12:17:50.646751 14531 ts_tablet_manager.cc:1403] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0: Time spent bootstrapping tablet: real 0.142s	user 0.015s	sys 0.004s
I20260709 12:17:50.649968 14531 raft_consensus.cc:359] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } }
I20260709 12:17:50.652710 14531 raft_consensus.cc:385] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.653095 14531 raft_consensus.cc:740] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.653184 14532 tablet_bootstrap.cc:492] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd: No bootstrap required, opened a new log
I20260709 12:17:50.654201 14532 ts_tablet_manager.cc:1403] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.005s
I20260709 12:17:50.656342 14532 raft_consensus.cc:359] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.656831 14532 raft_consensus.cc:385] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.657047 14532 raft_consensus.cc:740] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.657503 14531 consensus_queue.cc:260] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } }
I20260709 12:17:50.658849 14532 consensus_queue.cc:260] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.665056 14533 tablet_bootstrap.cc:654] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.670747 14442 heartbeater.cc:499] Master 127.4.78.126:40833 was elected leader, sending a full tablet report...
I20260709 12:17:50.671144 14367 heartbeater.cc:499] Master 127.4.78.126:40833 was elected leader, sending a full tablet report...
I20260709 12:17:50.671515 14531 ts_tablet_manager.cc:1434] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.012s
I20260709 12:17:50.672768 14531 tablet_bootstrap.cc:492] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0: Bootstrap starting.
I20260709 12:17:50.670828 14532 ts_tablet_manager.cc:1434] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.010s
I20260709 12:17:50.679445 14532 tablet_bootstrap.cc:492] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:50.680263 14531 tablet_bootstrap.cc:654] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.683282 14533 tablet_bootstrap.cc:492] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007: No bootstrap required, opened a new log
I20260709 12:17:50.683991 14533 ts_tablet_manager.cc:1403] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.003s
I20260709 12:17:50.687605 14533 raft_consensus.cc:359] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.688007 14532 tablet_bootstrap.cc:654] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.688585 14533 raft_consensus.cc:385] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.689070 14533 raft_consensus.cc:740] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.689424 14531 tablet_bootstrap.cc:492] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0: No bootstrap required, opened a new log
I20260709 12:17:50.690100 14531 ts_tablet_manager.cc:1403] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:17:50.690165 14533 consensus_queue.cc:260] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.693920 14531 raft_consensus.cc:359] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.694967 14531 raft_consensus.cc:385] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.695978 14516 heartbeater.cc:499] Master 127.4.78.126:40833 was elected leader, sending a full tablet report...
I20260709 12:17:50.697254 14533 ts_tablet_manager.cc:1434] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:17:50.698415 14533 tablet_bootstrap.cc:492] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007: Bootstrap starting.
I20260709 12:17:50.695413 14531 raft_consensus.cc:740] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.702725 14531 consensus_queue.cc:260] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.705463 14531 ts_tablet_manager.cc:1434] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 12:17:50.706763 14531 tablet_bootstrap.cc:492] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0: Bootstrap starting.
I20260709 12:17:50.708528 14532 tablet_bootstrap.cc:492] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: No bootstrap required, opened a new log
I20260709 12:17:50.709146 14532 ts_tablet_manager.cc:1403] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.006s
I20260709 12:17:50.705502 14533 tablet_bootstrap.cc:654] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.713352 14532 raft_consensus.cc:359] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.714197 14531 tablet_bootstrap.cc:654] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.714273 14532 raft_consensus.cc:385] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.715576 14537 raft_consensus.cc:493] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.716135 14537 raft_consensus.cc:515] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.719446 14537 leader_election.cc:290] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:50.714811 14532 raft_consensus.cc:740] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.721122 14532 consensus_queue.cc:260] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
W20260709 12:17:50.727339 14443 tablet.cc:2406] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:17:50.729444 14532 ts_tablet_manager.cc:1434] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:17:50.730715 14532 tablet_bootstrap.cc:492] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:50.737345 14532 tablet_bootstrap.cc:654] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.751958 14533 tablet_bootstrap.cc:492] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007: No bootstrap required, opened a new log
I20260709 12:17:50.752202 14531 tablet_bootstrap.cc:492] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0: No bootstrap required, opened a new log
I20260709 12:17:50.752538 14533 ts_tablet_manager.cc:1403] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.021s
I20260709 12:17:50.752725 14531 ts_tablet_manager.cc:1403] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.010s
I20260709 12:17:50.755779 14531 raft_consensus.cc:359] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.756537 14531 raft_consensus.cc:385] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.756882 14531 raft_consensus.cc:740] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.757093 14533 raft_consensus.cc:359] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } }
I20260709 12:17:50.757920 14533 raft_consensus.cc:385] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.759071 14533 raft_consensus.cc:740] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.759589 14532 tablet_bootstrap.cc:492] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd: No bootstrap required, opened a new log
I20260709 12:17:50.760169 14532 ts_tablet_manager.cc:1403] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.006s
I20260709 12:17:50.759944 14533 consensus_queue.cc:260] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } }
I20260709 12:17:50.757922 14531 consensus_queue.cc:260] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.763248 14532 raft_consensus.cc:359] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } }
I20260709 12:17:50.763947 14531 ts_tablet_manager.cc:1434] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 12:17:50.764096 14533 ts_tablet_manager.cc:1434] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:17:50.765336 14531 tablet_bootstrap.cc:492] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0: Bootstrap starting.
I20260709 12:17:50.764000 14532 raft_consensus.cc:385] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.765487 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:50.765844 14532 raft_consensus.cc:740] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.767482 14533 tablet_bootstrap.cc:492] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007: Bootstrap starting.
W20260709 12:17:50.768513 14306 leader_election.cc:343] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3de321a572024870b2e77cca814df007 (127.4.78.67:33019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.770666 14532 consensus_queue.cc:260] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } }
I20260709 12:17:50.772976 14417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:50.774220 14531 tablet_bootstrap.cc:654] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.774328 14533 tablet_bootstrap.cc:654] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.775298 14532 ts_tablet_manager.cc:1434] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:17:50.776405 14532 tablet_bootstrap.cc:492] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:50.783049 14532 tablet_bootstrap.cc:654] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:50.785724 14306 leader_election.cc:343] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.786950 14306 leader_election.cc:304] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57020114ade14e34a03fc02b9c884bbd; no voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007
I20260709 12:17:50.787827 14537 raft_consensus.cc:2749] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:50.807090 14531 tablet_bootstrap.cc:492] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0: No bootstrap required, opened a new log
I20260709 12:17:50.807293 14532 tablet_bootstrap.cc:492] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: No bootstrap required, opened a new log
I20260709 12:17:50.807446 14533 tablet_bootstrap.cc:492] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007: No bootstrap required, opened a new log
I20260709 12:17:50.807773 14531 ts_tablet_manager.cc:1403] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.030s
I20260709 12:17:50.807992 14532 ts_tablet_manager.cc:1403] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.014s
I20260709 12:17:50.808019 14533 ts_tablet_manager.cc:1403] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007: Time spent bootstrapping tablet: real 0.041s	user 0.025s	sys 0.014s
I20260709 12:17:50.810104 14531 raft_consensus.cc:359] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.810663 14531 raft_consensus.cc:385] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.810941 14531 raft_consensus.cc:740] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.810678 14532 raft_consensus.cc:359] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.811522 14532 raft_consensus.cc:385] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.811842 14532 raft_consensus.cc:740] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.811698 14531 consensus_queue.cc:260] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.812574 14533 raft_consensus.cc:359] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.812743 14532 consensus_queue.cc:260] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.813359 14533 raft_consensus.cc:385] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.813685 14533 raft_consensus.cc:740] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.813808 14531 ts_tablet_manager.cc:1434] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:17:50.814546 14533 consensus_queue.cc:260] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.815083 14532 ts_tablet_manager.cc:1434] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:50.815244 14531 tablet_bootstrap.cc:492] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0: Bootstrap starting.
I20260709 12:17:50.816831 14533 ts_tablet_manager.cc:1434] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:50.817924 14533 tablet_bootstrap.cc:492] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007: Bootstrap starting.
I20260709 12:17:50.822310 14532 tablet_bootstrap.cc:492] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:50.825536 14533 tablet_bootstrap.cc:654] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.828610 14532 tablet_bootstrap.cc:654] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.822365 14531 tablet_bootstrap.cc:654] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.837092 14532 tablet_bootstrap.cc:492] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd: No bootstrap required, opened a new log
I20260709 12:17:50.837134 14533 tablet_bootstrap.cc:492] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007: No bootstrap required, opened a new log
I20260709 12:17:50.837299 14531 tablet_bootstrap.cc:492] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0: No bootstrap required, opened a new log
I20260709 12:17:50.837716 14532 ts_tablet_manager.cc:1403] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.016s	user 0.002s	sys 0.009s
I20260709 12:17:50.837796 14533 ts_tablet_manager.cc:1403] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:17:50.837904 14531 ts_tablet_manager.cc:1403] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 12:17:50.840462 14531 raft_consensus.cc:359] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.840986 14531 raft_consensus.cc:385] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.840909 14532 raft_consensus.cc:359] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.841501 14531 raft_consensus.cc:740] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.841144 14533 raft_consensus.cc:359] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.841845 14532 raft_consensus.cc:385] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.842053 14533 raft_consensus.cc:385] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.842180 14532 raft_consensus.cc:740] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.842451 14533 raft_consensus.cc:740] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.842286 14531 consensus_queue.cc:260] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.843111 14532 consensus_queue.cc:260] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.843277 14533 consensus_queue.cc:260] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.844578 14531 ts_tablet_manager.cc:1434] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:17:50.845415 14532 ts_tablet_manager.cc:1434] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:17:50.845662 14531 tablet_bootstrap.cc:492] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0: Bootstrap starting.
I20260709 12:17:50.846487 14532 tablet_bootstrap.cc:492] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:50.850449 14533 ts_tablet_manager.cc:1434] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:17:50.851639 14533 tablet_bootstrap.cc:492] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007: Bootstrap starting.
I20260709 12:17:50.853008 14531 tablet_bootstrap.cc:654] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.853947 14532 tablet_bootstrap.cc:654] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.858256 14533 tablet_bootstrap.cc:654] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.887002 14531 tablet_bootstrap.cc:492] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0: No bootstrap required, opened a new log
I20260709 12:17:50.887526 14531 ts_tablet_manager.cc:1403] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.020s
I20260709 12:17:50.890307 14532 tablet_bootstrap.cc:492] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd: No bootstrap required, opened a new log
I20260709 12:17:50.890982 14532 ts_tablet_manager.cc:1403] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.030s
I20260709 12:17:50.890352 14531 raft_consensus.cc:359] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.891196 14533 tablet_bootstrap.cc:492] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007: No bootstrap required, opened a new log
I20260709 12:17:50.891399 14531 raft_consensus.cc:385] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.891733 14533 ts_tablet_manager.cc:1403] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007: Time spent bootstrapping tablet: real 0.040s	user 0.030s	sys 0.009s
I20260709 12:17:50.891749 14531 raft_consensus.cc:740] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.892864 14531 consensus_queue.cc:260] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.894106 14532 raft_consensus.cc:359] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.894855 14532 raft_consensus.cc:385] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.895172 14532 raft_consensus.cc:740] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.894932 14533 raft_consensus.cc:359] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.895674 14533 raft_consensus.cc:385] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.895958 14533 raft_consensus.cc:740] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.895939 14532 consensus_queue.cc:260] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.896911 14533 consensus_queue.cc:260] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.897612 14531 ts_tablet_manager.cc:1434] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:17:50.898631 14532 ts_tablet_manager.cc:1434] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 12:17:50.898671 14531 tablet_bootstrap.cc:492] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0: Bootstrap starting.
I20260709 12:17:50.899317 14533 ts_tablet_manager.cc:1434] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 12:17:50.899843 14532 tablet_bootstrap.cc:492] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:50.900318 14533 tablet_bootstrap.cc:492] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007: Bootstrap starting.
I20260709 12:17:50.906041 14531 tablet_bootstrap.cc:654] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.906081 14532 tablet_bootstrap.cc:654] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.907152 14533 tablet_bootstrap.cc:654] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.916595 14537 raft_consensus.cc:493] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.917171 14537 raft_consensus.cc:515] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.918051 14531 tablet_bootstrap.cc:492] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0: No bootstrap required, opened a new log
I20260709 12:17:50.918622 14531 ts_tablet_manager.cc:1403] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:17:50.919231 14533 tablet_bootstrap.cc:492] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007: No bootstrap required, opened a new log
I20260709 12:17:50.919413 14537 leader_election.cc:290] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:50.920903 14533 ts_tablet_manager.cc:1403] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:17:50.921182 14417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b8e8720ec44504ab88a0a116325d9e" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:50.921643 14531 raft_consensus.cc:359] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.922477 14531 raft_consensus.cc:385] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.922745 14531 raft_consensus.cc:740] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Initialized, Role: FOLLOWER
W20260709 12:17:50.922811 14306 leader_election.cc:343] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.923588 14536 raft_consensus.cc:493] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.923758 14533 raft_consensus.cc:359] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.924052 14536 raft_consensus.cc:515] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.924518 14533 raft_consensus.cc:385] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.924896 14532 tablet_bootstrap.cc:492] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: No bootstrap required, opened a new log
I20260709 12:17:50.924863 14533 raft_consensus.cc:740] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.925453 14532 ts_tablet_manager.cc:1403] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.007s
I20260709 12:17:50.925715 14533 consensus_queue.cc:260] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.926769 14536 leader_election.cc:290] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:50.927485 14531 consensus_queue.cc:260] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.928323 14533 ts_tablet_manager.cc:1434] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:17:50.929500 14533 tablet_bootstrap.cc:492] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007: Bootstrap starting.
I20260709 12:17:50.930761 14531 ts_tablet_manager.cc:1434] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:50.921557 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b8e8720ec44504ab88a0a116325d9e" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:50.931880 14531 tablet_bootstrap.cc:492] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0: Bootstrap starting.
I20260709 12:17:50.934918 14532 raft_consensus.cc:359] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
W20260709 12:17:50.935349 14306 leader_election.cc:343] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3de321a572024870b2e77cca814df007 (127.4.78.67:33019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.935686 14532 raft_consensus.cc:385] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.936046 14532 raft_consensus.cc:740] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.936239 14533 tablet_bootstrap.cc:654] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.936981 14306 leader_election.cc:304] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57020114ade14e34a03fc02b9c884bbd; no voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007
I20260709 12:17:50.938637 14531 tablet_bootstrap.cc:654] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.940337 14532 consensus_queue.cc:260] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.944779 14563 raft_consensus.cc:2749] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:50.947088 14532 ts_tablet_manager.cc:1434] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 12:17:50.948312 14532 tablet_bootstrap.cc:492] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:50.959056 14533 tablet_bootstrap.cc:492] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007: No bootstrap required, opened a new log
I20260709 12:17:50.959640 14533 ts_tablet_manager.cc:1403] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.008s
I20260709 12:17:50.962555 14533 raft_consensus.cc:359] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.963272 14533 raft_consensus.cc:385] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.963542 14533 raft_consensus.cc:740] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.964370 14533 consensus_queue.cc:260] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.965905 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00ac41e1f5948a7bee8ca041288ede9" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:50.966691 14491 raft_consensus.cc:2468] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 0.
I20260709 12:17:50.966903 14533 ts_tablet_manager.cc:1434] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:17:50.968070 14533 tablet_bootstrap.cc:492] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007: Bootstrap starting.
I20260709 12:17:50.968484 14381 leader_election.cc:304] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 
I20260709 12:17:50.969517 14536 raft_consensus.cc:2804] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:50.969901 14536 raft_consensus.cc:493] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.970237 14536 raft_consensus.cc:3060] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:50.972047 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:50.978031 14532 tablet_bootstrap.cc:654] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.978636 14536 raft_consensus.cc:515] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.976491 14533 tablet_bootstrap.cc:654] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.982867 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00ac41e1f5948a7bee8ca041288ede9" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:50.983489 14491 raft_consensus.cc:3060] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.988194 14536 leader_election.cc:290] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:50.993011 14342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00ac41e1f5948a7bee8ca041288ede9" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd" is_pre_election: true
I20260709 12:17:50.992918 14341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00ac41e1f5948a7bee8ca041288ede9" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
W20260709 12:17:50.995069 14383 leader_election.cc:343] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.995311 14532 tablet_bootstrap.cc:492] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd: No bootstrap required, opened a new log
I20260709 12:17:50.995831 14532 ts_tablet_manager.cc:1403] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.002s
I20260709 12:17:50.995831 14531 tablet_bootstrap.cc:492] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0: No bootstrap required, opened a new log
W20260709 12:17:50.996094 14383 leader_election.cc:343] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.999082 14491 raft_consensus.cc:2468] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 1.
I20260709 12:17:51.000474 14531 ts_tablet_manager.cc:1403] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.036s
I20260709 12:17:50.998863 14532 raft_consensus.cc:359] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.000762 14536 raft_consensus.cc:493] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.000882 14532 raft_consensus.cc:385] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.001446 14532 raft_consensus.cc:740] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.001374 14536 raft_consensus.cc:515] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } }
I20260709 12:17:51.003479 14531 raft_consensus.cc:359] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.004243 14531 raft_consensus.cc:385] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.004531 14531 raft_consensus.cc:740] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.004907 14536 leader_election.cc:290] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3de321a572024870b2e77cca814df007 (127.4.78.67:33019), 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783)
I20260709 12:17:51.005441 14536 raft_consensus.cc:493] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.002619 14381 leader_election.cc:304] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 57020114ade14e34a03fc02b9c884bbd
I20260709 12:17:51.005200 14531 consensus_queue.cc:260] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:50.999969 14533 tablet_bootstrap.cc:492] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007: No bootstrap required, opened a new log
I20260709 12:17:51.006964 14566 raft_consensus.cc:2804] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.003976 14532 consensus_queue.cc:260] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.007011 14533 ts_tablet_manager.cc:1403] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.007s
I20260709 12:17:51.007483 14536 raft_consensus.cc:515] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.011680 14533 raft_consensus.cc:359] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.013036 14490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1478173e5634b808e376dffb51b9517" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:51.013917 14533 raft_consensus.cc:385] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.014118 14490 raft_consensus.cc:2468] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 0.
I20260709 12:17:51.014366 14533 raft_consensus.cc:740] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.015421 14533 consensus_queue.cc:260] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.015748 14381 leader_election.cc:304] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 
I20260709 12:17:51.017127 14341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1515e01a4a4cd5a519eb207e92b92d" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd" is_pre_election: true
I20260709 12:17:51.017895 14341 raft_consensus.cc:2468] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 0.
I20260709 12:17:51.020095 14341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1478173e5634b808e376dffb51b9517" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd" is_pre_election: true
I20260709 12:17:51.020784 14341 raft_consensus.cc:2468] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 0.
I20260709 12:17:51.013355 14532 ts_tablet_manager.cc:1434] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:17:51.022889 14532 tablet_bootstrap.cc:492] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:51.024490 14533 ts_tablet_manager.cc:1434] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:17:51.026726 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1515e01a4a4cd5a519eb207e92b92d" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:51.027376 14491 raft_consensus.cc:2468] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 0.
I20260709 12:17:51.028163 14533 tablet_bootstrap.cc:492] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007: Bootstrap starting.
I20260709 12:17:51.028304 14536 leader_election.cc:290] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.026175 14383 leader_election.cc:304] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.032253 14536 raft_consensus.cc:2804] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.032541 14532 tablet_bootstrap.cc:654] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.032778 14536 raft_consensus.cc:493] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.033303 14536 raft_consensus.cc:3060] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.036155 14567 raft_consensus.cc:2804] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.036602 14567 raft_consensus.cc:493] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.037026 14531 ts_tablet_manager.cc:1434] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0: Time spent starting tablet: real 0.036s	user 0.012s	sys 0.024s
I20260709 12:17:51.036968 14567 raft_consensus.cc:3060] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.038164 14531 tablet_bootstrap.cc:492] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0: Bootstrap starting.
I20260709 12:17:51.044397 14531 tablet_bootstrap.cc:654] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.047264 14567 raft_consensus.cc:515] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } }
I20260709 12:17:51.049479 14567 leader_election.cc:290] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Requested vote from peers 3de321a572024870b2e77cca814df007 (127.4.78.67:33019), 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783)
I20260709 12:17:51.050385 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1515e01a4a4cd5a519eb207e92b92d" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:51.052487 14491 raft_consensus.cc:3060] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.050575 14341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1515e01a4a4cd5a519eb207e92b92d" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:51.054068 14341 raft_consensus.cc:3060] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.054929 14536 raft_consensus.cc:515] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.058183 14342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1478173e5634b808e376dffb51b9517" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:51.058825 14342 raft_consensus.cc:3060] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.059022 14491 raft_consensus.cc:2468] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 1.
I20260709 12:17:51.059388 14532 tablet_bootstrap.cc:492] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd: No bootstrap required, opened a new log
I20260709 12:17:51.059852 14532 ts_tablet_manager.cc:1403] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.007s
I20260709 12:17:51.051240 14566 raft_consensus.cc:697] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:51.061897 14532 raft_consensus.cc:359] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.062556 14532 raft_consensus.cc:385] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.062902 14532 raft_consensus.cc:740] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.062462 14536 leader_election.cc:290] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.063552 14532 consensus_queue.cc:260] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.062500 14566 consensus_queue.cc:237] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.066208 14381 leader_election.cc:304] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 
I20260709 12:17:51.068918 14532 ts_tablet_manager.cc:1434] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:17:51.069294 14341 raft_consensus.cc:2468] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 1.
I20260709 12:17:51.054157 14533 tablet_bootstrap.cc:654] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.071499 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1478173e5634b808e376dffb51b9517" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:51.072016 14491 raft_consensus.cc:3060] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.070999 14532 tablet_bootstrap.cc:492] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:51.074141 14563 raft_consensus.cc:493] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.074644 14563 raft_consensus.cc:515] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.076782 14563 leader_election.cc:290] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.078689 14342 raft_consensus.cc:2468] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 1.
I20260709 12:17:51.079202 14417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00ac41e1f5948a7bee8ca041288ede9" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:51.073661 14567 raft_consensus.cc:2804] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.079998 14383 leader_election.cc:304] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.080175 14567 raft_consensus.cc:697] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:51.080545 14490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00ac41e1f5948a7bee8ca041288ede9" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:51.079548 14532 tablet_bootstrap.cc:654] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.081043 14536 raft_consensus.cc:2804] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.081089 14567 consensus_queue.cc:237] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } }
I20260709 12:17:51.082679 14536 raft_consensus.cc:697] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:51.081899 14490 raft_consensus.cc:2393] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57020114ade14e34a03fc02b9c884bbd in current term 1: Already voted for candidate 09fc724994854a6ea5feb9376b8bd4b0 in this term.
I20260709 12:17:51.083535 14536 consensus_queue.cc:237] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.087858 14306 leader_election.cc:304] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57020114ade14e34a03fc02b9c884bbd; no voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007
I20260709 12:17:51.088992 14563 raft_consensus.cc:3060] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.089277 14491 raft_consensus.cc:2468] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 1.
I20260709 12:17:51.089516 14533 tablet_bootstrap.cc:492] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007: No bootstrap required, opened a new log
I20260709 12:17:51.090144 14533 ts_tablet_manager.cc:1403] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.004s
I20260709 12:17:51.093129 14533 raft_consensus.cc:359] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.094542 14563 raft_consensus.cc:2749] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.095258 14533 raft_consensus.cc:385] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.095582 14533 raft_consensus.cc:740] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.100914 14531 tablet_bootstrap.cc:492] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0: No bootstrap required, opened a new log
I20260709 12:17:51.101649 14531 ts_tablet_manager.cc:1403] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.019s
I20260709 12:17:51.102434 14541 raft_consensus.cc:493] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.102998 14541 raft_consensus.cc:515] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.103653 14240 catalog_manager.cc:5697] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.104784 14531 raft_consensus.cc:359] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.105621 14531 raft_consensus.cc:385] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.105993 14531 raft_consensus.cc:740] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.106653 14533 consensus_queue.cc:260] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.110163 14541 leader_election.cc:290] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:51.115120 14531 consensus_queue.cc:260] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.134837 14531 ts_tablet_manager.cc:1434] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:17:51.135823 14531 tablet_bootstrap.cc:492] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0: Bootstrap starting.
I20260709 12:17:51.143203 14531 tablet_bootstrap.cc:654] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.149471 14563 raft_consensus.cc:493] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.150162 14563 raft_consensus.cc:515] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.152309 14563 leader_election.cc:290] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.154876 14417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:51.155663 14417 raft_consensus.cc:2468] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57020114ade14e34a03fc02b9c884bbd in term 0.
I20260709 12:17:51.156772 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:51.157476 14491 raft_consensus.cc:2468] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57020114ade14e34a03fc02b9c884bbd in term 0.
I20260709 12:17:51.159483 14306 leader_election.cc:304] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.164354 14563 raft_consensus.cc:2804] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.164809 14563 raft_consensus.cc:493] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.165179 14563 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.174199 14341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd" is_pre_election: true
I20260709 12:17:51.176004 14580 raft_consensus.cc:493] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.176849 14417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:51.177564 14533 ts_tablet_manager.cc:1434] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.007s
I20260709 12:17:51.176558 14580 raft_consensus.cc:515] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.178072 14417 raft_consensus.cc:2468] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 0.
I20260709 12:17:51.178813 14533 tablet_bootstrap.cc:492] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007: Bootstrap starting.
I20260709 12:17:51.180557 14537 raft_consensus.cc:493] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.180711 14342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b8e8720ec44504ab88a0a116325d9e" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd" is_pre_election: true
I20260709 12:17:51.176275 14563 raft_consensus.cc:515] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.181609 14532 tablet_bootstrap.cc:492] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd: No bootstrap required, opened a new log
I20260709 12:17:51.182860 14580 leader_election.cc:290] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:51.181114 14537 raft_consensus.cc:515] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.184954 14532 ts_tablet_manager.cc:1403] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.114s	user 0.042s	sys 0.040s
I20260709 12:17:51.181445 14342 raft_consensus.cc:2468] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 0.
I20260709 12:17:51.186800 14457 leader_election.cc:304] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3de321a572024870b2e77cca814df007, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.187342 14537 leader_election.cc:290] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.187397 14533 tablet_bootstrap.cc:654] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.187800 14455 leader_election.cc:304] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 
I20260709 12:17:51.189612 14541 raft_consensus.cc:2804] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.190086 14541 raft_consensus.cc:493] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.187796 14580 raft_consensus.cc:2804] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.190759 14417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b8e8720ec44504ab88a0a116325d9e" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:51.191447 14417 raft_consensus.cc:2468] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 0.
I20260709 12:17:51.191605 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d992b49e1f4ce09e047515dc8fe865" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:51.192256 14416 raft_consensus.cc:2468] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57020114ade14e34a03fc02b9c884bbd in term 0.
I20260709 12:17:51.192963 14531 tablet_bootstrap.cc:492] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0: No bootstrap required, opened a new log
I20260709 12:17:51.190805 14580 raft_consensus.cc:493] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.193521 14531 ts_tablet_manager.cc:1403] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.001s
I20260709 12:17:51.193794 14306 leader_election.cc:304] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.194252 14580 raft_consensus.cc:3060] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.194417 14490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:51.194734 14537 raft_consensus.cc:2804] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.193235 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d992b49e1f4ce09e047515dc8fe865" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:51.195258 14537 raft_consensus.cc:493] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.195497 14491 raft_consensus.cc:2468] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57020114ade14e34a03fc02b9c884bbd in term 0.
I20260709 12:17:51.196018 14563 leader_election.cc:290] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 election: Requested vote from peers 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.189663 14341 raft_consensus.cc:2393] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3de321a572024870b2e77cca814df007 in current term 1: Already voted for candidate 57020114ade14e34a03fc02b9c884bbd in this term.
I20260709 12:17:51.197046 14531 raft_consensus.cc:359] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.190423 14541 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.197831 14531 raft_consensus.cc:385] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.198160 14531 raft_consensus.cc:740] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.198433 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:51.199015 14532 raft_consensus.cc:359] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.198936 14531 consensus_queue.cc:260] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.199788 14532 raft_consensus.cc:385] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.200130 14532 raft_consensus.cc:740] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.200799 14532 consensus_queue.cc:260] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.199062 14416 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.201560 14531 ts_tablet_manager.cc:1434] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:17:51.205296 14580 raft_consensus.cc:515] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.195688 14537 raft_consensus.cc:3060] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.206794 14563 raft_consensus.cc:493] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.207726 14563 raft_consensus.cc:515] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.209860 14563 leader_election.cc:290] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.207778 14536 raft_consensus.cc:493] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.211148 14536 raft_consensus.cc:515] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.212663 14416 raft_consensus.cc:2468] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57020114ade14e34a03fc02b9c884bbd in term 1.
I20260709 12:17:51.213245 14536 leader_election.cc:290] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.214327 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39436b3712f14a5791306727e430875f" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
W20260709 12:17:51.215734 14381 leader_election.cc:343] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3de321a572024870b2e77cca814df007 (127.4.78.67:33019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.216544 14341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39436b3712f14a5791306727e430875f" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd" is_pre_election: true
I20260709 12:17:51.217219 14341 raft_consensus.cc:2468] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 0.
I20260709 12:17:51.218315 14383 leader_election.cc:304] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 3de321a572024870b2e77cca814df007
I20260709 12:17:51.218961 14537 raft_consensus.cc:515] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.219408 14536 raft_consensus.cc:2804] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.219847 14536 raft_consensus.cc:493] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.220165 14536 raft_consensus.cc:3060] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.220991 14537 leader_election.cc:290] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 election: Requested vote from peers 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.220875 14342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b8e8720ec44504ab88a0a116325d9e" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:51.221622 14342 raft_consensus.cc:3060] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.223100 14417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b8e8720ec44504ab88a0a116325d9e" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:51.223680 14417 raft_consensus.cc:3060] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.221935 14238 catalog_manager.cc:5697] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.227088 14238 catalog_manager.cc:5697] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.228430 14342 raft_consensus.cc:2468] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 1.
I20260709 12:17:51.228763 14566 raft_consensus.cc:493] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.229216 14566 raft_consensus.cc:515] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.229666 14457 leader_election.cc:304] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3de321a572024870b2e77cca814df007, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.230636 14536 raft_consensus.cc:515] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.230940 14417 raft_consensus.cc:2468] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 1.
I20260709 12:17:51.231343 14566 leader_election.cc:290] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.231511 14580 leader_election.cc:290] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:51.232534 14580 raft_consensus.cc:2804] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.233026 14580 raft_consensus.cc:697] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 1 LEADER]: Becoming Leader. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:17:51.233913 14580 consensus_queue.cc:237] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.237906 14489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39436b3712f14a5791306727e430875f" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007"
W20260709 12:17:51.239640 14381 leader_election.cc:343] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3de321a572024870b2e77cca814df007 (127.4.78.67:33019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.240865 14342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd" is_pre_election: true
I20260709 12:17:51.241534 14342 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 0.
I20260709 12:17:51.241889 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:51.242188 14341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39436b3712f14a5791306727e430875f" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:51.243264 14491 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 0.
I20260709 12:17:51.244284 14417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d992b49e1f4ce09e047515dc8fe865" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:51.244899 14417 raft_consensus.cc:3060] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.242875 14383 leader_election.cc:304] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.248582 14566 raft_consensus.cc:2804] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.249006 14566 raft_consensus.cc:493] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.249353 14566 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.242807 14341 raft_consensus.cc:3060] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.251145 14417 raft_consensus.cc:2468] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57020114ade14e34a03fc02b9c884bbd in term 1.
I20260709 12:17:51.253536 14541 raft_consensus.cc:515] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.254530 14306 leader_election.cc:304] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.254894 14490 raft_consensus.cc:2393] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 57020114ade14e34a03fc02b9c884bbd in current term 1: Already voted for candidate 3de321a572024870b2e77cca814df007 in this term.
I20260709 12:17:51.255442 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e326c257307c4eeba83c7bbe1d14274b" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:51.256134 14416 raft_consensus.cc:2468] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57020114ade14e34a03fc02b9c884bbd in term 0.
I20260709 12:17:51.256243 14341 raft_consensus.cc:2468] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 1.
I20260709 12:17:51.257323 14533 tablet_bootstrap.cc:492] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007: No bootstrap required, opened a new log
I20260709 12:17:51.257470 14383 leader_election.cc:304] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 3de321a572024870b2e77cca814df007
I20260709 12:17:51.258380 14306 leader_election.cc:304] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.258666 14567 raft_consensus.cc:2804] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.259152 14567 raft_consensus.cc:697] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:51.259202 14537 raft_consensus.cc:2804] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.259742 14537 raft_consensus.cc:697] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 1 LEADER]: Becoming Leader. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Running, Role: LEADER
I20260709 12:17:51.260058 14567 consensus_queue.cc:237] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.260530 14537 consensus_queue.cc:237] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.262140 14563 raft_consensus.cc:2804] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.263065 14580 raft_consensus.cc:493] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.263535 14580 raft_consensus.cc:515] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.265502 14536 leader_election.cc:290] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.265640 14580 leader_election.cc:290] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:51.266556 14306 leader_election.cc:304] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.258251 14532 ts_tablet_manager.cc:1434] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 12:17:51.269852 14584 raft_consensus.cc:2804] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.271080 14584 raft_consensus.cc:493] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.271435 14584 raft_consensus.cc:3060] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.271919 14541 leader_election.cc:290] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:51.275025 14417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:51.275913 14417 raft_consensus.cc:2393] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3de321a572024870b2e77cca814df007 in current term 1: Already voted for candidate 57020114ade14e34a03fc02b9c884bbd in this term.
I20260709 12:17:51.276500 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:51.277205 14416 raft_consensus.cc:2468] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 0.
I20260709 12:17:51.278584 14455 leader_election.cc:304] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 
I20260709 12:17:51.280313 14566 raft_consensus.cc:515] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.267544 14533 ts_tablet_manager.cc:1403] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.001s
I20260709 12:17:51.282918 14541 raft_consensus.cc:2804] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.283370 14541 raft_consensus.cc:493] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.283481 14341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:51.283763 14541 raft_consensus.cc:3060] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.284133 14341 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.287351 14533 raft_consensus.cc:359] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.294755 14541 raft_consensus.cc:515] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.289089 14566 leader_election.cc:290] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.295521 14533 raft_consensus.cc:385] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.290776 14584 raft_consensus.cc:515] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.291205 14341 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 1.
W20260709 12:17:51.291978 14457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.65:32783, user_credentials={real_user=slave}} blocked reactor thread for 62398.6us
I20260709 12:17:51.297016 14383 leader_election.cc:304] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.298033 14585 raft_consensus.cc:493] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.295012 14563 raft_consensus.cc:697] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 1 LEADER]: Becoming Leader. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Running, Role: LEADER
I20260709 12:17:51.298540 14585 raft_consensus.cc:515] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.298940 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e326c257307c4eeba83c7bbe1d14274b" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:51.299083 14563 consensus_queue.cc:237] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.288290 14490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:51.299587 14491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e326c257307c4eeba83c7bbe1d14274b" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:51.299582 14416 raft_consensus.cc:3060] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.300374 14490 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.301539 14342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd" is_pre_election: true
I20260709 12:17:51.299942 14489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d992b49e1f4ce09e047515dc8fe865" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:51.302233 14342 raft_consensus.cc:2468] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 0.
I20260709 12:17:51.295871 14533 raft_consensus.cc:740] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.302574 14489 raft_consensus.cc:3060] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.303310 14533 consensus_queue.cc:260] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.303788 14566 raft_consensus.cc:2804] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.304546 14340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:51.300043 14240 catalog_manager.cc:5697] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3de321a572024870b2e77cca814df007 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "3de321a572024870b2e77cca814df007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.306109 14533 ts_tablet_manager.cc:1434] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:17:51.308640 14457 leader_election.cc:304] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3de321a572024870b2e77cca814df007; no voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd
I20260709 12:17:51.309568 14580 raft_consensus.cc:2749] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.311306 14416 raft_consensus.cc:2468] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57020114ade14e34a03fc02b9c884bbd in term 1.
I20260709 12:17:51.304554 14566 raft_consensus.cc:697] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:51.312544 14306 leader_election.cc:304] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:51.312876 14566 consensus_queue.cc:237] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.313547 14588 raft_consensus.cc:2804] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.314071 14588 raft_consensus.cc:697] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 1 LEADER]: Becoming Leader. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Running, Role: LEADER
I20260709 12:17:51.314888 14588 consensus_queue.cc:237] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.315807 14488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e326c257307c4eeba83c7bbe1d14274b" candidate_uuid: "57020114ade14e34a03fc02b9c884bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:51.318176 14491 raft_consensus.cc:2468] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57020114ade14e34a03fc02b9c884bbd in term 0.
I20260709 12:17:51.318264 14584 leader_election.cc:290] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [CANDIDATE]: Term 1 election: Requested vote from peers 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:51.319974 14585 leader_election.cc:290] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:51.320861 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e326c257307c4eeba83c7bbe1d14274b" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:51.321871 14416 raft_consensus.cc:2393] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3de321a572024870b2e77cca814df007 in current term 1: Already voted for candidate 57020114ade14e34a03fc02b9c884bbd in this term.
I20260709 12:17:51.328672 14490 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 1.
I20260709 12:17:51.317147 14238 catalog_manager.cc:5697] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.335042 14341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e326c257307c4eeba83c7bbe1d14274b" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd" is_pre_election: true
I20260709 12:17:51.335708 14489 raft_consensus.cc:2468] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57020114ade14e34a03fc02b9c884bbd in term 1.
I20260709 12:17:51.339571 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:51.340165 14416 raft_consensus.cc:3060] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.342306 14341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:51.342967 14341 raft_consensus.cc:3060] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.345857 14541 leader_election.cc:290] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:51.347982 14416 raft_consensus.cc:2468] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 1.
I20260709 12:17:51.349232 14457 leader_election.cc:304] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3de321a572024870b2e77cca814df007; no voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd
I20260709 12:17:51.350222 14541 raft_consensus.cc:3060] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.349475 14237 catalog_manager.cc:5697] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.353830 14455 leader_election.cc:304] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 
I20260709 12:17:51.354920 14585 raft_consensus.cc:2804] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.356114 14585 raft_consensus.cc:697] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 1 LEADER]: Becoming Leader. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:17:51.356813 14585 consensus_queue.cc:237] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.357267 14541 raft_consensus.cc:2749] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.358003 14341 raft_consensus.cc:2468] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 1.
I20260709 12:17:51.360793 14240 catalog_manager.cc:5697] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 57020114ade14e34a03fc02b9c884bbd (127.4.78.65). New cstate: current_term: 1 leader_uuid: "57020114ade14e34a03fc02b9c884bbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.362308 14240 catalog_manager.cc:5697] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 57020114ade14e34a03fc02b9c884bbd (127.4.78.65). New cstate: current_term: 1 leader_uuid: "57020114ade14e34a03fc02b9c884bbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.368368 14237 catalog_manager.cc:5697] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3de321a572024870b2e77cca814df007 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "3de321a572024870b2e77cca814df007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.376485 14240 catalog_manager.cc:5697] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 57020114ade14e34a03fc02b9c884bbd (127.4.78.65). New cstate: current_term: 1 leader_uuid: "57020114ade14e34a03fc02b9c884bbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.544260  4409 ts_manager.cc:295] Set tserver state for 57020114ade14e34a03fc02b9c884bbd to MAINTENANCE_MODE
I20260709 12:17:51.545006  4409 tablet_server.cc:179] TabletServer@127.4.78.65:0 shutting down...
I20260709 12:17:51.551309 14566 consensus_queue.cc:1048] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:51.568771 14383 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 387 similar messages]
I20260709 12:17:51.574429  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:51.576545  4409 tablet_replica.cc:333] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: stopping tablet replica
W20260709 12:17:51.576870 14383 consensus_peers.cc:597] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:51.577514  4409 raft_consensus.cc:2243] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.578394  4409 pending_rounds.cc:70] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Trying to abort 1 pending ops.
I20260709 12:17:51.578641  4409 pending_rounds.cc:77] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305623434517020672 op_type: NO_OP noop_request { }
I20260709 12:17:51.579030  4409 raft_consensus.cc:2889] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:17:51.579358  4409 raft_consensus.cc:2272] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:51.579445 14383 consensus_peers.cc:597] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:51.581564  4409 tablet_replica.cc:333] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd: stopping tablet replica
I20260709 12:17:51.582162  4409 raft_consensus.cc:2243] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.582496  4409 raft_consensus.cc:2272] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.584255  4409 tablet_replica.cc:333] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd: stopping tablet replica
I20260709 12:17:51.584738  4409 raft_consensus.cc:2243] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.585072  4409 raft_consensus.cc:2272] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.586704  4409 tablet_replica.cc:333] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd: stopping tablet replica
I20260709 12:17:51.587185  4409 raft_consensus.cc:2243] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.587488  4409 raft_consensus.cc:2272] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.589272  4409 tablet_replica.cc:333] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: stopping tablet replica
I20260709 12:17:51.589742  4409 raft_consensus.cc:2243] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.590309  4409 pending_rounds.cc:70] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Trying to abort 1 pending ops.
I20260709 12:17:51.590456  4409 pending_rounds.cc:77] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305623434451902464 op_type: NO_OP noop_request { }
I20260709 12:17:51.590667  4409 raft_consensus.cc:2889] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:17:51.590883  4409 raft_consensus.cc:2272] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.592986  4409 tablet_replica.cc:333] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd: stopping tablet replica
I20260709 12:17:51.593690  4409 raft_consensus.cc:2243] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.594115  4409 raft_consensus.cc:2272] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.596019  4409 tablet_replica.cc:333] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd: stopping tablet replica
I20260709 12:17:51.596535  4409 raft_consensus.cc:2243] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.596920  4409 raft_consensus.cc:2272] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.598702  4409 tablet_replica.cc:333] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd: stopping tablet replica
I20260709 12:17:51.599198  4409 raft_consensus.cc:2243] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.599557  4409 raft_consensus.cc:2272] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.601205  4409 tablet_replica.cc:333] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: stopping tablet replica
I20260709 12:17:51.601645  4409 raft_consensus.cc:2243] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.602370  4409 pending_rounds.cc:70] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Trying to abort 1 pending ops.
I20260709 12:17:51.602540  4409 pending_rounds.cc:77] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305623434294419456 op_type: NO_OP noop_request { }
I20260709 12:17:51.602813  4409 raft_consensus.cc:2889] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:17:51.603050  4409 raft_consensus.cc:2272] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.605014  4409 tablet_replica.cc:333] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd: stopping tablet replica
I20260709 12:17:51.605477  4409 raft_consensus.cc:2243] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.605858  4409 raft_consensus.cc:2272] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.607617 14566 consensus_queue.cc:1048] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:51.629364 14585 consensus_queue.cc:1048] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:51.629444 14567 consensus_queue.cc:1048] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:51.636072  4409 tablet_server.cc:196] TabletServer@127.4.78.65:0 shutdown complete.
W20260709 12:17:51.645903 14383 consensus_peers.cc:597] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:51.659221 14457 consensus_peers.cc:597] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:51.659512 14541 raft_consensus.cc:493] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.660059 14541 raft_consensus.cc:515] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:51.664057 14541 leader_election.cc:290] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
W20260709 12:17:51.666028 14457 leader_election.cc:336] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111)
I20260709 12:17:51.666114 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39436b3712f14a5791306727e430875f" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:51.667505 14455 leader_election.cc:304] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3de321a572024870b2e77cca814df007; no voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd
I20260709 12:17:51.668094 14541 raft_consensus.cc:2749] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:51.734097 14383 consensus_peers.cc:597] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:51.759859 14541 consensus_queue.cc:1048] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:51.762458 14489 raft_consensus.cc:3060] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.771113 14536 consensus_queue.cc:1048] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:51.771420 14566 consensus_queue.cc:1048] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:51.775599 14457 consensus_peers.cc:597] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:51.792093 14383 consensus_peers.cc:597] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:51.973078 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:52.841109 14541 raft_consensus.cc:493] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.841624 14541 raft_consensus.cc:515] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:52.843405 14541 leader_election.cc:290] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:52.844508 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0" is_pre_election: true
I20260709 12:17:52.845217 14416 raft_consensus.cc:2468] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 1.
I20260709 12:17:52.846360 14455 leader_election.cc:304] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 
W20260709 12:17:52.846968 14457 leader_election.cc:336] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111)
I20260709 12:17:52.847025 14541 raft_consensus.cc:2804] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:52.847463 14541 raft_consensus.cc:493] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.847723 14541 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.853140 14541 raft_consensus.cc:515] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:52.854800 14541 leader_election.cc:290] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:52.855885 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:52.856508 14416 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:52.861066 14457 leader_election.cc:336] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111)
I20260709 12:17:52.862308 14416 raft_consensus.cc:2468] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 2.
I20260709 12:17:52.863257 14455 leader_election.cc:304] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 57020114ade14e34a03fc02b9c884bbd
I20260709 12:17:52.863885 14541 raft_consensus.cc:2804] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:52.864684 14541 raft_consensus.cc:697] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Becoming Leader. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:17:52.865490 14541 consensus_queue.cc:237] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:52.872597 14237 catalog_manager.cc:5697] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 reported cstate change: term changed from 1 to 2, leader changed from 57020114ade14e34a03fc02b9c884bbd (127.4.78.65) to 3de321a572024870b2e77cca814df007 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "3de321a572024870b2e77cca814df007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:52.974097 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:53.060374 14566 raft_consensus.cc:493] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.060871 14566 raft_consensus.cc:515] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:53.062757 14566 leader_election.cc:290] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:53.063969 14489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e326c257307c4eeba83c7bbe1d14274b" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:53.064621 14489 raft_consensus.cc:2468] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 1.
I20260709 12:17:53.065714 14381 leader_election.cc:304] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 
W20260709 12:17:53.066216 14383 leader_election.cc:336] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111)
I20260709 12:17:53.066438 14566 raft_consensus.cc:2804] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:53.066898 14566 raft_consensus.cc:493] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.067173 14566 raft_consensus.cc:3060] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.072153 14566 raft_consensus.cc:515] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:53.073782 14566 leader_election.cc:290] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:53.074885 14489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e326c257307c4eeba83c7bbe1d14274b" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:53.075423 14489 raft_consensus.cc:3060] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:53.076887 14383 leader_election.cc:336] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111)
I20260709 12:17:53.081518 14489 raft_consensus.cc:2468] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 2.
I20260709 12:17:53.082597 14381 leader_election.cc:304] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 57020114ade14e34a03fc02b9c884bbd
I20260709 12:17:53.083187 14566 raft_consensus.cc:2804] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:53.083563 14566 raft_consensus.cc:697] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:53.084184 14566 consensus_queue.cc:237] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:53.085606 14613 raft_consensus.cc:493] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.086179 14613 raft_consensus.cc:515] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:53.088485 14613 leader_election.cc:290] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:53.090246 14489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d992b49e1f4ce09e047515dc8fe865" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007" is_pre_election: true
I20260709 12:17:53.090977 14489 raft_consensus.cc:2468] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 1.
I20260709 12:17:53.092195 14381 leader_election.cc:304] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 
W20260709 12:17:53.092648 14383 leader_election.cc:336] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111)
I20260709 12:17:53.092877 14613 raft_consensus.cc:2804] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:53.093319 14613 raft_consensus.cc:493] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.093739 14613 raft_consensus.cc:3060] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.093338 14237 catalog_manager.cc:5697] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 1 to 2, leader changed from 57020114ade14e34a03fc02b9c884bbd (127.4.78.65) to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.099792 14613 raft_consensus.cc:515] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:53.101477 14613 leader_election.cc:290] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:53.102464 14489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d992b49e1f4ce09e047515dc8fe865" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:53.102972 14489 raft_consensus.cc:3060] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:53.105136 14383 leader_election.cc:336] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111)
I20260709 12:17:53.107877 14489 raft_consensus.cc:2468] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 2.
I20260709 12:17:53.108848 14381 leader_election.cc:304] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 57020114ade14e34a03fc02b9c884bbd
I20260709 12:17:53.109474 14613 raft_consensus.cc:2804] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:53.109932 14613 raft_consensus.cc:697] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:53.110618 14613 consensus_queue.cc:237] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:53.117897 14237 catalog_manager.cc:5697] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 1 to 2, leader changed from 57020114ade14e34a03fc02b9c884bbd (127.4.78.65) to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.254859 14416 raft_consensus.cc:1275] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:53.255995 14541 consensus_queue.cc:1048] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:53.272076 14457 consensus_peers.cc:597] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:53.503484 14489 raft_consensus.cc:1275] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:53.504667 14613 consensus_queue.cc:1048] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:53.519194 14383 consensus_peers.cc:597] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:53.521615 14383 consensus_peers.cc:597] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:53.608314 14489 raft_consensus.cc:1275] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:53.609339 14620 consensus_queue.cc:1048] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:53.857482 14383 consensus_peers.cc:597] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:53.974967 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:17:54.033531 14383 consensus_peers.cc:597] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:54.102589 14457 consensus_peers.cc:597] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:54.115120 14383 consensus_peers.cc:597] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:54.124248 14383 consensus_peers.cc:597] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:54.221403 14383 consensus_peers.cc:597] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:54.402158 14457 consensus_peers.cc:597] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:54.975901 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:17:55.747221 14457 consensus_peers.cc:597] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.976854 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:17:56.039431 14383 consensus_peers.cc:597] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:56.055495 14383 consensus_peers.cc:597] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:56.123171 14383 consensus_peers.cc:597] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:56.425899 14383 consensus_peers.cc:597] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:56.518658 14383 consensus_peers.cc:597] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:56.586220 14383 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111) [suppressed 100 similar messages]
W20260709 12:17:56.643379 14383 consensus_peers.cc:597] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:56.649581 14457 consensus_peers.cc:597] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:56.664917  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:56.670644 14626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:56.671190 14627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:56.675194  4409 server_base.cc:1061] running on GCE node
W20260709 12:17:56.675585 14629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:56.676838  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:56.677040  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:56.677187  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599476677175 us; error 0 us; skew 500 ppm
I20260709 12:17:56.677646  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:56.679848  4409 webserver.cc:533] Webserver started at http://127.4.78.65:36933/ using document root <none> and password file <none>
I20260709 12:17:56.680267  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:56.680413  4409 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:17:56.683947  4409 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:17:56.687758 14634 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:56.688483  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:17:56.688777  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-0-root
uuid: "57020114ade14e34a03fc02b9c884bbd"
format_stamp: "Formatted at 2026-07-09 12:17:50 on dist-test-slave-9t7s"
I20260709 12:17:56.689057  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599105096696-4409-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:56.710970  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:56.712054  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:56.713589  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:56.716874 14641 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:17:56.761507  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:17:56.761906  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.046s	user 0.002s	sys 0.000s
I20260709 12:17:56.762142  4409 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:17:56.766345 14641 tablet_bootstrap.cc:492] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:56.776394 14641 tablet_bootstrap.cc:492] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:56.777051 14641 tablet_bootstrap.cc:492] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap complete.
I20260709 12:17:56.777580 14641 ts_tablet_manager.cc:1403] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:17:56.779497 14641 raft_consensus.cc:359] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.779982 14641 raft_consensus.cc:740] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.780606 14641 consensus_queue.cc:260] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.783910 14641 ts_tablet_manager.cc:1434] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
W20260709 12:17:56.785609 14383 consensus_peers.cc:597] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:56.785727 14641 tablet_bootstrap.cc:492] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:56.797739 14641 tablet_bootstrap.cc:492] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:56.798496 14641 tablet_bootstrap.cc:492] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap complete.
I20260709 12:17:56.799094 14641 ts_tablet_manager.cc:1403] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:17:56.801059 14641 raft_consensus.cc:359] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.801599 14641 raft_consensus.cc:740] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.801728  4409 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:17:56.802121  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.040s	user 0.036s	sys 0.004s
I20260709 12:17:56.802263 14641 consensus_queue.cc:260] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.804078 14641 ts_tablet_manager.cc:1434] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:17:56.804728 14641 tablet_bootstrap.cc:492] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:56.815701 14641 tablet_bootstrap.cc:492] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:56.816409 14641 tablet_bootstrap.cc:492] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd: Bootstrap complete.
I20260709 12:17:56.817082 14641 ts_tablet_manager.cc:1403] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:17:56.819332 14641 raft_consensus.cc:359] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } }
I20260709 12:17:56.819855 14641 raft_consensus.cc:740] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.820530 14641 consensus_queue.cc:260] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } }
I20260709 12:17:56.822866 14641 ts_tablet_manager.cc:1434] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:17:56.823863 14641 tablet_bootstrap.cc:492] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:56.834146 14641 tablet_bootstrap.cc:492] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:56.834782 14641 tablet_bootstrap.cc:492] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd: Bootstrap complete.
I20260709 12:17:56.835279 14641 ts_tablet_manager.cc:1403] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:17:56.836937 14641 raft_consensus.cc:359] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.837451 14641 raft_consensus.cc:740] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.838028 14641 consensus_queue.cc:260] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.839382 14641 ts_tablet_manager.cc:1434] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:17:56.839998 14641 tablet_bootstrap.cc:492] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:56.855515 14641 tablet_bootstrap.cc:492] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:17:56.856241 14641 tablet_bootstrap.cc:492] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap complete.
I20260709 12:17:56.856740 14641 ts_tablet_manager.cc:1403] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:17:56.858831 14641 raft_consensus.cc:359] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.859470 14641 raft_consensus.cc:740] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.860059 14641 consensus_queue.cc:260] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.861694 14641 ts_tablet_manager.cc:1434] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:17:56.862488 14641 tablet_bootstrap.cc:492] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:56.863731  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.65:32783
I20260709 12:17:56.863857 14703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.65:32783 every 8 connection(s)
I20260709 12:17:56.868330  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:56.881139 14641 tablet_bootstrap.cc:492] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:17:56.882270 14641 tablet_bootstrap.cc:492] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap complete.
I20260709 12:17:56.883064 14641 ts_tablet_manager.cc:1403] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:17:56.885848 14641 raft_consensus.cc:359] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.886775 14641 raft_consensus.cc:740] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.887550 14641 consensus_queue.cc:260] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.889623 14641 ts_tablet_manager.cc:1434] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:56.890553 14641 tablet_bootstrap.cc:492] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:56.900141 14704 heartbeater.cc:344] Connected to a master server at 127.4.78.126:40833
I20260709 12:17:56.900636 14704 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:56.901679 14704 heartbeater.cc:507] Master 127.4.78.126:40833 requested a full tablet report, sending...
I20260709 12:17:56.911208 14240 ts_manager.cc:194] Re-registered known tserver with Master: 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783)
I20260709 12:17:56.913954 14641 tablet_bootstrap.cc:492] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:17:56.914959 14641 tablet_bootstrap.cc:492] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Bootstrap complete.
I20260709 12:17:56.915468 14641 ts_tablet_manager.cc:1403] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 12:17:56.917337 14641 raft_consensus.cc:359] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.917929 14641 raft_consensus.cc:740] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.918459 14641 consensus_queue.cc:260] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.919770 14641 ts_tablet_manager.cc:1434] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:17:56.919821 14240 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43210
I20260709 12:17:56.920368 14641 tablet_bootstrap.cc:492] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:56.922370 14704 heartbeater.cc:499] Master 127.4.78.126:40833 was elected leader, sending a full tablet report...
I20260709 12:17:56.928925 14416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39436b3712f14a5791306727e430875f"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
mode: GRACEFUL
new_leader_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:37364
I20260709 12:17:56.929685 14416 raft_consensus.cc:606] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Received request to transfer leadership to TS 3de321a572024870b2e77cca814df007
I20260709 12:17:56.932879 14641 tablet_bootstrap.cc:492] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:56.933337 14416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b00ac41e1f5948a7bee8ca041288ede9"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
mode: GRACEFUL
new_leader_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:37364
I20260709 12:17:56.933725 14641 tablet_bootstrap.cc:492] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap complete.
I20260709 12:17:56.933990 14416 raft_consensus.cc:606] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Received request to transfer leadership to TS 3de321a572024870b2e77cca814df007
I20260709 12:17:56.934458 14641 ts_tablet_manager.cc:1403] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:17:56.936647 14416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
mode: GRACEFUL
new_leader_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:37364
I20260709 12:17:56.936818 14641 raft_consensus.cc:359] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.937264 14416 raft_consensus.cc:606] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Received request to transfer leadership to TS 3de321a572024870b2e77cca814df007
I20260709 12:17:56.937493 14641 raft_consensus.cc:740] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.938465  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:56.938215 14641 consensus_queue.cc:260] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.939002  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:56.939635  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:56.940052 14641 ts_tablet_manager.cc:1434] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:17:56.940860 14641 tablet_bootstrap.cc:492] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:56.952216 14641 tablet_bootstrap.cc:492] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:56.952916 14641 tablet_bootstrap.cc:492] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd: Bootstrap complete.
I20260709 12:17:56.953459 14641 ts_tablet_manager.cc:1403] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 12:17:56.955577 14641 raft_consensus.cc:359] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.956133 14641 raft_consensus.cc:740] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.956748 14641 consensus_queue.cc:260] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.958988 14641 ts_tablet_manager.cc:1434] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:17:56.959853 14641 tablet_bootstrap.cc:492] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap starting.
I20260709 12:17:56.970278 14641 tablet_bootstrap.cc:492] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:56.970916 14641 tablet_bootstrap.cc:492] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd: Bootstrap complete.
I20260709 12:17:56.971457 14641 ts_tablet_manager.cc:1403] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:17:56.973084 14641 raft_consensus.cc:359] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.973539 14641 raft_consensus.cc:740] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57020114ade14e34a03fc02b9c884bbd, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.974066 14641 consensus_queue.cc:260] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:56.975739 14641 ts_tablet_manager.cc:1434] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
W20260709 12:17:56.977882 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:56.986737 14678 raft_consensus.cc:3060] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:56.991925 14678 pending_rounds.cc:85] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Aborting all ops after (but not including) 0
I20260709 12:17:56.992146 14678 pending_rounds.cc:107] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:17:56.992368 14678 raft_consensus.cc:2889] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:57.040937 14625 raft_consensus.cc:993] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0: : Instructing follower 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:17:57.041390 14719 raft_consensus.cc:1081] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Signalling peer 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:17:57.042893 14489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b00ac41e1f5948a7bee8ca041288ede9"
dest_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:17:57.043515 14489 raft_consensus.cc:493] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:57.043882 14489 raft_consensus.cc:3060] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.049296 14489 raft_consensus.cc:515] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:57.051112 14489 leader_election.cc:290] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:57.052356 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00ac41e1f5948a7bee8ca041288ede9" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:57.053028 14416 raft_consensus.cc:3055] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:57.053352 14416 raft_consensus.cc:740] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:57.054013 14416 consensus_queue.cc:260] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:57.055274 14416 raft_consensus.cc:3060] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.060422 14677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00ac41e1f5948a7bee8ca041288ede9" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:57.061054 14677 raft_consensus.cc:3060] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.061911 14416 raft_consensus.cc:2468] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 2.
I20260709 12:17:57.063060 14455 leader_election.cc:304] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 
I20260709 12:17:57.063721 14541 raft_consensus.cc:2804] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:57.064782 14541 raft_consensus.cc:697] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Becoming Leader. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:17:57.065526 14541 consensus_queue.cc:237] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:57.066622 14677 raft_consensus.cc:2468] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 2.
I20260709 12:17:57.072417 14240 catalog_manager.cc:5697] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 reported cstate change: term changed from 1 to 2, leader changed from 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66) to 3de321a572024870b2e77cca814df007 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "3de321a572024870b2e77cca814df007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:57.182156 14625 raft_consensus.cc:993] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0: : Instructing follower 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:17:57.182586 14719 raft_consensus.cc:1081] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Signalling peer 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:17:57.184010 14489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39436b3712f14a5791306727e430875f"
dest_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:17:57.184445 14489 raft_consensus.cc:493] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:57.184688 14489 raft_consensus.cc:3060] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.189565 14489 raft_consensus.cc:515] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:57.191210 14489 leader_election.cc:290] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:57.191959 14677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39436b3712f14a5791306727e430875f" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:57.192150 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39436b3712f14a5791306727e430875f" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:57.192646 14677 raft_consensus.cc:3060] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.192696 14416 raft_consensus.cc:3055] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:57.193156 14416 raft_consensus.cc:740] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:57.194002 14416 consensus_queue.cc:260] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:57.195211 14416 raft_consensus.cc:3060] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.199699 14677 raft_consensus.cc:2468] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 2.
I20260709 12:17:57.200906 14457 leader_election.cc:304] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3de321a572024870b2e77cca814df007, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:57.201699 14541 raft_consensus.cc:2804] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:57.202060 14416 raft_consensus.cc:2468] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 2.
I20260709 12:17:57.202119 14541 raft_consensus.cc:697] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Becoming Leader. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:17:57.203070 14541 consensus_queue.cc:237] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:57.210006 14240 catalog_manager.cc:5697] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 reported cstate change: term changed from 1 to 2, leader changed from 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66) to 3de321a572024870b2e77cca814df007 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "3de321a572024870b2e77cca814df007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:57.318987 14677 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.324229 14677 pending_rounds.cc:85] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Aborting all ops after (but not including) 0
I20260709 12:17:57.324458 14677 pending_rounds.cc:107] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:17:57.324685 14677 raft_consensus.cc:2889] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:57.465957 14732 raft_consensus.cc:993] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0: : Instructing follower 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:17:57.466403 14719 raft_consensus.cc:1081] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Signalling peer 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:17:57.467756 14489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237"
dest_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:17:57.468137 14489 raft_consensus.cc:493] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:57.468357 14489 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.472818 14489 raft_consensus.cc:515] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:57.473313 14677 raft_consensus.cc:3060] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.474989 14489 leader_election.cc:290] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:57.475075 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:57.475724 14678 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.479224 14677 pending_rounds.cc:85] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Aborting all ops after (but not including) 0
I20260709 12:17:57.479485 14677 pending_rounds.cc:107] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:17:57.479707 14677 raft_consensus.cc:2889] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:57.480175 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:57.480778 14416 raft_consensus.cc:3055] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:57.481130 14416 raft_consensus.cc:740] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:57.481813 14416 consensus_queue.cc:260] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:57.482704 14416 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.480759 14678 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 2.
I20260709 12:17:57.488180 14457 leader_election.cc:304] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3de321a572024870b2e77cca814df007, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:57.489053 14541 raft_consensus.cc:2804] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:57.489493 14541 raft_consensus.cc:697] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Becoming Leader. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:17:57.490286 14541 consensus_queue.cc:237] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:57.495608 14677 raft_consensus.cc:1275] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:57.497032 14722 consensus_queue.cc:1048] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:57.498235 14416 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 2.
I20260709 12:17:57.504839 14237 catalog_manager.cc:5697] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 reported cstate change: term changed from 1 to 2, leader changed from 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66) to 3de321a572024870b2e77cca814df007 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "3de321a572024870b2e77cca814df007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:57.511572 14416 raft_consensus.cc:1275] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:57.512707 14722 consensus_queue.cc:1048] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:57.604219 14416 raft_consensus.cc:1275] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:57.605347 14740 consensus_queue.cc:1048] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:57.612942 14677 raft_consensus.cc:1275] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:57.614368 14722 consensus_queue.cc:1048] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:57.916370 14677 raft_consensus.cc:1275] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:57.917512 14722 consensus_queue.cc:1048] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:57.924783 14416 raft_consensus.cc:1275] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:57.926340 14740 consensus_queue.cc:1048] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:57.948941  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:57.964322 14489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39436b3712f14a5791306727e430875f"
dest_uuid: "3de321a572024870b2e77cca814df007"
mode: GRACEFUL
new_leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:17:57.964836 14489 raft_consensus.cc:606] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Received request to transfer leadership to TS 09fc724994854a6ea5feb9376b8bd4b0
I20260709 12:17:57.967064 14489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237"
dest_uuid: "3de321a572024870b2e77cca814df007"
mode: GRACEFUL
new_leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:17:57.967486 14489 raft_consensus.cc:606] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Received request to transfer leadership to TS 09fc724994854a6ea5feb9376b8bd4b0
I20260709 12:17:57.968329  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:57.968793  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:57.969380  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:57.978863 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:58.011269 14722 raft_consensus.cc:993] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007: : Instructing follower 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:17:58.011844 14722 raft_consensus.cc:1081] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Signalling peer 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:17:58.013419 14416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39436b3712f14a5791306727e430875f"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:37354
I20260709 12:17:58.013914 14416 raft_consensus.cc:493] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:58.014189 14416 raft_consensus.cc:3060] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:58.019927 14416 raft_consensus.cc:515] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:58.021430 14416 leader_election.cc:290] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 3 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:58.022027 14677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39436b3712f14a5791306727e430875f" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:58.022754 14677 raft_consensus.cc:3060] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:58.024235 14489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39436b3712f14a5791306727e430875f" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:58.024706 14489 raft_consensus.cc:3055] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:58.024933 14489 raft_consensus.cc:740] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:17:58.025524 14489 consensus_queue.cc:260] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:58.026424 14489 raft_consensus.cc:3060] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:58.028187 14677 raft_consensus.cc:2468] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 3.
I20260709 12:17:58.029162 14383 leader_election.cc:304] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:58.029888 14625 raft_consensus.cc:2804] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:58.030241 14625 raft_consensus.cc:697] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:58.030961 14489 raft_consensus.cc:2468] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 3.
I20260709 12:17:58.030952 14625 consensus_queue.cc:237] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:58.036623 14240 catalog_manager.cc:5697] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 2 to 3, leader changed from 3de321a572024870b2e77cca814df007 (127.4.78.67) to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 3 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:58.462914 14489 raft_consensus.cc:1275] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:58.464049 14625 consensus_queue.cc:1048] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:58.473011 14677 raft_consensus.cc:1275] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:58.474320 14750 consensus_queue.cc:1048] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:58.545092 14755 raft_consensus.cc:993] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007: : Instructing follower 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:17:58.546276 14755 raft_consensus.cc:1081] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Signalling peer 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:17:58.548870 14416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:37354
I20260709 12:17:58.549860 14416 raft_consensus.cc:493] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:58.550388 14416 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:58.558760 14416 raft_consensus.cc:515] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:58.560511 14416 leader_election.cc:290] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 3 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:58.561442 14677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:58.561919 14489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:58.562376 14677 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:58.562481 14489 raft_consensus.cc:3055] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:58.562842 14489 raft_consensus.cc:740] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:17:58.563593 14489 consensus_queue.cc:260] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:58.564837 14489 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:58.569530 14677 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 3.
I20260709 12:17:58.570807 14383 leader_election.cc:304] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:58.571589 14489 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 3.
I20260709 12:17:58.571883 14750 raft_consensus.cc:2804] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:58.572533 14750 raft_consensus.cc:697] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:58.574016 14750 consensus_queue.cc:237] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:58.582415 14237 catalog_manager.cc:5697] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 2 to 3, leader changed from 3de321a572024870b2e77cca814df007 (127.4.78.67) to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 3 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:58.975730  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:58.980005 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:58.985074 14489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339"
dest_uuid: "3de321a572024870b2e77cca814df007"
mode: GRACEFUL
new_leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:17:58.985644 14489 raft_consensus.cc:606] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Received request to transfer leadership to TS 09fc724994854a6ea5feb9376b8bd4b0
I20260709 12:17:58.987990 14416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1478173e5634b808e376dffb51b9517"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
mode: GRACEFUL
new_leader_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:37364
I20260709 12:17:58.988384 14416 raft_consensus.cc:606] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Received request to transfer leadership to TS 3de321a572024870b2e77cca814df007
I20260709 12:17:58.990656 14416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
mode: GRACEFUL
new_leader_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:37364
I20260709 12:17:58.991022 14416 raft_consensus.cc:606] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Received request to transfer leadership to TS 3de321a572024870b2e77cca814df007
I20260709 12:17:58.991828  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:58.992286  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:58.992913  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:59.087591 14677 raft_consensus.cc:1275] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:59.089082 14719 consensus_queue.cc:1048] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:59.100538 14489 raft_consensus.cc:1275] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:59.102069 14750 consensus_queue.cc:1048] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:59.109197 14625 raft_consensus.cc:993] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0: : Instructing follower 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:17:59.109645 14750 raft_consensus.cc:1081] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Signalling peer 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:17:59.111163 14489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237"
dest_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:17:59.111606 14489 raft_consensus.cc:493] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:59.111857 14489 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.116806 14489 raft_consensus.cc:515] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:59.118408 14489 leader_election.cc:290] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 4 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:59.119565 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:59.119782 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:59.120276 14678 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.120378 14416 raft_consensus.cc:3055] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:59.120793 14416 raft_consensus.cc:740] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:59.121527 14416 consensus_queue.cc:260] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:59.122731 14416 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.126786 14678 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 4.
I20260709 12:17:59.127308 14416 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 4.
I20260709 12:17:59.127977 14457 leader_election.cc:304] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3de321a572024870b2e77cca814df007, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:59.128705 14755 raft_consensus.cc:2804] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:59.129657 14755 raft_consensus.cc:697] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 4 LEADER]: Becoming Leader. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:17:59.130344 14755 consensus_queue.cc:237] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:59.136085 14237 catalog_manager.cc:5697] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 reported cstate change: term changed from 3 to 4, leader changed from 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66) to 3de321a572024870b2e77cca814df007 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "3de321a572024870b2e77cca814df007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:59.244387 14765 raft_consensus.cc:993] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007: : Instructing follower 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:17:59.244859 14755 raft_consensus.cc:1081] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Signalling peer 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:17:59.246599 14416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:37354
I20260709 12:17:59.247071 14416 raft_consensus.cc:493] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:59.247347 14416 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.251915 14416 raft_consensus.cc:515] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:59.253283 14416 leader_election.cc:290] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 3 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:17:59.254153 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:59.254361 14489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:17:59.254817 14678 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.254855 14489 raft_consensus.cc:3055] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:59.255398 14489 raft_consensus.cc:740] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:17:59.256307 14489 consensus_queue.cc:260] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:59.257551 14489 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.262454 14678 raft_consensus.cc:2468] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 3.
I20260709 12:17:59.263674 14383 leader_election.cc:304] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:59.264447 14750 raft_consensus.cc:2804] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:59.264849 14750 raft_consensus.cc:697] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:59.264926 14489 raft_consensus.cc:2468] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 3.
I20260709 12:17:59.265865 14750 consensus_queue.cc:237] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:59.272805 14237 catalog_manager.cc:5697] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 2 to 3, leader changed from 3de321a572024870b2e77cca814df007 (127.4.78.67) to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 3 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:59.313000 14625 raft_consensus.cc:993] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0: : Instructing follower 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:17:59.313406 14750 raft_consensus.cc:1081] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Signalling peer 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:17:59.314792 14489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1478173e5634b808e376dffb51b9517"
dest_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:17:59.315225 14489 raft_consensus.cc:493] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:59.315512 14489 raft_consensus.cc:3060] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.319970 14489 raft_consensus.cc:515] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:59.321324 14489 leader_election.cc:290] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:17:59.322111 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1478173e5634b808e376dffb51b9517" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:17:59.322332 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1478173e5634b808e376dffb51b9517" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:17:59.322788 14678 raft_consensus.cc:3060] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.322868 14416 raft_consensus.cc:3055] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:59.323246 14416 raft_consensus.cc:740] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:17:59.323876 14416 consensus_queue.cc:260] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:59.324806 14416 raft_consensus.cc:3060] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.328347 14678 raft_consensus.cc:2468] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 2.
I20260709 12:17:59.329453 14416 raft_consensus.cc:2468] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 2.
I20260709 12:17:59.329479 14457 leader_election.cc:304] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3de321a572024870b2e77cca814df007, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:17:59.330384 14755 raft_consensus.cc:2804] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:59.330840 14755 raft_consensus.cc:697] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Becoming Leader. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:17:59.331653 14755 consensus_queue.cc:237] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:17:59.338961 14237 catalog_manager.cc:5697] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 reported cstate change: term changed from 1 to 2, leader changed from 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66) to 3de321a572024870b2e77cca814df007 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "3de321a572024870b2e77cca814df007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:59.605458 14416 raft_consensus.cc:1275] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 4 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:59.606492 14755 consensus_queue.cc:1048] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:59.614503 14678 raft_consensus.cc:1275] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 4 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:59.616819 14765 consensus_queue.cc:1048] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:59.644959 14489 raft_consensus.cc:1275] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:59.646154 14750 consensus_queue.cc:1048] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:59.655674 14678 raft_consensus.cc:1275] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:59.657552 14777 consensus_queue.cc:1048] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:59.865314 14678 raft_consensus.cc:1275] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:59.866583 14765 consensus_queue.cc:1048] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:59.875399 14416 raft_consensus.cc:1275] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:59.876783 14755 consensus_queue.cc:1048] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:17:59.980978 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:59.999228  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:00.006660 14416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
mode: GRACEFUL
new_leader_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:37364
I20260709 12:18:00.007169 14416 raft_consensus.cc:606] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Received request to transfer leadership to TS 3de321a572024870b2e77cca814df007
I20260709 12:18:00.009738 14489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7"
dest_uuid: "3de321a572024870b2e77cca814df007"
mode: GRACEFUL
new_leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:18:00.010236 14489 raft_consensus.cc:606] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 1 LEADER]: Received request to transfer leadership to TS 09fc724994854a6ea5feb9376b8bd4b0
I20260709 12:18:00.012862 14489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237"
dest_uuid: "3de321a572024870b2e77cca814df007"
mode: GRACEFUL
new_leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:18:00.013367 14489 raft_consensus.cc:606] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 4 LEADER]: Received request to transfer leadership to TS 09fc724994854a6ea5feb9376b8bd4b0
I20260709 12:18:00.014340  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:00.014803  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:00.015348  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:00.043334 14765 raft_consensus.cc:993] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007: : Instructing follower 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:18:00.043799 14755 raft_consensus.cc:1081] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 4 LEADER]: Signalling peer 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:18:00.045149 14416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:37354
I20260709 12:18:00.045570 14416 raft_consensus.cc:493] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:00.045835 14416 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.050911 14416 raft_consensus.cc:515] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:00.052479 14416 leader_election.cc:290] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 5 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:18:00.053443 14489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:18:00.053887 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0da15c46664f6f8088ac7761ec3237" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:18:00.054005 14489 raft_consensus.cc:3055] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:00.054412 14678 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.054409 14489 raft_consensus.cc:740] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:18:00.055207 14489 consensus_queue.cc:260] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:00.056038 14489 raft_consensus.cc:3060] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.059871 14678 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 5.
I20260709 12:18:00.060173 14489 raft_consensus.cc:2468] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 5.
I20260709 12:18:00.060957 14383 leader_election.cc:304] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:18:00.061666 14750 raft_consensus.cc:2804] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:00.062084 14750 raft_consensus.cc:697] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 5 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:18:00.062757 14750 consensus_queue.cc:237] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:00.068120 14237 catalog_manager.cc:5697] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 4 to 5, leader changed from 3de321a572024870b2e77cca814df007 (127.4.78.67) to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 5 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.221401 14777 raft_consensus.cc:993] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0: : Instructing follower 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:18:00.221844 14750 raft_consensus.cc:1081] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Signalling peer 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:18:00.223294 14489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339"
dest_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:18:00.223739 14489 raft_consensus.cc:493] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:00.223989 14489 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.228459 14489 raft_consensus.cc:515] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:00.229897 14489 leader_election.cc:290] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 4 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:18:00.230708 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:18:00.230891 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd51a1669ec44f88bf485256c140339" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:18:00.231477 14678 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.231539 14416 raft_consensus.cc:3055] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:00.231977 14416 raft_consensus.cc:740] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:18:00.232554 14416 consensus_queue.cc:260] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:00.233453 14416 raft_consensus.cc:3060] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.236619 14678 raft_consensus.cc:2468] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 4.
I20260709 12:18:00.237737 14457 leader_election.cc:304] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3de321a572024870b2e77cca814df007, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:18:00.238178 14416 raft_consensus.cc:2468] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 4.
I20260709 12:18:00.238508 14755 raft_consensus.cc:2804] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:00.238962 14755 raft_consensus.cc:697] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 4 LEADER]: Becoming Leader. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:18:00.239750 14755 consensus_queue.cc:237] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:00.245559 14237 catalog_manager.cc:5697] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 reported cstate change: term changed from 3 to 4, leader changed from 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66) to 3de321a572024870b2e77cca814df007 (127.4.78.67). New cstate: current_term: 4 leader_uuid: "3de321a572024870b2e77cca814df007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:00.455538 14489 raft_consensus.cc:1275] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 5 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:00.456629 14750 consensus_queue.cc:1048] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:00.464241 14678 raft_consensus.cc:1275] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 5 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:00.465592 14750 consensus_queue.cc:1048] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:00.591192 14784 raft_consensus.cc:993] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007: : Instructing follower 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:18:00.591610 14755 raft_consensus.cc:1081] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 1 LEADER]: Signalling peer 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:18:00.592969 14416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:37354
I20260709 12:18:00.593423 14416 raft_consensus.cc:493] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:00.593698 14416 raft_consensus.cc:3060] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.598413 14416 raft_consensus.cc:515] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:00.599876 14416 leader_election.cc:290] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:18:00.600943 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:18:00.600956 14489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:18:00.601557 14678 raft_consensus.cc:3060] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.601703 14489 raft_consensus.cc:3055] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:00.602145 14489 raft_consensus.cc:740] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:18:00.603111 14489 consensus_queue.cc:260] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:00.604419 14489 raft_consensus.cc:3060] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.606658 14678 raft_consensus.cc:2468] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 2.
I20260709 12:18:00.607618 14383 leader_election.cc:304] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:18:00.608256 14750 raft_consensus.cc:2804] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:00.608775 14750 raft_consensus.cc:697] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:18:00.609543 14489 raft_consensus.cc:2468] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 2.
I20260709 12:18:00.609807 14750 consensus_queue.cc:237] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:00.617455 14237 catalog_manager.cc:5697] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 1 to 2, leader changed from 3de321a572024870b2e77cca814df007 (127.4.78.67) to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.753715 14416 raft_consensus.cc:1275] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 4 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:00.754757 14755 consensus_queue.cc:1048] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:00.762918 14678 raft_consensus.cc:1275] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 4 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:00.764721 14784 consensus_queue.cc:1048] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:18:00.981835 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:01.023005  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:01.031067 14416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
mode: GRACEFUL
new_leader_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:37364
I20260709 12:18:01.031581 14416 raft_consensus.cc:606] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Received request to transfer leadership to TS 3de321a572024870b2e77cca814df007
I20260709 12:18:01.033715 14416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7d992b49e1f4ce09e047515dc8fe865"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
mode: GRACEFUL
new_leader_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:37364
I20260709 12:18:01.034245 14416 raft_consensus.cc:606] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Received request to transfer leadership to TS 3de321a572024870b2e77cca814df007
I20260709 12:18:01.036731 14490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1478173e5634b808e376dffb51b9517"
dest_uuid: "3de321a572024870b2e77cca814df007"
mode: GRACEFUL
new_leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:18:01.037277 14490 raft_consensus.cc:606] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Received request to transfer leadership to TS 09fc724994854a6ea5feb9376b8bd4b0
I20260709 12:18:01.037686 14777 raft_consensus.cc:993] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0: : Instructing follower 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:18:01.038367 14793 raft_consensus.cc:1081] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Signalling peer 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:18:01.038486  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:01.039001  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:01.039628  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:01.039800 14490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7d992b49e1f4ce09e047515dc8fe865"
dest_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:18:01.040345 14490 raft_consensus.cc:493] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:01.040679 14490 raft_consensus.cc:3060] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.048676 14490 raft_consensus.cc:515] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:01.050256 14490 leader_election.cc:290] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 3 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:18:01.051011 14677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d992b49e1f4ce09e047515dc8fe865" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:18:01.051148 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d992b49e1f4ce09e047515dc8fe865" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:18:01.051628 14677 raft_consensus.cc:3060] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.051733 14416 raft_consensus.cc:3055] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.052098 14416 raft_consensus.cc:740] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:18:01.052711 14416 consensus_queue.cc:260] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:01.053620 14416 raft_consensus.cc:3060] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.056449 14677 raft_consensus.cc:2468] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 3.
I20260709 12:18:01.057384 14457 leader_election.cc:304] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3de321a572024870b2e77cca814df007, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:18:01.058087 14784 raft_consensus.cc:2804] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:01.058132 14416 raft_consensus.cc:2468] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 3.
I20260709 12:18:01.058534 14784 raft_consensus.cc:697] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 3 LEADER]: Becoming Leader. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:18:01.059557 14784 consensus_queue.cc:237] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:01.066771 14240 catalog_manager.cc:5697] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 reported cstate change: term changed from 2 to 3, leader changed from 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66) to 3de321a572024870b2e77cca814df007 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "3de321a572024870b2e77cca814df007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.125741 14677 raft_consensus.cc:1275] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:01.126996 14793 consensus_queue.cc:1048] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:01.135972 14490 raft_consensus.cc:1275] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:01.138137 14793 consensus_queue.cc:1048] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:01.145102 14750 raft_consensus.cc:993] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0: : Instructing follower 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:18:01.145496 14793 raft_consensus.cc:1081] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Signalling peer 3de321a572024870b2e77cca814df007 to start an election
I20260709 12:18:01.146798 14490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7"
dest_uuid: "3de321a572024870b2e77cca814df007"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:18:01.147344 14490 raft_consensus.cc:493] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:01.147682 14490 raft_consensus.cc:3060] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.152946 14490 raft_consensus.cc:515] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:01.154582 14490 leader_election.cc:290] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 3 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66:41115)
I20260709 12:18:01.155596 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
I20260709 12:18:01.155682 14677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9ece67920cc454fa88c0e0f0a07ccb7" candidate_uuid: "3de321a572024870b2e77cca814df007" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:18:01.156195 14416 raft_consensus.cc:3055] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.156487 14416 raft_consensus.cc:740] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:18:01.156498 14677 raft_consensus.cc:3060] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.157099 14416 consensus_queue.cc:260] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:01.158073 14416 raft_consensus.cc:3060] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.162442 14677 raft_consensus.cc:2468] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 3.
I20260709 12:18:01.162492 14416 raft_consensus.cc:2468] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3de321a572024870b2e77cca814df007 in term 3.
I20260709 12:18:01.163648 14455 leader_election.cc:304] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 3de321a572024870b2e77cca814df007; no voters: 
I20260709 12:18:01.164312 14784 raft_consensus.cc:2804] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:01.164716 14784 raft_consensus.cc:697] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 3 LEADER]: Becoming Leader. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:18:01.165359 14784 consensus_queue.cc:237] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:01.171353 14237 catalog_manager.cc:5697] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 reported cstate change: term changed from 2 to 3, leader changed from 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66) to 3de321a572024870b2e77cca814df007 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "3de321a572024870b2e77cca814df007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.279102 14791 raft_consensus.cc:993] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007: : Instructing follower 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:18:01.279564 14784 raft_consensus.cc:1081] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Signalling peer 09fc724994854a6ea5feb9376b8bd4b0 to start an election
I20260709 12:18:01.280954 14416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1478173e5634b808e376dffb51b9517"
dest_uuid: "09fc724994854a6ea5feb9376b8bd4b0"
 from {username='slave'} at 127.0.0.1:37354
I20260709 12:18:01.281376 14416 raft_consensus.cc:493] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:01.281595 14416 raft_consensus.cc:3060] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.285913 14416 raft_consensus.cc:515] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:01.287160 14416 leader_election.cc:290] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 3 election: Requested vote from peers 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783), 3de321a572024870b2e77cca814df007 (127.4.78.67:33019)
I20260709 12:18:01.288055 14677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1478173e5634b808e376dffb51b9517" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57020114ade14e34a03fc02b9c884bbd"
I20260709 12:18:01.288172 14490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1478173e5634b808e376dffb51b9517" candidate_uuid: "09fc724994854a6ea5feb9376b8bd4b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3de321a572024870b2e77cca814df007"
I20260709 12:18:01.288781 14677 raft_consensus.cc:3060] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.288849 14490 raft_consensus.cc:3055] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.289250 14490 raft_consensus.cc:740] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3de321a572024870b2e77cca814df007, State: Running, Role: LEADER
I20260709 12:18:01.290061 14490 consensus_queue.cc:260] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:01.291291 14490 raft_consensus.cc:3060] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.295639 14677 raft_consensus.cc:2468] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 3.
I20260709 12:18:01.296809 14383 leader_election.cc:304] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09fc724994854a6ea5feb9376b8bd4b0, 57020114ade14e34a03fc02b9c884bbd; no voters: 
I20260709 12:18:01.297526 14793 raft_consensus.cc:2804] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:01.297923 14793 raft_consensus.cc:697] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Becoming Leader. State: Replica: 09fc724994854a6ea5feb9376b8bd4b0, State: Running, Role: LEADER
I20260709 12:18:01.297919 14490 raft_consensus.cc:2468] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09fc724994854a6ea5feb9376b8bd4b0 in term 3.
I20260709 12:18:01.298673 14793 consensus_queue.cc:237] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } }
I20260709 12:18:01.304991 14237 catalog_manager.cc:5697] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 reported cstate change: term changed from 2 to 3, leader changed from 3de321a572024870b2e77cca814df007 (127.4.78.67) to 09fc724994854a6ea5feb9376b8bd4b0 (127.4.78.66). New cstate: current_term: 3 leader_uuid: "09fc724994854a6ea5feb9376b8bd4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:01.505548 14416 raft_consensus.cc:1275] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:01.506779 14791 consensus_queue.cc:1048] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:01.514999 14677 raft_consensus.cc:1275] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:01.516685 14784 consensus_queue.cc:1048] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:01.559813 14677 raft_consensus.cc:1275] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:01.560915 14784 consensus_queue.cc:1048] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:01.569239 14416 raft_consensus.cc:1275] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Refusing update from remote peer 3de321a572024870b2e77cca814df007: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:01.570557 14784 consensus_queue.cc:1048] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09fc724994854a6ea5feb9376b8bd4b0" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 41115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:01.803177 14490 raft_consensus.cc:1275] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:01.804386 14793 consensus_queue.cc:1048] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3de321a572024870b2e77cca814df007" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:01.812824 14678 raft_consensus.cc:1275] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Refusing update from remote peer 09fc724994854a6ea5feb9376b8bd4b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:01.814450 14801 consensus_queue.cc:1048] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57020114ade14e34a03fc02b9c884bbd" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:18:01.982785 14288 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:02.048813  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:02.081179  4409 tablet_server.cc:179] TabletServer@127.4.78.65:32783 shutting down...
I20260709 12:18:02.102092  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:02.102855  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:02.103575  4409 raft_consensus.cc:2243] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.104075  4409 raft_consensus.cc:2272] T e326c257307c4eeba83c7bbe1d14274b P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.106351  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:02.106945  4409 raft_consensus.cc:2243] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.107374  4409 raft_consensus.cc:2272] T 6dd51a1669ec44f88bf485256c140339 P 57020114ade14e34a03fc02b9c884bbd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.109325  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:02.110142  4409 raft_consensus.cc:2243] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.110647  4409 raft_consensus.cc:2272] T 59b8e8720ec44504ab88a0a116325d9e P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.112802  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:02.113340  4409 raft_consensus.cc:2243] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.113723  4409 raft_consensus.cc:2272] T b7d992b49e1f4ce09e047515dc8fe865 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.116539  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:02.117223  4409 raft_consensus.cc:2243] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.117688  4409 raft_consensus.cc:2272] T a9ece67920cc454fa88c0e0f0a07ccb7 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:02.117858 14383 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:18:02.122758 14383 consensus_peers.cc:597] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.122982  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:02.123695  4409 raft_consensus.cc:2243] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.124176  4409 raft_consensus.cc:2272] T 39436b3712f14a5791306727e430875f P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.126601  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:02.127275  4409 raft_consensus.cc:2243] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.127839  4409 raft_consensus.cc:2272] T 1c1515e01a4a4cd5a519eb207e92b92d P 57020114ade14e34a03fc02b9c884bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.130259  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:02.130779  4409 raft_consensus.cc:2243] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.131217  4409 raft_consensus.cc:2272] T b00ac41e1f5948a7bee8ca041288ede9 P 57020114ade14e34a03fc02b9c884bbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.133253  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:02.133708  4409 raft_consensus.cc:2243] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.134155  4409 raft_consensus.cc:2272] T e1478173e5634b808e376dffb51b9517 P 57020114ade14e34a03fc02b9c884bbd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.136591  4409 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:02.137074  4409 raft_consensus.cc:2243] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.137560  4409 raft_consensus.cc:2272] T ee0da15c46664f6f8088ac7761ec3237 P 57020114ade14e34a03fc02b9c884bbd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.168658  4409 tablet_server.cc:196] TabletServer@127.4.78.65:32783 shutdown complete.
W20260709 12:18:02.176466 14383 consensus_peers.cc:597] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.196834  4409 tablet_server.cc:179] TabletServer@127.4.78.66:0 shutting down...
I20260709 12:18:02.216846  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:02.217492  4409 tablet_replica.cc:333] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0: stopping tablet replica
I20260709 12:18:02.218194  4409 raft_consensus.cc:2243] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.219096  4409 raft_consensus.cc:2272] T e326c257307c4eeba83c7bbe1d14274b P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.221451  4409 tablet_replica.cc:333] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0: stopping tablet replica
I20260709 12:18:02.222051  4409 raft_consensus.cc:2243] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.222764  4409 raft_consensus.cc:2272] T ee0da15c46664f6f8088ac7761ec3237 P 09fc724994854a6ea5feb9376b8bd4b0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.224839  4409 tablet_replica.cc:333] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0: stopping tablet replica
I20260709 12:18:02.225342  4409 raft_consensus.cc:2243] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.226111  4409 raft_consensus.cc:2272] T e1478173e5634b808e376dffb51b9517 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.228497  4409 tablet_replica.cc:333] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0: stopping tablet replica
I20260709 12:18:02.229034  4409 raft_consensus.cc:2243] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.229462  4409 raft_consensus.cc:2272] T b00ac41e1f5948a7bee8ca041288ede9 P 09fc724994854a6ea5feb9376b8bd4b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.231606  4409 tablet_replica.cc:333] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0: stopping tablet replica
I20260709 12:18:02.232159  4409 raft_consensus.cc:2243] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.232534  4409 raft_consensus.cc:2272] T 6dd51a1669ec44f88bf485256c140339 P 09fc724994854a6ea5feb9376b8bd4b0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.234372  4409 tablet_replica.cc:333] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0: stopping tablet replica
I20260709 12:18:02.234932  4409 raft_consensus.cc:2243] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.235333  4409 raft_consensus.cc:2272] T 59b8e8720ec44504ab88a0a116325d9e P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.237282  4409 tablet_replica.cc:333] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0: stopping tablet replica
I20260709 12:18:02.237787  4409 raft_consensus.cc:2243] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.238175  4409 raft_consensus.cc:2272] T b7d992b49e1f4ce09e047515dc8fe865 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.240676  4409 tablet_replica.cc:333] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0: stopping tablet replica
I20260709 12:18:02.241134  4409 raft_consensus.cc:2243] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.241910  4409 raft_consensus.cc:2272] T 39436b3712f14a5791306727e430875f P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.243964  4409 tablet_replica.cc:333] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0: stopping tablet replica
I20260709 12:18:02.244367  4409 raft_consensus.cc:2243] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.244704  4409 raft_consensus.cc:2272] T a9ece67920cc454fa88c0e0f0a07ccb7 P 09fc724994854a6ea5feb9376b8bd4b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.246905  4409 tablet_replica.cc:333] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0: stopping tablet replica
I20260709 12:18:02.247340  4409 raft_consensus.cc:2243] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.248126  4409 raft_consensus.cc:2272] T 1c1515e01a4a4cd5a519eb207e92b92d P 09fc724994854a6ea5feb9376b8bd4b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:02.254010 14457 consensus_peers.cc:597] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.280076  4409 tablet_server.cc:196] TabletServer@127.4.78.66:0 shutdown complete.
I20260709 12:18:02.304296  4409 tablet_server.cc:179] TabletServer@127.4.78.67:0 shutting down...
W20260709 12:18:02.316084 14457 consensus_peers.cc:597] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 -> Peer 57020114ade14e34a03fc02b9c884bbd (127.4.78.65:32783): Couldn't send request to peer 57020114ade14e34a03fc02b9c884bbd. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:32783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.326912  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:02.327589  4409 tablet_replica.cc:333] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007: stopping tablet replica
I20260709 12:18:02.328394  4409 raft_consensus.cc:2243] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.328881  4409 raft_consensus.cc:2272] T e326c257307c4eeba83c7bbe1d14274b P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.331072  4409 tablet_replica.cc:333] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007: stopping tablet replica
I20260709 12:18:02.331601  4409 raft_consensus.cc:2243] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.332333  4409 raft_consensus.cc:2272] T b7d992b49e1f4ce09e047515dc8fe865 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.334851  4409 tablet_replica.cc:333] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007: stopping tablet replica
I20260709 12:18:02.335430  4409 raft_consensus.cc:2243] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.336261  4409 raft_consensus.cc:2272] T 59b8e8720ec44504ab88a0a116325d9e P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.338471  4409 tablet_replica.cc:333] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007: stopping tablet replica
I20260709 12:18:02.338979  4409 raft_consensus.cc:2243] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.339706  4409 raft_consensus.cc:2272] T 6dd51a1669ec44f88bf485256c140339 P 3de321a572024870b2e77cca814df007 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.341953  4409 tablet_replica.cc:333] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007: stopping tablet replica
I20260709 12:18:02.342537  4409 raft_consensus.cc:2243] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.342950  4409 raft_consensus.cc:2272] T ee0da15c46664f6f8088ac7761ec3237 P 3de321a572024870b2e77cca814df007 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.345115  4409 tablet_replica.cc:333] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007: stopping tablet replica
I20260709 12:18:02.345667  4409 raft_consensus.cc:2243] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.346230  4409 raft_consensus.cc:2272] T 39436b3712f14a5791306727e430875f P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.348299  4409 tablet_replica.cc:333] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007: stopping tablet replica
I20260709 12:18:02.348814  4409 raft_consensus.cc:2243] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.349231  4409 raft_consensus.cc:2272] T 1c1515e01a4a4cd5a519eb207e92b92d P 3de321a572024870b2e77cca814df007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.351459  4409 tablet_replica.cc:333] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007: stopping tablet replica
I20260709 12:18:02.351951  4409 raft_consensus.cc:2243] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.352658  4409 raft_consensus.cc:2272] T a9ece67920cc454fa88c0e0f0a07ccb7 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.355221  4409 tablet_replica.cc:333] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007: stopping tablet replica
I20260709 12:18:02.355727  4409 raft_consensus.cc:2243] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.356112  4409 raft_consensus.cc:2272] T e1478173e5634b808e376dffb51b9517 P 3de321a572024870b2e77cca814df007 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.358731  4409 tablet_replica.cc:333] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007: stopping tablet replica
I20260709 12:18:02.359272  4409 raft_consensus.cc:2243] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.360090  4409 raft_consensus.cc:2272] T b00ac41e1f5948a7bee8ca041288ede9 P 3de321a572024870b2e77cca814df007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.390931  4409 tablet_server.cc:196] TabletServer@127.4.78.67:0 shutdown complete.
I20260709 12:18:02.415436  4409 master.cc:562] Master@127.4.78.126:40833 shutting down...
I20260709 12:18:02.438009  4409 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.438540  4409 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.438860  4409 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5d1cd54963d649f1b47cbfb2432d878f: stopping tablet replica
I20260709 12:18:02.458536  4409 master.cc:584] Master@127.4.78.126:40833 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12657 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:18:02.498252  4409 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.78.126:34115
I20260709 12:18:02.499373  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:02.504572 14811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:02.505457 14812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:02.505738 14814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:02.506196  4409 server_base.cc:1061] running on GCE node
I20260709 12:18:02.507169  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:02.507365  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:02.507479  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599482507468 us; error 0 us; skew 500 ppm
I20260709 12:18:02.507965  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:02.510252  4409 webserver.cc:533] Webserver started at http://127.4.78.126:38041/ using document root <none> and password file <none>
I20260709 12:18:02.510687  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:02.510835  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:02.511045  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:02.512085  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/master-0-root/instance:
uuid: "b31cd0ddcc72447298f3209b4adf8794"
format_stamp: "Formatted at 2026-07-09 12:18:02 on dist-test-slave-9t7s"
I20260709 12:18:02.516207  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:18:02.519369 14819 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:02.520040  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:18:02.520292  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/master-0-root
uuid: "b31cd0ddcc72447298f3209b4adf8794"
format_stamp: "Formatted at 2026-07-09 12:18:02 on dist-test-slave-9t7s"
I20260709 12:18:02.520536  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:02.543349  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:02.544552  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:02.581123  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.126:34115
I20260709 12:18:02.581243 14870 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.126:34115 every 8 connection(s)
I20260709 12:18:02.584972 14871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:02.596846 14871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794: Bootstrap starting.
I20260709 12:18:02.601838 14871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:02.606365 14871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794: No bootstrap required, opened a new log
I20260709 12:18:02.608546 14871 raft_consensus.cc:359] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b31cd0ddcc72447298f3209b4adf8794" member_type: VOTER }
I20260709 12:18:02.608919 14871 raft_consensus.cc:385] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:02.609092 14871 raft_consensus.cc:740] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b31cd0ddcc72447298f3209b4adf8794, State: Initialized, Role: FOLLOWER
I20260709 12:18:02.609594 14871 consensus_queue.cc:260] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b31cd0ddcc72447298f3209b4adf8794" member_type: VOTER }
I20260709 12:18:02.610047 14871 raft_consensus.cc:399] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:02.610244 14871 raft_consensus.cc:493] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:02.610452 14871 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:02.615075 14871 raft_consensus.cc:515] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b31cd0ddcc72447298f3209b4adf8794" member_type: VOTER }
I20260709 12:18:02.615540 14871 leader_election.cc:304] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b31cd0ddcc72447298f3209b4adf8794; no voters: 
I20260709 12:18:02.616571 14871 leader_election.cc:290] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:02.616885 14874 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:02.618233 14874 raft_consensus.cc:697] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [term 1 LEADER]: Becoming Leader. State: Replica: b31cd0ddcc72447298f3209b4adf8794, State: Running, Role: LEADER
I20260709 12:18:02.618803 14874 consensus_queue.cc:237] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b31cd0ddcc72447298f3209b4adf8794" member_type: VOTER }
I20260709 12:18:02.619362 14871 sys_catalog.cc:565] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:02.621824 14875 sys_catalog.cc:455] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b31cd0ddcc72447298f3209b4adf8794" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b31cd0ddcc72447298f3209b4adf8794" member_type: VOTER } }
I20260709 12:18:02.621879 14876 sys_catalog.cc:455] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b31cd0ddcc72447298f3209b4adf8794. Latest consensus state: current_term: 1 leader_uuid: "b31cd0ddcc72447298f3209b4adf8794" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b31cd0ddcc72447298f3209b4adf8794" member_type: VOTER } }
I20260709 12:18:02.622599 14875 sys_catalog.cc:458] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:02.622716 14876 sys_catalog.cc:458] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:02.626044 14881 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:02.630893 14881 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:02.634207  4409 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:02.639380 14881 catalog_manager.cc:1383] Generated new cluster ID: b294e67029ba4895af42f0c97d542172
I20260709 12:18:02.639616 14881 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:02.658999 14881 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:02.660247 14881 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:02.672168 14881 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794: Generated new TSK 0
I20260709 12:18:02.672722 14881 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:02.700982  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:02.707142 14892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:02.708087 14893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:02.710006  4409 server_base.cc:1061] running on GCE node
W20260709 12:18:02.710389 14895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:02.711299  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:02.711498  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:02.711663  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599482711645 us; error 0 us; skew 500 ppm
I20260709 12:18:02.712218  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:02.714550  4409 webserver.cc:533] Webserver started at http://127.4.78.65:33699/ using document root <none> and password file <none>
I20260709 12:18:02.715044  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:02.715214  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:02.715461  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:02.716552  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-0-root/instance:
uuid: "0698150b0f4540e59d9b2c38d2b67120"
format_stamp: "Formatted at 2026-07-09 12:18:02 on dist-test-slave-9t7s"
I20260709 12:18:02.721109  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:18:02.724644 14900 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:02.725481  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:18:02.725845  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-0-root
uuid: "0698150b0f4540e59d9b2c38d2b67120"
format_stamp: "Formatted at 2026-07-09 12:18:02 on dist-test-slave-9t7s"
I20260709 12:18:02.726136  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:02.746569  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:02.747745  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:02.749173  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:02.751857  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:02.752063  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:02.752316  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:02.752478  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:02.790939  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.65:38319
I20260709 12:18:02.791033 14962 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.65:38319 every 8 connection(s)
I20260709 12:18:02.796133  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:02.802898 14967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:02.804517 14968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:02.805986 14970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:02.807682  4409 server_base.cc:1061] running on GCE node
I20260709 12:18:02.808280 14963 heartbeater.cc:344] Connected to a master server at 127.4.78.126:34115
I20260709 12:18:02.808661 14963 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:02.808887  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:02.809136  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:02.809289  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599482809273 us; error 0 us; skew 500 ppm
I20260709 12:18:02.809377 14963 heartbeater.cc:507] Master 127.4.78.126:34115 requested a full tablet report, sending...
I20260709 12:18:02.809943  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:02.811698 14836 ts_manager.cc:194] Registered new tserver with Master: 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65:38319)
I20260709 12:18:02.812698  4409 webserver.cc:533] Webserver started at http://127.4.78.66:44601/ using document root <none> and password file <none>
I20260709 12:18:02.813410  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:02.813645  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:02.813948  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:02.814203 14836 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50156
I20260709 12:18:02.815454  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-1-root/instance:
uuid: "802e3cd97ba64233ab70fb75dad24372"
format_stamp: "Formatted at 2026-07-09 12:18:02 on dist-test-slave-9t7s"
I20260709 12:18:02.819860  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:18:02.823149 14975 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:02.823841  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:18:02.824102  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-1-root
uuid: "802e3cd97ba64233ab70fb75dad24372"
format_stamp: "Formatted at 2026-07-09 12:18:02 on dist-test-slave-9t7s"
I20260709 12:18:02.824355  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:02.838770  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:02.839905  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:02.841257  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:02.843396  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:02.843592  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:02.843809  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:02.843956  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:02.882369  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.66:43201
I20260709 12:18:02.882485 15037 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.66:43201 every 8 connection(s)
I20260709 12:18:02.887295  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:02.894246 15041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:02.895680 15042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:02.897742  4409 server_base.cc:1061] running on GCE node
W20260709 12:18:02.898202 15044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:02.899322  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:18:02.899411 15038 heartbeater.cc:344] Connected to a master server at 127.4.78.126:34115
W20260709 12:18:02.899626  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:02.899868  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599482899848 us; error 0 us; skew 500 ppm
I20260709 12:18:02.899881 15038 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:02.900727  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:02.900950 15038 heartbeater.cc:507] Master 127.4.78.126:34115 requested a full tablet report, sending...
I20260709 12:18:02.903146 14836 ts_manager.cc:194] Registered new tserver with Master: 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66:43201)
I20260709 12:18:02.903538  4409 webserver.cc:533] Webserver started at http://127.4.78.67:41609/ using document root <none> and password file <none>
I20260709 12:18:02.904218  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:02.904438  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:02.904482 14836 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50168
I20260709 12:18:02.904795  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:02.906488  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-2-root/instance:
uuid: "6306904386de4c94b3c995922471f706"
format_stamp: "Formatted at 2026-07-09 12:18:02 on dist-test-slave-9t7s"
I20260709 12:18:02.912202  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 12:18:02.915218 15049 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:02.915927  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:18:02.916181  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-2-root
uuid: "6306904386de4c94b3c995922471f706"
format_stamp: "Formatted at 2026-07-09 12:18:02 on dist-test-slave-9t7s"
I20260709 12:18:02.916407  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599105096696-4409-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:02.930779  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:02.931874  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:02.933198  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:02.935326  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:02.935510  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:02.935740  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:02.935890  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:02.973479  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.67:37643
I20260709 12:18:02.973582 15111 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.67:37643 every 8 connection(s)
I20260709 12:18:02.987257 15112 heartbeater.cc:344] Connected to a master server at 127.4.78.126:34115
I20260709 12:18:02.987711 15112 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:02.988425 15112 heartbeater.cc:507] Master 127.4.78.126:34115 requested a full tablet report, sending...
I20260709 12:18:02.990298 14836 ts_manager.cc:194] Registered new tserver with Master: 6306904386de4c94b3c995922471f706 (127.4.78.67:37643)
I20260709 12:18:02.990918  4409 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014217224s
I20260709 12:18:02.991607 14836 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50174
I20260709 12:18:03.015192 14836 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50186:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:03.017285 14836 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:03.062657 15003 tablet_service.cc:1511] Processing CreateTablet for tablet 009743499dcf48e7bd91e54d9e19ecb5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f8180629097544728ebbd0b3db8f5633]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:03.064637 15003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009743499dcf48e7bd91e54d9e19ecb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.068703 15002 tablet_service.cc:1511] Processing CreateTablet for tablet 63d57218055847c0b3eeee0f1e2bf99f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f8180629097544728ebbd0b3db8f5633]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:03.070154 15002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d57218055847c0b3eeee0f1e2bf99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.071327 15077 tablet_service.cc:1511] Processing CreateTablet for tablet 009743499dcf48e7bd91e54d9e19ecb5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f8180629097544728ebbd0b3db8f5633]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:03.071782 14927 tablet_service.cc:1511] Processing CreateTablet for tablet 63d57218055847c0b3eeee0f1e2bf99f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f8180629097544728ebbd0b3db8f5633]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:03.072412 15077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009743499dcf48e7bd91e54d9e19ecb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.073091 14927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d57218055847c0b3eeee0f1e2bf99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.076807 14928 tablet_service.cc:1511] Processing CreateTablet for tablet 009743499dcf48e7bd91e54d9e19ecb5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f8180629097544728ebbd0b3db8f5633]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:03.078357 14928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009743499dcf48e7bd91e54d9e19ecb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.076954 15076 tablet_service.cc:1511] Processing CreateTablet for tablet 63d57218055847c0b3eeee0f1e2bf99f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f8180629097544728ebbd0b3db8f5633]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:03.082672 15076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d57218055847c0b3eeee0f1e2bf99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.092682 15127 tablet_bootstrap.cc:492] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372: Bootstrap starting.
I20260709 12:18:03.099521 15129 tablet_bootstrap.cc:492] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706: Bootstrap starting.
I20260709 12:18:03.101991 15127 tablet_bootstrap.cc:654] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.108134 15129 tablet_bootstrap.cc:654] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.119803 15129 tablet_bootstrap.cc:492] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706: No bootstrap required, opened a new log
I20260709 12:18:03.120379 15129 ts_tablet_manager.cc:1403] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.009s
I20260709 12:18:03.123533 15129 raft_consensus.cc:359] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:03.124701 15129 raft_consensus.cc:385] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.125090 15129 raft_consensus.cc:740] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6306904386de4c94b3c995922471f706, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.126363 15128 tablet_bootstrap.cc:492] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120: Bootstrap starting.
I20260709 12:18:03.126065 15129 consensus_queue.cc:260] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:03.136374 15128 tablet_bootstrap.cc:654] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.144371 15112 heartbeater.cc:499] Master 127.4.78.126:34115 was elected leader, sending a full tablet report...
I20260709 12:18:03.144963 15127 tablet_bootstrap.cc:492] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372: No bootstrap required, opened a new log
I20260709 12:18:03.145406 15127 ts_tablet_manager.cc:1403] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.039s
I20260709 12:18:03.146207 15128 tablet_bootstrap.cc:492] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120: No bootstrap required, opened a new log
I20260709 12:18:03.146759 15128 ts_tablet_manager.cc:1403] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.004s
I20260709 12:18:03.147070 15129 ts_tablet_manager.cc:1434] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.011s
I20260709 12:18:03.147905 15127 raft_consensus.cc:359] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:03.148734 15127 raft_consensus.cc:385] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.149084 15127 raft_consensus.cc:740] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 802e3cd97ba64233ab70fb75dad24372, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.149243 15129 tablet_bootstrap.cc:492] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706: Bootstrap starting.
I20260709 12:18:03.150063 15127 consensus_queue.cc:260] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:03.151157 15128 raft_consensus.cc:359] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.152036 15128 raft_consensus.cc:385] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.152381 15128 raft_consensus.cc:740] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0698150b0f4540e59d9b2c38d2b67120, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.153364 15128 consensus_queue.cc:260] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.156383 15129 tablet_bootstrap.cc:654] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.162325 15038 heartbeater.cc:499] Master 127.4.78.126:34115 was elected leader, sending a full tablet report...
I20260709 12:18:03.162925 15127 ts_tablet_manager.cc:1434] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.012s
I20260709 12:18:03.163249 14963 heartbeater.cc:499] Master 127.4.78.126:34115 was elected leader, sending a full tablet report...
I20260709 12:18:03.163632 15128 ts_tablet_manager.cc:1434] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 12:18:03.164009 15127 tablet_bootstrap.cc:492] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372: Bootstrap starting.
I20260709 12:18:03.164587 15128 tablet_bootstrap.cc:492] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120: Bootstrap starting.
I20260709 12:18:03.171170 15129 tablet_bootstrap.cc:492] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706: No bootstrap required, opened a new log
I20260709 12:18:03.171651 15128 tablet_bootstrap.cc:654] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.171160 15127 tablet_bootstrap.cc:654] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.171778 15129 ts_tablet_manager.cc:1403] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 12:18:03.177150 15129 raft_consensus.cc:359] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.178058 15129 raft_consensus.cc:385] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.178429 15129 raft_consensus.cc:740] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6306904386de4c94b3c995922471f706, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.179356 15129 consensus_queue.cc:260] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.181797 15129 ts_tablet_manager.cc:1434] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:03.186717 15127 tablet_bootstrap.cc:492] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372: No bootstrap required, opened a new log
I20260709 12:18:03.187462 15128 tablet_bootstrap.cc:492] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120: No bootstrap required, opened a new log
I20260709 12:18:03.187803 15127 ts_tablet_manager.cc:1403] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.010s
I20260709 12:18:03.188091 15128 ts_tablet_manager.cc:1403] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:18:03.191217 15127 raft_consensus.cc:359] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.191434 15128 raft_consensus.cc:359] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:03.192018 15127 raft_consensus.cc:385] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.192140 15128 raft_consensus.cc:385] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.192363 15127 raft_consensus.cc:740] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 802e3cd97ba64233ab70fb75dad24372, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.192469 15128 raft_consensus.cc:740] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0698150b0f4540e59d9b2c38d2b67120, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.193281 15127 consensus_queue.cc:260] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.193415 15128 consensus_queue.cc:260] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:03.195549 15127 ts_tablet_manager.cc:1434] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:03.195602 15128 ts_tablet_manager.cc:1434] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:03.202419 15132 raft_consensus.cc:493] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.202971 15132 raft_consensus.cc:515] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.205523 15132 leader_election.cc:290] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65:38319), 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66:43201)
I20260709 12:18:03.214257 14938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d57218055847c0b3eeee0f1e2bf99f" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0698150b0f4540e59d9b2c38d2b67120" is_pre_election: true
I20260709 12:18:03.215049 14938 raft_consensus.cc:2468] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 0.
I20260709 12:18:03.216223 15050 leader_election.cc:304] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0698150b0f4540e59d9b2c38d2b67120, 6306904386de4c94b3c995922471f706; no voters: 
I20260709 12:18:03.217015 15132 raft_consensus.cc:2804] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.217370 15132 raft_consensus.cc:493] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.217615 15132 raft_consensus.cc:3060] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.217622 15013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d57218055847c0b3eeee0f1e2bf99f" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "802e3cd97ba64233ab70fb75dad24372" is_pre_election: true
I20260709 12:18:03.218413 15013 raft_consensus.cc:2468] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 0.
I20260709 12:18:03.223106 15132 raft_consensus.cc:515] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.224833 15132 leader_election.cc:290] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 election: Requested vote from peers 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65:38319), 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66:43201)
I20260709 12:18:03.225422 14938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d57218055847c0b3eeee0f1e2bf99f" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0698150b0f4540e59d9b2c38d2b67120"
I20260709 12:18:03.225812 15013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d57218055847c0b3eeee0f1e2bf99f" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "802e3cd97ba64233ab70fb75dad24372"
I20260709 12:18:03.226056 14938 raft_consensus.cc:3060] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.226382 15013 raft_consensus.cc:3060] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.233215 14938 raft_consensus.cc:2468] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 1.
I20260709 12:18:03.233286 15013 raft_consensus.cc:2468] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 1.
I20260709 12:18:03.234479 15050 leader_election.cc:304] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0698150b0f4540e59d9b2c38d2b67120, 6306904386de4c94b3c995922471f706; no voters: 
I20260709 12:18:03.235049 15132 raft_consensus.cc:2804] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.235864 15132 raft_consensus.cc:697] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Becoming Leader. State: Replica: 6306904386de4c94b3c995922471f706, State: Running, Role: LEADER
I20260709 12:18:03.236613 15132 consensus_queue.cc:237] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.242810 14834 catalog_manager.cc:5697] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6306904386de4c94b3c995922471f706 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "6306904386de4c94b3c995922471f706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:03.288476 15132 raft_consensus.cc:493] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.289008 15132 raft_consensus.cc:515] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:03.290622 15132 leader_election.cc:290] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66:43201), 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65:38319)
I20260709 12:18:03.291481 15013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009743499dcf48e7bd91e54d9e19ecb5" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "802e3cd97ba64233ab70fb75dad24372" is_pre_election: true
I20260709 12:18:03.291690 14938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009743499dcf48e7bd91e54d9e19ecb5" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0698150b0f4540e59d9b2c38d2b67120" is_pre_election: true
I20260709 12:18:03.292104 15013 raft_consensus.cc:2468] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 0.
I20260709 12:18:03.292268 14938 raft_consensus.cc:2468] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 0.
I20260709 12:18:03.293061 15050 leader_election.cc:304] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6306904386de4c94b3c995922471f706, 802e3cd97ba64233ab70fb75dad24372; no voters: 
I20260709 12:18:03.293809 15132 raft_consensus.cc:2804] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.294153 15132 raft_consensus.cc:493] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.294477 15132 raft_consensus.cc:3060] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.299957 15132 raft_consensus.cc:515] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:03.301591 15132 leader_election.cc:290] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 election: Requested vote from peers 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66:43201), 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65:38319)
I20260709 12:18:03.302444 15013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009743499dcf48e7bd91e54d9e19ecb5" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "802e3cd97ba64233ab70fb75dad24372"
I20260709 12:18:03.302630 14938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009743499dcf48e7bd91e54d9e19ecb5" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0698150b0f4540e59d9b2c38d2b67120"
I20260709 12:18:03.302969 15013 raft_consensus.cc:3060] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.303164 14938 raft_consensus.cc:3060] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.307778 14938 raft_consensus.cc:2468] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 1.
I20260709 12:18:03.307894 15013 raft_consensus.cc:2468] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 1.
I20260709 12:18:03.308701 15050 leader_election.cc:304] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0698150b0f4540e59d9b2c38d2b67120, 6306904386de4c94b3c995922471f706; no voters: 
I20260709 12:18:03.309325 15132 raft_consensus.cc:2804] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.309684 15132 raft_consensus.cc:697] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Becoming Leader. State: Replica: 6306904386de4c94b3c995922471f706, State: Running, Role: LEADER
I20260709 12:18:03.310454 15132 consensus_queue.cc:237] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:03.316299 14834 catalog_manager.cc:5697] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6306904386de4c94b3c995922471f706 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "6306904386de4c94b3c995922471f706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:03.363087 14834 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50188:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:03.364952 14834 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:03.385939 14928 tablet_service.cc:1511] Processing CreateTablet for tablet cb9e8a1a45a9423f87970c479b8f9f99 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7001bde72a4944af9d7861cc83b66721]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:03.387250 14928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9e8a1a45a9423f87970c479b8f9f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.387295 15002 tablet_service.cc:1511] Processing CreateTablet for tablet cb9e8a1a45a9423f87970c479b8f9f99 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7001bde72a4944af9d7861cc83b66721]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:03.388616 15002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9e8a1a45a9423f87970c479b8f9f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.388533 15076 tablet_service.cc:1511] Processing CreateTablet for tablet cb9e8a1a45a9423f87970c479b8f9f99 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7001bde72a4944af9d7861cc83b66721]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:03.389830 15076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9e8a1a45a9423f87970c479b8f9f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.397572 15003 tablet_service.cc:1511] Processing CreateTablet for tablet d8601a1079224340af1ef76772a71514 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7001bde72a4944af9d7861cc83b66721]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:03.397920 14927 tablet_service.cc:1511] Processing CreateTablet for tablet d8601a1079224340af1ef76772a71514 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7001bde72a4944af9d7861cc83b66721]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:03.399546 15003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8601a1079224340af1ef76772a71514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.399868 14927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8601a1079224340af1ef76772a71514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.397889 15077 tablet_service.cc:1511] Processing CreateTablet for tablet d8601a1079224340af1ef76772a71514 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7001bde72a4944af9d7861cc83b66721]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:03.402321 15077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8601a1079224340af1ef76772a71514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.407217 15129 tablet_bootstrap.cc:492] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706: Bootstrap starting.
I20260709 12:18:03.412353 15127 tablet_bootstrap.cc:492] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372: Bootstrap starting.
I20260709 12:18:03.413050 15129 tablet_bootstrap.cc:654] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.418138 15128 tablet_bootstrap.cc:492] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120: Bootstrap starting.
I20260709 12:18:03.418651 15127 tablet_bootstrap.cc:654] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.424852 15128 tablet_bootstrap.cc:654] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.430500 15127 tablet_bootstrap.cc:492] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372: No bootstrap required, opened a new log
I20260709 12:18:03.431099 15127 ts_tablet_manager.cc:1403] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 12:18:03.434353 15127 raft_consensus.cc:359] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.435721 15127 raft_consensus.cc:385] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.436067 15127 raft_consensus.cc:740] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 802e3cd97ba64233ab70fb75dad24372, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.436986 15127 consensus_queue.cc:260] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.437836 15128 tablet_bootstrap.cc:492] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120: No bootstrap required, opened a new log
I20260709 12:18:03.438413 15128 ts_tablet_manager.cc:1403] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:18:03.439582 15127 ts_tablet_manager.cc:1434] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:18:03.440663 15127 tablet_bootstrap.cc:492] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372: Bootstrap starting.
I20260709 12:18:03.441305 15128 raft_consensus.cc:359] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.442075 15128 raft_consensus.cc:385] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.442373 15128 raft_consensus.cc:740] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0698150b0f4540e59d9b2c38d2b67120, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.443753 15128 consensus_queue.cc:260] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.447952 15127 tablet_bootstrap.cc:654] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.448380 15128 ts_tablet_manager.cc:1434] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:18:03.449512 15128 tablet_bootstrap.cc:492] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120: Bootstrap starting.
I20260709 12:18:03.446542 15129 tablet_bootstrap.cc:492] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706: No bootstrap required, opened a new log
I20260709 12:18:03.452096 15129 ts_tablet_manager.cc:1403] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.014s
I20260709 12:18:03.453860 15127 tablet_bootstrap.cc:492] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372: No bootstrap required, opened a new log
I20260709 12:18:03.454407 15127 ts_tablet_manager.cc:1403] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:18:03.455687 15128 tablet_bootstrap.cc:654] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.455314 15129 raft_consensus.cc:359] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.456149 15129 raft_consensus.cc:385] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.456509 15129 raft_consensus.cc:740] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6306904386de4c94b3c995922471f706, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.457412 15129 consensus_queue.cc:260] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.457541 15127 raft_consensus.cc:359] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.458367 15127 raft_consensus.cc:385] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.458698 15127 raft_consensus.cc:740] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 802e3cd97ba64233ab70fb75dad24372, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.459460 15127 consensus_queue.cc:260] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.462528 15127 ts_tablet_manager.cc:1434] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:03.465395 15129 ts_tablet_manager.cc:1434] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:18:03.466572 15129 tablet_bootstrap.cc:492] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706: Bootstrap starting.
I20260709 12:18:03.468825 15128 tablet_bootstrap.cc:492] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120: No bootstrap required, opened a new log
I20260709 12:18:03.469378 15128 ts_tablet_manager.cc:1403] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 12:18:03.472224 15128 raft_consensus.cc:359] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.472944 15128 raft_consensus.cc:385] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.473225 15128 raft_consensus.cc:740] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0698150b0f4540e59d9b2c38d2b67120, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.473989 15129 tablet_bootstrap.cc:654] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.473939 15128 consensus_queue.cc:260] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.476208 15128 ts_tablet_manager.cc:1434] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:18:03.479224 15129 tablet_bootstrap.cc:492] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706: No bootstrap required, opened a new log
I20260709 12:18:03.479683 15129 ts_tablet_manager.cc:1403] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:18:03.482316 15129 raft_consensus.cc:359] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.482999 15129 raft_consensus.cc:385] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.483283 15129 raft_consensus.cc:740] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6306904386de4c94b3c995922471f706, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.484021 15129 consensus_queue.cc:260] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.485635 15129 ts_tablet_manager.cc:1434] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:03.558429 15132 raft_consensus.cc:493] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.558949 15132 raft_consensus.cc:515] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.560678 15132 leader_election.cc:290] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65:38319), 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66:43201)
I20260709 12:18:03.561480 14938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8601a1079224340af1ef76772a71514" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0698150b0f4540e59d9b2c38d2b67120" is_pre_election: true
I20260709 12:18:03.561652 15013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8601a1079224340af1ef76772a71514" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "802e3cd97ba64233ab70fb75dad24372" is_pre_election: true
I20260709 12:18:03.562111 14938 raft_consensus.cc:2468] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 0.
I20260709 12:18:03.562268 15013 raft_consensus.cc:2468] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 0.
I20260709 12:18:03.563045 15050 leader_election.cc:304] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0698150b0f4540e59d9b2c38d2b67120, 6306904386de4c94b3c995922471f706; no voters: 
I20260709 12:18:03.563781 15132 raft_consensus.cc:2804] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.564066 15132 raft_consensus.cc:493] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.564329 15132 raft_consensus.cc:3060] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.569702 15132 raft_consensus.cc:515] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.571358 15132 leader_election.cc:290] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 election: Requested vote from peers 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65:38319), 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66:43201)
I20260709 12:18:03.572288 14938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8601a1079224340af1ef76772a71514" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0698150b0f4540e59d9b2c38d2b67120"
I20260709 12:18:03.572499 15013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8601a1079224340af1ef76772a71514" candidate_uuid: "6306904386de4c94b3c995922471f706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "802e3cd97ba64233ab70fb75dad24372"
I20260709 12:18:03.572866 14938 raft_consensus.cc:3060] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.573063 15013 raft_consensus.cc:3060] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.578294 15013 raft_consensus.cc:2468] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 1.
I20260709 12:18:03.578294 14938 raft_consensus.cc:2468] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6306904386de4c94b3c995922471f706 in term 1.
I20260709 12:18:03.579507 15050 leader_election.cc:304] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0698150b0f4540e59d9b2c38d2b67120, 6306904386de4c94b3c995922471f706; no voters: 
I20260709 12:18:03.580183 15132 raft_consensus.cc:2804] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.580606 15132 raft_consensus.cc:697] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Becoming Leader. State: Replica: 6306904386de4c94b3c995922471f706, State: Running, Role: LEADER
I20260709 12:18:03.581375 15132 consensus_queue.cc:237] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.587848 14834 catalog_manager.cc:5697] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6306904386de4c94b3c995922471f706 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "6306904386de4c94b3c995922471f706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:03.629215 14884 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:03.743824 15132 consensus_queue.cc:1048] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:03.755908 15132 consensus_queue.cc:1048] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:03.782632 15134 raft_consensus.cc:493] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.783071 15134 raft_consensus.cc:515] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.784752 15132 consensus_queue.cc:1048] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:03.785373 15134 leader_election.cc:290] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65:38319), 6306904386de4c94b3c995922471f706 (127.4.78.67:37643)
I20260709 12:18:03.799944 14938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99" candidate_uuid: "802e3cd97ba64233ab70fb75dad24372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0698150b0f4540e59d9b2c38d2b67120" is_pre_election: true
I20260709 12:18:03.800652 14938 raft_consensus.cc:2468] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 802e3cd97ba64233ab70fb75dad24372 in term 0.
I20260709 12:18:03.801127 15087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99" candidate_uuid: "802e3cd97ba64233ab70fb75dad24372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6306904386de4c94b3c995922471f706" is_pre_election: true
I20260709 12:18:03.801869 14976 leader_election.cc:304] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0698150b0f4540e59d9b2c38d2b67120, 802e3cd97ba64233ab70fb75dad24372; no voters: 
I20260709 12:18:03.802328 15140 consensus_queue.cc:1048] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:03.801821 15087 raft_consensus.cc:2468] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 802e3cd97ba64233ab70fb75dad24372 in term 0.
I20260709 12:18:03.802783 15134 raft_consensus.cc:2804] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.803200 15134 raft_consensus.cc:493] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.803517 15134 raft_consensus.cc:3060] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.811082 15134 raft_consensus.cc:515] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.813782 15134 leader_election.cc:290] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [CANDIDATE]: Term 1 election: Requested vote from peers 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65:38319), 6306904386de4c94b3c995922471f706 (127.4.78.67:37643)
I20260709 12:18:03.813750 14937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99" candidate_uuid: "802e3cd97ba64233ab70fb75dad24372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0698150b0f4540e59d9b2c38d2b67120"
I20260709 12:18:03.814811 15087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99" candidate_uuid: "802e3cd97ba64233ab70fb75dad24372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6306904386de4c94b3c995922471f706"
I20260709 12:18:03.815240 14937 raft_consensus.cc:3060] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.815276 15087 raft_consensus.cc:3060] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.821182 14937 raft_consensus.cc:2468] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 802e3cd97ba64233ab70fb75dad24372 in term 1.
I20260709 12:18:03.822144 14976 leader_election.cc:304] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0698150b0f4540e59d9b2c38d2b67120, 802e3cd97ba64233ab70fb75dad24372; no voters: 
I20260709 12:18:03.822170 15087 raft_consensus.cc:2468] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 802e3cd97ba64233ab70fb75dad24372 in term 1.
I20260709 12:18:03.822801 15134 raft_consensus.cc:2804] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.823221 15134 raft_consensus.cc:697] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 1 LEADER]: Becoming Leader. State: Replica: 802e3cd97ba64233ab70fb75dad24372, State: Running, Role: LEADER
I20260709 12:18:03.823946 15134 consensus_queue.cc:237] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:03.830462 14834 catalog_manager.cc:5697] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "802e3cd97ba64233ab70fb75dad24372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:03.874900 15087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "009743499dcf48e7bd91e54d9e19ecb5"
dest_uuid: "6306904386de4c94b3c995922471f706"
mode: GRACEFUL
new_leader_uuid: "0698150b0f4540e59d9b2c38d2b67120"
 from {username='slave'} at 127.0.0.1:51140
I20260709 12:18:03.875409 15087 raft_consensus.cc:606] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Received request to transfer leadership to TS 0698150b0f4540e59d9b2c38d2b67120
I20260709 12:18:03.890319 15013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99"
dest_uuid: "802e3cd97ba64233ab70fb75dad24372"
mode: GRACEFUL
new_leader_uuid: "0698150b0f4540e59d9b2c38d2b67120"
 from {username='slave'} at 127.0.0.1:54440
I20260709 12:18:03.890974 15013 raft_consensus.cc:606] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 1 LEADER]: Received request to transfer leadership to TS 0698150b0f4540e59d9b2c38d2b67120
I20260709 12:18:03.895795 15087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8601a1079224340af1ef76772a71514"
dest_uuid: "6306904386de4c94b3c995922471f706"
mode: GRACEFUL
new_leader_uuid: "0698150b0f4540e59d9b2c38d2b67120"
 from {username='slave'} at 127.0.0.1:51140
I20260709 12:18:03.896286 15087 raft_consensus.cc:606] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Received request to transfer leadership to TS 0698150b0f4540e59d9b2c38d2b67120
I20260709 12:18:03.976199 15140 consensus_queue.cc:1048] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:03.982060 15132 raft_consensus.cc:993] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706: : Instructing follower 0698150b0f4540e59d9b2c38d2b67120 to start an election
I20260709 12:18:03.982796 15140 raft_consensus.cc:1081] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Signalling peer 0698150b0f4540e59d9b2c38d2b67120 to start an election
I20260709 12:18:03.984381 14938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8601a1079224340af1ef76772a71514"
dest_uuid: "0698150b0f4540e59d9b2c38d2b67120"
 from {username='slave'} at 127.0.0.1:50492
I20260709 12:18:03.985467 14938 raft_consensus.cc:493] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:03.985848 14938 raft_consensus.cc:3060] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:03.988827 15171 consensus_queue.cc:1048] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:03.993121 14938 raft_consensus.cc:515] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:04.001400 14938 leader_election.cc:290] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [CANDIDATE]: Term 2 election: Requested vote from peers 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66:43201), 6306904386de4c94b3c995922471f706 (127.4.78.67:37643)
I20260709 12:18:04.013631 15013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8601a1079224340af1ef76772a71514" candidate_uuid: "0698150b0f4540e59d9b2c38d2b67120" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "802e3cd97ba64233ab70fb75dad24372"
I20260709 12:18:04.014317 15013 raft_consensus.cc:3060] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.020496 15087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8601a1079224340af1ef76772a71514" candidate_uuid: "0698150b0f4540e59d9b2c38d2b67120" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6306904386de4c94b3c995922471f706"
I20260709 12:18:04.021126 15013 raft_consensus.cc:2468] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0698150b0f4540e59d9b2c38d2b67120 in term 2.
I20260709 12:18:04.021207 15087 raft_consensus.cc:3055] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:04.021697 15087 raft_consensus.cc:740] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6306904386de4c94b3c995922471f706, State: Running, Role: LEADER
I20260709 12:18:04.022323 14901 leader_election.cc:304] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0698150b0f4540e59d9b2c38d2b67120, 802e3cd97ba64233ab70fb75dad24372; no voters: 
I20260709 12:18:04.022588 15087 consensus_queue.cc:260] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:04.023082 15135 raft_consensus.cc:2804] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:04.023694 15087 raft_consensus.cc:3060] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.024302 15135 raft_consensus.cc:697] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 LEADER]: Becoming Leader. State: Replica: 0698150b0f4540e59d9b2c38d2b67120, State: Running, Role: LEADER
I20260709 12:18:04.025115 15135 consensus_queue.cc:237] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:04.030222 15087 raft_consensus.cc:2468] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0698150b0f4540e59d9b2c38d2b67120 in term 2.
I20260709 12:18:04.033293 14833 catalog_manager.cc:5697] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 reported cstate change: term changed from 1 to 2, leader changed from 6306904386de4c94b3c995922471f706 (127.4.78.67) to 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "0698150b0f4540e59d9b2c38d2b67120" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:04.159588 15132 raft_consensus.cc:993] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706: : Instructing follower 0698150b0f4540e59d9b2c38d2b67120 to start an election
I20260709 12:18:04.160039 15171 raft_consensus.cc:1081] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Signalling peer 0698150b0f4540e59d9b2c38d2b67120 to start an election
I20260709 12:18:04.161638 14938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "009743499dcf48e7bd91e54d9e19ecb5"
dest_uuid: "0698150b0f4540e59d9b2c38d2b67120"
 from {username='slave'} at 127.0.0.1:50492
I20260709 12:18:04.162262 14938 raft_consensus.cc:493] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:04.162585 14938 raft_consensus.cc:3060] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.168248 14938 raft_consensus.cc:515] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:04.170032 14938 leader_election.cc:290] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [CANDIDATE]: Term 2 election: Requested vote from peers 6306904386de4c94b3c995922471f706 (127.4.78.67:37643), 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66:43201)
I20260709 12:18:04.170869 15087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009743499dcf48e7bd91e54d9e19ecb5" candidate_uuid: "0698150b0f4540e59d9b2c38d2b67120" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6306904386de4c94b3c995922471f706"
I20260709 12:18:04.171123 15013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "009743499dcf48e7bd91e54d9e19ecb5" candidate_uuid: "0698150b0f4540e59d9b2c38d2b67120" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "802e3cd97ba64233ab70fb75dad24372"
I20260709 12:18:04.171537 15087 raft_consensus.cc:3055] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:04.171692 15013 raft_consensus.cc:3060] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.171947 15087 raft_consensus.cc:740] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6306904386de4c94b3c995922471f706, State: Running, Role: LEADER
I20260709 12:18:04.172920 15087 consensus_queue.cc:260] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:04.174181 15087 raft_consensus.cc:3060] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.177800 15013 raft_consensus.cc:2468] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0698150b0f4540e59d9b2c38d2b67120 in term 2.
I20260709 12:18:04.178951 14901 leader_election.cc:304] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0698150b0f4540e59d9b2c38d2b67120, 802e3cd97ba64233ab70fb75dad24372; no voters: 
I20260709 12:18:04.179800 15135 raft_consensus.cc:2804] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:04.180266 15135 raft_consensus.cc:697] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 LEADER]: Becoming Leader. State: Replica: 0698150b0f4540e59d9b2c38d2b67120, State: Running, Role: LEADER
I20260709 12:18:04.180703 15087 raft_consensus.cc:2468] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0698150b0f4540e59d9b2c38d2b67120 in term 2.
I20260709 12:18:04.181018 15135 consensus_queue.cc:237] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } }
I20260709 12:18:04.187554 14833 catalog_manager.cc:5697] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 reported cstate change: term changed from 1 to 2, leader changed from 6306904386de4c94b3c995922471f706 (127.4.78.67) to 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "0698150b0f4540e59d9b2c38d2b67120" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:04.234755 15134 consensus_queue.cc:1048] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.242234 15165 raft_consensus.cc:993] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372: : Instructing follower 0698150b0f4540e59d9b2c38d2b67120 to start an election
I20260709 12:18:04.242846 15134 raft_consensus.cc:1081] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 1 LEADER]: Signalling peer 0698150b0f4540e59d9b2c38d2b67120 to start an election
I20260709 12:18:04.244704 14937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99"
dest_uuid: "0698150b0f4540e59d9b2c38d2b67120"
 from {username='slave'} at 127.0.0.1:50508
I20260709 12:18:04.245338 14937 raft_consensus.cc:493] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:04.245719 14937 raft_consensus.cc:3060] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.250560 15134 consensus_queue.cc:1048] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.252348 14937 raft_consensus.cc:515] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:04.256680 15086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99" candidate_uuid: "0698150b0f4540e59d9b2c38d2b67120" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6306904386de4c94b3c995922471f706"
I20260709 12:18:04.257973 15013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99" candidate_uuid: "0698150b0f4540e59d9b2c38d2b67120" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "802e3cd97ba64233ab70fb75dad24372"
I20260709 12:18:04.258569 15013 raft_consensus.cc:3055] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:04.258807 15013 raft_consensus.cc:740] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 802e3cd97ba64233ab70fb75dad24372, State: Running, Role: LEADER
I20260709 12:18:04.259702 15013 consensus_queue.cc:260] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:04.260210 14937 leader_election.cc:290] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [CANDIDATE]: Term 2 election: Requested vote from peers 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66:43201), 6306904386de4c94b3c995922471f706 (127.4.78.67:37643)
I20260709 12:18:04.260799 15013 raft_consensus.cc:3060] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.266889 15013 raft_consensus.cc:2468] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0698150b0f4540e59d9b2c38d2b67120 in term 2.
I20260709 12:18:04.268033 14901 leader_election.cc:304] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0698150b0f4540e59d9b2c38d2b67120, 802e3cd97ba64233ab70fb75dad24372; no voters: 6306904386de4c94b3c995922471f706
I20260709 12:18:04.268805 15135 raft_consensus.cc:2804] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:04.269197 15135 raft_consensus.cc:697] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 LEADER]: Becoming Leader. State: Replica: 0698150b0f4540e59d9b2c38d2b67120, State: Running, Role: LEADER
I20260709 12:18:04.269876 15135 consensus_queue.cc:237] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:04.275564 14833 catalog_manager.cc:5697] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 reported cstate change: term changed from 1 to 2, leader changed from 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66) to 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "0698150b0f4540e59d9b2c38d2b67120" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:04.336803  4409 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:18:04.338323  4409 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:18:04.338683  4409 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:18:04.351908 14937 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99"
dest_uuid: "0698150b0f4540e59d9b2c38d2b67120"
mode: GRACEFUL
new_leader_uuid: "802e3cd97ba64233ab70fb75dad24372"
 from {username='slave'} at 127.0.0.1:50522
I20260709 12:18:04.352416 14937 raft_consensus.cc:606] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 LEADER]: Received request to transfer leadership to TS 802e3cd97ba64233ab70fb75dad24372
I20260709 12:18:04.353449  4409 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:18:04.409458 15013 raft_consensus.cc:1275] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Refusing update from remote peer 0698150b0f4540e59d9b2c38d2b67120: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:04.410759 15135 consensus_queue.cc:1048] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [LEADER]: Connected to new peer: Peer: permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:04.417878 15087 raft_consensus.cc:1275] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 2 FOLLOWER]: Refusing update from remote peer 0698150b0f4540e59d9b2c38d2b67120: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:04.419487 15181 consensus_queue.cc:1048] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:04.597808 15013 raft_consensus.cc:1275] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Refusing update from remote peer 0698150b0f4540e59d9b2c38d2b67120: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:04.598964 15181 consensus_queue.cc:1048] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [LEADER]: Connected to new peer: Peer: permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:04.606439 15087 raft_consensus.cc:1275] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 2 FOLLOWER]: Refusing update from remote peer 0698150b0f4540e59d9b2c38d2b67120: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:04.608253 15181 consensus_queue.cc:1048] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:04.707880 15013 raft_consensus.cc:1275] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Refusing update from remote peer 0698150b0f4540e59d9b2c38d2b67120: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:04.709039 15181 consensus_queue.cc:1048] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [LEADER]: Connected to new peer: Peer: permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:04.713474 15175 raft_consensus.cc:993] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120: : Instructing follower 802e3cd97ba64233ab70fb75dad24372 to start an election
I20260709 12:18:04.713922 15135 raft_consensus.cc:1081] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 LEADER]: Signalling peer 802e3cd97ba64233ab70fb75dad24372 to start an election
I20260709 12:18:04.716681 15013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99"
dest_uuid: "802e3cd97ba64233ab70fb75dad24372"
 from {username='slave'} at 127.0.0.1:54450
I20260709 12:18:04.717386 15013 raft_consensus.cc:493] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:04.717938 15013 raft_consensus.cc:3060] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:04.718000 15087 raft_consensus.cc:3060] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.724763 15013 raft_consensus.cc:515] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:04.725132 15087 raft_consensus.cc:1275] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 2 FOLLOWER]: Refusing update from remote peer 0698150b0f4540e59d9b2c38d2b67120: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:04.726585 15013 leader_election.cc:290] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [CANDIDATE]: Term 3 election: Requested vote from peers 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65:38319), 6306904386de4c94b3c995922471f706 (127.4.78.67:37643)
I20260709 12:18:04.726492 15181 consensus_queue.cc:1048] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:04.727214 14937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99" candidate_uuid: "802e3cd97ba64233ab70fb75dad24372" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0698150b0f4540e59d9b2c38d2b67120"
I20260709 12:18:04.727818 14937 raft_consensus.cc:3055] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:04.728073 14937 raft_consensus.cc:740] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0698150b0f4540e59d9b2c38d2b67120, State: Running, Role: LEADER
I20260709 12:18:04.728826 14937 consensus_queue.cc:260] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:04.729746 14937 raft_consensus.cc:3060] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:04.735162 14937 raft_consensus.cc:2468] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 802e3cd97ba64233ab70fb75dad24372 in term 3.
I20260709 12:18:04.736090 14976 leader_election.cc:304] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0698150b0f4540e59d9b2c38d2b67120, 802e3cd97ba64233ab70fb75dad24372; no voters: 
I20260709 12:18:04.736112 15087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9e8a1a45a9423f87970c479b8f9f99" candidate_uuid: "802e3cd97ba64233ab70fb75dad24372" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6306904386de4c94b3c995922471f706"
I20260709 12:18:04.736848 15087 raft_consensus.cc:3060] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:04.737011 15134 raft_consensus.cc:2804] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:04.737627 15134 raft_consensus.cc:697] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 3 LEADER]: Becoming Leader. State: Replica: 802e3cd97ba64233ab70fb75dad24372, State: Running, Role: LEADER
I20260709 12:18:04.738281 15134 consensus_queue.cc:237] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } }
I20260709 12:18:04.742841 15087 raft_consensus.cc:2468] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 802e3cd97ba64233ab70fb75dad24372 in term 3.
I20260709 12:18:04.744240 14834 catalog_manager.cc:5697] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 reported cstate change: term changed from 2 to 3, leader changed from 0698150b0f4540e59d9b2c38d2b67120 (127.4.78.65) to 802e3cd97ba64233ab70fb75dad24372 (127.4.78.66). New cstate: current_term: 3 leader_uuid: "802e3cd97ba64233ab70fb75dad24372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0698150b0f4540e59d9b2c38d2b67120" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 38319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "802e3cd97ba64233ab70fb75dad24372" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 43201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6306904386de4c94b3c995922471f706" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 37643 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:04.953631  4409 tablet_server.cc:179] TabletServer@127.4.78.65:0 shutting down...
I20260709 12:18:04.970855  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:04.971508  4409 tablet_replica.cc:333] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120: stopping tablet replica
I20260709 12:18:04.972093  4409 raft_consensus.cc:2243] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:04.972858  4409 raft_consensus.cc:2272] T d8601a1079224340af1ef76772a71514 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:04.975229  4409 tablet_replica.cc:333] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120: stopping tablet replica
I20260709 12:18:04.975741  4409 raft_consensus.cc:2243] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:04.976480  4409 raft_consensus.cc:2272] T 009743499dcf48e7bd91e54d9e19ecb5 P 0698150b0f4540e59d9b2c38d2b67120 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:04.978543  4409 tablet_replica.cc:333] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120: stopping tablet replica
I20260709 12:18:04.979027  4409 raft_consensus.cc:2243] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:04.979419  4409 raft_consensus.cc:2272] T cb9e8a1a45a9423f87970c479b8f9f99 P 0698150b0f4540e59d9b2c38d2b67120 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:04.981451  4409 tablet_replica.cc:333] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120: stopping tablet replica
I20260709 12:18:04.981951  4409 raft_consensus.cc:2243] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:04.982321  4409 raft_consensus.cc:2272] T 63d57218055847c0b3eeee0f1e2bf99f P 0698150b0f4540e59d9b2c38d2b67120 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.004159  4409 tablet_server.cc:196] TabletServer@127.4.78.65:0 shutdown complete.
I20260709 12:18:05.015774  4409 tablet_server.cc:179] TabletServer@127.4.78.66:0 shutting down...
I20260709 12:18:05.032584  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:05.033226  4409 tablet_replica.cc:333] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372: stopping tablet replica
I20260709 12:18:05.033959  4409 raft_consensus.cc:2243] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:05.034471  4409 raft_consensus.cc:2272] T d8601a1079224340af1ef76772a71514 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.036844  4409 tablet_replica.cc:333] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372: stopping tablet replica
I20260709 12:18:05.037365  4409 raft_consensus.cc:2243] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:05.037993  4409 pending_rounds.cc:70] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372: Trying to abort 1 pending ops.
I20260709 12:18:05.038151  4409 pending_rounds.cc:77] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305623489495068672 op_type: NO_OP noop_request { }
I20260709 12:18:05.038432  4409 raft_consensus.cc:2889] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:05.038679  4409 raft_consensus.cc:2272] T cb9e8a1a45a9423f87970c479b8f9f99 P 802e3cd97ba64233ab70fb75dad24372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.040614  4409 tablet_replica.cc:333] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372: stopping tablet replica
I20260709 12:18:05.041100  4409 raft_consensus.cc:2243] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:05.041472  4409 raft_consensus.cc:2272] T 63d57218055847c0b3eeee0f1e2bf99f P 802e3cd97ba64233ab70fb75dad24372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.043133  4409 tablet_replica.cc:333] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372: stopping tablet replica
I20260709 12:18:05.043569  4409 raft_consensus.cc:2243] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:05.043941  4409 raft_consensus.cc:2272] T 009743499dcf48e7bd91e54d9e19ecb5 P 802e3cd97ba64233ab70fb75dad24372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.065855  4409 tablet_server.cc:196] TabletServer@127.4.78.66:0 shutdown complete.
I20260709 12:18:05.077788  4409 tablet_server.cc:179] TabletServer@127.4.78.67:0 shutting down...
I20260709 12:18:05.093611  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:05.094210  4409 tablet_replica.cc:333] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706: stopping tablet replica
I20260709 12:18:05.094712  4409 raft_consensus.cc:2243] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:05.095124  4409 raft_consensus.cc:2272] T d8601a1079224340af1ef76772a71514 P 6306904386de4c94b3c995922471f706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.097091  4409 tablet_replica.cc:333] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706: stopping tablet replica
I20260709 12:18:05.097563  4409 raft_consensus.cc:2243] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:05.097985  4409 raft_consensus.cc:2272] T cb9e8a1a45a9423f87970c479b8f9f99 P 6306904386de4c94b3c995922471f706 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.099995  4409 tablet_replica.cc:333] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706: stopping tablet replica
I20260709 12:18:05.100442  4409 raft_consensus.cc:2243] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:05.101110  4409 raft_consensus.cc:2272] T 63d57218055847c0b3eeee0f1e2bf99f P 6306904386de4c94b3c995922471f706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.102850  4409 tablet_replica.cc:333] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706: stopping tablet replica
I20260709 12:18:05.103264  4409 raft_consensus.cc:2243] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:05.103605  4409 raft_consensus.cc:2272] T 009743499dcf48e7bd91e54d9e19ecb5 P 6306904386de4c94b3c995922471f706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.124352  4409 tablet_server.cc:196] TabletServer@127.4.78.67:0 shutdown complete.
I20260709 12:18:05.136916  4409 master.cc:562] Master@127.4.78.126:34115 shutting down...
I20260709 12:18:05.151588  4409 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:05.152120  4409 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:05.152412  4409 tablet_replica.cc:333] T 00000000000000000000000000000000 P b31cd0ddcc72447298f3209b4adf8794: stopping tablet replica
I20260709 12:18:05.169880  4409 master.cc:584] Master@127.4.78.126:34115 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2705 ms)
[----------] 6 tests from LeaderRebalancerTest (379945 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:18:05.205804  4409 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.78.126:44551
I20260709 12:18:05.207288  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:05.212860 15182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:05.214355 15185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:05.214346 15183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:05.214797  4409 server_base.cc:1061] running on GCE node
I20260709 12:18:05.215777  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:05.215945  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:05.216102  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599485216087 us; error 0 us; skew 500 ppm
I20260709 12:18:05.216609  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:05.219338  4409 webserver.cc:533] Webserver started at http://127.4.78.126:38091/ using document root <none> and password file <none>
I20260709 12:18:05.219786  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:05.219952  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:05.220206  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:05.221215  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/master-0-root/instance:
uuid: "ba7116787a414414ac2509fdac078b71"
format_stamp: "Formatted at 2026-07-09 12:18:05 on dist-test-slave-9t7s"
I20260709 12:18:05.225351  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:18:05.228425 15190 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:05.229066  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:18:05.229329  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/master-0-root
uuid: "ba7116787a414414ac2509fdac078b71"
format_stamp: "Formatted at 2026-07-09 12:18:05 on dist-test-slave-9t7s"
I20260709 12:18:05.229571  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:05.250725  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:05.251762  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:05.285276  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.126:44551
I20260709 12:18:05.285368 15241 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.126:44551 every 8 connection(s)
I20260709 12:18:05.288944 15242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.299144 15242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71: Bootstrap starting.
I20260709 12:18:05.303829 15242 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.307785 15242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71: No bootstrap required, opened a new log
I20260709 12:18:05.309931 15242 raft_consensus.cc:359] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7116787a414414ac2509fdac078b71" member_type: VOTER }
I20260709 12:18:05.310329 15242 raft_consensus.cc:385] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.310503 15242 raft_consensus.cc:740] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7116787a414414ac2509fdac078b71, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.311065 15242 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7116787a414414ac2509fdac078b71" member_type: VOTER }
I20260709 12:18:05.311497 15242 raft_consensus.cc:399] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:05.311682 15242 raft_consensus.cc:493] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:05.311897 15242 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:05.316752 15242 raft_consensus.cc:515] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7116787a414414ac2509fdac078b71" member_type: VOTER }
I20260709 12:18:05.317207 15242 leader_election.cc:304] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba7116787a414414ac2509fdac078b71; no voters: 
I20260709 12:18:05.318300 15242 leader_election.cc:290] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:05.318619 15245 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:05.319986 15245 raft_consensus.cc:697] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [term 1 LEADER]: Becoming Leader. State: Replica: ba7116787a414414ac2509fdac078b71, State: Running, Role: LEADER
I20260709 12:18:05.320575 15245 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7116787a414414ac2509fdac078b71" member_type: VOTER }
I20260709 12:18:05.321162 15242 sys_catalog.cc:565] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:05.323386 15247 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba7116787a414414ac2509fdac078b71. Latest consensus state: current_term: 1 leader_uuid: "ba7116787a414414ac2509fdac078b71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7116787a414414ac2509fdac078b71" member_type: VOTER } }
I20260709 12:18:05.323378 15246 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba7116787a414414ac2509fdac078b71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba7116787a414414ac2509fdac078b71" member_type: VOTER } }
I20260709 12:18:05.324095 15247 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:05.324203 15246 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:05.331993 15251 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:05.336467 15251 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:05.337525  4409 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:05.344828 15251 catalog_manager.cc:1383] Generated new cluster ID: 40eb37f2178d44398fc05f52c468e252
I20260709 12:18:05.345129 15251 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:05.359287 15251 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:05.360496 15251 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:05.375226 15251 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71: Generated new TSK 0
I20260709 12:18:05.375813 15251 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:05.403947  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:05.409260 15263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:05.410154 15264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:05.412048 15266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:05.412300  4409 server_base.cc:1061] running on GCE node
I20260709 12:18:05.413169  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:05.413363  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:05.413518  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599485413503 us; error 0 us; skew 500 ppm
I20260709 12:18:05.414055  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:05.416103  4409 webserver.cc:533] Webserver started at http://127.4.78.65:37383/ using document root <none> and password file <none>
I20260709 12:18:05.416548  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:05.416719  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:05.416953  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:05.418044  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-0-root/instance:
uuid: "40fb690455fd4a778fbe670376d73807"
format_stamp: "Formatted at 2026-07-09 12:18:05 on dist-test-slave-9t7s"
I20260709 12:18:05.422246  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:18:05.425633 15271 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:05.426404  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:18:05.426724  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-0-root
uuid: "40fb690455fd4a778fbe670376d73807"
format_stamp: "Formatted at 2026-07-09 12:18:05 on dist-test-slave-9t7s"
I20260709 12:18:05.427049  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:05.443252  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:05.444289  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:05.445626  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:05.447753  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:05.447924  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:05.448160  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:05.448298  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:05.484122  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.65:46187
I20260709 12:18:05.484218 15333 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.65:46187 every 8 connection(s)
I20260709 12:18:05.488739  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:05.495417 15338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:05.496732 15339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:05.497694  4409 server_base.cc:1061] running on GCE node
W20260709 12:18:05.499306 15342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:05.500085 15334 heartbeater.cc:344] Connected to a master server at 127.4.78.126:44551
I20260709 12:18:05.500241  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:18:05.500437 15334 heartbeater.cc:461] Registering TS with master...
W20260709 12:18:05.500546  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:05.500833  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599485500814 us; error 0 us; skew 500 ppm
I20260709 12:18:05.501247 15334 heartbeater.cc:507] Master 127.4.78.126:44551 requested a full tablet report, sending...
I20260709 12:18:05.501384  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:05.503494 15207 ts_manager.cc:194] Registered new tserver with Master: 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187)
I20260709 12:18:05.503789  4409 webserver.cc:533] Webserver started at http://127.4.78.66:46125/ using document root <none> and password file <none>
I20260709 12:18:05.504426  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:05.504658  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:05.504984  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:05.505810 15207 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40062
I20260709 12:18:05.506393  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-1-root/instance:
uuid: "cfcfc154929046d2a604387040d29ca2"
format_stamp: "Formatted at 2026-07-09 12:18:05 on dist-test-slave-9t7s"
I20260709 12:18:05.510504  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:18:05.513365 15346 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:05.514073  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:18:05.514309  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-1-root
uuid: "cfcfc154929046d2a604387040d29ca2"
format_stamp: "Formatted at 2026-07-09 12:18:05 on dist-test-slave-9t7s"
I20260709 12:18:05.514544  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:05.529217  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:05.530215  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:05.531442  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:05.533449  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:05.533629  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:05.533869  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:05.534017  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:05.568688  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.66:35767
I20260709 12:18:05.568791 15408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.66:35767 every 8 connection(s)
I20260709 12:18:05.573238  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:05.579715 15413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:05.580092 15412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:05.583384 15409 heartbeater.cc:344] Connected to a master server at 127.4.78.126:44551
I20260709 12:18:05.583894 15409 heartbeater.cc:461] Registering TS with master...
W20260709 12:18:05.584046 15415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:05.584739 15409 heartbeater.cc:507] Master 127.4.78.126:44551 requested a full tablet report, sending...
I20260709 12:18:05.585029  4409 server_base.cc:1061] running on GCE node
I20260709 12:18:05.586020  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:05.586216  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:05.586396  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599485586380 us; error 0 us; skew 500 ppm
I20260709 12:18:05.587107  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:05.587110 15207 ts_manager.cc:194] Registered new tserver with Master: cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:05.589051 15207 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40068
I20260709 12:18:05.589849  4409 webserver.cc:533] Webserver started at http://127.4.78.67:43045/ using document root <none> and password file <none>
I20260709 12:18:05.590502  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:05.590734  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:05.591042  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:05.592186  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-2-root/instance:
uuid: "376f0d1f5e014993bc041d3f3815f1ef"
format_stamp: "Formatted at 2026-07-09 12:18:05 on dist-test-slave-9t7s"
I20260709 12:18:05.596225  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:18:05.599267 15420 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:05.599967  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:18:05.600214  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-2-root
uuid: "376f0d1f5e014993bc041d3f3815f1ef"
format_stamp: "Formatted at 2026-07-09 12:18:05 on dist-test-slave-9t7s"
I20260709 12:18:05.600463  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599105096696-4409-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:05.633965  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:05.634938  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:05.636252  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:05.638398  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:05.638586  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:05.638803  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:05.638952  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:05.673972  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.67:45481
I20260709 12:18:05.674073 15482 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.67:45481 every 8 connection(s)
I20260709 12:18:05.686770 15483 heartbeater.cc:344] Connected to a master server at 127.4.78.126:44551
I20260709 12:18:05.687203 15483 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:05.687883 15483 heartbeater.cc:507] Master 127.4.78.126:44551 requested a full tablet report, sending...
I20260709 12:18:05.689726 15207 ts_manager.cc:194] Registered new tserver with Master: 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:05.689934  4409 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013036576s
I20260709 12:18:05.691030 15207 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40078
I20260709 12:18:05.712734 15207 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40082:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:05.715179 15207 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:05.776890 15374 tablet_service.cc:1511] Processing CreateTablet for tablet 2852e548dc65469abd36a65d8b6b2559 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:05.777386 15299 tablet_service.cc:1511] Processing CreateTablet for tablet 2852e548dc65469abd36a65d8b6b2559 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:05.779034 15299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2852e548dc65469abd36a65d8b6b2559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.778662 15373 tablet_service.cc:1511] Processing CreateTablet for tablet 871ff99eb1ce422c8ede104ce618c2e2 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:05.780170 15373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871ff99eb1ce422c8ede104ce618c2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.780435 15298 tablet_service.cc:1511] Processing CreateTablet for tablet 871ff99eb1ce422c8ede104ce618c2e2 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:05.782730 15297 tablet_service.cc:1511] Processing CreateTablet for tablet a36d5ce297d642f0b8d6a39be10b4dcf (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:05.784008 15297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36d5ce297d642f0b8d6a39be10b4dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.786479 15374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2852e548dc65469abd36a65d8b6b2559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.790270 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871ff99eb1ce422c8ede104ce618c2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.805011 15372 tablet_service.cc:1511] Processing CreateTablet for tablet a36d5ce297d642f0b8d6a39be10b4dcf (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:05.806392 15372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36d5ce297d642f0b8d6a39be10b4dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.808656 15296 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2be86f2b0d4debb255d35e38fefc7b (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:05.809991 15296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2be86f2b0d4debb255d35e38fefc7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.816143 15371 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2be86f2b0d4debb255d35e38fefc7b (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:05.817523 15371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2be86f2b0d4debb255d35e38fefc7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.821105 15297 tablet_service.cc:1511] Processing CreateTablet for tablet 6575b35e91424d748cb8970584e2af56 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:05.822613 15297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6575b35e91424d748cb8970584e2af56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.830148 15370 tablet_service.cc:1511] Processing CreateTablet for tablet 6575b35e91424d748cb8970584e2af56 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:05.831516 15370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6575b35e91424d748cb8970584e2af56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.836930 15299 tablet_service.cc:1511] Processing CreateTablet for tablet b2e2117b92054e8692ab0a648e9034ef (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:05.838663 15299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e2117b92054e8692ab0a648e9034ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.839002 15448 tablet_service.cc:1511] Processing CreateTablet for tablet 2852e548dc65469abd36a65d8b6b2559 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:05.840243 15448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2852e548dc65469abd36a65d8b6b2559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.842741 15444 tablet_service.cc:1511] Processing CreateTablet for tablet 6575b35e91424d748cb8970584e2af56 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:05.844095 15444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6575b35e91424d748cb8970584e2af56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.846735 15445 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2be86f2b0d4debb255d35e38fefc7b (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:05.848029 15445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2be86f2b0d4debb255d35e38fefc7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.850694 15446 tablet_service.cc:1511] Processing CreateTablet for tablet a36d5ce297d642f0b8d6a39be10b4dcf (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:05.851920 15446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36d5ce297d642f0b8d6a39be10b4dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.853434 15295 tablet_service.cc:1511] Processing CreateTablet for tablet b8f28ced2be34f94a52200f6cdc787c9 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:05.854732 15295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f28ced2be34f94a52200f6cdc787c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.857219 15369 tablet_service.cc:1511] Processing CreateTablet for tablet b2e2117b92054e8692ab0a648e9034ef (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:05.854636 15447 tablet_service.cc:1511] Processing CreateTablet for tablet 871ff99eb1ce422c8ede104ce618c2e2 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:05.858566 15447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871ff99eb1ce422c8ede104ce618c2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.859601 15368 tablet_service.cc:1511] Processing CreateTablet for tablet b8f28ced2be34f94a52200f6cdc787c9 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:05.861292 15443 tablet_service.cc:1511] Processing CreateTablet for tablet b2e2117b92054e8692ab0a648e9034ef (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:05.862565 15443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e2117b92054e8692ab0a648e9034ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.864837 15294 tablet_service.cc:1511] Processing CreateTablet for tablet 324ce7d305c2400f8be7dc122371aea5 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:05.866168 15294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 324ce7d305c2400f8be7dc122371aea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.858536 15369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e2117b92054e8692ab0a648e9034ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.871162 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f28ced2be34f94a52200f6cdc787c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.872632 15442 tablet_service.cc:1511] Processing CreateTablet for tablet b8f28ced2be34f94a52200f6cdc787c9 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:05.873934 15442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f28ced2be34f94a52200f6cdc787c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.883339 15499 tablet_bootstrap.cc:492] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:05.888741 15499 tablet_bootstrap.cc:654] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.905483 15372 tablet_service.cc:1511] Processing CreateTablet for tablet 324ce7d305c2400f8be7dc122371aea5 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:05.927812 15448 tablet_service.cc:1511] Processing CreateTablet for tablet 324ce7d305c2400f8be7dc122371aea5 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:05.929288 15448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 324ce7d305c2400f8be7dc122371aea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.931445 15298 tablet_service.cc:1511] Processing CreateTablet for tablet ed9c4cb9c00045619b0ba92cf7622817 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:05.933897 15374 tablet_service.cc:1511] Processing CreateTablet for tablet ed9c4cb9c00045619b0ba92cf7622817 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:05.936177 15441 tablet_service.cc:1511] Processing CreateTablet for tablet ed9c4cb9c00045619b0ba92cf7622817 (DEFAULT_TABLE table=test-workload [id=376f38aaadbc4c218b2845bd029c9a2a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:05.937569 15441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9c4cb9c00045619b0ba92cf7622817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.938464 15499 tablet_bootstrap.cc:492] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:05.939008 15499 ts_tablet_manager.cc:1403] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.004s
I20260709 12:18:05.927699 15498 tablet_bootstrap.cc:492] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:05.941948 15499 raft_consensus.cc:359] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:05.944088 15499 raft_consensus.cc:385] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.944434 15499 raft_consensus.cc:740] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.949635 15372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 324ce7d305c2400f8be7dc122371aea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.953205 15374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9c4cb9c00045619b0ba92cf7622817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.954097 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9c4cb9c00045619b0ba92cf7622817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.960125 15498 tablet_bootstrap.cc:654] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.967967 15500 tablet_bootstrap.cc:492] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:05.945351 15499 consensus_queue.cc:260] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:05.977136 15500 tablet_bootstrap.cc:654] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.981295 15499 ts_tablet_manager.cc:1434] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.005s
I20260709 12:18:05.982161 15409 heartbeater.cc:499] Master 127.4.78.126:44551 was elected leader, sending a full tablet report...
I20260709 12:18:05.983918 15498 tablet_bootstrap.cc:492] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:05.984457 15498 ts_tablet_manager.cc:1403] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.057s	user 0.006s	sys 0.005s
I20260709 12:18:05.985980 15499 tablet_bootstrap.cc:492] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:05.991225 15499 tablet_bootstrap.cc:654] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.992120 15498 raft_consensus.cc:359] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:05.992970 15498 raft_consensus.cc:385] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.993295 15498 raft_consensus.cc:740] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.994194 15500 tablet_bootstrap.cc:492] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:05.994235 15498 consensus_queue.cc:260] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:05.995039 15500 ts_tablet_manager.cc:1403] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.011s
I20260709 12:18:05.998030 15499 tablet_bootstrap.cc:492] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:05.998754 15499 ts_tablet_manager.cc:1403] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 12:18:05.998633 15500 raft_consensus.cc:359] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:05.999599 15500 raft_consensus.cc:385] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.999938 15500 raft_consensus.cc:740] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.000840 15500 consensus_queue.cc:260] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.002213 15499 raft_consensus.cc:359] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.003139 15499 raft_consensus.cc:385] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.003484 15499 raft_consensus.cc:740] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.004387 15499 consensus_queue.cc:260] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.007054 15499 ts_tablet_manager.cc:1434] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:18:06.007995 15498 ts_tablet_manager.cc:1434] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.005s
I20260709 12:18:06.008129 15499 tablet_bootstrap.cc:492] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:06.008692 15334 heartbeater.cc:499] Master 127.4.78.126:44551 was elected leader, sending a full tablet report...
I20260709 12:18:06.009711 15483 heartbeater.cc:499] Master 127.4.78.126:44551 was elected leader, sending a full tablet report...
I20260709 12:18:06.010144 15500 ts_tablet_manager.cc:1434] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 12:18:06.011210 15500 tablet_bootstrap.cc:492] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:06.017143 15500 tablet_bootstrap.cc:654] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.018739 15498 tablet_bootstrap.cc:492] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:06.020073 15499 tablet_bootstrap.cc:654] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.024884 15498 tablet_bootstrap.cc:654] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.030913 15500 tablet_bootstrap.cc:492] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:06.031540 15500 ts_tablet_manager.cc:1403] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:18:06.034776 15498 tablet_bootstrap.cc:492] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:06.034521 15500 raft_consensus.cc:359] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.035230 15500 raft_consensus.cc:385] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.035331 15498 ts_tablet_manager.cc:1403] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:18:06.035555 15500 raft_consensus.cc:740] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.036454 15500 consensus_queue.cc:260] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.038837 15500 ts_tablet_manager.cc:1434] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:06.038501 15498 raft_consensus.cc:359] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.039275 15498 raft_consensus.cc:385] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.039546 15498 raft_consensus.cc:740] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.040205 15498 consensus_queue.cc:260] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.043808 15498 ts_tablet_manager.cc:1434] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:18:06.045464 15498 tablet_bootstrap.cc:492] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:06.046164 15500 tablet_bootstrap.cc:492] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:06.050582 15499 tablet_bootstrap.cc:492] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:06.051198 15499 ts_tablet_manager.cc:1403] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.016s
I20260709 12:18:06.052372 15500 tablet_bootstrap.cc:654] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.054309 15499 raft_consensus.cc:359] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.055150 15499 raft_consensus.cc:385] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.055507 15499 raft_consensus.cc:740] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.056407 15499 consensus_queue.cc:260] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.058699 15499 ts_tablet_manager.cc:1434] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:18:06.059444 15500 tablet_bootstrap.cc:492] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:06.059773 15499 tablet_bootstrap.cc:492] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:06.060192 15500 ts_tablet_manager.cc:1403] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 12:18:06.051242 15498 tablet_bootstrap.cc:654] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.063616 15500 raft_consensus.cc:359] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.064486 15500 raft_consensus.cc:385] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.064852 15500 raft_consensus.cc:740] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.065945 15500 consensus_queue.cc:260] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.066517 15499 tablet_bootstrap.cc:654] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.072587 15506 raft_consensus.cc:493] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.073092 15506 raft_consensus.cc:515] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.072324 15500 ts_tablet_manager.cc:1434] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:18:06.076289 15506 leader_election.cc:290] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.082029 15498 tablet_bootstrap.cc:492] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:06.083316 15499 tablet_bootstrap.cc:492] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:06.083933 15499 ts_tablet_manager.cc:1403] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.001s
I20260709 12:18:06.086906 15499 raft_consensus.cc:359] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.087317 15498 ts_tablet_manager.cc:1403] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.008s
I20260709 12:18:06.087675 15499 raft_consensus.cc:385] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.088039 15499 raft_consensus.cc:740] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.090274 15500 tablet_bootstrap.cc:492] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:06.090199 15498 raft_consensus.cc:359] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.091130 15498 raft_consensus.cc:385] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.091442 15498 raft_consensus.cc:740] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.092360 15498 consensus_queue.cc:260] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.094625 15498 ts_tablet_manager.cc:1434] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:06.095602 15498 tablet_bootstrap.cc:492] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:06.097110 15500 tablet_bootstrap.cc:654] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.091425 15499 consensus_queue.cc:260] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.099640 15499 ts_tablet_manager.cc:1434] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:18:06.100664 15499 tablet_bootstrap.cc:492] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:06.101719 15498 tablet_bootstrap.cc:654] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.108635 15500 tablet_bootstrap.cc:492] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:06.109155 15499 tablet_bootstrap.cc:654] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.109179 15500 ts_tablet_manager.cc:1403] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 12:18:06.112618 15500 raft_consensus.cc:359] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.113395 15500 raft_consensus.cc:385] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.113695 15500 raft_consensus.cc:740] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.114617 15500 consensus_queue.cc:260] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.118944 15500 ts_tablet_manager.cc:1434] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:06.119966 15500 tablet_bootstrap.cc:492] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:06.120996 15499 tablet_bootstrap.cc:492] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:06.121634 15499 ts_tablet_manager.cc:1403] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 12:18:06.121706 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871ff99eb1ce422c8ede104ce618c2e2" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:06.122500 15458 raft_consensus.cc:2468] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:06.124797 15499 raft_consensus.cc:359] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.125643 15499 raft_consensus.cc:385] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.125988 15499 raft_consensus.cc:740] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.126219 15500 tablet_bootstrap.cc:654] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.126907 15499 consensus_queue.cc:260] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.127266 15274 leader_election.cc:304] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:06.128080 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871ff99eb1ce422c8ede104ce618c2e2" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:06.128764 15384 raft_consensus.cc:2468] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:06.128901 15507 raft_consensus.cc:493] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.129554 15507 raft_consensus.cc:515] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.131176 15499 ts_tablet_manager.cc:1434] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:18:06.132246 15499 tablet_bootstrap.cc:492] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:06.135123 15503 raft_consensus.cc:493] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.135609 15503 raft_consensus.cc:515] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.129262 15506 raft_consensus.cc:2804] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.138080 15506 raft_consensus.cc:493] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.138172 15503 leader_election.cc:290] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.138441 15506 raft_consensus.cc:3060] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.146178 15506 raft_consensus.cc:515] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.148881 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871ff99eb1ce422c8ede104ce618c2e2" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:06.149456 15384 raft_consensus.cc:3060] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.152518 15507 leader_election.cc:290] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:06.156620 15384 raft_consensus.cc:2468] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:06.157970 15272 leader_election.cc:304] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.167927 15506 leader_election.cc:290] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.168267 15500 tablet_bootstrap.cc:492] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:06.168454 15506 raft_consensus.cc:2804] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.168817 15500 ts_tablet_manager.cc:1403] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.000s
I20260709 12:18:06.169010 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871ff99eb1ce422c8ede104ce618c2e2" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:06.169647 15458 raft_consensus.cc:3060] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.172084 15500 raft_consensus.cc:359] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.172899 15500 raft_consensus.cc:385] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.173192 15500 raft_consensus.cc:740] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.174117 15500 consensus_queue.cc:260] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.177016 15458 raft_consensus.cc:2468] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:06.168977 15506 raft_consensus.cc:697] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:06.183542 15506 consensus_queue.cc:237] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.185806 15500 ts_tablet_manager.cc:1434] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:18:06.186748 15523 raft_consensus.cc:493] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.187268 15523 raft_consensus.cc:515] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.189620 15499 tablet_bootstrap.cc:654] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.190127 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2852e548dc65469abd36a65d8b6b2559" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:06.190773 15384 raft_consensus.cc:2468] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:06.191994 15272 leader_election.cc:304] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.195565 15523 leader_election.cc:290] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.196118 15523 raft_consensus.cc:2804] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.196420 15523 raft_consensus.cc:493] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.196911 15523 raft_consensus.cc:3060] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.196382 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:06.198061 15309 raft_consensus.cc:2468] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 0.
I20260709 12:18:06.199391 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:06.199921 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:06.200129 15308 raft_consensus.cc:2468] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 0.
I20260709 12:18:06.197083 15498 tablet_bootstrap.cc:492] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:06.201212 15498 ts_tablet_manager.cc:1403] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.106s	user 0.030s	sys 0.040s
I20260709 12:18:06.202589 15424 leader_election.cc:304] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:06.200611 15384 raft_consensus.cc:2468] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 0.
I20260709 12:18:06.203634 15507 raft_consensus.cc:2804] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.204016 15507 raft_consensus.cc:493] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.204356 15507 raft_consensus.cc:3060] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.206952 15350 leader_election.cc:304] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.208051 15503 raft_consensus.cc:2804] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.208451 15503 raft_consensus.cc:493] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.208798 15503 raft_consensus.cc:3060] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.212476 15498 raft_consensus.cc:359] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.213567 15498 raft_consensus.cc:385] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.213920 15498 raft_consensus.cc:740] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.215004 15500 tablet_bootstrap.cc:492] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:06.214686 15498 consensus_queue.cc:260] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.217039 15498 ts_tablet_manager.cc:1434] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 12:18:06.217419 15503 raft_consensus.cc:515] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.218170 15498 tablet_bootstrap.cc:492] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:06.219213 15523 raft_consensus.cc:515] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.220096 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:06.220701 15308 raft_consensus.cc:3060] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.222885 15507 raft_consensus.cc:515] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.224896 15498 tablet_bootstrap.cc:654] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.225114 15507 leader_election.cc:290] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:06.226006 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:06.227149 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:06.227885 15384 raft_consensus.cc:2393] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 376f0d1f5e014993bc041d3f3815f1ef in current term 1: Already voted for candidate cfcfc154929046d2a604387040d29ca2 in this term.
I20260709 12:18:06.229223 15421 leader_election.cc:304] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef; no voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:06.229465 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:06.230252 15458 raft_consensus.cc:2393] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfcfc154929046d2a604387040d29ca2 in current term 1: Already voted for candidate 376f0d1f5e014993bc041d3f3815f1ef in this term.
I20260709 12:18:06.230350 15308 raft_consensus.cc:2468] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 1.
I20260709 12:18:06.230629 15507 raft_consensus.cc:2749] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:06.232350 15350 leader_election.cc:304] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.232648 15500 tablet_bootstrap.cc:654] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.234676 15503 leader_election.cc:290] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.235260 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2852e548dc65469abd36a65d8b6b2559" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:06.235814 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:06.235952 15458 raft_consensus.cc:2468] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:06.236629 15457 raft_consensus.cc:2393] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cfcfc154929046d2a604387040d29ca2 in current term 1: Already voted for candidate 376f0d1f5e014993bc041d3f3815f1ef in this term.
I20260709 12:18:06.235270 15503 raft_consensus.cc:2804] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.238003 15503 raft_consensus.cc:697] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:06.241143 15523 leader_election.cc:290] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.242031 15503 consensus_queue.cc:237] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.242309 15205 catalog_manager.cc:5697] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.239063 15499 tablet_bootstrap.cc:492] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:06.241115 15528 raft_consensus.cc:493] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.239602 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2852e548dc65469abd36a65d8b6b2559" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:06.246412 15384 raft_consensus.cc:3060] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.246279 15528 raft_consensus.cc:515] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.248848 15528 leader_election.cc:290] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.245949 15499 ts_tablet_manager.cc:1403] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.004s
I20260709 12:18:06.249807 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:06.250686 15308 raft_consensus.cc:2468] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 0.
I20260709 12:18:06.253988 15350 leader_election.cc:304] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.253474 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:06.255333 15457 raft_consensus.cc:2468] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 0.
I20260709 12:18:06.256254 15528 raft_consensus.cc:2804] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.253263 15499 raft_consensus.cc:359] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.256649 15528 raft_consensus.cc:493] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.257087 15528 raft_consensus.cc:3060] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.262310 15204 catalog_manager.cc:5697] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.264425 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2852e548dc65469abd36a65d8b6b2559" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:06.265216 15457 raft_consensus.cc:3060] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.270553 15528 raft_consensus.cc:515] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.273151 15457 raft_consensus.cc:2468] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:06.257007 15499 raft_consensus.cc:385] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.273998 15499 raft_consensus.cc:740] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.274950 15499 consensus_queue.cc:260] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.277336 15499 ts_tablet_manager.cc:1434] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:18:06.278528 15499 tablet_bootstrap.cc:492] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:06.278360 15528 leader_election.cc:290] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.279765 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:06.280499 15458 raft_consensus.cc:3060] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.278242 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:06.282831 15274 leader_election.cc:304] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:06.283618 15308 raft_consensus.cc:3060] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.286916 15523 raft_consensus.cc:2804] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.287744 15523 raft_consensus.cc:697] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:06.288728 15523 consensus_queue.cc:237] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.300758 15499 tablet_bootstrap.cc:654] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.300863 15384 raft_consensus.cc:2468] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:06.300668 15308 raft_consensus.cc:2468] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 1.
I20260709 12:18:06.305748 15350 leader_election.cc:304] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.306718 15528 raft_consensus.cc:2804] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.309047 15528 raft_consensus.cc:697] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:06.311074 15528 consensus_queue.cc:237] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.312544 15498 tablet_bootstrap.cc:492] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:06.313207 15498 ts_tablet_manager.cc:1403] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.028s
I20260709 12:18:06.327795 15499 tablet_bootstrap.cc:492] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:06.328495 15499 ts_tablet_manager.cc:1403] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.001s
I20260709 12:18:06.328881 15458 raft_consensus.cc:2468] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 1.
I20260709 12:18:06.325486 15498 raft_consensus.cc:359] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.330931 15498 raft_consensus.cc:385] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.331243 15498 raft_consensus.cc:740] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.331835 15500 tablet_bootstrap.cc:492] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:06.333338 15500 ts_tablet_manager.cc:1403] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.127s	user 0.033s	sys 0.046s
I20260709 12:18:06.332710 15498 consensus_queue.cc:260] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.334049 15499 raft_consensus.cc:359] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.334779 15499 raft_consensus.cc:385] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.335075 15499 raft_consensus.cc:740] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.335799 15499 consensus_queue.cc:260] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.335544 15204 catalog_manager.cc:5697] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.337013 15500 raft_consensus.cc:359] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.337807 15500 raft_consensus.cc:385] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.338114 15499 ts_tablet_manager.cc:1434] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:18:06.338140 15500 raft_consensus.cc:740] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.335531 15498 ts_tablet_manager.cc:1434] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:18:06.339305 15499 tablet_bootstrap.cc:492] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:06.339625 15498 tablet_bootstrap.cc:492] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:06.339382 15500 consensus_queue.cc:260] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.345803 15499 tablet_bootstrap.cc:654] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.346347 15498 tablet_bootstrap.cc:654] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:06.346489 15255 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:06.349069 15500 ts_tablet_manager.cc:1434] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:18:06.353621 15500 tablet_bootstrap.cc:492] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:06.357812 15207 catalog_manager.cc:5697] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.360553 15500 tablet_bootstrap.cc:654] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.368052 15498 tablet_bootstrap.cc:492] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:06.368425 15500 tablet_bootstrap.cc:492] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:06.368669 15498 ts_tablet_manager.cc:1403] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 12:18:06.369001 15500 ts_tablet_manager.cc:1403] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 12:18:06.371186 15499 tablet_bootstrap.cc:492] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:06.371747 15499 ts_tablet_manager.cc:1403] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.008s
I20260709 12:18:06.372224 15500 raft_consensus.cc:359] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.373041 15500 raft_consensus.cc:385] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.372583 15498 raft_consensus.cc:359] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.373366 15500 raft_consensus.cc:740] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.373489 15498 raft_consensus.cc:385] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.373926 15498 raft_consensus.cc:740] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.374402 15500 consensus_queue.cc:260] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.374696 15499 raft_consensus.cc:359] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.374770 15498 consensus_queue.cc:260] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.375547 15499 raft_consensus.cc:385] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.376117 15499 raft_consensus.cc:740] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.377018 15500 ts_tablet_manager.cc:1434] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:18:06.376941 15499 consensus_queue.cc:260] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.378095 15500 tablet_bootstrap.cc:492] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:06.379201 15499 ts_tablet_manager.cc:1434] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:18:06.380188 15499 tablet_bootstrap.cc:492] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:06.383152 15498 ts_tablet_manager.cc:1434] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.007s
I20260709 12:18:06.384333 15500 tablet_bootstrap.cc:654] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.384385 15498 tablet_bootstrap.cc:492] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:06.385552 15499 tablet_bootstrap.cc:654] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.392331 15498 tablet_bootstrap.cc:654] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.392843 15523 raft_consensus.cc:493] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.393373 15523 raft_consensus.cc:515] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.395596 15523 leader_election.cc:290] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.395831 15500 tablet_bootstrap.cc:492] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:06.396855 15500 ts_tablet_manager.cc:1403] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.019s	user 0.002s	sys 0.015s
I20260709 12:18:06.397598 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:06.397661 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:06.398350 15458 raft_consensus.cc:2468] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:06.398495 15384 raft_consensus.cc:2468] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:06.399631 15274 leader_election.cc:304] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:06.400863 15523 raft_consensus.cc:2804] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.401218 15523 raft_consensus.cc:493] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.401636 15523 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.406636 15499 tablet_bootstrap.cc:492] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:06.407234 15499 ts_tablet_manager.cc:1403] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.008s
I20260709 12:18:06.408308 15500 raft_consensus.cc:359] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.409017 15500 raft_consensus.cc:385] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.409118 15528 raft_consensus.cc:493] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.408946 15523 raft_consensus.cc:515] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.409588 15500 raft_consensus.cc:740] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.409895 15528 raft_consensus.cc:515] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.410449 15500 consensus_queue.cc:260] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.411960 15528 leader_election.cc:290] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.412513 15500 ts_tablet_manager.cc:1434] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 12:18:06.413300 15498 tablet_bootstrap.cc:492] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:06.413488 15500 tablet_bootstrap.cc:492] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:06.414038 15498 ts_tablet_manager.cc:1403] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.011s
I20260709 12:18:06.414198 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:06.414810 15384 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.417227 15498 raft_consensus.cc:359] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.418033 15498 raft_consensus.cc:385] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.418408 15498 raft_consensus.cc:740] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.419016 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9c4cb9c00045619b0ba92cf7622817" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:06.419659 15500 tablet_bootstrap.cc:654] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.419301 15498 consensus_queue.cc:260] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.420251 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9c4cb9c00045619b0ba92cf7622817" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:06.420894 15458 raft_consensus.cc:2468] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 0.
I20260709 12:18:06.422433 15349 leader_election.cc:304] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 
W20260709 12:18:06.423832 15350 leader_election.cc:343] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:06.424787 15528 raft_consensus.cc:2804] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.425266 15528 raft_consensus.cc:493] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.425588 15528 raft_consensus.cc:3060] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.427064 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:06.427774 15458 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.429345 15498 ts_tablet_manager.cc:1434] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:18:06.433151 15384 raft_consensus.cc:2468] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:06.435257 15458 raft_consensus.cc:2468] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:06.435660 15525 raft_consensus.cc:493] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.436229 15525 raft_consensus.cc:515] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.437465 15498 tablet_bootstrap.cc:492] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:06.438402 15525 leader_election.cc:290] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.439474 15272 leader_election.cc:304] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.440871 15528 raft_consensus.cc:515] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.441253 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6575b35e91424d748cb8970584e2af56" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:06.441910 15525 raft_consensus.cc:2804] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.441999 15384 raft_consensus.cc:2468] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:06.442505 15499 raft_consensus.cc:359] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.443218 15499 raft_consensus.cc:385] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.443491 15499 raft_consensus.cc:740] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.443836 15272 leader_election.cc:304] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.444283 15499 consensus_queue.cc:260] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.444751 15506 raft_consensus.cc:2804] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.445205 15506 raft_consensus.cc:493] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.445555 15506 raft_consensus.cc:3060] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.447495 15498 tablet_bootstrap.cc:654] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.447295 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9c4cb9c00045619b0ba92cf7622817" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:06.448284 15528 leader_election.cc:290] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.449476 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9c4cb9c00045619b0ba92cf7622817" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:06.450101 15457 raft_consensus.cc:3060] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.450253 15499 ts_tablet_manager.cc:1434] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
W20260709 12:18:06.454176 15350 leader_election.cc:343] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:06.456871 15500 tablet_bootstrap.cc:492] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:06.457369 15500 ts_tablet_manager.cc:1403] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.011s
I20260709 12:18:06.458868 15457 raft_consensus.cc:2468] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 1.
I20260709 12:18:06.436462 15523 leader_election.cc:290] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.460273 15500 raft_consensus.cc:359] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.461031 15500 raft_consensus.cc:385] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.461305 15500 raft_consensus.cc:740] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.453474 15506 raft_consensus.cc:515] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.462054 15500 consensus_queue.cc:260] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.462869 15498 tablet_bootstrap.cc:492] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:06.463456 15498 ts_tablet_manager.cc:1403] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.005s
I20260709 12:18:06.463749 15506 leader_election.cc:290] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.460341 15349 leader_election.cc:304] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 40fb690455fd4a778fbe670376d73807
I20260709 12:18:06.465410 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6575b35e91424d748cb8970584e2af56" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:06.466080 15458 raft_consensus.cc:2468] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:06.466408 15498 raft_consensus.cc:359] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.467190 15498 raft_consensus.cc:385] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.467262 15500 ts_tablet_manager.cc:1434] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:18:06.467532 15498 raft_consensus.cc:740] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.468493 15525 raft_consensus.cc:697] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:06.468451 15498 consensus_queue.cc:260] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.465932 15528 raft_consensus.cc:2804] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.469480 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6575b35e91424d748cb8970584e2af56" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:06.469465 15525 consensus_queue.cc:237] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.470245 15384 raft_consensus.cc:3060] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.471633 15498 ts_tablet_manager.cc:1434] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:18:06.472802 15498 tablet_bootstrap.cc:492] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:06.472607 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6575b35e91424d748cb8970584e2af56" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:06.474424 15458 raft_consensus.cc:3060] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.469481 15528 raft_consensus.cc:697] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:06.478642 15528 consensus_queue.cc:237] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.479471 15498 tablet_bootstrap.cc:654] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.480741 15507 raft_consensus.cc:493] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.481300 15507 raft_consensus.cc:515] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.483578 15507 leader_election.cc:290] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:06.485308 15384 raft_consensus.cc:2468] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:06.485744 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324ce7d305c2400f8be7dc122371aea5" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:06.486572 15308 raft_consensus.cc:2468] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 0.
I20260709 12:18:06.488152 15531 raft_consensus.cc:493] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.488404 15424 leader_election.cc:304] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:06.488723 15531 raft_consensus.cc:515] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.489410 15507 raft_consensus.cc:2804] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.489835 15507 raft_consensus.cc:493] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.490192 15507 raft_consensus.cc:3060] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.491801 15531 leader_election.cc:290] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.493506 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324ce7d305c2400f8be7dc122371aea5" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:06.494217 15308 raft_consensus.cc:2468] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 0.
I20260709 12:18:06.495640 15350 leader_election.cc:304] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.486894 15272 leader_election.cc:304] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.497695 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324ce7d305c2400f8be7dc122371aea5" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:06.497741 15546 raft_consensus.cc:2804] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.499051 15546 raft_consensus.cc:697] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:06.499953 15546 consensus_queue.cc:237] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.490309 15383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324ce7d305c2400f8be7dc122371aea5" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:06.497699 15531 raft_consensus.cc:2804] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.504444 15531 raft_consensus.cc:493] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.505048 15531 raft_consensus.cc:3060] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.510926 15203 catalog_manager.cc:5697] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.512506 15498 tablet_bootstrap.cc:492] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:06.513084 15498 ts_tablet_manager.cc:1403] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.011s
I20260709 12:18:06.513464 15205 catalog_manager.cc:5697] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.515013 15531 raft_consensus.cc:515] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.516100 15383 raft_consensus.cc:2393] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 376f0d1f5e014993bc041d3f3815f1ef in current term 1: Already voted for candidate cfcfc154929046d2a604387040d29ca2 in this term.
I20260709 12:18:06.503917 15507 raft_consensus.cc:515] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.516750 15458 raft_consensus.cc:2468] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:06.517154 15457 raft_consensus.cc:2393] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfcfc154929046d2a604387040d29ca2 in current term 1: Already voted for candidate 376f0d1f5e014993bc041d3f3815f1ef in this term.
I20260709 12:18:06.520423 15531 leader_election.cc:290] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.520854 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324ce7d305c2400f8be7dc122371aea5" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:06.521484 15308 raft_consensus.cc:3060] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.521836 15498 raft_consensus.cc:359] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.522653 15383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324ce7d305c2400f8be7dc122371aea5" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:06.522989 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324ce7d305c2400f8be7dc122371aea5" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:06.523888 15457 raft_consensus.cc:2393] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cfcfc154929046d2a604387040d29ca2 in current term 1: Already voted for candidate 376f0d1f5e014993bc041d3f3815f1ef in this term.
I20260709 12:18:06.523435 15383 raft_consensus.cc:2393] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 376f0d1f5e014993bc041d3f3815f1ef in current term 1: Already voted for candidate cfcfc154929046d2a604387040d29ca2 in this term.
I20260709 12:18:06.522989 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324ce7d305c2400f8be7dc122371aea5" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:06.526396 15498 raft_consensus.cc:385] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.526437 15507 leader_election.cc:290] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:06.527113 15498 raft_consensus.cc:740] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.527086 15424 leader_election.cc:304] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef; no voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:06.528342 15507 raft_consensus.cc:2749] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:06.528885 15498 consensus_queue.cc:260] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.530150 15308 raft_consensus.cc:2468] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 1.
I20260709 12:18:06.530898 15498 ts_tablet_manager.cc:1434] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.003s
I20260709 12:18:06.531200 15350 leader_election.cc:304] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 376f0d1f5e014993bc041d3f3815f1ef
I20260709 12:18:06.532002 15531 raft_consensus.cc:2804] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.532444 15531 raft_consensus.cc:697] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:06.533193 15531 consensus_queue.cc:237] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.536160 15205 catalog_manager.cc:5697] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.543622 15203 catalog_manager.cc:5697] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.602137 15507 raft_consensus.cc:493] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.602670 15507 raft_consensus.cc:515] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.604583 15507 leader_election.cc:290] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:06.605255 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e2117b92054e8692ab0a648e9034ef" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:06.605578 15383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e2117b92054e8692ab0a648e9034ef" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:06.605851 15308 raft_consensus.cc:2468] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 0.
I20260709 12:18:06.606184 15383 raft_consensus.cc:2468] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 0.
I20260709 12:18:06.606814 15424 leader_election.cc:304] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:06.607455 15507 raft_consensus.cc:2804] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.607764 15507 raft_consensus.cc:493] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.607976 15507 raft_consensus.cc:3060] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.612730 15507 raft_consensus.cc:515] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.614288 15507 leader_election.cc:290] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:06.614837 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e2117b92054e8692ab0a648e9034ef" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:06.615152 15383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e2117b92054e8692ab0a648e9034ef" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:06.615291 15308 raft_consensus.cc:3060] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.615626 15383 raft_consensus.cc:3060] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.619855 15308 raft_consensus.cc:2468] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 1.
I20260709 12:18:06.620254 15383 raft_consensus.cc:2468] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 1.
I20260709 12:18:06.620764 15424 leader_election.cc:304] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:06.621517 15507 raft_consensus.cc:2804] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.622707 15507 raft_consensus.cc:697] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Becoming Leader. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:06.623401 15507 consensus_queue.cc:237] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.630340 15203 catalog_manager.cc:5697] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:06.681335 15525 consensus_queue.cc:1048] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.682611 15546 consensus_queue.cc:1048] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.720402 15531 consensus_queue.cc:1048] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.725086 15383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf"
dest_uuid: "cfcfc154929046d2a604387040d29ca2"
mode: GRACEFUL
new_leader_uuid: "40fb690455fd4a778fbe670376d73807"
 from {username='slave'} at 127.0.0.1:43090
I20260709 12:18:06.725257 15546 consensus_queue.cc:1048] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.725858 15383 raft_consensus.cc:606] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Received request to transfer leadership to TS 40fb690455fd4a778fbe670376d73807
I20260709 12:18:06.734113 15383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b"
dest_uuid: "cfcfc154929046d2a604387040d29ca2"
mode: GRACEFUL
new_leader_uuid: "40fb690455fd4a778fbe670376d73807"
 from {username='slave'} at 127.0.0.1:43090
I20260709 12:18:06.734723 15383 raft_consensus.cc:606] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Received request to transfer leadership to TS 40fb690455fd4a778fbe670376d73807
I20260709 12:18:06.737298 15523 consensus_queue.cc:1048] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.738826 15503 consensus_queue.cc:1048] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.772699 15528 raft_consensus.cc:993] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2: : Instructing follower 40fb690455fd4a778fbe670376d73807 to start an election
I20260709 12:18:06.773180 15503 raft_consensus.cc:1081] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Signalling peer 40fb690455fd4a778fbe670376d73807 to start an election
I20260709 12:18:06.774813 15308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf"
dest_uuid: "40fb690455fd4a778fbe670376d73807"
 from {username='slave'} at 127.0.0.1:46362
I20260709 12:18:06.775444 15308 raft_consensus.cc:493] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:06.775875 15308 raft_consensus.cc:3060] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.778636 15503 consensus_queue.cc:1048] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.783282 15309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6575b35e91424d748cb8970584e2af56"
dest_uuid: "40fb690455fd4a778fbe670376d73807"
mode: GRACEFUL
new_leader_uuid: "cfcfc154929046d2a604387040d29ca2"
 from {username='slave'} at 127.0.0.1:46374
I20260709 12:18:06.783146 15308 raft_consensus.cc:515] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.783928 15309 raft_consensus.cc:606] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Received request to transfer leadership to TS cfcfc154929046d2a604387040d29ca2
I20260709 12:18:06.786219 15383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:06.786773 15383 raft_consensus.cc:3055] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:06.787063 15383 raft_consensus.cc:740] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:06.787228 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d5ce297d642f0b8d6a39be10b4dcf" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:06.787976 15308 leader_election.cc:290] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 2 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.787830 15383 consensus_queue.cc:260] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.788861 15383 raft_consensus.cc:3060] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.787891 15458 raft_consensus.cc:3060] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.795656 15383 raft_consensus.cc:2468] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 2.
I20260709 12:18:06.797287 15272 leader_election.cc:304] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.798211 15523 raft_consensus.cc:2804] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:06.798682 15523 raft_consensus.cc:697] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 2 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:06.799492 15523 consensus_queue.cc:237] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.808459 15503 consensus_queue.cc:1048] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.814352 15458 raft_consensus.cc:2468] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 2.
I20260709 12:18:06.816418 15531 raft_consensus.cc:993] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2: : Instructing follower 40fb690455fd4a778fbe670376d73807 to start an election
I20260709 12:18:06.816815 15503 raft_consensus.cc:1081] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Signalling peer 40fb690455fd4a778fbe670376d73807 to start an election
I20260709 12:18:06.818115 15457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2e2117b92054e8692ab0a648e9034ef"
dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
mode: GRACEFUL
new_leader_uuid: "cfcfc154929046d2a604387040d29ca2"
 from {username='slave'} at 127.0.0.1:52668
I20260709 12:18:06.818360 15308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b"
dest_uuid: "40fb690455fd4a778fbe670376d73807"
 from {username='slave'} at 127.0.0.1:46362
I20260709 12:18:06.818789 15457 raft_consensus.cc:606] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Received request to transfer leadership to TS cfcfc154929046d2a604387040d29ca2
I20260709 12:18:06.819067 15308 raft_consensus.cc:493] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:06.818399 15205 catalog_manager.cc:5697] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 1 to 2, leader changed from cfcfc154929046d2a604387040d29ca2 (127.4.78.66) to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.819463 15308 raft_consensus.cc:3060] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.825141 15309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9"
dest_uuid: "40fb690455fd4a778fbe670376d73807"
mode: GRACEFUL
new_leader_uuid: "cfcfc154929046d2a604387040d29ca2"
 from {username='slave'} at 127.0.0.1:46374
I20260709 12:18:06.825799 15309 raft_consensus.cc:606] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Received request to transfer leadership to TS cfcfc154929046d2a604387040d29ca2
I20260709 12:18:06.825631 15308 raft_consensus.cc:515] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.827607 15308 leader_election.cc:290] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 2 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.828334 15383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:06.828979 15383 raft_consensus.cc:3055] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:06.829303 15383 raft_consensus.cc:740] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:06.830003 15383 consensus_queue.cc:260] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.830999 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:06.831243 15383 raft_consensus.cc:3060] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.831652 15457 raft_consensus.cc:3060] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.837801 15383 raft_consensus.cc:2468] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 2.
I20260709 12:18:06.838660 15384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed9c4cb9c00045619b0ba92cf7622817"
dest_uuid: "cfcfc154929046d2a604387040d29ca2"
mode: GRACEFUL
new_leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:43090
I20260709 12:18:06.838852 15272 leader_election.cc:304] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.839344 15384 raft_consensus.cc:606] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Received request to transfer leadership to TS 376f0d1f5e014993bc041d3f3815f1ef
I20260709 12:18:06.839563 15523 raft_consensus.cc:2804] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:06.840054 15523 raft_consensus.cc:697] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 2 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:06.840760 15523 consensus_queue.cc:237] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.842177 15457 raft_consensus.cc:2468] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 2.
I20260709 12:18:06.847373 15205 catalog_manager.cc:5697] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 1 to 2, leader changed from cfcfc154929046d2a604387040d29ca2 (127.4.78.66) to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.863822 15506 consensus_queue.cc:1048] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.874064 15525 consensus_queue.cc:1048] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.881222 15546 raft_consensus.cc:993] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807: : Instructing follower cfcfc154929046d2a604387040d29ca2 to start an election
I20260709 12:18:06.881698 15525 raft_consensus.cc:1081] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Signalling peer cfcfc154929046d2a604387040d29ca2 to start an election
I20260709 12:18:06.883226 15384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9"
dest_uuid: "cfcfc154929046d2a604387040d29ca2"
 from {username='slave'} at 127.0.0.1:43070
I20260709 12:18:06.883723 15384 raft_consensus.cc:493] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:06.884025 15384 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.889627 15384 raft_consensus.cc:515] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.891389 15384 leader_election.cc:290] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 2 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.892136 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:06.892441 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:06.892799 15308 raft_consensus.cc:3055] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:06.893013 15457 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.893222 15308 raft_consensus.cc:740] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:06.894062 15308 consensus_queue.cc:260] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.895053 15308 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.898757 15457 raft_consensus.cc:2468] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 2.
I20260709 12:18:06.899658 15349 leader_election.cc:304] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:06.899883 15308 raft_consensus.cc:2468] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 2.
I20260709 12:18:06.900324 15503 raft_consensus.cc:2804] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:06.900786 15503 raft_consensus.cc:697] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:06.901494 15503 consensus_queue.cc:237] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.909838 15206 catalog_manager.cc:5697] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 1 to 2, leader changed from 40fb690455fd4a778fbe670376d73807 (127.4.78.65) to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.966024 15503 consensus_queue.cc:1048] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.979068 15528 consensus_queue.cc:1048] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.978765 15503 consensus_queue.cc:1048] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:06.984625 15525 raft_consensus.cc:493] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.985212 15525 raft_consensus.cc:515] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:06.987262 15525 leader_election.cc:290] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:06.988325 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9c4cb9c00045619b0ba92cf7622817" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:06.988768 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9c4cb9c00045619b0ba92cf7622817" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:06.989182 15528 raft_consensus.cc:993] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2: : Instructing follower 376f0d1f5e014993bc041d3f3815f1ef to start an election
I20260709 12:18:06.989665 15528 raft_consensus.cc:1081] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Signalling peer 376f0d1f5e014993bc041d3f3815f1ef to start an election
I20260709 12:18:06.990080 15274 leader_election.cc:304] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40fb690455fd4a778fbe670376d73807; no voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:06.991357 15525 raft_consensus.cc:2749] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:06.991729 15456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed9c4cb9c00045619b0ba92cf7622817"
dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:52666
I20260709 12:18:06.992349 15456 raft_consensus.cc:493] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:06.992674 15456 raft_consensus.cc:3060] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.993129 15308 raft_consensus.cc:3060] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:07.000125 15456 raft_consensus.cc:515] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:07.001358 15457 raft_consensus.cc:1240] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Rejecting Update request from peer cfcfc154929046d2a604387040d29ca2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:07.001533 15503 consensus_queue.cc:1048] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:07.003669 15456 leader_election.cc:290] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:07.003830 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9c4cb9c00045619b0ba92cf7622817" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:07.004549 15308 raft_consensus.cc:3060] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.004741 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9c4cb9c00045619b0ba92cf7622817" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:07.005388 15384 raft_consensus.cc:3055] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:07.005713 15384 raft_consensus.cc:740] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:07.006547 15384 consensus_queue.cc:260] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:07.007650 15384 raft_consensus.cc:3060] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.012439 15308 raft_consensus.cc:2468] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 2.
I20260709 12:18:07.013309 15309 raft_consensus.cc:1240] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Rejecting Update request from peer cfcfc154929046d2a604387040d29ca2 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:18:07.013803 15424 leader_election.cc:304] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:07.014727 15507 raft_consensus.cc:2804] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:07.014742 15384 raft_consensus.cc:2468] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 2.
I20260709 12:18:07.015312 15507 raft_consensus.cc:697] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 LEADER]: Becoming Leader. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:07.016155 15507 consensus_queue.cc:237] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:07.022317 15205 catalog_manager.cc:5697] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef reported cstate change: term changed from 1 to 2, leader changed from cfcfc154929046d2a604387040d29ca2 (127.4.78.66) to 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:07.067917 15525 consensus_queue.cc:1048] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:07.073992 15546 raft_consensus.cc:993] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807: : Instructing follower cfcfc154929046d2a604387040d29ca2 to start an election
I20260709 12:18:07.074445 15523 raft_consensus.cc:1081] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Signalling peer cfcfc154929046d2a604387040d29ca2 to start an election
I20260709 12:18:07.076073 15383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6575b35e91424d748cb8970584e2af56"
dest_uuid: "cfcfc154929046d2a604387040d29ca2"
 from {username='slave'} at 127.0.0.1:43070
I20260709 12:18:07.078277 15383 raft_consensus.cc:493] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:07.078694 15383 raft_consensus.cc:3060] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.079902 15523 consensus_queue.cc:1048] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:07.084821 15507 consensus_queue.cc:1048] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:07.086182 15383 raft_consensus.cc:515] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:07.087316 15384 raft_consensus.cc:1240] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Rejecting Update request from peer 40fb690455fd4a778fbe670376d73807 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:07.089500 15546 consensus_queue.cc:1059] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:07.089593 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6575b35e91424d748cb8970584e2af56" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:07.090600 15308 raft_consensus.cc:3055] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:07.090993 15308 raft_consensus.cc:740] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:07.091907 15308 consensus_queue.cc:260] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:07.092937 15308 raft_consensus.cc:3060] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.098820 15383 leader_election.cc:290] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 2 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:07.100586 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6575b35e91424d748cb8970584e2af56" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:07.101210 15457 raft_consensus.cc:3060] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.102249 15308 raft_consensus.cc:2468] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 2.
W20260709 12:18:07.102969 15525 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:18:07.105916 15350 leader_election.cc:304] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:07.107538 15503 raft_consensus.cc:2804] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:07.108013 15503 raft_consensus.cc:697] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:07.108494 15457 raft_consensus.cc:2468] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 2.
I20260709 12:18:07.108837 15503 consensus_queue.cc:237] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:07.113540 15507 consensus_queue.cc:1048] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:07.117527 15205 catalog_manager.cc:5697] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 1 to 2, leader changed from 40fb690455fd4a778fbe670376d73807 (127.4.78.65) to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:07.120434 15553 raft_consensus.cc:993] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef: : Instructing follower cfcfc154929046d2a604387040d29ca2 to start an election
I20260709 12:18:07.120880 15507 raft_consensus.cc:1081] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Signalling peer cfcfc154929046d2a604387040d29ca2 to start an election
I20260709 12:18:07.122346 15383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2e2117b92054e8692ab0a648e9034ef"
dest_uuid: "cfcfc154929046d2a604387040d29ca2"
 from {username='slave'} at 127.0.0.1:43076
I20260709 12:18:07.122856 15383 raft_consensus.cc:493] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:07.123189 15383 raft_consensus.cc:3060] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.128520 15383 raft_consensus.cc:515] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:07.130173 15383 leader_election.cc:290] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 2 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:07.130824 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e2117b92054e8692ab0a648e9034ef" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:07.131291 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e2117b92054e8692ab0a648e9034ef" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:07.131920 15457 raft_consensus.cc:3055] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:07.132229 15457 raft_consensus.cc:740] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:07.133010 15457 consensus_queue.cc:260] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:07.131475 15309 raft_consensus.cc:3060] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.134284 15457 raft_consensus.cc:3060] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.138545 15309 raft_consensus.cc:2468] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 2.
I20260709 12:18:07.138852 15457 raft_consensus.cc:2468] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 2.
I20260709 12:18:07.139462 15350 leader_election.cc:304] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:07.140216 15503 raft_consensus.cc:2804] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:07.140647 15503 raft_consensus.cc:697] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:07.141351 15503 consensus_queue.cc:237] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:07.146849 15205 catalog_manager.cc:5697] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 1 to 2, leader changed from 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67) to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:07.223088 15457 raft_consensus.cc:1275] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Refusing update from remote peer 40fb690455fd4a778fbe670376d73807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.224313 15525 consensus_queue.cc:1048] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:07.233747 15383 raft_consensus.cc:1275] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Refusing update from remote peer 40fb690455fd4a778fbe670376d73807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.235136 15525 consensus_queue.cc:1048] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:07.258064 15456 raft_consensus.cc:1275] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Refusing update from remote peer 40fb690455fd4a778fbe670376d73807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.259230 15523 consensus_queue.cc:1048] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:07.266953 15383 raft_consensus.cc:1275] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Refusing update from remote peer 40fb690455fd4a778fbe670376d73807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.268355 15506 consensus_queue.cc:1048] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:07.357388 15309 raft_consensus.cc:1275] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Refusing update from remote peer cfcfc154929046d2a604387040d29ca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.358577 15503 consensus_queue.cc:1048] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:07.367134 15456 raft_consensus.cc:1275] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Refusing update from remote peer cfcfc154929046d2a604387040d29ca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.368408 15503 consensus_queue.cc:1048] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:07.489815 15309 raft_consensus.cc:1275] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Refusing update from remote peer cfcfc154929046d2a604387040d29ca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.490995 15503 consensus_queue.cc:1048] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:07.499228 15456 raft_consensus.cc:1275] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Refusing update from remote peer cfcfc154929046d2a604387040d29ca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.501266 15503 consensus_queue.cc:1048] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:07.540818 15383 raft_consensus.cc:1275] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.541975 15507 consensus_queue.cc:1048] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:07.551250 15309 raft_consensus.cc:1275] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.552637 15581 consensus_queue.cc:1048] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:07.598276 15309 raft_consensus.cc:1275] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Refusing update from remote peer cfcfc154929046d2a604387040d29ca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.599423 15503 consensus_queue.cc:1048] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:07.606732 15456 raft_consensus.cc:1275] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Refusing update from remote peer cfcfc154929046d2a604387040d29ca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.609103 15574 consensus_queue.cc:1048] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:09.876510 15205 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53982:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:09.879643 15205 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:09.935667 15298 tablet_service.cc:1511] Processing CreateTablet for tablet d58cf9a767de4477b81dfca94405c1bb (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:09.937601 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58cf9a767de4477b81dfca94405c1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.937218 15372 tablet_service.cc:1511] Processing CreateTablet for tablet d58cf9a767de4477b81dfca94405c1bb (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:09.938352 15445 tablet_service.cc:1511] Processing CreateTablet for tablet d58cf9a767de4477b81dfca94405c1bb (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:09.938993 15372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58cf9a767de4477b81dfca94405c1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.939975 15445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58cf9a767de4477b81dfca94405c1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.943372 15443 tablet_service.cc:1511] Processing CreateTablet for tablet caa4274c181d4a4ba938dd4265a3630b (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:09.944842 15443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa4274c181d4a4ba938dd4265a3630b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.948139 15294 tablet_service.cc:1511] Processing CreateTablet for tablet caa4274c181d4a4ba938dd4265a3630b (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:09.949528 15294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa4274c181d4a4ba938dd4265a3630b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.950942 15297 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4ea5cb7eba404c94be17c6e629ae11 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:09.953907 15374 tablet_service.cc:1511] Processing CreateTablet for tablet caa4274c181d4a4ba938dd4265a3630b (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:09.955397 15374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa4274c181d4a4ba938dd4265a3630b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.955192 15368 tablet_service.cc:1511] Processing CreateTablet for tablet fa38d6149c764c27b0745a20f6ade89a (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:09.956573 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa38d6149c764c27b0745a20f6ade89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.957610 15369 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4ea5cb7eba404c94be17c6e629ae11 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:09.959000 15369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4ea5cb7eba404c94be17c6e629ae11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.960978 15444 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4ea5cb7eba404c94be17c6e629ae11 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:09.963104 15371 tablet_service.cc:1511] Processing CreateTablet for tablet f298d7d50e4048048dc3a7102707bcf6 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:09.963276 15448 tablet_service.cc:1511] Processing CreateTablet for tablet fa38d6149c764c27b0745a20f6ade89a (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:09.965281 15444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4ea5cb7eba404c94be17c6e629ae11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.966993 15299 tablet_service.cc:1511] Processing CreateTablet for tablet fa38d6149c764c27b0745a20f6ade89a (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:09.967489 15295 tablet_service.cc:1511] Processing CreateTablet for tablet f298d7d50e4048048dc3a7102707bcf6 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:09.969872 15299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa38d6149c764c27b0745a20f6ade89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.970289 15448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa38d6149c764c27b0745a20f6ade89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.972940 15295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f298d7d50e4048048dc3a7102707bcf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.974196 15297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4ea5cb7eba404c94be17c6e629ae11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:09.978813 15371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f298d7d50e4048048dc3a7102707bcf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.010648 15441 tablet_service.cc:1511] Processing CreateTablet for tablet f298d7d50e4048048dc3a7102707bcf6 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:10.012236 15441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f298d7d50e4048048dc3a7102707bcf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.022423 15296 tablet_service.cc:1511] Processing CreateTablet for tablet 0b936e302bf240b796d4bed4fda04e69 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:10.035789 15296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b936e302bf240b796d4bed4fda04e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.035863 15446 tablet_service.cc:1511] Processing CreateTablet for tablet 0b936e302bf240b796d4bed4fda04e69 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:10.037257 15446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b936e302bf240b796d4bed4fda04e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.021797 15595 tablet_bootstrap.cc:492] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:10.042390 15370 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8cf9b6eea8455485079a7ea60216c3 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:10.043824 15370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8cf9b6eea8455485079a7ea60216c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.043941 15298 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8cf9b6eea8455485079a7ea60216c3 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:10.042294 15372 tablet_service.cc:1511] Processing CreateTablet for tablet 0b936e302bf240b796d4bed4fda04e69 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:10.045262 15442 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8cf9b6eea8455485079a7ea60216c3 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:10.046495 15372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b936e302bf240b796d4bed4fda04e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.047294 15442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8cf9b6eea8455485079a7ea60216c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.053227 15293 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5d6a219d9e48dbaa370121656f76c3 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:10.054276 15373 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5d6a219d9e48dbaa370121656f76c3 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:10.054366 15447 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5d6a219d9e48dbaa370121656f76c3 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:10.056249 15447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5d6a219d9e48dbaa370121656f76c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.045288 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8cf9b6eea8455485079a7ea60216c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.021080 15594 tablet_bootstrap.cc:492] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:10.058295 15293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5d6a219d9e48dbaa370121656f76c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.065047 15292 tablet_service.cc:1511] Processing CreateTablet for tablet cfa1e225b8694340a3a514e79fe45490 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:10.066522 15292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa1e225b8694340a3a514e79fe45490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.067448 15367 tablet_service.cc:1511] Processing CreateTablet for tablet cfa1e225b8694340a3a514e79fe45490 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:10.069200 15367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa1e225b8694340a3a514e79fe45490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.070274 15373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5d6a219d9e48dbaa370121656f76c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.082506 15440 tablet_service.cc:1511] Processing CreateTablet for tablet cfa1e225b8694340a3a514e79fe45490 (DEFAULT_TABLE table=soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:10.083963 15440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa1e225b8694340a3a514e79fe45490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:10.118177 15595 tablet_bootstrap.cc:654] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:10.131064 15272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:35767, user_credentials={real_user=slave}} blocked reactor thread for 91955.5us
I20260709 12:18:10.149715 15594 tablet_bootstrap.cc:654] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.155512 15596 tablet_bootstrap.cc:492] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:10.185523 15595 tablet_bootstrap.cc:492] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:10.186097 15595 ts_tablet_manager.cc:1403] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.167s	user 0.030s	sys 0.038s
I20260709 12:18:10.190253 15595 raft_consensus.cc:359] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.190951 15595 raft_consensus.cc:385] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.191207 15595 raft_consensus.cc:740] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.191891 15595 consensus_queue.cc:260] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.194430 15595 ts_tablet_manager.cc:1434] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:10.194742 15596 tablet_bootstrap.cc:654] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.195524 15594 tablet_bootstrap.cc:492] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:10.196045 15594 ts_tablet_manager.cc:1403] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.175s	user 0.008s	sys 0.003s
I20260709 12:18:10.195418 15595 tablet_bootstrap.cc:492] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:10.199162 15594 raft_consensus.cc:359] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.199928 15594 raft_consensus.cc:385] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.200219 15594 raft_consensus.cc:740] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.201093 15594 consensus_queue.cc:260] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.205349 15595 tablet_bootstrap.cc:654] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.207489 15594 ts_tablet_manager.cc:1434] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:18:10.208772 15594 tablet_bootstrap.cc:492] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:10.216897 15594 tablet_bootstrap.cc:654] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.219422 15596 tablet_bootstrap.cc:492] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:10.219944 15596 ts_tablet_manager.cc:1403] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.018s
I20260709 12:18:10.222473 15595 tablet_bootstrap.cc:492] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:10.223050 15595 ts_tablet_manager.cc:1403] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.016s
I20260709 12:18:10.222949 15596 raft_consensus.cc:359] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.223606 15596 raft_consensus.cc:385] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.223820 15596 raft_consensus.cc:740] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.224591 15594 tablet_bootstrap.cc:492] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:10.225320 15594 ts_tablet_manager.cc:1403] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:18:10.224638 15596 consensus_queue.cc:260] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.226593 15595 raft_consensus.cc:359] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.227321 15595 raft_consensus.cc:385] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.227612 15595 raft_consensus.cc:740] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.228307 15595 consensus_queue.cc:260] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.228982 15596 ts_tablet_manager.cc:1434] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:18:10.228780 15594 raft_consensus.cc:359] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.229919 15594 raft_consensus.cc:385] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.230250 15596 tablet_bootstrap.cc:492] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:10.230268 15594 raft_consensus.cc:740] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.231463 15595 ts_tablet_manager.cc:1434] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:18:10.231817 15594 consensus_queue.cc:260] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.232466 15595 tablet_bootstrap.cc:492] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:10.234460 15594 ts_tablet_manager.cc:1434] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:18:10.235527 15594 tablet_bootstrap.cc:492] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:10.237519 15596 tablet_bootstrap.cc:654] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.239877 15595 tablet_bootstrap.cc:654] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.242281 15594 tablet_bootstrap.cc:654] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.249239 15596 tablet_bootstrap.cc:492] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:10.249752 15596 ts_tablet_manager.cc:1403] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 12:18:10.252585 15596 raft_consensus.cc:359] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.253257 15596 raft_consensus.cc:385] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.253523 15596 raft_consensus.cc:740] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.254216 15596 consensus_queue.cc:260] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.256502 15596 ts_tablet_manager.cc:1434] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:18:10.257411 15596 tablet_bootstrap.cc:492] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:10.260314 15595 tablet_bootstrap.cc:492] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:10.260869 15595 ts_tablet_manager.cc:1403] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.015s
I20260709 12:18:10.261459 15594 tablet_bootstrap.cc:492] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:10.262081 15594 ts_tablet_manager.cc:1403] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.006s
I20260709 12:18:10.263904 15595 raft_consensus.cc:359] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.264639 15595 raft_consensus.cc:385] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.264940 15595 raft_consensus.cc:740] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.265659 15595 consensus_queue.cc:260] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.267877 15595 ts_tablet_manager.cc:1434] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:18:10.268038 15594 raft_consensus.cc:359] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.268893 15595 tablet_bootstrap.cc:492] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:10.269165 15596 tablet_bootstrap.cc:654] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.269531 15574 raft_consensus.cc:493] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.270148 15574 raft_consensus.cc:515] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.272348 15574 leader_election.cc:290] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.275008 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298d7d50e4048048dc3a7102707bcf6" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:10.276072 15595 tablet_bootstrap.cc:654] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:10.276958 15350 leader_election.cc:343] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.278806 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298d7d50e4048048dc3a7102707bcf6" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
W20260709 12:18:10.280586 15349 leader_election.cc:343] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.281083 15349 leader_election.cc:304] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfcfc154929046d2a604387040d29ca2; no voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807
I20260709 12:18:10.281989 15596 tablet_bootstrap.cc:492] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:10.282567 15596 ts_tablet_manager.cc:1403] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.012s
I20260709 12:18:10.282318 15574 raft_consensus.cc:2749] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:10.268864 15594 raft_consensus.cc:385] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.283731 15594 raft_consensus.cc:740] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.285851 15596 raft_consensus.cc:359] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.286597 15596 raft_consensus.cc:385] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.286871 15596 raft_consensus.cc:740] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.287791 15596 consensus_queue.cc:260] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.290215 15596 ts_tablet_manager.cc:1434] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:18:10.291126 15596 tablet_bootstrap.cc:492] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:10.284772 15594 consensus_queue.cc:260] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.297607 15596 tablet_bootstrap.cc:654] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.300707 15594 ts_tablet_manager.cc:1434] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 12:18:10.302070 15594 tablet_bootstrap.cc:492] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:10.305984 15574 raft_consensus.cc:493] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.306670 15574 raft_consensus.cc:515] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.310532 15596 tablet_bootstrap.cc:492] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:10.311126 15596 ts_tablet_manager.cc:1403] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.005s
I20260709 12:18:10.311537 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4ea5cb7eba404c94be17c6e629ae11" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:10.311149 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4ea5cb7eba404c94be17c6e629ae11" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:10.314064 15596 raft_consensus.cc:359] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
W20260709 12:18:10.314450 15350 leader_election.cc:343] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.314870 15596 raft_consensus.cc:385] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.315194 15596 raft_consensus.cc:740] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.316360 15574 leader_election.cc:290] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.316028 15596 consensus_queue.cc:260] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
W20260709 12:18:10.315851 15349 leader_election.cc:343] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.317265 15349 leader_election.cc:304] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfcfc154929046d2a604387040d29ca2; no voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807
I20260709 12:18:10.318476 15596 ts_tablet_manager.cc:1434] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:10.318485 15574 raft_consensus.cc:2749] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:10.319602 15596 tablet_bootstrap.cc:492] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:10.322136 15595 tablet_bootstrap.cc:492] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:10.322700 15595 ts_tablet_manager.cc:1403] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.031s
I20260709 12:18:10.324400 15594 tablet_bootstrap.cc:654] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.325958 15596 tablet_bootstrap.cc:654] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.325724 15595 raft_consensus.cc:359] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.326524 15595 raft_consensus.cc:385] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.326828 15595 raft_consensus.cc:740] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.327580 15595 consensus_queue.cc:260] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.329969 15595 ts_tablet_manager.cc:1434] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:10.330996 15595 tablet_bootstrap.cc:492] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:10.336064 15596 tablet_bootstrap.cc:492] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:10.336524 15596 ts_tablet_manager.cc:1403] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 12:18:10.337419 15595 tablet_bootstrap.cc:654] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.339053 15596 raft_consensus.cc:359] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.339892 15596 raft_consensus.cc:385] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.340185 15596 raft_consensus.cc:740] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.341017 15596 consensus_queue.cc:260] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.343564 15596 ts_tablet_manager.cc:1434] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:18:10.344707 15596 tablet_bootstrap.cc:492] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:10.346499 15594 tablet_bootstrap.cc:492] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:10.347064 15594 ts_tablet_manager.cc:1403] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.001s
I20260709 12:18:10.350162 15594 raft_consensus.cc:359] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.350845 15594 raft_consensus.cc:385] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.351112 15594 raft_consensus.cc:740] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.351301 15596 tablet_bootstrap.cc:654] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.351257 15595 tablet_bootstrap.cc:492] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:10.352118 15595 ts_tablet_manager.cc:1403] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 12:18:10.351867 15594 consensus_queue.cc:260] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.355157 15595 raft_consensus.cc:359] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.355857 15595 raft_consensus.cc:385] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.356138 15595 raft_consensus.cc:740] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.356909 15595 consensus_queue.cc:260] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.357867 15594 ts_tablet_manager.cc:1434] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:18:10.359153 15594 tablet_bootstrap.cc:492] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:10.359326 15595 ts_tablet_manager.cc:1434] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:18:10.360476 15595 tablet_bootstrap.cc:492] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:10.363344 15596 tablet_bootstrap.cc:492] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:10.363940 15596 ts_tablet_manager.cc:1403] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:18:10.366773 15594 tablet_bootstrap.cc:654] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.367075 15596 raft_consensus.cc:359] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.368528 15596 raft_consensus.cc:385] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.371299 15596 raft_consensus.cc:740] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.373601 15595 tablet_bootstrap.cc:654] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.373718 15596 consensus_queue.cc:260] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
W20260709 12:18:10.388150 15255 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:10.392297 15596 ts_tablet_manager.cc:1434] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.016s
I20260709 12:18:10.393615 15596 tablet_bootstrap.cc:492] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:10.398116 15594 tablet_bootstrap.cc:492] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:10.398684 15594 ts_tablet_manager.cc:1403] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.040s	user 0.004s	sys 0.008s
I20260709 12:18:10.401659 15594 raft_consensus.cc:359] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.402616 15594 raft_consensus.cc:385] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.402812 15596 tablet_bootstrap.cc:654] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.402915 15594 raft_consensus.cc:740] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.403787 15594 consensus_queue.cc:260] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.406894 15594 ts_tablet_manager.cc:1434] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:18:10.407884 15594 tablet_bootstrap.cc:492] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:10.408223 15595 tablet_bootstrap.cc:492] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:10.408746 15595 ts_tablet_manager.cc:1403] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.006s
I20260709 12:18:10.411506 15595 raft_consensus.cc:359] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.412149 15595 raft_consensus.cc:385] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.412433 15595 raft_consensus.cc:740] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.413069 15614 raft_consensus.cc:493] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.413628 15614 raft_consensus.cc:515] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.415735 15614 leader_election.cc:290] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:10.417150 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa1e225b8694340a3a514e79fe45490" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:10.418519 15594 tablet_bootstrap.cc:654] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.413138 15595 consensus_queue.cc:260] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.420033 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa1e225b8694340a3a514e79fe45490" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:10.421640 15595 ts_tablet_manager.cc:1434] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 12:18:10.422732 15595 tablet_bootstrap.cc:492] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:10.424043 15596 tablet_bootstrap.cc:492] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:10.424608 15596 ts_tablet_manager.cc:1403] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.005s
I20260709 12:18:10.426316 15594 tablet_bootstrap.cc:492] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:10.426837 15594 ts_tablet_manager.cc:1403] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.001s
I20260709 12:18:10.427846 15596 raft_consensus.cc:359] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.428620 15596 raft_consensus.cc:385] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.429039 15595 tablet_bootstrap.cc:654] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.429008 15596 raft_consensus.cc:740] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
W20260709 12:18:10.418918 15424 leader_election.cc:343] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.429940 15594 raft_consensus.cc:359] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
W20260709 12:18:10.430274 15421 leader_election.cc:343] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.430100 15596 consensus_queue.cc:260] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.430760 15594 raft_consensus.cc:385] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.431133 15594 raft_consensus.cc:740] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.432055 15594 consensus_queue.cc:260] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.434883 15594 ts_tablet_manager.cc:1434] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:10.435973 15594 tablet_bootstrap.cc:492] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:10.436687 15596 ts_tablet_manager.cc:1434] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:18:10.437820 15596 tablet_bootstrap.cc:492] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:10.432703 15421 leader_election.cc:304] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef; no voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:10.445060 15594 tablet_bootstrap.cc:654] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.446090 15614 raft_consensus.cc:2749] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:10.451512 15596 tablet_bootstrap.cc:654] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.453421 15594 tablet_bootstrap.cc:492] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:10.453986 15594 ts_tablet_manager.cc:1403] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 12:18:10.454708 15595 tablet_bootstrap.cc:492] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:10.455216 15595 ts_tablet_manager.cc:1403] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.012s
I20260709 12:18:10.456826 15594 raft_consensus.cc:359] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.457584 15594 raft_consensus.cc:385] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.457882 15594 raft_consensus.cc:740] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.458065 15595 raft_consensus.cc:359] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.458806 15595 raft_consensus.cc:385] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.458660 15594 consensus_queue.cc:260] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.459115 15595 raft_consensus.cc:740] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.459826 15596 tablet_bootstrap.cc:492] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:10.460278 15596 ts_tablet_manager.cc:1403] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 12:18:10.459893 15595 consensus_queue.cc:260] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.462335 15595 ts_tablet_manager.cc:1434] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:10.462744 15596 raft_consensus.cc:359] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.463294 15595 tablet_bootstrap.cc:492] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:10.463385 15596 raft_consensus.cc:385] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.463997 15596 raft_consensus.cc:740] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.464680 15596 consensus_queue.cc:260] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.466696 15596 ts_tablet_manager.cc:1434] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:10.467819 15596 tablet_bootstrap.cc:492] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef: Bootstrap starting.
I20260709 12:18:10.468439 15574 raft_consensus.cc:493] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.468683 15599 raft_consensus.cc:493] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.468926 15574 raft_consensus.cc:515] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.469214 15599 raft_consensus.cc:515] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.463315 15594 ts_tablet_manager.cc:1434] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:10.470650 15594 tablet_bootstrap.cc:492] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:10.471029 15574 leader_election.cc:290] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.471423 15599 leader_election.cc:290] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.471818 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:10.473392 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa4274c181d4a4ba938dd4265a3630b" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:10.474560 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa4274c181d4a4ba938dd4265a3630b" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:10.475162 15457 raft_consensus.cc:2468] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
W20260709 12:18:10.476539 15272 leader_election.cc:343] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.476979 15594 tablet_bootstrap.cc:654] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.477600 15596 tablet_bootstrap.cc:654] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:10.478066 15350 leader_election.cc:343] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.480543 15274 leader_election.cc:304] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: cfcfc154929046d2a604387040d29ca2
I20260709 12:18:10.480664 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:10.481369 15457 raft_consensus.cc:2468] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 0.
I20260709 12:18:10.480036 15599 raft_consensus.cc:493] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.481994 15599 raft_consensus.cc:515] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.482263 15506 raft_consensus.cc:2804] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:10.482970 15506 raft_consensus.cc:493] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.483296 15506 raft_consensus.cc:3060] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.484107 15599 leader_election.cc:290] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.480123 15595 tablet_bootstrap.cc:654] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.485853 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58cf9a767de4477b81dfca94405c1bb" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:10.486586 15457 raft_consensus.cc:2468] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:10.486675 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58cf9a767de4477b81dfca94405c1bb" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:10.487355 15384 raft_consensus.cc:2468] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:10.487890 15274 leader_election.cc:304] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:10.488730 15599 raft_consensus.cc:2804] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:10.489073 15599 raft_consensus.cc:493] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.489477 15599 raft_consensus.cc:3060] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.492029 15506 raft_consensus.cc:515] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.494884 15506 leader_election.cc:290] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.495489 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa4274c181d4a4ba938dd4265a3630b" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
W20260709 12:18:10.496657 15272 leader_election.cc:343] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.496917 15599 raft_consensus.cc:515] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.499156 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa4274c181d4a4ba938dd4265a3630b" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:10.489001 15349 leader_election.cc:304] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 40fb690455fd4a778fbe670376d73807
I20260709 12:18:10.500756 15617 raft_consensus.cc:2804] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:10.501159 15617 raft_consensus.cc:493] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.501474 15617 raft_consensus.cc:3060] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.499791 15457 raft_consensus.cc:3060] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.509590 15596 tablet_bootstrap.cc:492] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef: No bootstrap required, opened a new log
I20260709 12:18:10.510658 15596 ts_tablet_manager.cc:1403] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.005s
I20260709 12:18:10.513430 15457 raft_consensus.cc:2468] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:10.509564 15617 raft_consensus.cc:515] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.515744 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58cf9a767de4477b81dfca94405c1bb" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:10.516342 15384 raft_consensus.cc:3060] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.516695 15595 tablet_bootstrap.cc:492] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:10.516695 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:10.517372 15595 ts_tablet_manager.cc:1403] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.000s
I20260709 12:18:10.517581 15596 raft_consensus.cc:359] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.518314 15596 raft_consensus.cc:385] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:18:10.518061 15350 leader_election.cc:343] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.518599 15596 raft_consensus.cc:740] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.519405 15596 consensus_queue.cc:260] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.520092 15595 raft_consensus.cc:359] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.520727 15595 raft_consensus.cc:385] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.520988 15595 raft_consensus.cc:740] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.521009 15274 leader_election.cc:304] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: cfcfc154929046d2a604387040d29ca2
I20260709 12:18:10.521657 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58cf9a767de4477b81dfca94405c1bb" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:10.522044 15597 raft_consensus.cc:2804] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:10.521888 15595 consensus_queue.cc:260] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.523159 15574 raft_consensus.cc:493] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.523604 15574 raft_consensus.cc:515] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.525696 15574 leader_election.cc:290] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.526459 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa4274c181d4a4ba938dd4265a3630b" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:10.527304 15384 raft_consensus.cc:2468] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:10.528173 15457 raft_consensus.cc:3060] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.528409 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa4274c181d4a4ba938dd4265a3630b" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:10.529222 15456 raft_consensus.cc:2393] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfcfc154929046d2a604387040d29ca2 in current term 1: Already voted for candidate 40fb690455fd4a778fbe670376d73807 in this term.
I20260709 12:18:10.531021 15596 ts_tablet_manager.cc:1434] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:18:10.519889 15599 leader_election.cc:290] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.535142 15595 ts_tablet_manager.cc:1434] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:18:10.537464 15272 leader_election.cc:304] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:10.535495 15457 raft_consensus.cc:2468] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:10.539531 15594 tablet_bootstrap.cc:492] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:10.539623 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:10.537366 15617 leader_election.cc:290] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.540357 15456 raft_consensus.cc:3060] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.540469 15594 ts_tablet_manager.cc:1403] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.070s	user 0.000s	sys 0.025s
I20260709 12:18:10.539517 15599 raft_consensus.cc:2804] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:10.542172 15599 raft_consensus.cc:697] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:10.542821 15599 consensus_queue.cc:237] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.543390 15594 raft_consensus.cc:359] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.544065 15594 raft_consensus.cc:385] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.544330 15594 raft_consensus.cc:740] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.545090 15594 consensus_queue.cc:260] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.546084 15595 tablet_bootstrap.cc:492] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2: Bootstrap starting.
I20260709 12:18:10.548161 15597 raft_consensus.cc:697] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:10.549098 15597 consensus_queue.cc:237] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.552556 15594 ts_tablet_manager.cc:1434] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:18:10.553476 15595 tablet_bootstrap.cc:654] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.553577 15594 tablet_bootstrap.cc:492] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807: Bootstrap starting.
I20260709 12:18:10.560141 15594 tablet_bootstrap.cc:654] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:10.557448 15456 raft_consensus.cc:2468] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 1.
I20260709 12:18:10.562572 15349 leader_election.cc:304] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 40fb690455fd4a778fbe670376d73807
I20260709 12:18:10.563530 15617 raft_consensus.cc:2804] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:10.564100 15617 raft_consensus.cc:697] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:10.564996 15617 consensus_queue.cc:237] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.565721 15350 leader_election.cc:304] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfcfc154929046d2a604387040d29ca2; no voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807
I20260709 12:18:10.567183 15574 raft_consensus.cc:3060] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.574589 15614 raft_consensus.cc:493] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.575455 15574 raft_consensus.cc:2749] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:10.575330 15614 raft_consensus.cc:515] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.578358 15581 raft_consensus.cc:493] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.578992 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8cf9b6eea8455485079a7ea60216c3" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:10.578959 15581 raft_consensus.cc:515] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.580484 15614 leader_election.cc:290] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
W20260709 12:18:10.580643 15424 leader_election.cc:343] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.581435 15581 leader_election.cc:290] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:10.582530 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:10.583235 15308 raft_consensus.cc:2468] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 0.
I20260709 12:18:10.583811 15204 catalog_manager.cc:5697] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:10.585265 15574 raft_consensus.cc:493] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.585752 15574 raft_consensus.cc:515] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.586206 15383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:10.586079 15204 catalog_manager.cc:5697] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:10.586880 15383 raft_consensus.cc:2468] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 0.
I20260709 12:18:10.587884 15574 leader_election.cc:290] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.588941 15424 leader_election.cc:304] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:10.589919 15581 raft_consensus.cc:2804] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:10.590284 15581 raft_consensus.cc:493] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.590588 15581 raft_consensus.cc:3060] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.597467 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b936e302bf240b796d4bed4fda04e69" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:10.598361 15308 raft_consensus.cc:2468] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 0.
I20260709 12:18:10.598742 15595 tablet_bootstrap.cc:492] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2: No bootstrap required, opened a new log
I20260709 12:18:10.599216 15595 ts_tablet_manager.cc:1403] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.012s
I20260709 12:18:10.585822 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8cf9b6eea8455485079a7ea60216c3" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:10.599519 15350 leader_election.cc:304] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:10.600061 15384 raft_consensus.cc:2468] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 0.
I20260709 12:18:10.600554 15617 raft_consensus.cc:2804] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:10.601014 15617 raft_consensus.cc:493] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.601401 15617 raft_consensus.cc:3060] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.602030 15595 raft_consensus.cc:359] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.602802 15595 raft_consensus.cc:385] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.603065 15595 raft_consensus.cc:740] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.603871 15595 consensus_queue.cc:260] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.601447 15421 leader_election.cc:304] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 40fb690455fd4a778fbe670376d73807
I20260709 12:18:10.606202 15595 ts_tablet_manager.cc:1434] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:10.606623 15614 raft_consensus.cc:2804] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:10.607086 15614 raft_consensus.cc:493] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.607460 15614 raft_consensus.cc:3060] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.608963 15581 raft_consensus.cc:515] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.609256 15617 raft_consensus.cc:515] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.611491 15617 leader_election.cc:290] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.613081 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b936e302bf240b796d4bed4fda04e69" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:10.613683 15457 raft_consensus.cc:3060] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.614344 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b936e302bf240b796d4bed4fda04e69" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:10.613600 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:10.615690 15308 raft_consensus.cc:3060] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.614897 15614 raft_consensus.cc:515] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.617530 15614 leader_election.cc:290] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:10.619727 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8cf9b6eea8455485079a7ea60216c3" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
W20260709 12:18:10.621407 15424 leader_election.cc:343] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:10.622853 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8cf9b6eea8455485079a7ea60216c3" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:10.623517 15384 raft_consensus.cc:3060] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.615041 15309 raft_consensus.cc:3060] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.629019 15457 raft_consensus.cc:2468] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 1.
I20260709 12:18:10.634363 15349 leader_election.cc:304] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:10.635560 15617 raft_consensus.cc:2804] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:10.636096 15617 raft_consensus.cc:697] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:10.636989 15617 consensus_queue.cc:237] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.607247 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b936e302bf240b796d4bed4fda04e69" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:10.642529 15456 raft_consensus.cc:2376] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 1. Re-sending same reply.
I20260709 12:18:10.646592 15308 raft_consensus.cc:2468] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 1.
I20260709 12:18:10.648226 15581 leader_election.cc:290] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:10.650439 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:10.651149 15382 raft_consensus.cc:3060] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.651400 15309 raft_consensus.cc:2468] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 1.
I20260709 12:18:10.654287 15594 tablet_bootstrap.cc:492] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807: No bootstrap required, opened a new log
I20260709 12:18:10.654824 15594 ts_tablet_manager.cc:1403] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807: Time spent bootstrapping tablet: real 0.101s	user 0.031s	sys 0.019s
I20260709 12:18:10.651031 15424 leader_election.cc:304] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:10.656476 15581 raft_consensus.cc:2804] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:10.656960 15581 raft_consensus.cc:697] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Becoming Leader. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:10.657784 15594 raft_consensus.cc:359] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.658515 15594 raft_consensus.cc:385] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:10.658272 15581 consensus_queue.cc:237] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.660648 15597 raft_consensus.cc:493] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.658785 15594 raft_consensus.cc:740] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Initialized, Role: FOLLOWER
I20260709 12:18:10.661140 15597 raft_consensus.cc:515] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.665105 15384 raft_consensus.cc:2468] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 1.
I20260709 12:18:10.665472 15594 consensus_queue.cc:260] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.667078 15597 leader_election.cc:290] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.667244 15421 leader_election.cc:304] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 40fb690455fd4a778fbe670376d73807
I20260709 12:18:10.661489 15382 raft_consensus.cc:2468] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 1.
I20260709 12:18:10.668007 15594 ts_tablet_manager.cc:1434] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:18:10.668151 15383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298d7d50e4048048dc3a7102707bcf6" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:10.668828 15383 raft_consensus.cc:2468] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:10.668831 15614 raft_consensus.cc:2804] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:10.669047 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298d7d50e4048048dc3a7102707bcf6" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:10.669742 15456 raft_consensus.cc:2468] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:10.670723 15272 leader_election.cc:304] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:10.671685 15597 raft_consensus.cc:2804] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:10.672031 15597 raft_consensus.cc:493] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.672377 15597 raft_consensus.cc:3060] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.677338 15614 raft_consensus.cc:697] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Becoming Leader. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:10.678522 15614 consensus_queue.cc:237] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.680773 15597 raft_consensus.cc:515] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.684530 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298d7d50e4048048dc3a7102707bcf6" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:10.685307 15384 raft_consensus.cc:3060] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.687582 15617 raft_consensus.cc:493] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.688110 15617 raft_consensus.cc:515] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.696496 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298d7d50e4048048dc3a7102707bcf6" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:10.697156 15456 raft_consensus.cc:3060] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.697227 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa1e225b8694340a3a514e79fe45490" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:10.697947 15309 raft_consensus.cc:2468] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 0.
I20260709 12:18:10.699263 15350 leader_election.cc:304] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:10.700170 15574 raft_consensus.cc:2804] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:10.700531 15574 raft_consensus.cc:493] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.692512 15203 catalog_manager.cc:5697] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:10.700829 15574 raft_consensus.cc:3060] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.702629 15617 leader_election.cc:290] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.692414 15205 catalog_manager.cc:5697] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:10.706858 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa1e225b8694340a3a514e79fe45490" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:10.707476 15457 raft_consensus.cc:2468] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 0.
I20260709 12:18:10.711124 15574 raft_consensus.cc:515] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.714030 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa1e225b8694340a3a514e79fe45490" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:10.714596 15309 raft_consensus.cc:3060] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.699525 15597 leader_election.cc:290] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.722965 15309 raft_consensus.cc:2468] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 1.
I20260709 12:18:10.723354 15574 leader_election.cc:290] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.726598 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa1e225b8694340a3a514e79fe45490" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:10.726881 15350 leader_election.cc:304] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:10.727190 15457 raft_consensus.cc:3060] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.727815 15574 raft_consensus.cc:2804] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:10.728298 15574 raft_consensus.cc:697] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:10.713564 15456 raft_consensus.cc:2468] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:10.729107 15574 consensus_queue.cc:237] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.731168 15274 leader_election.cc:304] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:10.732251 15506 raft_consensus.cc:2804] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:10.732558 15384 raft_consensus.cc:2468] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:10.732744 15506 raft_consensus.cc:697] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:10.733425 15599 raft_consensus.cc:493] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.733736 15506 consensus_queue.cc:237] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.733919 15599 raft_consensus.cc:515] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.735466 15457 raft_consensus.cc:2468] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 1.
I20260709 12:18:10.736984 15599 leader_election.cc:290] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.737797 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4ea5cb7eba404c94be17c6e629ae11" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:10.738474 15384 raft_consensus.cc:2468] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:10.739529 15272 leader_election.cc:304] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:10.739964 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4ea5cb7eba404c94be17c6e629ae11" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:10.740319 15599 raft_consensus.cc:2804] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:10.740777 15599 raft_consensus.cc:493] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.741150 15599 raft_consensus.cc:3060] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.742198 15457 raft_consensus.cc:2468] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 0.
I20260709 12:18:10.751251 15599 raft_consensus.cc:515] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.751591 15203 catalog_manager.cc:5697] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67). New cstate: current_term: 1 leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:10.754055 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4ea5cb7eba404c94be17c6e629ae11" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:10.755146 15599 leader_election.cc:290] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.754653 15384 raft_consensus.cc:3060] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.756707 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4ea5cb7eba404c94be17c6e629ae11" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:10.754575 15204 catalog_manager.cc:5697] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:10.757292 15457 raft_consensus.cc:3060] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.761317 15205 catalog_manager.cc:5697] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:10.763995 15457 raft_consensus.cc:2468] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:10.764770 15205 catalog_manager.cc:5697] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:10.767215 15274 leader_election.cc:304] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:10.768174 15599 raft_consensus.cc:493] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.768667 15599 raft_consensus.cc:515] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.769053 15506 raft_consensus.cc:2804] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:10.774245 15506 raft_consensus.cc:697] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:10.775123 15506 consensus_queue.cc:237] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.775947 15599 leader_election.cc:290] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.776907 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8cf9b6eea8455485079a7ea60216c3" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:10.777144 15383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8cf9b6eea8455485079a7ea60216c3" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:10.778048 15383 raft_consensus.cc:2393] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40fb690455fd4a778fbe670376d73807 in current term 1: Already voted for candidate 376f0d1f5e014993bc041d3f3815f1ef in this term.
I20260709 12:18:10.779234 15272 leader_election.cc:304] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40fb690455fd4a778fbe670376d73807; no voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:10.773438 15384 raft_consensus.cc:2468] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 1.
I20260709 12:18:10.780666 15597 raft_consensus.cc:3060] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.785701 15205 catalog_manager.cc:5697] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:10.787176 15597 raft_consensus.cc:2749] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:10.859082 15597 raft_consensus.cc:493] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.859544 15597 raft_consensus.cc:515] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:10.861126 15597 leader_election.cc:290] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:10.862000 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:10.862131 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:10.862746 15457 raft_consensus.cc:2393] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40fb690455fd4a778fbe670376d73807 in current term 1: Already voted for candidate cfcfc154929046d2a604387040d29ca2 in this term.
I20260709 12:18:10.863606 15274 leader_election.cc:304] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40fb690455fd4a778fbe670376d73807; no voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:10.864181 15597 raft_consensus.cc:3060] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:10.869076 15597 raft_consensus.cc:2749] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:10.916674 15457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a"
dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
mode: GRACEFUL
new_leader_uuid: "40fb690455fd4a778fbe670376d73807"
 from {username='slave'} at 127.0.0.1:52668
I20260709 12:18:10.917202 15457 raft_consensus.cc:606] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Received request to transfer leadership to TS 40fb690455fd4a778fbe670376d73807
I20260709 12:18:10.921558 15309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f298d7d50e4048048dc3a7102707bcf6"
dest_uuid: "40fb690455fd4a778fbe670376d73807"
mode: GRACEFUL
new_leader_uuid: "cfcfc154929046d2a604387040d29ca2"
 from {username='slave'} at 127.0.0.1:46374
I20260709 12:18:10.922046 15309 raft_consensus.cc:606] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Received request to transfer leadership to TS cfcfc154929046d2a604387040d29ca2
I20260709 12:18:10.928687 15457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e8cf9b6eea8455485079a7ea60216c3"
dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
mode: GRACEFUL
new_leader_uuid: "cfcfc154929046d2a604387040d29ca2"
 from {username='slave'} at 127.0.0.1:52668
I20260709 12:18:10.929144 15457 raft_consensus.cc:606] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Received request to transfer leadership to TS cfcfc154929046d2a604387040d29ca2
I20260709 12:18:10.936213 15384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfa1e225b8694340a3a514e79fe45490"
dest_uuid: "cfcfc154929046d2a604387040d29ca2"
mode: GRACEFUL
new_leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:43090
I20260709 12:18:10.936673 15384 raft_consensus.cc:606] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Received request to transfer leadership to TS 376f0d1f5e014993bc041d3f3815f1ef
I20260709 12:18:10.976094 15597 consensus_queue.cc:1048] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:10.986640 15506 consensus_queue.cc:1048] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:10.995525 15617 consensus_queue.cc:1048] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:10.996742 15597 consensus_queue.cc:1048] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:11.013013 15641 consensus_queue.cc:1048] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:11.017098 15506 consensus_queue.cc:1048] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:11.029594 15641 consensus_queue.cc:1048] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:11.051045 15617 consensus_queue.cc:1048] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:11.145917 15614 consensus_queue.cc:1048] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:11.156836 15614 consensus_queue.cc:1048] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:11.165132 15581 raft_consensus.cc:993] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef: : Instructing follower 40fb690455fd4a778fbe670376d73807 to start an election
I20260709 12:18:11.165607 15614 raft_consensus.cc:1081] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Signalling peer 40fb690455fd4a778fbe670376d73807 to start an election
I20260709 12:18:11.167385 15308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a"
dest_uuid: "40fb690455fd4a778fbe670376d73807"
 from {username='slave'} at 127.0.0.1:46350
I20260709 12:18:11.168026 15308 raft_consensus.cc:493] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:11.168390 15308 raft_consensus.cc:3060] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.174593 15308 raft_consensus.cc:515] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.175580 15506 consensus_queue.cc:1048] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:11.176671 15308 leader_election.cc:290] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 2 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:11.177248 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:11.177870 15384 raft_consensus.cc:3060] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.178198 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:11.178768 15456 raft_consensus.cc:3055] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:11.179020 15456 raft_consensus.cc:740] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:11.179695 15456 consensus_queue.cc:260] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.180778 15456 raft_consensus.cc:3060] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.184518 15384 raft_consensus.cc:2468] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 2.
I20260709 12:18:11.185815 15272 leader_election.cc:304] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:11.186589 15506 raft_consensus.cc:2804] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:11.187083 15506 raft_consensus.cc:697] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 2 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:11.187896 15506 consensus_queue.cc:237] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.191097 15506 consensus_queue.cc:1048] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:11.195562 15614 consensus_queue.cc:1048] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:11.198146 15205 catalog_manager.cc:5697] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 1 to 2, leader changed from 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67) to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:11.190541 15456 raft_consensus.cc:2468] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 2.
I20260709 12:18:11.211664 15658 consensus_queue.cc:1048] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:11.221304 15638 raft_consensus.cc:993] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef: : Instructing follower cfcfc154929046d2a604387040d29ca2 to start an election
I20260709 12:18:11.221745 15638 raft_consensus.cc:1081] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Signalling peer cfcfc154929046d2a604387040d29ca2 to start an election
I20260709 12:18:11.223229 15383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e8cf9b6eea8455485079a7ea60216c3"
dest_uuid: "cfcfc154929046d2a604387040d29ca2"
 from {username='slave'} at 127.0.0.1:43076
I20260709 12:18:11.223721 15383 raft_consensus.cc:493] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:11.224059 15383 raft_consensus.cc:3060] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.230201 15383 raft_consensus.cc:515] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.232535 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8cf9b6eea8455485079a7ea60216c3" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:11.232815 15383 leader_election.cc:290] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 2 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:11.233108 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8cf9b6eea8455485079a7ea60216c3" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:11.233052 15308 raft_consensus.cc:3060] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.233876 15457 raft_consensus.cc:3055] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:11.234201 15457 raft_consensus.cc:740] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:11.234910 15457 consensus_queue.cc:260] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.235920 15457 raft_consensus.cc:3060] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.240990 15506 consensus_queue.cc:1048] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:11.247642 15457 raft_consensus.cc:2468] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 2.
I20260709 12:18:11.247869 15308 raft_consensus.cc:2468] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 2.
I20260709 12:18:11.248935 15629 raft_consensus.cc:993] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807: : Instructing follower cfcfc154929046d2a604387040d29ca2 to start an election
I20260709 12:18:11.249373 15349 leader_election.cc:304] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:11.250289 15574 raft_consensus.cc:2804] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:11.250663 15574 raft_consensus.cc:697] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:11.251345 15574 consensus_queue.cc:237] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.249398 15629 raft_consensus.cc:1081] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Signalling peer cfcfc154929046d2a604387040d29ca2 to start an election
I20260709 12:18:11.256958 15384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f298d7d50e4048048dc3a7102707bcf6"
dest_uuid: "cfcfc154929046d2a604387040d29ca2"
 from {username='slave'} at 127.0.0.1:43070
I20260709 12:18:11.257472 15384 raft_consensus.cc:493] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:11.257833 15384 raft_consensus.cc:3060] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.258876 15629 consensus_queue.cc:1048] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:11.265961 15384 raft_consensus.cc:515] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.267177 15203 catalog_manager.cc:5697] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 1 to 2, leader changed from 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67) to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:11.268932 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298d7d50e4048048dc3a7102707bcf6" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:11.269543 15309 raft_consensus.cc:3055] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:11.269850 15309 raft_consensus.cc:740] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:11.270606 15309 consensus_queue.cc:260] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.271485 15309 raft_consensus.cc:3060] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.274360 15384 leader_election.cc:290] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 2 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:11.275403 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298d7d50e4048048dc3a7102707bcf6" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:11.276017 15456 raft_consensus.cc:3060] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.283048 15456 raft_consensus.cc:2468] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 2.
I20260709 12:18:11.284488 15349 leader_election.cc:304] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:11.284804 15309 raft_consensus.cc:2468] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 2.
I20260709 12:18:11.285320 15574 raft_consensus.cc:2804] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:11.285828 15574 raft_consensus.cc:697] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Becoming Leader. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:11.286607 15574 consensus_queue.cc:237] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.290475 15574 consensus_queue.cc:1048] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:11.294425 15204 catalog_manager.cc:5697] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 reported cstate change: term changed from 1 to 2, leader changed from 40fb690455fd4a778fbe670376d73807 (127.4.78.65) to cfcfc154929046d2a604387040d29ca2 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "cfcfc154929046d2a604387040d29ca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:11.303133 15574 consensus_queue.cc:1048] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:11.312939 15667 raft_consensus.cc:993] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2: : Instructing follower 376f0d1f5e014993bc041d3f3815f1ef to start an election
I20260709 12:18:11.313413 15574 raft_consensus.cc:1081] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Signalling peer 376f0d1f5e014993bc041d3f3815f1ef to start an election
I20260709 12:18:11.315130 15456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfa1e225b8694340a3a514e79fe45490"
dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:52666
I20260709 12:18:11.315846 15456 raft_consensus.cc:493] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:11.316207 15456 raft_consensus.cc:3060] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.322315 15456 raft_consensus.cc:515] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.323925 15456 leader_election.cc:290] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:11.324643 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa1e225b8694340a3a514e79fe45490" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:11.325073 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa1e225b8694340a3a514e79fe45490" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:11.325340 15309 raft_consensus.cc:3060] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.325645 15384 raft_consensus.cc:3055] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:11.325973 15384 raft_consensus.cc:740] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:11.326711 15384 consensus_queue.cc:260] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.327854 15384 raft_consensus.cc:3060] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.332489 15309 raft_consensus.cc:2468] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 2.
I20260709 12:18:11.333868 15424 leader_election.cc:304] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:11.334602 15384 raft_consensus.cc:2468] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 2.
I20260709 12:18:11.334738 15638 raft_consensus.cc:2804] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:11.335358 15638 raft_consensus.cc:697] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 LEADER]: Becoming Leader. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:11.336220 15638 consensus_queue.cc:237] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:11.343559 15203 catalog_manager.cc:5697] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef reported cstate change: term changed from 1 to 2, leader changed from cfcfc154929046d2a604387040d29ca2 (127.4.78.66) to 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:11.647903 15308 raft_consensus.cc:1275] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Refusing update from remote peer cfcfc154929046d2a604387040d29ca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:11.649350 15667 consensus_queue.cc:1048] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:11.656512 15456 raft_consensus.cc:1275] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Refusing update from remote peer cfcfc154929046d2a604387040d29ca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:11.658190 15574 consensus_queue.cc:1048] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:11.698700 15456 raft_consensus.cc:1275] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Refusing update from remote peer 40fb690455fd4a778fbe670376d73807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:11.699968 15629 consensus_queue.cc:1048] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:11.707473 15384 raft_consensus.cc:1275] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Refusing update from remote peer 40fb690455fd4a778fbe670376d73807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:11.709594 15629 consensus_queue.cc:1048] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:11.736944 15384 raft_consensus.cc:1275] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:11.737066 15456 raft_consensus.cc:1275] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Refusing update from remote peer cfcfc154929046d2a604387040d29ca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:11.738142 15638 consensus_queue.cc:1048] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:11.738456 15574 consensus_queue.cc:1048] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:11.747510 15309 raft_consensus.cc:1275] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:11.749262 15658 consensus_queue.cc:1048] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:11.749298 15308 raft_consensus.cc:1275] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Refusing update from remote peer cfcfc154929046d2a604387040d29ca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:11.751967 15574 consensus_queue.cc:1048] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:13.544772 15679 raft_consensus.cc:493] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfcfc154929046d2a604387040d29ca2)
I20260709 12:18:13.545444 15679 raft_consensus.cc:515] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:13.547911 15679 leader_election.cc:290] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:13.558650 15683 raft_consensus.cc:493] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40fb690455fd4a778fbe670376d73807)
I20260709 12:18:13.559294 15683 raft_consensus.cc:515] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:13.561383 15683 leader_election.cc:290] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:13.562230 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:13.564575 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:13.565188 15457 raft_consensus.cc:2468] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfcfc154929046d2a604387040d29ca2 in term 2.
I20260709 12:18:13.565626 15676 raft_consensus.cc:493] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cfcfc154929046d2a604387040d29ca2)
I20260709 12:18:13.566157 15676 raft_consensus.cc:515] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:13.568967 15676 leader_election.cc:290] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:13.568991 15349 leader_election.cc:304] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:13.570086 15671 raft_consensus.cc:2804] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.570448 15671 raft_consensus.cc:493] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40fb690455fd4a778fbe670376d73807)
I20260709 12:18:13.570775 15671 raft_consensus.cc:3060] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.572129 15677 raft_consensus.cc:493] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40fb690455fd4a778fbe670376d73807)
I20260709 12:18:13.572677 15677 raft_consensus.cc:515] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:13.574208 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:13.579988 15677 leader_election.cc:290] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:13.581573 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6575b35e91424d748cb8970584e2af56" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:13.582494 15687 raft_consensus.cc:493] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cfcfc154929046d2a604387040d29ca2)
I20260709 12:18:13.583015 15687 raft_consensus.cc:515] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:13.584157 15671 raft_consensus.cc:515] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:13.594969 15676 raft_consensus.cc:493] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfcfc154929046d2a604387040d29ca2)
I20260709 12:18:13.595598 15676 raft_consensus.cc:515] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:13.595966 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58cf9a767de4477b81dfca94405c1bb" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:13.598847 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b936e302bf240b796d4bed4fda04e69" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:13.599330 15676 leader_election.cc:290] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:13.603713 15685 raft_consensus.cc:493] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40fb690455fd4a778fbe670376d73807)
I20260709 12:18:13.604240 15685 raft_consensus.cc:515] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:13.604596 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58cf9a767de4477b81dfca94405c1bb" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:13.606623 15687 leader_election.cc:290] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:13.606961 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:13.607734 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:13.608333 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b936e302bf240b796d4bed4fda04e69" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:13.608907 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6575b35e91424d748cb8970584e2af56" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef" is_pre_election: true
I20260709 12:18:13.611440 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:13.611688 15685 leader_election.cc:290] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:13.613364 15274 leader_election.cc:304] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40fb690455fd4a778fbe670376d73807; no voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:13.614149 15676 raft_consensus.cc:2749] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.614557 15274 leader_election.cc:304] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40fb690455fd4a778fbe670376d73807; no voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:13.615424 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:13.615784 15274 leader_election.cc:304] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40fb690455fd4a778fbe670376d73807; no voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:13.615767 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa4274c181d4a4ba938dd4265a3630b" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:13.615437 15309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa4274c181d4a4ba938dd4265a3630b" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:13.616936 15673 raft_consensus.cc:2749] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.617415 15676 raft_consensus.cc:2749] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.618793 15424 leader_election.cc:304] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef; no voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:13.619580 15687 raft_consensus.cc:2749] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.619971 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "cfcfc154929046d2a604387040d29ca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:13.619987 15424 leader_election.cc:304] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef; no voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:13.620869 15687 raft_consensus.cc:2749] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.619537 15671 leader_election.cc:290] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 3 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:13.621572 15424 leader_election.cc:304] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef; no voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2
I20260709 12:18:13.621899 15350 leader_election.cc:304] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfcfc154929046d2a604387040d29ca2; no voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807
I20260709 12:18:13.622431 15687 raft_consensus.cc:2749] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.622748 15671 raft_consensus.cc:2749] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.005144 15382 raft_consensus.cc:1240] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Rejecting Update request from peer 40fb690455fd4a778fbe670376d73807 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.006253 15680 consensus_queue.cc:1059] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:14.006978 15676 raft_consensus.cc:3055] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.007254 15676 raft_consensus.cc:740] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:14.007865 15676 consensus_queue.cc:260] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:14.008826 15676 raft_consensus.cc:3060] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.108107 15206 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53982:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:18:14.128430 15206 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53982:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:18:14.157742  4409 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:14.207985 15384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3"
dest_uuid: "cfcfc154929046d2a604387040d29ca2"
mode: GRACEFUL
new_leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:41522
I20260709 12:18:14.216676 15384 raft_consensus.cc:606] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Received request to transfer leadership to TS 376f0d1f5e014993bc041d3f3815f1ef
I20260709 12:18:14.229390 15717 tablet.cc:1724] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.234193 15718 tablet.cc:1724] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:14.280805 15410 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:f298d7d50e4048048dc3a7102707bcf6)
I20260709 12:18:14.292912 15716 tablet.cc:1724] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.303608 15683 raft_consensus.cc:993] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2: : Instructing follower 376f0d1f5e014993bc041d3f3815f1ef to start an election
I20260709 12:18:14.304219 15683 raft_consensus.cc:1081] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Signalling peer 376f0d1f5e014993bc041d3f3815f1ef to start an election
W20260709 12:18:14.338917 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:45481, user_credentials={real_user=slave}} blocked reactor thread for 65899us
W20260709 12:18:14.334064 15421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.66:35767, user_credentials={real_user=slave}} blocked reactor thread for 49512us
W20260709 12:18:14.364579 15410 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:f298d7d50e4048048dc3a7102707bcf6)
W20260709 12:18:14.365654 15410 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:f298d7d50e4048048dc3a7102707bcf6)
I20260709 12:18:14.368328 15723 tablet.cc:1724] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.402164 15733 tablet.cc:1724] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.426949 15718 tablet.cc:1724] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:14.437526 15722 log.cc:927] Time spent T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:18:14.458859 15717 tablet.cc:1724] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.443110 15455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3"
dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:52666
I20260709 12:18:14.484599 15734 tablet.cc:1724] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.486088 15455 raft_consensus.cc:493] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:14.509801 15455 raft_consensus.cc:3060] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.524283 15733 tablet.cc:1724] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.511909 15745 tablet.cc:1724] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.551049 15717 tablet.cc:1724] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.556531 15455 raft_consensus.cc:515] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:14.575001 15743 tablet.cc:1724] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:14.576936 15479 debug-util.cc:398] Leaking SignalData structure 0x7b080038d280 after lost signal to thread 4412
W20260709 12:18:14.578148 15479 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe380 after lost signal to thread 15241
I20260709 12:18:14.581818 15723 tablet.cc:1724] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.582113 15749 tablet.cc:1724] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:14.571776 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.67:45481, user_credentials={real_user=slave}} blocked reactor thread for 52411.2us
I20260709 12:18:14.573323 15716 tablet.cc:1724] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:14.594714 15479 debug-util.cc:398] Leaking SignalData structure 0x7b080016ac00 after lost signal to thread 15482
I20260709 12:18:14.601243 15751 tablet.cc:1724] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.607523 15718 tablet.cc:1724] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.610759 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:14.611557 15302 raft_consensus.cc:3060] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.606411 15752 tablet.cc:1724] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.615859 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5d6a219d9e48dbaa370121656f76c3" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:14.616586 15379 raft_consensus.cc:3055] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.616885 15379 raft_consensus.cc:740] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:14.617710 15379 consensus_queue.cc:260] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:14.618989 15379 raft_consensus.cc:3060] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.620478 15751 tablet.cc:1724] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.622555 15716 tablet.cc:1724] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.630359 15301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a"
dest_uuid: "40fb690455fd4a778fbe670376d73807"
mode: GRACEFUL
new_leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:46458
I20260709 12:18:14.631762 15751 tablet.cc:1724] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.634014 15455 leader_election.cc:290] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:14.632788 15717 tablet.cc:1724] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.644178 15734 tablet.cc:1724] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.650198 15301 raft_consensus.cc:606] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 2 LEADER]: Received request to transfer leadership to TS 376f0d1f5e014993bc041d3f3815f1ef
I20260709 12:18:14.665189  4409 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:18:14.662096 15302 raft_consensus.cc:2468] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 2.
I20260709 12:18:14.665954  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:14.681511 15379 raft_consensus.cc:2468] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 2.
I20260709 12:18:14.687795 15754 tablet.cc:1724] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.684412 15424 leader_election.cc:304] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:14.690022 15685 raft_consensus.cc:2804] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:14.690485 15685 raft_consensus.cc:697] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 LEADER]: Becoming Leader. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:14.691252 15685 consensus_queue.cc:237] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:14.673156 15749 tablet.cc:1724] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.698800 15723 tablet.cc:1724] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.700698 15302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "871ff99eb1ce422c8ede104ce618c2e2"
dest_uuid: "40fb690455fd4a778fbe670376d73807"
mode: GRACEFUL
new_leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:46458
I20260709 12:18:14.701386 15302 raft_consensus.cc:606] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Received request to transfer leadership to TS 376f0d1f5e014993bc041d3f3815f1ef
I20260709 12:18:14.705092 15379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9"
dest_uuid: "cfcfc154929046d2a604387040d29ca2"
mode: GRACEFUL
new_leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:41522
I20260709 12:18:14.705735 15379 raft_consensus.cc:606] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Received request to transfer leadership to TS 376f0d1f5e014993bc041d3f3815f1ef
I20260709 12:18:14.707724  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:14.708350  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:14.711333 15752 tablet.cc:1724] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:14.736150 15206 catalog_manager.cc:6242] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71: soft_deleted_table [id=f842f55d6c3e452681998b198246d1ad] alter complete (version 1)
I20260709 12:18:14.744568 15205 catalog_manager.cc:5697] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef reported cstate change: term changed from 1 to 2, leader changed from cfcfc154929046d2a604387040d29ca2 (127.4.78.66) to 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.023283 15671 raft_consensus.cc:993] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2: : Instructing follower 376f0d1f5e014993bc041d3f3815f1ef to start an election
I20260709 12:18:15.023882 15744 raft_consensus.cc:1081] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Signalling peer 376f0d1f5e014993bc041d3f3815f1ef to start an election
I20260709 12:18:15.025839 15455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9"
dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:52666
I20260709 12:18:15.026408 15455 raft_consensus.cc:493] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:15.026832 15455 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.029789 15673 raft_consensus.cc:993] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807: : Instructing follower 376f0d1f5e014993bc041d3f3815f1ef to start an election
I20260709 12:18:15.030535 15748 raft_consensus.cc:1081] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 2 LEADER]: Signalling peer 376f0d1f5e014993bc041d3f3815f1ef to start an election
I20260709 12:18:15.032526 15457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a"
dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:52660
I20260709 12:18:15.033095 15457 raft_consensus.cc:493] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:15.033432 15457 raft_consensus.cc:3060] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.033742 15455 raft_consensus.cc:515] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.036412 15455 leader_election.cc:290] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 3 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:15.037590 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:15.038282 15382 raft_consensus.cc:3055] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:15.038569 15382 raft_consensus.cc:740] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cfcfc154929046d2a604387040d29ca2, State: Running, Role: LEADER
I20260709 12:18:15.039377 15382 consensus_queue.cc:260] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.040058 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:15.040616 15302 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.041443 15457 raft_consensus.cc:515] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.040627 15382 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.044111 15457 leader_election.cc:290] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 3 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:15.048880 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:15.049474 15379 raft_consensus.cc:3060] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.050034 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa38d6149c764c27b0745a20f6ade89a" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:15.050664 15306 raft_consensus.cc:3055] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:15.050957 15306 raft_consensus.cc:740] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:15.053272 15306 consensus_queue.cc:260] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.054209 15382 raft_consensus.cc:2468] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 3.
I20260709 12:18:15.055385 15421 leader_election.cc:304] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:15.057191 15685 raft_consensus.cc:2804] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:15.057665 15685 raft_consensus.cc:697] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 3 LEADER]: Becoming Leader. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:15.058727 15302 raft_consensus.cc:2468] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 3.
I20260709 12:18:15.058542 15685 consensus_queue.cc:237] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.054428 15306 raft_consensus.cc:3060] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.061674 15673 raft_consensus.cc:993] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807: : Instructing follower 376f0d1f5e014993bc041d3f3815f1ef to start an election
I20260709 12:18:15.062335 15724 raft_consensus.cc:1081] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Signalling peer 376f0d1f5e014993bc041d3f3815f1ef to start an election
I20260709 12:18:15.066039 15455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "871ff99eb1ce422c8ede104ce618c2e2"
dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
 from {username='slave'} at 127.0.0.1:52660
I20260709 12:18:15.066676 15455 raft_consensus.cc:493] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:15.066804 15379 raft_consensus.cc:2468] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 3.
I20260709 12:18:15.072126 15384 raft_consensus.cc:1240] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Rejecting Update request from peer 40fb690455fd4a778fbe670376d73807 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:15.068389 15306 raft_consensus.cc:2468] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 3.
I20260709 12:18:15.073680 15455 raft_consensus.cc:3060] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:15.079366 15205 catalog_manager.cc:5697] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef reported cstate change: term changed from 2 to 3, leader changed from cfcfc154929046d2a604387040d29ca2 (127.4.78.66) to 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.080644 15421 leader_election.cc:304] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:15.081406 15455 raft_consensus.cc:515] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.081861 15685 raft_consensus.cc:2804] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:15.083316 15685 raft_consensus.cc:697] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 3 LEADER]: Becoming Leader. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:15.083762 15455 leader_election.cc:290] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:15.084823 15685 consensus_queue.cc:237] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.087360 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871ff99eb1ce422c8ede104ce618c2e2" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:15.088068 15306 raft_consensus.cc:3055] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:15.088384 15306 raft_consensus.cc:740] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:15.089190 15306 consensus_queue.cc:260] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.090585 15306 raft_consensus.cc:3060] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:15.090682 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871ff99eb1ce422c8ede104ce618c2e2" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:15.091960 15384 raft_consensus.cc:3060] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:15.096881 15206 catalog_manager.cc:5697] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef reported cstate change: term changed from 2 to 3, leader changed from 40fb690455fd4a778fbe670376d73807 (127.4.78.65) to 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.097863 15306 raft_consensus.cc:2468] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 2.
I20260709 12:18:15.098703 15384 raft_consensus.cc:2468] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 2.
I20260709 12:18:15.099169 15424 leader_election.cc:304] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: 
I20260709 12:18:15.100417 15736 raft_consensus.cc:2804] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:15.100416 15685 raft_consensus.cc:493] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40fb690455fd4a778fbe670376d73807)
I20260709 12:18:15.101312 15685 raft_consensus.cc:515] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.103466 15685 leader_election.cc:290] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:15.105283 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2" is_pre_election: true
I20260709 12:18:15.106360 15384 raft_consensus.cc:2393] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 376f0d1f5e014993bc041d3f3815f1ef in current term 3: Already voted for candidate cfcfc154929046d2a604387040d29ca2 in this term.
I20260709 12:18:15.107697 15736 raft_consensus.cc:697] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 LEADER]: Becoming Leader. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:15.108734 15736 consensus_queue.cc:237] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.109270 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807" is_pre_election: true
I20260709 12:18:15.109951 15306 raft_consensus.cc:2468] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 3.
I20260709 12:18:15.110931 15424 leader_election.cc:304] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: cfcfc154929046d2a604387040d29ca2
I20260709 12:18:15.111761 15759 raft_consensus.cc:2804] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.112121 15759 raft_consensus.cc:493] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40fb690455fd4a778fbe670376d73807)
I20260709 12:18:15.112397 15759 raft_consensus.cc:3060] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.119099 15206 catalog_manager.cc:5697] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef reported cstate change: term changed from 1 to 2, leader changed from 40fb690455fd4a778fbe670376d73807 (127.4.78.65) to 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67). New cstate: current_term: 2 leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.121181 15759 raft_consensus.cc:515] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.123860 15759 leader_election.cc:290] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 3 election: Requested vote from peers 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187), cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767)
I20260709 12:18:15.124433 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40fb690455fd4a778fbe670376d73807"
I20260709 12:18:15.124940 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2be86f2b0d4debb255d35e38fefc7b" candidate_uuid: "376f0d1f5e014993bc041d3f3815f1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:15.125684 15384 raft_consensus.cc:2393] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 376f0d1f5e014993bc041d3f3815f1ef in current term 3: Already voted for candidate cfcfc154929046d2a604387040d29ca2 in this term.
I20260709 12:18:15.131537 15306 raft_consensus.cc:2468] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376f0d1f5e014993bc041d3f3815f1ef in term 3.
I20260709 12:18:15.132921 15424 leader_election.cc:304] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 376f0d1f5e014993bc041d3f3815f1ef, 40fb690455fd4a778fbe670376d73807; no voters: cfcfc154929046d2a604387040d29ca2
I20260709 12:18:15.133663 15759 raft_consensus.cc:2804] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:15.134878 15759 raft_consensus.cc:697] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 3 LEADER]: Becoming Leader. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:15.135746 15759 consensus_queue.cc:237] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.145010 15206 catalog_manager.cc:5697] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef reported cstate change: term changed from 2 to 3, leader changed from 40fb690455fd4a778fbe670376d73807 (127.4.78.65) to 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67). New cstate: current_term: 3 leader_uuid: "376f0d1f5e014993bc041d3f3815f1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.278246 15306 raft_consensus.cc:1275] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:15.279731 15736 consensus_queue.cc:1048] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.294916 15384 raft_consensus.cc:1275] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:15.296543 15736 consensus_queue.cc:1048] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.485349 15306 raft_consensus.cc:1275] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:15.486801 15736 consensus_queue.cc:1048] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.503949 15384 raft_consensus.cc:1275] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:15.505569 15759 consensus_queue.cc:1048] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.518994 15379 raft_consensus.cc:1275] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:15.520336 15759 consensus_queue.cc:1048] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:15.534248 15306 raft_consensus.cc:1275] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:15.536002 15736 consensus_queue.cc:1048] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:15.554929 15379 raft_consensus.cc:1275] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:15.556177 15736 consensus_queue.cc:1048] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:15.564563 15306 raft_consensus.cc:1275] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:15.566125 15759 consensus_queue.cc:1048] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:15.710475  4409 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:15.718080  4409 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:15.718669  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:15.720202 15379 raft_consensus.cc:1275] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:15.722566 15759 consensus_queue.cc:1048] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.734267 15306 raft_consensus.cc:1275] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Refusing update from remote peer 376f0d1f5e014993bc041d3f3815f1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:15.735972 15759 consensus_queue.cc:1048] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.780634 15455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9"
dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
mode: GRACEFUL
new_leader_uuid: "40fb690455fd4a778fbe670376d73807"
 from {username='slave'} at 127.0.0.1:49020
I20260709 12:18:15.781251 15455 raft_consensus.cc:606] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 3 LEADER]: Received request to transfer leadership to TS 40fb690455fd4a778fbe670376d73807
I20260709 12:18:15.782511  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:18:15.783062  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:15.893963 15685 raft_consensus.cc:993] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef: : Instructing follower 40fb690455fd4a778fbe670376d73807 to start an election
I20260709 12:18:15.894460 15759 raft_consensus.cc:1081] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 3 LEADER]: Signalling peer 40fb690455fd4a778fbe670376d73807 to start an election
I20260709 12:18:15.895859 15306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9"
dest_uuid: "40fb690455fd4a778fbe670376d73807"
 from {username='slave'} at 127.0.0.1:46350
I20260709 12:18:15.896459 15306 raft_consensus.cc:493] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:15.896828 15306 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.904006 15306 raft_consensus.cc:515] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.906922 15384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cfcfc154929046d2a604387040d29ca2"
I20260709 12:18:15.907477 15384 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.909791 15306 leader_election.cc:290] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 4 election: Requested vote from peers cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767), 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67:45481)
I20260709 12:18:15.911682 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f28ced2be34f94a52200f6cdc787c9" candidate_uuid: "40fb690455fd4a778fbe670376d73807" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "376f0d1f5e014993bc041d3f3815f1ef"
I20260709 12:18:15.912250 15455 raft_consensus.cc:3055] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:15.912577 15455 raft_consensus.cc:740] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 376f0d1f5e014993bc041d3f3815f1ef, State: Running, Role: LEADER
I20260709 12:18:15.913367 15455 consensus_queue.cc:260] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.913797 15384 raft_consensus.cc:2468] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 4.
I20260709 12:18:15.914563 15455 raft_consensus.cc:3060] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.915007 15272 leader_election.cc:304] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fb690455fd4a778fbe670376d73807, cfcfc154929046d2a604387040d29ca2; no voters: 
I20260709 12:18:15.915854 15724 raft_consensus.cc:2804] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:15.916327 15724 raft_consensus.cc:697] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 4 LEADER]: Becoming Leader. State: Replica: 40fb690455fd4a778fbe670376d73807, State: Running, Role: LEADER
I20260709 12:18:15.917147 15724 consensus_queue.cc:237] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } }
I20260709 12:18:15.921448 15455 raft_consensus.cc:2468] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fb690455fd4a778fbe670376d73807 in term 4.
I20260709 12:18:15.925858 15206 catalog_manager.cc:5697] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 reported cstate change: term changed from 3 to 4, leader changed from 376f0d1f5e014993bc041d3f3815f1ef (127.4.78.67) to 40fb690455fd4a778fbe670376d73807 (127.4.78.65). New cstate: current_term: 4 leader_uuid: "40fb690455fd4a778fbe670376d73807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fb690455fd4a778fbe670376d73807" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:16.373485 15455 raft_consensus.cc:1275] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 4 FOLLOWER]: Refusing update from remote peer 40fb690455fd4a778fbe670376d73807: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:16.374835 15724 consensus_queue.cc:1048] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376f0d1f5e014993bc041d3f3815f1ef" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:16.386098 15384 raft_consensus.cc:1275] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 4 FOLLOWER]: Refusing update from remote peer 40fb690455fd4a778fbe670376d73807: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:16.387609 15724 consensus_queue.cc:1048] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfc154929046d2a604387040d29ca2" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:16.783998  4409 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:16.790038  4409 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:16.790452  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:16.795610  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:16.796054  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:17.797029  4409 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:17.802942  4409 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:17.803431  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:17.808521  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:17.808863  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:18.810194  4409 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:18.816124  4409 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:18.816557  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:18.820963  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:18.821323  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:19.822403  4409 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:19.827477  4409 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:19.827843  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:19.833005  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:19.833328  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:21.326746  4409 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:21.332173  4409 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:21.332659  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:21.340193  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:21.340633  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:21.878365 15405 debug-util.cc:398] Leaking SignalData structure 0x7b080026d6a0 after lost signal to thread 4412
W20260709 12:18:21.879659 15405 debug-util.cc:398] Leaking SignalData structure 0x7b080023af40 after lost signal to thread 15241
W20260709 12:18:21.881163 15405 debug-util.cc:398] Leaking SignalData structure 0x7b0800358800 after lost signal to thread 15333
W20260709 12:18:21.882547 15405 debug-util.cc:398] Leaking SignalData structure 0x7b080003a460 after lost signal to thread 15408
W20260709 12:18:21.883937 15405 debug-util.cc:398] Leaking SignalData structure 0x7b0800307680 after lost signal to thread 15482
I20260709 12:18:22.341531  4409 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:22.346865  4409 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:22.347283  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:22.352875  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:22.353240  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:23.354285  4409 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:23.359464  4409 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:23.359912  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:23.364727  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:23.365247  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:24.366288  4409 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:24.371858  4409 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:24.372356  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:24.377224  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:24.377643  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:25.431180  4409 tablet_server.cc:179] TabletServer@127.4.78.65:0 shutting down...
W20260709 12:18:25.457944 15424 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:18:25.463814 15424 consensus_peers.cc:597] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef -> Peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Couldn't send request to peer 40fb690455fd4a778fbe670376d73807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:25.466948  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:25.467938  4409 tablet_replica.cc:333] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.469182  4409 raft_consensus.cc:2243] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.470132  4409 raft_consensus.cc:2272] T 4e8cf9b6eea8455485079a7ea60216c3 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:25.472384 15350 consensus_peers.cc:597] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 -> Peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Couldn't send request to peer 40fb690455fd4a778fbe670376d73807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:25.473272  4409 tablet_replica.cc:333] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.474081  4409 raft_consensus.cc:2243] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.474647  4409 raft_consensus.cc:2272] T cfa1e225b8694340a3a514e79fe45490 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.477061  4409 tablet_replica.cc:333] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.477728  4409 raft_consensus.cc:2243] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.478319  4409 raft_consensus.cc:2272] T f298d7d50e4048048dc3a7102707bcf6 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.480844  4409 tablet_replica.cc:333] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.481706  4409 raft_consensus.cc:2243] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.482848  4409 raft_consensus.cc:2272] T caa4274c181d4a4ba938dd4265a3630b P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.486189  4409 tablet_replica.cc:333] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.487044  4409 raft_consensus.cc:2243] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.488011  4409 raft_consensus.cc:2272] T b8f28ced2be34f94a52200f6cdc787c9 P 40fb690455fd4a778fbe670376d73807 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.491475  4409 tablet_replica.cc:333] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.492206  4409 raft_consensus.cc:2243] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.492769  4409 raft_consensus.cc:2272] T ed9c4cb9c00045619b0ba92cf7622817 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.495122  4409 tablet_replica.cc:333] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.495716  4409 raft_consensus.cc:2243] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.496170  4409 raft_consensus.cc:2272] T fa38d6149c764c27b0745a20f6ade89a P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.498420  4409 tablet_replica.cc:333] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.498977  4409 raft_consensus.cc:2243] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.499387  4409 raft_consensus.cc:2272] T 324ce7d305c2400f8be7dc122371aea5 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.501576  4409 tablet_replica.cc:333] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.502174  4409 raft_consensus.cc:2243] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.502683  4409 raft_consensus.cc:2272] T 5a5d6a219d9e48dbaa370121656f76c3 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.505213  4409 tablet_replica.cc:333] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.505980  4409 raft_consensus.cc:2243] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.506579  4409 raft_consensus.cc:2272] T 0b936e302bf240b796d4bed4fda04e69 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.509456  4409 tablet_replica.cc:333] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.510125  4409 raft_consensus.cc:2243] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.510716  4409 raft_consensus.cc:2272] T b2e2117b92054e8692ab0a648e9034ef P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.513099  4409 tablet_replica.cc:333] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.513621  4409 raft_consensus.cc:2243] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.514171  4409 raft_consensus.cc:2272] T 6575b35e91424d748cb8970584e2af56 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.516448  4409 tablet_replica.cc:333] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.516992  4409 raft_consensus.cc:2243] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.517459  4409 raft_consensus.cc:2272] T 0a2be86f2b0d4debb255d35e38fefc7b P 40fb690455fd4a778fbe670376d73807 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.519806  4409 tablet_replica.cc:333] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.520390  4409 raft_consensus.cc:2243] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.521235  4409 raft_consensus.cc:2272] T d58cf9a767de4477b81dfca94405c1bb P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.523576  4409 tablet_replica.cc:333] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.524096  4409 raft_consensus.cc:2243] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.524974  4409 raft_consensus.cc:2272] T 2852e548dc65469abd36a65d8b6b2559 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.527345  4409 tablet_replica.cc:333] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.528005  4409 raft_consensus.cc:2243] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.528990  4409 raft_consensus.cc:2272] T 7a4ea5cb7eba404c94be17c6e629ae11 P 40fb690455fd4a778fbe670376d73807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:25.531556 15350 consensus_peers.cc:597] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 -> Peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Couldn't send request to peer 40fb690455fd4a778fbe670376d73807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:25.531930  4409 tablet_replica.cc:333] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.532562  4409 raft_consensus.cc:2243] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.533429  4409 raft_consensus.cc:2272] T a36d5ce297d642f0b8d6a39be10b4dcf P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.535917  4409 tablet_replica.cc:333] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807: stopping tablet replica
I20260709 12:18:25.536419  4409 raft_consensus.cc:2243] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.536867  4409 raft_consensus.cc:2272] T 871ff99eb1ce422c8ede104ce618c2e2 P 40fb690455fd4a778fbe670376d73807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.582261  4409 tablet_server.cc:196] TabletServer@127.4.78.65:0 shutdown complete.
W20260709 12:18:25.591678 15424 consensus_peers.cc:597] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef -> Peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Couldn't send request to peer 40fb690455fd4a778fbe670376d73807. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:25.599026 15424 consensus_peers.cc:597] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef -> Peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Couldn't send request to peer 40fb690455fd4a778fbe670376d73807. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:25.629247  4409 tablet_server.cc:179] TabletServer@127.4.78.66:0 shutting down...
I20260709 12:18:25.655809  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:25.656628  4409 tablet_replica.cc:333] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.657589  4409 raft_consensus.cc:2243] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.658424  4409 raft_consensus.cc:2272] T caa4274c181d4a4ba938dd4265a3630b P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:25.659955 15424 consensus_peers.cc:597] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef -> Peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Couldn't send request to peer 40fb690455fd4a778fbe670376d73807. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:25.661402  4409 tablet_replica.cc:333] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.662117  4409 raft_consensus.cc:2243] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.662632  4409 raft_consensus.cc:2272] T cfa1e225b8694340a3a514e79fe45490 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.664810  4409 tablet_replica.cc:333] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.665457  4409 raft_consensus.cc:2243] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.666320  4409 raft_consensus.cc:2272] T 4e8cf9b6eea8455485079a7ea60216c3 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.668462  4409 tablet_replica.cc:333] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.669035  4409 raft_consensus.cc:2243] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.669487  4409 raft_consensus.cc:2272] T fa38d6149c764c27b0745a20f6ade89a P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.671612  4409 tablet_replica.cc:333] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.672093  4409 raft_consensus.cc:2243] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.672821  4409 raft_consensus.cc:2272] T f298d7d50e4048048dc3a7102707bcf6 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.675021  4409 tablet_replica.cc:333] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.675534  4409 raft_consensus.cc:2243] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.676295  4409 raft_consensus.cc:2272] T 324ce7d305c2400f8be7dc122371aea5 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.679171  4409 tablet_replica.cc:333] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.679900  4409 raft_consensus.cc:2243] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:18:25.680375 15421 consensus_peers.cc:597] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef -> Peer cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767): Couldn't send request to peer cfcfc154929046d2a604387040d29ca2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:25.680513  4409 raft_consensus.cc:2272] T b8f28ced2be34f94a52200f6cdc787c9 P cfcfc154929046d2a604387040d29ca2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.683120  4409 tablet_replica.cc:333] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.683691  4409 raft_consensus.cc:2243] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.684206  4409 raft_consensus.cc:2272] T ed9c4cb9c00045619b0ba92cf7622817 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.686530  4409 tablet_replica.cc:333] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.687100  4409 raft_consensus.cc:2243] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.687891  4409 raft_consensus.cc:2272] T 0b936e302bf240b796d4bed4fda04e69 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.690100  4409 tablet_replica.cc:333] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.690636  4409 raft_consensus.cc:2243] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.691223  4409 raft_consensus.cc:2272] T 5a5d6a219d9e48dbaa370121656f76c3 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.693473  4409 tablet_replica.cc:333] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.694011  4409 raft_consensus.cc:2243] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.695060  4409 raft_consensus.cc:2272] T b2e2117b92054e8692ab0a648e9034ef P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.697438  4409 tablet_replica.cc:333] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.698067  4409 raft_consensus.cc:2243] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.698488  4409 raft_consensus.cc:2272] T 0a2be86f2b0d4debb255d35e38fefc7b P cfcfc154929046d2a604387040d29ca2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.700623  4409 tablet_replica.cc:333] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.701104  4409 raft_consensus.cc:2243] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.701939  4409 raft_consensus.cc:2272] T 6575b35e91424d748cb8970584e2af56 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.704609  4409 tablet_replica.cc:333] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.705335  4409 raft_consensus.cc:2243] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.706018  4409 raft_consensus.cc:2272] T 7a4ea5cb7eba404c94be17c6e629ae11 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:25.707315 15421 consensus_peers.cc:597] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef -> Peer cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767): Couldn't send request to peer cfcfc154929046d2a604387040d29ca2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:25.708648  4409 tablet_replica.cc:333] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.709283  4409 raft_consensus.cc:2243] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.709729  4409 raft_consensus.cc:2272] T a36d5ce297d642f0b8d6a39be10b4dcf P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.711897  4409 tablet_replica.cc:333] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.712374  4409 raft_consensus.cc:2243] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.712796  4409 raft_consensus.cc:2272] T 871ff99eb1ce422c8ede104ce618c2e2 P cfcfc154929046d2a604387040d29ca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.714844  4409 tablet_replica.cc:333] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.715312  4409 raft_consensus.cc:2243] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.715728  4409 raft_consensus.cc:2272] T d58cf9a767de4477b81dfca94405c1bb P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.717861  4409 tablet_replica.cc:333] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2: stopping tablet replica
I20260709 12:18:25.718309  4409 raft_consensus.cc:2243] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.718719  4409 raft_consensus.cc:2272] T 2852e548dc65469abd36a65d8b6b2559 P cfcfc154929046d2a604387040d29ca2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:25.748996 15421 consensus_peers.cc:597] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef -> Peer cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767): Couldn't send request to peer cfcfc154929046d2a604387040d29ca2. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:25.778195  4409 tablet_server.cc:196] TabletServer@127.4.78.66:0 shutdown complete.
I20260709 12:18:25.815713  4409 tablet_server.cc:179] TabletServer@127.4.78.67:0 shutting down...
I20260709 12:18:25.842435  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:25.843187  4409 tablet_replica.cc:333] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.844040  4409 raft_consensus.cc:2243] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.844712  4409 raft_consensus.cc:2272] T f298d7d50e4048048dc3a7102707bcf6 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.847774  4409 tablet_replica.cc:333] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
W20260709 12:18:25.848371 15421 consensus_peers.cc:597] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef -> Peer cfcfc154929046d2a604387040d29ca2 (127.4.78.66:35767): Couldn't send request to peer cfcfc154929046d2a604387040d29ca2. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.66:35767: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:25.848548  4409 raft_consensus.cc:2243] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.849493  4409 raft_consensus.cc:2272] T fa38d6149c764c27b0745a20f6ade89a P 376f0d1f5e014993bc041d3f3815f1ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.851773  4409 tablet_replica.cc:333] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.852348  4409 raft_consensus.cc:2243] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.853174  4409 raft_consensus.cc:2272] T cfa1e225b8694340a3a514e79fe45490 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.855434  4409 tablet_replica.cc:333] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.856019  4409 raft_consensus.cc:2243] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.856488  4409 raft_consensus.cc:2272] T 4e8cf9b6eea8455485079a7ea60216c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.858731  4409 tablet_replica.cc:333] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.859289  4409 raft_consensus.cc:2243] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.859757  4409 raft_consensus.cc:2272] T 0b936e302bf240b796d4bed4fda04e69 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.861991  4409 tablet_replica.cc:333] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.862557  4409 raft_consensus.cc:2243] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.863377  4409 raft_consensus.cc:2272] T 5a5d6a219d9e48dbaa370121656f76c3 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.865999  4409 tablet_replica.cc:333] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.866755  4409 raft_consensus.cc:2243] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:18:25.867142 15424 consensus_peers.cc:597] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef -> Peer 40fb690455fd4a778fbe670376d73807 (127.4.78.65:46187): Couldn't send request to peer 40fb690455fd4a778fbe670376d73807. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:25.867370  4409 raft_consensus.cc:2272] T b2e2117b92054e8692ab0a648e9034ef P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.869488  4409 tablet_replica.cc:333] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.870092  4409 raft_consensus.cc:2243] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.870555  4409 raft_consensus.cc:2272] T caa4274c181d4a4ba938dd4265a3630b P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.872593  4409 tablet_replica.cc:333] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.873070  4409 raft_consensus.cc:2243] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.873868  4409 raft_consensus.cc:2272] T ed9c4cb9c00045619b0ba92cf7622817 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.875774  4409 tablet_replica.cc:333] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.876247  4409 raft_consensus.cc:2243] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.876669  4409 raft_consensus.cc:2272] T b8f28ced2be34f94a52200f6cdc787c9 P 376f0d1f5e014993bc041d3f3815f1ef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.878662  4409 tablet_replica.cc:333] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.879148  4409 raft_consensus.cc:2243] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.879508  4409 raft_consensus.cc:2272] T 324ce7d305c2400f8be7dc122371aea5 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.881497  4409 tablet_replica.cc:333] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.882006  4409 raft_consensus.cc:2243] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.882409  4409 raft_consensus.cc:2272] T 6575b35e91424d748cb8970584e2af56 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.884366  4409 tablet_replica.cc:333] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.884815  4409 raft_consensus.cc:2243] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.885592  4409 raft_consensus.cc:2272] T 0a2be86f2b0d4debb255d35e38fefc7b P 376f0d1f5e014993bc041d3f3815f1ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.887614  4409 tablet_replica.cc:333] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.888067  4409 raft_consensus.cc:2243] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.888489  4409 raft_consensus.cc:2272] T d58cf9a767de4477b81dfca94405c1bb P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.890568  4409 tablet_replica.cc:333] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.891052  4409 raft_consensus.cc:2243] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.891430  4409 raft_consensus.cc:2272] T 2852e548dc65469abd36a65d8b6b2559 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.893379  4409 tablet_replica.cc:333] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.893859  4409 raft_consensus.cc:2243] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:25.894626  4409 raft_consensus.cc:2272] T 871ff99eb1ce422c8ede104ce618c2e2 P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.896574  4409 tablet_replica.cc:333] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.897051  4409 raft_consensus.cc:2243] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.897496  4409 raft_consensus.cc:2272] T 7a4ea5cb7eba404c94be17c6e629ae11 P 376f0d1f5e014993bc041d3f3815f1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.899629  4409 tablet_replica.cc:333] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef: stopping tablet replica
I20260709 12:18:25.900111  4409 raft_consensus.cc:2243] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:25.900524  4409 raft_consensus.cc:2272] T a36d5ce297d642f0b8d6a39be10b4dcf P 376f0d1f5e014993bc041d3f3815f1ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:25.965163  4409 tablet_server.cc:196] TabletServer@127.4.78.67:0 shutdown complete.
I20260709 12:18:26.000095  4409 master.cc:562] Master@127.4.78.126:44551 shutting down...
I20260709 12:18:26.021968  4409 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:26.022605  4409 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.022923  4409 tablet_replica.cc:333] T 00000000000000000000000000000000 P ba7116787a414414ac2509fdac078b71: stopping tablet replica
I20260709 12:18:26.042917  4409 master.cc:584] Master@127.4.78.126:44551 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20887 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:18:26.092211  4409 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.78.126:41023
I20260709 12:18:26.093355  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:26.098672 15814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:26.099378 15815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:26.099977 15817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:26.100530  4409 server_base.cc:1061] running on GCE node
I20260709 12:18:26.101492  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:26.101671  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:26.101861  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599506101842 us; error 0 us; skew 500 ppm
I20260709 12:18:26.102349  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:26.105283  4409 webserver.cc:533] Webserver started at http://127.4.78.126:34435/ using document root <none> and password file <none>
I20260709 12:18:26.106020  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:26.106225  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:26.106544  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:26.107776  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/master-0-root/instance:
uuid: "82a1e439ac334de3adcee3539c4c2762"
format_stamp: "Formatted at 2026-07-09 12:18:26 on dist-test-slave-9t7s"
I20260709 12:18:26.112336  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:18:26.115607 15822 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:26.116382  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:18:26.116637  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/master-0-root
uuid: "82a1e439ac334de3adcee3539c4c2762"
format_stamp: "Formatted at 2026-07-09 12:18:26 on dist-test-slave-9t7s"
I20260709 12:18:26.116870  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:26.131158  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:26.132310  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:26.168689  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.126:41023
I20260709 12:18:26.168780 15873 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.126:41023 every 8 connection(s)
I20260709 12:18:26.172808 15874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.183833 15874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762: Bootstrap starting.
I20260709 12:18:26.188647 15874 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.192998 15874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762: No bootstrap required, opened a new log
I20260709 12:18:26.195343 15874 raft_consensus.cc:359] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a1e439ac334de3adcee3539c4c2762" member_type: VOTER }
I20260709 12:18:26.195809 15874 raft_consensus.cc:385] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.196035 15874 raft_consensus.cc:740] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a1e439ac334de3adcee3539c4c2762, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.196626 15874 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a1e439ac334de3adcee3539c4c2762" member_type: VOTER }
I20260709 12:18:26.197084 15874 raft_consensus.cc:399] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:26.197299 15874 raft_consensus.cc:493] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:26.197551 15874 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.202231 15874 raft_consensus.cc:515] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a1e439ac334de3adcee3539c4c2762" member_type: VOTER }
I20260709 12:18:26.202740 15874 leader_election.cc:304] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82a1e439ac334de3adcee3539c4c2762; no voters: 
I20260709 12:18:26.203804 15874 leader_election.cc:290] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:26.204213 15877 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:26.205518 15877 raft_consensus.cc:697] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [term 1 LEADER]: Becoming Leader. State: Replica: 82a1e439ac334de3adcee3539c4c2762, State: Running, Role: LEADER
I20260709 12:18:26.206249 15877 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a1e439ac334de3adcee3539c4c2762" member_type: VOTER }
I20260709 12:18:26.206831 15874 sys_catalog.cc:565] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:26.210919 15878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82a1e439ac334de3adcee3539c4c2762" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a1e439ac334de3adcee3539c4c2762" member_type: VOTER } }
I20260709 12:18:26.211642 15878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:26.211148 15879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82a1e439ac334de3adcee3539c4c2762. Latest consensus state: current_term: 1 leader_uuid: "82a1e439ac334de3adcee3539c4c2762" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82a1e439ac334de3adcee3539c4c2762" member_type: VOTER } }
I20260709 12:18:26.212563 15879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:26.223429 15883 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:26.228313 15883 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:26.229233  4409 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:26.237177 15883 catalog_manager.cc:1383] Generated new cluster ID: 7080d44e7b5e443eb5dc331d77567e8e
I20260709 12:18:26.237466 15883 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:26.274012 15883 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:26.275285 15883 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:26.290683 15883 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762: Generated new TSK 0
I20260709 12:18:26.291275 15883 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:26.296123  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:26.302032 15895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:26.303098 15896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:26.304171 15898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:26.304450  4409 server_base.cc:1061] running on GCE node
I20260709 12:18:26.305531  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:26.305723  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:26.305917  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599506305898 us; error 0 us; skew 500 ppm
I20260709 12:18:26.306447  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:26.308833  4409 webserver.cc:533] Webserver started at http://127.4.78.65:33365/ using document root <none> and password file <none>
I20260709 12:18:26.309298  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:26.309468  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:26.309732  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:26.310997  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-0-root/instance:
uuid: "260d4aab0b964b578f642abfc831dd60"
format_stamp: "Formatted at 2026-07-09 12:18:26 on dist-test-slave-9t7s"
I20260709 12:18:26.315418  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:18:26.318605 15903 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:26.319433  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:18:26.319708  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-0-root
uuid: "260d4aab0b964b578f642abfc831dd60"
format_stamp: "Formatted at 2026-07-09 12:18:26 on dist-test-slave-9t7s"
I20260709 12:18:26.319972  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:26.347302  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:26.348497  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:26.349923  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:26.352068  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:26.352252  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:26.352476  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:26.352641  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:26.391276  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.65:36745
I20260709 12:18:26.391372 15965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.65:36745 every 8 connection(s)
I20260709 12:18:26.395998  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:26.402959 15970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:26.403855 15971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:26.405493 15973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:26.407680  4409 server_base.cc:1061] running on GCE node
I20260709 12:18:26.408810 15966 heartbeater.cc:344] Connected to a master server at 127.4.78.126:41023
I20260709 12:18:26.409027  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:18:26.409180 15966 heartbeater.cc:461] Registering TS with master...
W20260709 12:18:26.409332  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:26.409610  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599506409596 us; error 0 us; skew 500 ppm
I20260709 12:18:26.410123 15966 heartbeater.cc:507] Master 127.4.78.126:41023 requested a full tablet report, sending...
I20260709 12:18:26.410210  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:26.412396 15839 ts_manager.cc:194] Registered new tserver with Master: 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745)
I20260709 12:18:26.412926  4409 webserver.cc:533] Webserver started at http://127.4.78.66:40427/ using document root <none> and password file <none>
I20260709 12:18:26.413463  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:26.413638  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:26.413913  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:26.414386 15839 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54176
I20260709 12:18:26.415027  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-1-root/instance:
uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
format_stamp: "Formatted at 2026-07-09 12:18:26 on dist-test-slave-9t7s"
I20260709 12:18:26.419488  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:18:26.422523 15978 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:26.423167  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:18:26.423429  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-1-root
uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
format_stamp: "Formatted at 2026-07-09 12:18:26 on dist-test-slave-9t7s"
I20260709 12:18:26.423678  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:26.437366  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:26.438503  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:26.439795  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:26.441898  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:26.442087  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:26.442298  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:26.442442  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:26.480582  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.66:37877
I20260709 12:18:26.480697 16040 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.66:37877 every 8 connection(s)
I20260709 12:18:26.485257  4409 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:26.492436 16044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:26.493475 16045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:26.495594 16047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:26.496402  4409 server_base.cc:1061] running on GCE node
I20260709 12:18:26.497550  4409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:18:26.497709 16041 heartbeater.cc:344] Connected to a master server at 127.4.78.126:41023
W20260709 12:18:26.497792  4409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:26.498220  4409 hybrid_clock.cc:648] HybridClock initialized: now 1783599506498202 us; error 0 us; skew 500 ppm
I20260709 12:18:26.498262 16041 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:26.498857  4409 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:26.499121 16041 heartbeater.cc:507] Master 127.4.78.126:41023 requested a full tablet report, sending...
I20260709 12:18:26.501413 15839 ts_manager.cc:194] Registered new tserver with Master: 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:26.501564  4409 webserver.cc:533] Webserver started at http://127.4.78.67:40819/ using document root <none> and password file <none>
I20260709 12:18:26.502231  4409 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:26.502452  4409 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:26.502765  4409 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:26.503259 15839 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54182
I20260709 12:18:26.504227  4409 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-2-root/instance:
uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
format_stamp: "Formatted at 2026-07-09 12:18:26 on dist-test-slave-9t7s"
I20260709 12:18:26.508625  4409 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:18:26.511845 16052 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:26.512545  4409 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:18:26.512850  4409 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-2-root
uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
format_stamp: "Formatted at 2026-07-09 12:18:26 on dist-test-slave-9t7s"
I20260709 12:18:26.513104  4409 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0xLggS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599105096696-4409-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:26.547219  4409 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:26.548375  4409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:26.549805  4409 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:26.552026  4409 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:26.552207  4409 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:26.552459  4409 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:26.552611  4409 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:26.589787  4409 rpc_server.cc:307] RPC server started. Bound to: 127.4.78.67:38847
I20260709 12:18:26.589884 16114 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.78.67:38847 every 8 connection(s)
I20260709 12:18:26.602252 16115 heartbeater.cc:344] Connected to a master server at 127.4.78.126:41023
I20260709 12:18:26.602696 16115 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:26.603346 16115 heartbeater.cc:507] Master 127.4.78.126:41023 requested a full tablet report, sending...
I20260709 12:18:26.605202 15839 ts_manager.cc:194] Registered new tserver with Master: d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:26.606022  4409 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013208872s
I20260709 12:18:26.606580 15839 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54196
I20260709 12:18:26.629212 15839 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54206:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:26.631834 15839 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:26.703289 15931 tablet_service.cc:1511] Processing CreateTablet for tablet 34f08f5134c7466a978d1b189f34bff5 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:26.704727 15931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f08f5134c7466a978d1b189f34bff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.713647 15929 tablet_service.cc:1511] Processing CreateTablet for tablet f5cc8a09b3ac4e91808e27698aef80ba (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:26.715656 15929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cc8a09b3ac4e91808e27698aef80ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.715782 15928 tablet_service.cc:1511] Processing CreateTablet for tablet 615c065b41924e9083551a8d5c2a02d2 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:26.717305 15928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615c065b41924e9083551a8d5c2a02d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.718250 16006 tablet_service.cc:1511] Processing CreateTablet for tablet 34f08f5134c7466a978d1b189f34bff5 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:26.719045 16004 tablet_service.cc:1511] Processing CreateTablet for tablet f5cc8a09b3ac4e91808e27698aef80ba (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:26.719782 16006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f08f5134c7466a978d1b189f34bff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.720388 16004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cc8a09b3ac4e91808e27698aef80ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.720821 16075 tablet_service.cc:1511] Processing CreateTablet for tablet 4d095f1cc36043d381261e761834d924 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:26.722579 16003 tablet_service.cc:1511] Processing CreateTablet for tablet 615c065b41924e9083551a8d5c2a02d2 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:26.722851 16005 tablet_service.cc:1511] Processing CreateTablet for tablet 919804186c204a3e81872852d49fea8c (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:26.723255 16075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d095f1cc36043d381261e761834d924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.723899 16003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615c065b41924e9083551a8d5c2a02d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.724545 16002 tablet_service.cc:1511] Processing CreateTablet for tablet 2240639ea8cc4078824a3cea684b5d69 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:26.727782 16002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2240639ea8cc4078824a3cea684b5d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.726899 16080 tablet_service.cc:1511] Processing CreateTablet for tablet 34f08f5134c7466a978d1b189f34bff5 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:26.731511 16080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f08f5134c7466a978d1b189f34bff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.731362 16076 tablet_service.cc:1511] Processing CreateTablet for tablet 2240639ea8cc4078824a3cea684b5d69 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:26.732276 15927 tablet_service.cc:1511] Processing CreateTablet for tablet 2240639ea8cc4078824a3cea684b5d69 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:26.713169 15930 tablet_service.cc:1511] Processing CreateTablet for tablet 919804186c204a3e81872852d49fea8c (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:26.734838 16005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919804186c204a3e81872852d49fea8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.734949 16073 tablet_service.cc:1511] Processing CreateTablet for tablet 5d89b0abbf8142e1a50b635107b8a769 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:26.735975 16000 tablet_service.cc:1511] Processing CreateTablet for tablet 761fa1e757fb4690abc0bfc7951dc1d1 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:26.736482 16073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d89b0abbf8142e1a50b635107b8a769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.737385 16000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 761fa1e757fb4690abc0bfc7951dc1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.733675 15927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2240639ea8cc4078824a3cea684b5d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.738863 15999 tablet_service.cc:1511] Processing CreateTablet for tablet 5d89b0abbf8142e1a50b635107b8a769 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:26.734949 15926 tablet_service.cc:1511] Processing CreateTablet for tablet 4d095f1cc36043d381261e761834d924 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:26.742249 15930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919804186c204a3e81872852d49fea8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.742518 16077 tablet_service.cc:1511] Processing CreateTablet for tablet 615c065b41924e9083551a8d5c2a02d2 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:26.744061 16077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615c065b41924e9083551a8d5c2a02d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.729504 16079 tablet_service.cc:1511] Processing CreateTablet for tablet 919804186c204a3e81872852d49fea8c (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:26.747186 16079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919804186c204a3e81872852d49fea8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.729161 16078 tablet_service.cc:1511] Processing CreateTablet for tablet f5cc8a09b3ac4e91808e27698aef80ba (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:26.750726 16078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cc8a09b3ac4e91808e27698aef80ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.726899 16001 tablet_service.cc:1511] Processing CreateTablet for tablet 4d095f1cc36043d381261e761834d924 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:26.755062 16076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2240639ea8cc4078824a3cea684b5d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.733589 16074 tablet_service.cc:1511] Processing CreateTablet for tablet 761fa1e757fb4690abc0bfc7951dc1d1 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:26.760664 16074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 761fa1e757fb4690abc0bfc7951dc1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.762176 16001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d095f1cc36043d381261e761834d924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.743080 15926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d095f1cc36043d381261e761834d924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.766247 15999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d89b0abbf8142e1a50b635107b8a769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.770529 15925 tablet_service.cc:1511] Processing CreateTablet for tablet 761fa1e757fb4690abc0bfc7951dc1d1 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:26.771963 15925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 761fa1e757fb4690abc0bfc7951dc1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.779863 15924 tablet_service.cc:1511] Processing CreateTablet for tablet 5d89b0abbf8142e1a50b635107b8a769 (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:26.781332 15924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d89b0abbf8142e1a50b635107b8a769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.796898 15923 tablet_service.cc:1511] Processing CreateTablet for tablet 9a332a1c11604255aba256e0bc4b2cbf (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:26.798275 15923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a332a1c11604255aba256e0bc4b2cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.818017 16132 tablet_bootstrap.cc:492] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:26.863478 15998 tablet_service.cc:1511] Processing CreateTablet for tablet 9a332a1c11604255aba256e0bc4b2cbf (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:26.873586 15998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a332a1c11604255aba256e0bc4b2cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.887951 16076 tablet_service.cc:1511] Processing CreateTablet for tablet 9a332a1c11604255aba256e0bc4b2cbf (DEFAULT_TABLE table=test-workload [id=7080e5e4bbf14e91a1fdd776298a15e3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:26.897140 16076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a332a1c11604255aba256e0bc4b2cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:26.897831 16130 tablet_bootstrap.cc:492] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:26.914216 16130 tablet_bootstrap.cc:654] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.935655 16132 tablet_bootstrap.cc:654] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.937623 16131 tablet_bootstrap.cc:492] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:26.964129 16131 tablet_bootstrap.cc:654] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.972434 16130 tablet_bootstrap.cc:492] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:26.972457 16132 tablet_bootstrap.cc:492] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:26.973138 16130 ts_tablet_manager.cc:1403] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.039s
I20260709 12:18:26.973237 16132 ts_tablet_manager.cc:1403] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.156s	user 0.013s	sys 0.027s
I20260709 12:18:26.976246 16130 raft_consensus.cc:359] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:26.976967 16130 raft_consensus.cc:385] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.977290 16130 raft_consensus.cc:740] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.976541 16132 raft_consensus.cc:359] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:26.978204 16130 consensus_queue.cc:260] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:26.978703 16132 raft_consensus.cc:385] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.979060 16132 raft_consensus.cc:740] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.979924 16132 consensus_queue.cc:260] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:26.985605 16115 heartbeater.cc:499] Master 127.4.78.126:41023 was elected leader, sending a full tablet report...
I20260709 12:18:26.985975 16131 tablet_bootstrap.cc:492] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:26.986150 16132 ts_tablet_manager.cc:1434] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:18:26.986747 16131 ts_tablet_manager.cc:1403] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.007s
I20260709 12:18:26.987222 16132 tablet_bootstrap.cc:492] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:26.990376 16131 raft_consensus.cc:359] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:26.991457 16041 heartbeater.cc:499] Master 127.4.78.126:41023 was elected leader, sending a full tablet report...
I20260709 12:18:26.991956 16130 ts_tablet_manager.cc:1434] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.014s
I20260709 12:18:26.993059 16130 tablet_bootstrap.cc:492] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:26.994966 16132 tablet_bootstrap.cc:654] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.995512 16131 raft_consensus.cc:385] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.995975 16131 raft_consensus.cc:740] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.996872 16131 consensus_queue.cc:260] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.001353 16132 tablet_bootstrap.cc:492] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:27.001693 16130 tablet_bootstrap.cc:654] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.001994 16132 ts_tablet_manager.cc:1403] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.002s
I20260709 12:18:27.005213 16132 raft_consensus.cc:359] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.006003 16132 raft_consensus.cc:385] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.006310 16132 raft_consensus.cc:740] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.007125 16132 consensus_queue.cc:260] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.008180 16131 ts_tablet_manager.cc:1434] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.006s
I20260709 12:18:27.008984 15966 heartbeater.cc:499] Master 127.4.78.126:41023 was elected leader, sending a full tablet report...
I20260709 12:18:27.009382 16132 ts_tablet_manager.cc:1434] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:27.010581 16132 tablet_bootstrap.cc:492] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:27.017356 16132 tablet_bootstrap.cc:654] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.025597 16131 tablet_bootstrap.cc:492] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:27.029517 16130 tablet_bootstrap.cc:492] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:27.030119 16130 ts_tablet_manager.cc:1403] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.012s
I20260709 12:18:27.030519 16132 tablet_bootstrap.cc:492] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:27.031049 16132 ts_tablet_manager.cc:1403] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:18:27.032951 16130 raft_consensus.cc:359] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.033708 16130 raft_consensus.cc:385] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.034052 16130 raft_consensus.cc:740] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.033792 16132 raft_consensus.cc:359] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:27.034534 16132 raft_consensus.cc:385] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.034824 16132 raft_consensus.cc:740] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.034824 16130 consensus_queue.cc:260] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.035857 16132 consensus_queue.cc:260] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:27.037117 16130 ts_tablet_manager.cc:1434] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:27.038116 16130 tablet_bootstrap.cc:492] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:27.038086 16132 ts_tablet_manager.cc:1434] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:18:27.039285 16132 tablet_bootstrap.cc:492] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:27.045089 16132 tablet_bootstrap.cc:654] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.045089 16130 tablet_bootstrap.cc:654] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.050839 16130 tablet_bootstrap.cc:492] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:27.051333 16132 tablet_bootstrap.cc:492] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:27.051331 16130 ts_tablet_manager.cc:1403] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 12:18:27.051923 16132 ts_tablet_manager.cc:1403] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 12:18:27.054703 16130 raft_consensus.cc:359] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.054962 16132 raft_consensus.cc:359] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.055516 16130 raft_consensus.cc:385] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.055708 16132 raft_consensus.cc:385] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.055892 16130 raft_consensus.cc:740] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.056069 16132 raft_consensus.cc:740] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.056833 16132 consensus_queue.cc:260] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.057200 16131 tablet_bootstrap.cc:654] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.056882 16130 consensus_queue.cc:260] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.058964 16132 ts_tablet_manager.cc:1434] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:18:27.059978 16132 tablet_bootstrap.cc:492] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:27.061048 16130 ts_tablet_manager.cc:1434] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:27.062258 16130 tablet_bootstrap.cc:492] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:27.066213 16132 tablet_bootstrap.cc:654] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.068831 16130 tablet_bootstrap.cc:654] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.072206 16132 tablet_bootstrap.cc:492] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:27.072780 16132 ts_tablet_manager.cc:1403] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 12:18:27.074577 16130 tablet_bootstrap.cc:492] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:27.075189 16130 ts_tablet_manager.cc:1403] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.003s
I20260709 12:18:27.075274 16132 raft_consensus.cc:359] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.075884 16132 raft_consensus.cc:385] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.076085 16132 raft_consensus.cc:740] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.076771 16132 consensus_queue.cc:260] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.078270 16131 tablet_bootstrap.cc:492] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:27.078387 16130 raft_consensus.cc:359] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:27.079035 16131 ts_tablet_manager.cc:1403] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.000s
I20260709 12:18:27.079334 16130 raft_consensus.cc:385] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.079716 16130 raft_consensus.cc:740] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.080689 16130 consensus_queue.cc:260] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:27.081966 16132 ts_tablet_manager.cc:1434] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 12:18:27.083046 16132 tablet_bootstrap.cc:492] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:27.083287 16130 ts_tablet_manager.cc:1434] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:27.084381 16130 tablet_bootstrap.cc:492] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:27.084331 16131 raft_consensus.cc:359] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:27.085275 16131 raft_consensus.cc:385] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.085583 16131 raft_consensus.cc:740] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.086468 16131 consensus_queue.cc:260] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:27.089934 16132 tablet_bootstrap.cc:654] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.091073 16135 raft_consensus.cc:493] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.091593 16135 raft_consensus.cc:515] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
W20260709 12:18:27.093670 16116 tablet.cc:2406] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:18:27.097339 16135 leader_election.cc:290] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.099501 16131 ts_tablet_manager.cc:1434] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:18:27.100454 16130 tablet_bootstrap.cc:654] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.100890 16131 tablet_bootstrap.cc:492] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:27.112663 16131 tablet_bootstrap.cc:654] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.120347 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c065b41924e9083551a8d5c2a02d2" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
W20260709 12:18:27.121932 15982 leader_election.cc:343] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.123188 16130 tablet_bootstrap.cc:492] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:27.123312 16132 tablet_bootstrap.cc:492] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:27.123903 16130 ts_tablet_manager.cc:1403] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.011s
I20260709 12:18:27.123983 16132 ts_tablet_manager.cc:1403] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.006s
I20260709 12:18:27.125453 16137 raft_consensus.cc:493] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.126050 16137 raft_consensus.cc:515] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:27.127378 16132 raft_consensus.cc:359] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.127676 16130 raft_consensus.cc:359] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.128168 16132 raft_consensus.cc:385] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.128451 16130 raft_consensus.cc:385] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.128661 16132 raft_consensus.cc:740] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.128881 16130 raft_consensus.cc:740] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.129153 16131 tablet_bootstrap.cc:492] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:27.129693 16131 ts_tablet_manager.cc:1403] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 12:18:27.129709 16132 consensus_queue.cc:260] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.129858 16130 consensus_queue.cc:260] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.128098 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c065b41924e9083551a8d5c2a02d2" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:27.132941 16131 raft_consensus.cc:359] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.133638 16131 raft_consensus.cc:385] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.133951 16131 raft_consensus.cc:740] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
W20260709 12:18:27.134208 15980 leader_election.cc:343] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.134785 15980 leader_election.cc:304] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:27.134758 16131 consensus_queue.cc:260] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.136379 16135 raft_consensus.cc:2749] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:27.138989 16130 ts_tablet_manager.cc:1434] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:18:27.140219 16130 tablet_bootstrap.cc:492] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:27.145272 16131 ts_tablet_manager.cc:1434] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:18:27.147208 16137 leader_election.cc:290] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:27.150895 16131 tablet_bootstrap.cc:492] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:27.156927 16130 tablet_bootstrap.cc:654] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.159614 16131 tablet_bootstrap.cc:654] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.162328 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f08f5134c7466a978d1b189f34bff5" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:27.163029 15941 raft_consensus.cc:2468] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:27.164331 16054 leader_election.cc:304] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:27.164883 16132 ts_tablet_manager.cc:1434] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.041s	user 0.016s	sys 0.020s
I20260709 12:18:27.166047 16132 tablet_bootstrap.cc:492] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:27.173283 16132 tablet_bootstrap.cc:654] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.165966 16153 raft_consensus.cc:2804] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.174460 16153 raft_consensus.cc:493] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.174830 16153 raft_consensus.cc:3060] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.178380 16132 tablet_bootstrap.cc:492] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:27.179283 16137 raft_consensus.cc:493] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.179770 16137 raft_consensus.cc:515] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.182000 16137 leader_election.cc:290] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:27.182386 16132 ts_tablet_manager.cc:1403] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:18:27.182828 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:27.183600 15941 raft_consensus.cc:2468] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:27.184716 16016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f08f5134c7466a978d1b189f34bff5" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:27.185539 16016 raft_consensus.cc:2468] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:27.185444 16132 raft_consensus.cc:359] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.186216 16132 raft_consensus.cc:385] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.186293 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:27.186534 16132 raft_consensus.cc:740] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.187000 16015 raft_consensus.cc:2468] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:27.187558 16132 consensus_queue.cc:260] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.187778 16054 leader_election.cc:304] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:27.189457 16137 raft_consensus.cc:2804] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.189877 16137 raft_consensus.cc:493] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.190217 16137 raft_consensus.cc:3060] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.191591 16153 raft_consensus.cc:515] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:27.192045 16132 ts_tablet_manager.cc:1434] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:27.194137 16132 tablet_bootstrap.cc:492] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:27.194772 16131 tablet_bootstrap.cc:492] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:27.194818 16153 leader_election.cc:290] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:27.195403 16131 ts_tablet_manager.cc:1403] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.019s
I20260709 12:18:27.197547 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f08f5134c7466a978d1b189f34bff5" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:27.198199 16015 raft_consensus.cc:3060] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.198494 16131 raft_consensus.cc:359] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.199220 16131 raft_consensus.cc:385] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.199488 16131 raft_consensus.cc:740] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.199913 16132 tablet_bootstrap.cc:654] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.200387 16131 consensus_queue.cc:260] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.204807 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f08f5134c7466a978d1b189f34bff5" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:27.205447 16131 ts_tablet_manager.cc:1434] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:18:27.205415 15941 raft_consensus.cc:3060] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.216096 15941 raft_consensus.cc:2468] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:27.217595 16054 leader_election.cc:304] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:27.218521 16137 raft_consensus.cc:515] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.218869 16153 raft_consensus.cc:2804] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.220459 16131 tablet_bootstrap.cc:492] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
W20260709 12:18:27.222729 15887 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:27.227102 16015 raft_consensus.cc:2468] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:27.227766 16131 tablet_bootstrap.cc:654] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.226864 16153 raft_consensus.cc:697] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:27.228976 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:27.229614 15941 raft_consensus.cc:3060] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.229296 16153 consensus_queue.cc:237] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:27.231287 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:27.231912 16015 raft_consensus.cc:3060] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.234372 16137 leader_election.cc:290] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:27.235900 16130 tablet_bootstrap.cc:492] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:27.236472 16130 ts_tablet_manager.cc:1403] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.000s
I20260709 12:18:27.239137 15941 raft_consensus.cc:2468] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:27.239923 16130 raft_consensus.cc:359] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.240562 16054 leader_election.cc:304] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:27.240840 16130 raft_consensus.cc:385] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.241228 16130 raft_consensus.cc:740] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.241469 16137 raft_consensus.cc:2804] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.242103 16137 raft_consensus.cc:697] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:27.241973 16130 consensus_queue.cc:260] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.243079 16137 consensus_queue.cc:237] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.244189 16135 raft_consensus.cc:493] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.244518 16130 ts_tablet_manager.cc:1434] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:18:27.244689 16135 raft_consensus.cc:515] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.245625 16130 tablet_bootstrap.cc:492] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:27.248189 16131 tablet_bootstrap.cc:492] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:27.248741 16131 ts_tablet_manager.cc:1403] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 12:18:27.240346 16015 raft_consensus.cc:2468] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:27.249351 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d89b0abbf8142e1a50b635107b8a769" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:27.250066 16090 raft_consensus.cc:2468] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 0.
I20260709 12:18:27.251718 16131 raft_consensus.cc:359] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.252442 16131 raft_consensus.cc:385] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.252712 16131 raft_consensus.cc:740] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.253656 16131 consensus_queue.cc:260] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.254500 15982 leader_election.cc:304] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:27.256421 16130 tablet_bootstrap.cc:654] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.258483 16131 ts_tablet_manager.cc:1434] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:18:27.259701 16131 tablet_bootstrap.cc:492] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:27.262244 16135 leader_election.cc:290] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.262977 16135 raft_consensus.cc:2804] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.263350 16135 raft_consensus.cc:493] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.263687 16135 raft_consensus.cc:3060] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.266286 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d89b0abbf8142e1a50b635107b8a769" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:27.266714 16131 tablet_bootstrap.cc:654] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:27.267731 15980 leader_election.cc:343] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.262274 15837 catalog_manager.cc:5697] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.279731 16132 tablet_bootstrap.cc:492] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:27.280691 16132 ts_tablet_manager.cc:1403] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.028s
I20260709 12:18:27.283579 16131 tablet_bootstrap.cc:492] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:27.283368 16132 raft_consensus.cc:359] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.284029 16132 raft_consensus.cc:385] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.284127 16131 ts_tablet_manager.cc:1403] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.003s
I20260709 12:18:27.284341 16132 raft_consensus.cc:740] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.285081 16132 consensus_queue.cc:260] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.287050 16132 ts_tablet_manager.cc:1434] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:18:27.287307 16131 raft_consensus.cc:359] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.287931 16132 tablet_bootstrap.cc:492] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:27.288012 16131 raft_consensus.cc:385] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.288460 16131 raft_consensus.cc:740] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.289382 16131 consensus_queue.cc:260] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.277709 16135 raft_consensus.cc:515] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.292856 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d89b0abbf8142e1a50b635107b8a769" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:27.293605 16131 ts_tablet_manager.cc:1434] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
W20260709 12:18:27.294260 15980 leader_election.cc:343] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.294708 16131 tablet_bootstrap.cc:492] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:27.299404 16132 tablet_bootstrap.cc:654] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.301612 16131 tablet_bootstrap.cc:654] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.303682 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d89b0abbf8142e1a50b635107b8a769" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:27.304328 16090 raft_consensus.cc:3060] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.312453 16139 raft_consensus.cc:493] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.313083 16135 leader_election.cc:290] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.313230 16139 raft_consensus.cc:515] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.316395 16130 tablet_bootstrap.cc:492] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:27.317003 16130 ts_tablet_manager.cc:1403] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.049s
I20260709 12:18:27.318773 16139 leader_election.cc:290] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.320259 16130 raft_consensus.cc:359] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.321106 16130 raft_consensus.cc:385] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.321475 16130 raft_consensus.cc:740] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.322391 16130 consensus_queue.cc:260] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.322962 16131 tablet_bootstrap.cc:492] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:27.324415 16131 ts_tablet_manager.cc:1403] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.008s
I20260709 12:18:27.324904 16130 ts_tablet_manager.cc:1434] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:18:27.326081 16130 tablet_bootstrap.cc:492] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:27.325281 15837 catalog_manager.cc:5697] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:27.312559 16090 raft_consensus.cc:2468] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 1.
I20260709 12:18:27.330195 16137 raft_consensus.cc:493] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.330825 16137 raft_consensus.cc:515] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.333046 16137 leader_election.cc:290] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:27.333695 16130 tablet_bootstrap.cc:654] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.334381 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919804186c204a3e81872852d49fea8c" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:27.334810 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919804186c204a3e81872852d49fea8c" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:27.335129 16015 raft_consensus.cc:2468] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
W20260709 12:18:27.336335 16054 leader_election.cc:343] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.337419 16055 leader_election.cc:304] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:27.337850 15982 leader_election.cc:304] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:27.338748 16135 raft_consensus.cc:2804] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.338925 16137 raft_consensus.cc:2804] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.339448 16137 raft_consensus.cc:493] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.339851 16137 raft_consensus.cc:3060] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.339514 16135 raft_consensus.cc:697] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Becoming Leader. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:27.329551 16131 raft_consensus.cc:359] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.341423 16131 raft_consensus.cc:385] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.341455 16135 consensus_queue.cc:237] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.342046 16131 raft_consensus.cc:740] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.343497 16131 consensus_queue.cc:260] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.343924 16153 raft_consensus.cc:493] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.344470 16153 raft_consensus.cc:515] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.348042 16131 ts_tablet_manager.cc:1434] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:18:27.349480 16131 tablet_bootstrap.cc:492] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:27.351222 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d095f1cc36043d381261e761834d924" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
W20260709 12:18:27.353262 16054 leader_election.cc:343] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.353260 16153 leader_election.cc:290] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:27.356204 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d095f1cc36043d381261e761834d924" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:27.357070 16015 raft_consensus.cc:2468] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:27.358549 16055 leader_election.cc:304] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:27.360078 16159 raft_consensus.cc:2804] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.360469 16159 raft_consensus.cc:493] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.360800 16159 raft_consensus.cc:3060] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.364020 16131 tablet_bootstrap.cc:654] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.358459 16137 raft_consensus.cc:515] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.365954 16153 raft_consensus.cc:493] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.366595 16153 raft_consensus.cc:515] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.368552 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919804186c204a3e81872852d49fea8c" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:27.368789 16153 leader_election.cc:290] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
W20260709 12:18:27.369979 16054 leader_election.cc:343] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.370615 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cc8a09b3ac4e91808e27698aef80ba" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:27.376174 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cc8a09b3ac4e91808e27698aef80ba" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:27.376922 16015 raft_consensus.cc:2468] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:27.371361 15941 raft_consensus.cc:2468] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:27.378213 16055 leader_election.cc:304] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:27.379251 16137 leader_election.cc:290] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:27.379961 16137 raft_consensus.cc:2804] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.380311 16137 raft_consensus.cc:493] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.380638 16137 raft_consensus.cc:3060] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.381274 15836 catalog_manager.cc:5697] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.387835 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919804186c204a3e81872852d49fea8c" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:27.388525 16015 raft_consensus.cc:3060] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.390900 16130 tablet_bootstrap.cc:492] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:27.391518 16130 ts_tablet_manager.cc:1403] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.019s
I20260709 12:18:27.394518 16130 raft_consensus.cc:359] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.395201 16130 raft_consensus.cc:385] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.395522 16130 raft_consensus.cc:740] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.396247 16130 consensus_queue.cc:260] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.391513 16159 raft_consensus.cc:515] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.398613 16130 ts_tablet_manager.cc:1434] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:27.399834 16130 tablet_bootstrap.cc:492] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:27.399946 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d095f1cc36043d381261e761834d924" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
W20260709 12:18:27.401376 16054 leader_election.cc:343] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.403507 16016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d095f1cc36043d381261e761834d924" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:27.404397 16016 raft_consensus.cc:3060] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.404603 16139 raft_consensus.cc:493] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.405119 16139 raft_consensus.cc:515] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.407063 16139 leader_election.cc:290] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.407258 16159 leader_election.cc:290] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:27.411986 16014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761fa1e757fb4690abc0bfc7951dc1d1" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:27.412711 16014 raft_consensus.cc:2468] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 0.
I20260709 12:18:27.413838 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d89b0abbf8142e1a50b635107b8a769" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:27.414645 16015 raft_consensus.cc:2468] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:27.415803 15906 leader_election.cc:304] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:27.416363 16137 raft_consensus.cc:515] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.417068 16139 raft_consensus.cc:2804] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.417498 16139 raft_consensus.cc:493] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.417912 16139 raft_consensus.cc:3060] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.418231 16055 leader_election.cc:304] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:27.420176 16132 tablet_bootstrap.cc:492] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:27.420572 16159 raft_consensus.cc:2804] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.420738 16132 ts_tablet_manager.cc:1403] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.133s	user 0.022s	sys 0.003s
I20260709 12:18:27.424001 16159 raft_consensus.cc:697] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:27.424065 16132 raft_consensus.cc:359] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.425287 16132 raft_consensus.cc:385] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.425558 16132 raft_consensus.cc:740] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.425621 16159 consensus_queue.cc:237] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.426548 16132 consensus_queue.cc:260] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.428793 16132 ts_tablet_manager.cc:1434] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:18:27.429478 16130 tablet_bootstrap.cc:654] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.431329 16137 leader_election.cc:290] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:27.432700 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cc8a09b3ac4e91808e27698aef80ba" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:27.433291 16131 tablet_bootstrap.cc:492] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:27.433880 16131 ts_tablet_manager.cc:1403] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.085s	user 0.023s	sys 0.026s
I20260709 12:18:27.434134 16016 raft_consensus.cc:2468] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:27.434342 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cc8a09b3ac4e91808e27698aef80ba" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:27.435019 16015 raft_consensus.cc:3060] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.436354 16139 raft_consensus.cc:515] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.436573 16131 raft_consensus.cc:359] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.436879 16055 leader_election.cc:304] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:27.437341 16131 raft_consensus.cc:385] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.437677 16131 raft_consensus.cc:740] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.433372 15941 raft_consensus.cc:3060] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.438520 16131 consensus_queue.cc:260] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.439589 16016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761fa1e757fb4690abc0bfc7951dc1d1" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:27.440306 16139 leader_election.cc:290] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 election: Requested vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.440351 16016 raft_consensus.cc:3060] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.444510 16137 raft_consensus.cc:2804] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.445385 16137 raft_consensus.cc:697] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:27.446312 16137 consensus_queue.cc:237] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.450021 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761fa1e757fb4690abc0bfc7951dc1d1" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:27.450863 16090 raft_consensus.cc:2468] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 0.
I20260709 12:18:27.451715 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761fa1e757fb4690abc0bfc7951dc1d1" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:27.452412 16088 raft_consensus.cc:3060] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.451009 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d89b0abbf8142e1a50b635107b8a769" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:27.458683 16089 raft_consensus.cc:2393] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 260d4aab0b964b578f642abfc831dd60 in current term 1: Already voted for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in this term.
I20260709 12:18:27.459111 16015 raft_consensus.cc:2468] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:27.460351 15907 leader_election.cc:304] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60; no voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:27.460546 16055 leader_election.cc:304] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:27.461433 16153 raft_consensus.cc:2804] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.462009 15941 raft_consensus.cc:2468] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:27.465956 16130 tablet_bootstrap.cc:492] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:27.466607 16130 ts_tablet_manager.cc:1403] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.002s
I20260709 12:18:27.468384 16139 raft_consensus.cc:493] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.470453 16139 raft_consensus.cc:515] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.471570 16130 raft_consensus.cc:359] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.469558 16088 raft_consensus.cc:2468] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 1.
I20260709 12:18:27.475148 16016 raft_consensus.cc:2468] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 1.
I20260709 12:18:27.476020 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c065b41924e9083551a8d5c2a02d2" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:27.476504 15906 leader_election.cc:304] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:27.476790 16015 raft_consensus.cc:2468] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 0.
I20260709 12:18:27.478283 15906 leader_election.cc:304] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:27.480142 16180 raft_consensus.cc:3060] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.480989 16139 leader_election.cc:290] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.482620 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c065b41924e9083551a8d5c2a02d2" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:27.490550 16088 raft_consensus.cc:2468] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 0.
I20260709 12:18:27.490181 15837 catalog_manager.cc:5697] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:27.492640 16153 raft_consensus.cc:697] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:27.493628 16153 consensus_queue.cc:237] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.490175 16139 raft_consensus.cc:2804] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.497587 16139 raft_consensus.cc:697] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Becoming Leader. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:27.500039 16131 ts_tablet_manager.cc:1434] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.066s	user 0.033s	sys 0.031s
I20260709 12:18:27.501180 16131 tablet_bootstrap.cc:492] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:27.502107 16178 raft_consensus.cc:2804] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.502615 16178 raft_consensus.cc:493] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.502987 16178 raft_consensus.cc:3060] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.472380 16130 raft_consensus.cc:385] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.503480 16130 raft_consensus.cc:740] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.504956 16139 consensus_queue.cc:237] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.500262 16180 raft_consensus.cc:2749] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:27.507102 16131 tablet_bootstrap.cc:654] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.507136 16130 consensus_queue.cc:260] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.511660 16178 raft_consensus.cc:515] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.514694 16178 leader_election.cc:290] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 election: Requested vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.515271 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c065b41924e9083551a8d5c2a02d2" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:27.515805 16088 raft_consensus.cc:3060] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.516459 16016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c065b41924e9083551a8d5c2a02d2" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:27.517215 16016 raft_consensus.cc:3060] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.521010 16131 tablet_bootstrap.cc:492] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:27.521639 16131 ts_tablet_manager.cc:1403] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 12:18:27.522375 15836 catalog_manager.cc:5697] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 260d4aab0b964b578f642abfc831dd60 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "260d4aab0b964b578f642abfc831dd60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.524438 16131 raft_consensus.cc:359] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.525422 16131 raft_consensus.cc:385] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.525691 16131 raft_consensus.cc:740] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.523254 16130 ts_tablet_manager.cc:1434] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 12:18:27.526546 16131 consensus_queue.cc:260] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.528970 16131 ts_tablet_manager.cc:1434] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:27.537068 16088 raft_consensus.cc:2468] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 1.
I20260709 12:18:27.538237 15907 leader_election.cc:304] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:27.539120 16178 raft_consensus.cc:2804] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.539860 16178 raft_consensus.cc:697] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Becoming Leader. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:27.540683 16178 consensus_queue.cc:237] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.542900 16016 raft_consensus.cc:2468] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 1.
I20260709 12:18:27.542117 15837 catalog_manager.cc:5697] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:27.546958 15837 catalog_manager.cc:5697] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:27.548843 16178 raft_consensus.cc:493] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.549407 16178 raft_consensus.cc:515] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.551518 16178 leader_election.cc:290] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.552210 16016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d095f1cc36043d381261e761834d924" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:27.551859 15838 catalog_manager.cc:5697] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 260d4aab0b964b578f642abfc831dd60 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "260d4aab0b964b578f642abfc831dd60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.552985 16016 raft_consensus.cc:2393] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 260d4aab0b964b578f642abfc831dd60 in current term 1: Already voted for candidate d2d4a09985a34e668f02fa94cc8d43d1 in this term.
I20260709 12:18:27.552603 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d095f1cc36043d381261e761834d924" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:27.555299 15907 leader_election.cc:304] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60; no voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:27.556365 16178 raft_consensus.cc:3060] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.562307 16178 raft_consensus.cc:2749] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:27.612063 16153 consensus_queue.cc:1048] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:27.624213 16153 consensus_queue.cc:1048] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.639007 16178 raft_consensus.cc:493] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.639523 16178 raft_consensus.cc:515] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.641561 16178 leader_election.cc:290] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.642271 16016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a332a1c11604255aba256e0bc4b2cbf" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:27.642575 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a332a1c11604255aba256e0bc4b2cbf" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:27.642834 16016 raft_consensus.cc:2468] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 0.
I20260709 12:18:27.643121 16088 raft_consensus.cc:2468] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 0.
I20260709 12:18:27.643810 15906 leader_election.cc:304] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:27.644508 16178 raft_consensus.cc:2804] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.644924 16178 raft_consensus.cc:493] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.645259 16178 raft_consensus.cc:3060] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.650029 16178 raft_consensus.cc:515] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.651530 16178 leader_election.cc:290] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 election: Requested vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.652410 16016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a332a1c11604255aba256e0bc4b2cbf" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:27.652608 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a332a1c11604255aba256e0bc4b2cbf" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:27.652938 16016 raft_consensus.cc:3060] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.653285 16088 raft_consensus.cc:3060] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.657512 16016 raft_consensus.cc:2468] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 1.
I20260709 12:18:27.657920 16088 raft_consensus.cc:2468] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 1.
I20260709 12:18:27.658610 15906 leader_election.cc:304] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:27.659286 16178 raft_consensus.cc:2804] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.659729 16178 raft_consensus.cc:697] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Becoming Leader. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:27.660421 16178 consensus_queue.cc:237] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.667167 15837 catalog_manager.cc:5697] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 260d4aab0b964b578f642abfc831dd60 (127.4.78.65). New cstate: current_term: 1 leader_uuid: "260d4aab0b964b578f642abfc831dd60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.707399 16088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34f08f5134c7466a978d1b189f34bff5"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
mode: GRACEFUL
new_leader_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:42456
I20260709 12:18:27.707947 16088 raft_consensus.cc:606] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Received request to transfer leadership to TS 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:27.712898 16088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "919804186c204a3e81872852d49fea8c"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
mode: GRACEFUL
new_leader_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:42456
I20260709 12:18:27.713366 16088 raft_consensus.cc:606] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Received request to transfer leadership to TS 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:27.717960 16088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5cc8a09b3ac4e91808e27698aef80ba"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
mode: GRACEFUL
new_leader_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:42456
I20260709 12:18:27.718446 16088 raft_consensus.cc:606] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Received request to transfer leadership to TS 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:27.725824 16088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
mode: GRACEFUL
new_leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
 from {username='slave'} at 127.0.0.1:42456
I20260709 12:18:27.726311 16088 raft_consensus.cc:606] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Received request to transfer leadership to TS 6dae5090ab1b4af98c4edeae63cf9df6
I20260709 12:18:27.730736 16088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d095f1cc36043d381261e761834d924"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
mode: GRACEFUL
new_leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
 from {username='slave'} at 127.0.0.1:42456
I20260709 12:18:27.731195 16088 raft_consensus.cc:606] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Received request to transfer leadership to TS 6dae5090ab1b4af98c4edeae63cf9df6
I20260709 12:18:27.743189 15941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "761fa1e757fb4690abc0bfc7951dc1d1"
dest_uuid: "260d4aab0b964b578f642abfc831dd60"
mode: GRACEFUL
new_leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
 from {username='slave'} at 127.0.0.1:48480
I20260709 12:18:27.743660 15941 raft_consensus.cc:606] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Received request to transfer leadership to TS 6dae5090ab1b4af98c4edeae63cf9df6
I20260709 12:18:27.751395 15941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a332a1c11604255aba256e0bc4b2cbf"
dest_uuid: "260d4aab0b964b578f642abfc831dd60"
mode: GRACEFUL
new_leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
 from {username='slave'} at 127.0.0.1:48480
I20260709 12:18:27.751888 15941 raft_consensus.cc:606] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Received request to transfer leadership to TS d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:27.806927 16159 consensus_queue.cc:1048] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.813020 16153 raft_consensus.cc:993] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1: : Instructing follower 6dae5090ab1b4af98c4edeae63cf9df6 to start an election
I20260709 12:18:27.813482 16153 raft_consensus.cc:1081] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Signalling peer 6dae5090ab1b4af98c4edeae63cf9df6 to start an election
I20260709 12:18:27.815251 16015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69"
dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
 from {username='slave'} at 127.0.0.1:51768
I20260709 12:18:27.818522 16015 raft_consensus.cc:493] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:27.818645 16181 consensus_queue.cc:1048] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:27.818969 16015 raft_consensus.cc:3060] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.825989 16015 raft_consensus.cc:515] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.829814 16015 leader_election.cc:290] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 2 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.831385 15941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:27.831615 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:27.832046 15941 raft_consensus.cc:3060] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.832321 16088 raft_consensus.cc:3055] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:27.832700 16088 raft_consensus.cc:740] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:27.833494 16088 consensus_queue.cc:260] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.834824 16088 raft_consensus.cc:3060] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.839232 15941 raft_consensus.cc:2468] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 2.
I20260709 12:18:27.840025 16088 raft_consensus.cc:2468] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 2.
I20260709 12:18:27.840343 15980 leader_election.cc:304] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:27.841168 16135 raft_consensus.cc:2804] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:27.842032 16135 raft_consensus.cc:697] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Becoming Leader. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:27.842759 16135 consensus_queue.cc:237] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.848517 15838 catalog_manager.cc:5697] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 reported cstate change: term changed from 1 to 2, leader changed from d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67) to 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.881033 16135 consensus_queue.cc:1048] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.892479 16199 consensus_queue.cc:1048] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.929440 16181 consensus_queue.cc:1048] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.934383 16178 consensus_queue.cc:1048] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.938642 15941 raft_consensus.cc:3060] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.945647 16178 consensus_queue.cc:1048] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:27.947877 16182 raft_consensus.cc:993] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60: : Instructing follower 6dae5090ab1b4af98c4edeae63cf9df6 to start an election
I20260709 12:18:27.948319 16182 raft_consensus.cc:1081] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Signalling peer 6dae5090ab1b4af98c4edeae63cf9df6 to start an election
I20260709 12:18:27.949915 16159 consensus_queue.cc:1048] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.953253 16159 consensus_queue.cc:1048] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.953485 16013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "761fa1e757fb4690abc0bfc7951dc1d1"
dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
 from {username='slave'} at 127.0.0.1:51774
I20260709 12:18:27.954171 16013 raft_consensus.cc:493] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:27.954551 16013 raft_consensus.cc:3060] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.960373 16153 raft_consensus.cc:993] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1: : Instructing follower 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:27.960954 16153 raft_consensus.cc:1081] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Signalling peer 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:27.962941 15940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "919804186c204a3e81872852d49fea8c"
dest_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:48466
I20260709 12:18:27.963549 15940 raft_consensus.cc:493] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:27.963913 15940 raft_consensus.cc:3060] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.967788 16181 raft_consensus.cc:993] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1: : Instructing follower 6dae5090ab1b4af98c4edeae63cf9df6 to start an election
I20260709 12:18:27.968300 16181 raft_consensus.cc:1081] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Signalling peer 6dae5090ab1b4af98c4edeae63cf9df6 to start an election
I20260709 12:18:27.969949 16015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d095f1cc36043d381261e761834d924"
dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
 from {username='slave'} at 127.0.0.1:51768
I20260709 12:18:27.971565 16015 raft_consensus.cc:493] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:27.972004 16015 raft_consensus.cc:3060] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.973940 16182 consensus_queue.cc:1048] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.975206 16013 raft_consensus.cc:515] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.976264 16016 raft_consensus.cc:1240] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Rejecting Update request from peer 260d4aab0b964b578f642abfc831dd60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:27.978157 16153 consensus_queue.cc:1048] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.980811 16015 raft_consensus.cc:515] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.982985 15940 raft_consensus.cc:515] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.984181 16012 raft_consensus.cc:1240] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Rejecting Update request from peer d2d4a09985a34e668f02fa94cc8d43d1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:27.984620 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761fa1e757fb4690abc0bfc7951dc1d1" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:27.986651 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919804186c204a3e81872852d49fea8c" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:27.986820 16153 consensus_queue.cc:1059] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.987217 16089 raft_consensus.cc:3055] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:27.987540 16089 raft_consensus.cc:740] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:27.987643 16153 raft_consensus.cc:3055] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:27.988020 16153 raft_consensus.cc:740] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:27.981897 16013 leader_election.cc:290] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 2 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:27.982862 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761fa1e757fb4690abc0bfc7951dc1d1" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:27.988946 15937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d095f1cc36043d381261e761834d924" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:27.989461 15938 raft_consensus.cc:3055] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:27.989822 15938 raft_consensus.cc:740] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:27.990041 16180 consensus_queue.cc:1059] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.988408 16089 consensus_queue.cc:260] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.991084 15938 consensus_queue.cc:260] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.992093 15938 raft_consensus.cc:3060] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.988927 16153 consensus_queue.cc:260] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.992926 16153 raft_consensus.cc:3060] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:27.993824 16180 consensus_queue.cc:1175] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:18:27.994891 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919804186c204a3e81872852d49fea8c" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:27.995563 16012 raft_consensus.cc:3060] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:27.998360 16089 raft_consensus.cc:3060] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.000298 16088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d095f1cc36043d381261e761834d924" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:28.002946 16181 consensus_queue.cc:1048] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:28.006251 15940 leader_election.cc:290] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Requested vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:28.012398 16012 raft_consensus.cc:2468] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:28.014166 15906 leader_election.cc:304] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:28.017153 15938 raft_consensus.cc:2468] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 2.
I20260709 12:18:28.017737 16153 raft_consensus.cc:993] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1: : Instructing follower 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:28.017377 16178 raft_consensus.cc:2804] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:28.019254 16178 raft_consensus.cc:697] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Becoming Leader. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:28.020140 16178 consensus_queue.cc:237] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:27.989085 16015 leader_election.cc:290] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 2 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:28.027951 16089 raft_consensus.cc:2468] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:28.028141 15980 leader_election.cc:304] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:28.029510 16199 raft_consensus.cc:2804] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:28.030047 16199 raft_consensus.cc:697] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Becoming Leader. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:28.031260 16199 consensus_queue.cc:237] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:28.033226 16181 consensus_queue.cc:1048] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:28.018242 16153 raft_consensus.cc:1081] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Signalling peer 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:28.038538 16088 raft_consensus.cc:2468] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 2.
I20260709 12:18:28.040642 15837 catalog_manager.cc:5697] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 reported cstate change: term changed from 1 to 2, leader changed from d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67) to 260d4aab0b964b578f642abfc831dd60 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "260d4aab0b964b578f642abfc831dd60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.042526 16180 consensus_queue.cc:1048] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:28.044006 15938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5cc8a09b3ac4e91808e27698aef80ba"
dest_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:48466
I20260709 12:18:28.044585 15938 raft_consensus.cc:493] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:28.044935 15938 raft_consensus.cc:3060] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.052343 15938 raft_consensus.cc:515] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:28.054702 16159 raft_consensus.cc:993] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1: : Instructing follower 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:28.055238 16159 raft_consensus.cc:1081] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Signalling peer 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:28.056188 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cc8a09b3ac4e91808e27698aef80ba" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:28.056876 15939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34f08f5134c7466a978d1b189f34bff5"
dest_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:48466
I20260709 12:18:28.057060 15938 leader_election.cc:290] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Requested vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:28.057507 15939 raft_consensus.cc:493] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:28.057937 15939 raft_consensus.cc:3060] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.056839 16089 raft_consensus.cc:3055] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:28.058899 16089 raft_consensus.cc:740] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:28.059798 16089 consensus_queue.cc:260] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:28.060977 15982 leader_election.cc:304] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:28.061832 16089 raft_consensus.cc:3060] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.062415 16199 raft_consensus.cc:2804] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:28.063154 16199 raft_consensus.cc:697] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Becoming Leader. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:28.063978 16199 consensus_queue.cc:237] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:28.066099 15939 raft_consensus.cc:515] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:28.062649 16180 consensus_queue.cc:1048] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:18:28.068847 16087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f08f5134c7466a978d1b189f34bff5" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:28.068895 16089 raft_consensus.cc:2468] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:28.069403 16087 raft_consensus.cc:3055] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:28.069737 16087 raft_consensus.cc:740] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:28.070356 15907 leader_election.cc:304] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:28.071389 16087 consensus_queue.cc:260] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:28.072350 16180 raft_consensus.cc:2804] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:28.072808 16087 raft_consensus.cc:3060] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.073388 15939 leader_election.cc:290] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Requested vote from peers d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:28.073978 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f08f5134c7466a978d1b189f34bff5" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:28.074572 16013 raft_consensus.cc:3060] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.073047 16180 raft_consensus.cc:697] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Becoming Leader. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:28.076572 16180 consensus_queue.cc:237] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:28.082706 16087 raft_consensus.cc:2468] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:28.070390 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cc8a09b3ac4e91808e27698aef80ba" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:28.083993 16012 raft_consensus.cc:3060] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.083987 15907 leader_election.cc:304] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:28.085124 16180 raft_consensus.cc:2804] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:28.085947 16180 raft_consensus.cc:697] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Becoming Leader. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:28.086802 16180 consensus_queue.cc:237] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } }
I20260709 12:18:28.091908 16013 raft_consensus.cc:2468] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:28.092679 16012 raft_consensus.cc:2468] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:28.093536 15836 catalog_manager.cc:5697] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 reported cstate change: term changed from 1 to 2, leader changed from d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67) to 260d4aab0b964b578f642abfc831dd60 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "260d4aab0b964b578f642abfc831dd60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.098621 16182 consensus_queue.cc:1048] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:28.105981 15838 catalog_manager.cc:5697] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 reported cstate change: term changed from 1 to 2, leader changed from 260d4aab0b964b578f642abfc831dd60 (127.4.78.65) to 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.108548 16182 raft_consensus.cc:993] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60: : Instructing follower d2d4a09985a34e668f02fa94cc8d43d1 to start an election
I20260709 12:18:28.109091 16178 raft_consensus.cc:1081] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Signalling peer d2d4a09985a34e668f02fa94cc8d43d1 to start an election
I20260709 12:18:28.110586 16087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a332a1c11604255aba256e0bc4b2cbf"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
 from {username='slave'} at 127.0.0.1:42446
I20260709 12:18:28.111112 16087 raft_consensus.cc:493] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:28.111474 16087 raft_consensus.cc:3060] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.115837 15836 catalog_manager.cc:5697] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 reported cstate change: term changed from 1 to 2, leader changed from d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67) to 260d4aab0b964b578f642abfc831dd60 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "260d4aab0b964b578f642abfc831dd60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.122092 16087 raft_consensus.cc:515] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:28.124557 16087 leader_election.cc:290] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 2 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:28.124967 15939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a332a1c11604255aba256e0bc4b2cbf" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:28.125945 15939 raft_consensus.cc:3055] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:28.126268 15939 raft_consensus.cc:740] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:28.127014 15939 consensus_queue.cc:260] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:28.127964 15939 raft_consensus.cc:3060] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.127476 15838 catalog_manager.cc:5697] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 reported cstate change: term changed from 1 to 2, leader changed from d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67) to 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.125212 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a332a1c11604255aba256e0bc4b2cbf" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:28.130049 16012 raft_consensus.cc:3060] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.135020 15939 raft_consensus.cc:2468] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 2.
I20260709 12:18:28.136310 16054 leader_election.cc:304] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:28.136911 16012 raft_consensus.cc:2468] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 2.
I20260709 12:18:28.137171 16159 raft_consensus.cc:2804] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:28.137722 16159 raft_consensus.cc:697] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:28.138501 16159 consensus_queue.cc:237] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:28.144703 15838 catalog_manager.cc:5697] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 1 to 2, leader changed from 260d4aab0b964b578f642abfc831dd60 (127.4.78.65) to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:28.304492 15939 raft_consensus.cc:1275] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Refusing update from remote peer 6dae5090ab1b4af98c4edeae63cf9df6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.305706 16199 consensus_queue.cc:1048] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.315237 16087 raft_consensus.cc:1275] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 6dae5090ab1b4af98c4edeae63cf9df6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.316532 16135 consensus_queue.cc:1048] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.441692 16087 raft_consensus.cc:3060] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.447342 16087 raft_consensus.cc:1275] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 6dae5090ab1b4af98c4edeae63cf9df6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.448777 16135 consensus_queue.cc:1048] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:28.450908 16087 raft_consensus.cc:1275] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.452306 16180 consensus_queue.cc:1048] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.459122 15938 raft_consensus.cc:3060] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.466336 15939 raft_consensus.cc:1275] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Refusing update from remote peer 6dae5090ab1b4af98c4edeae63cf9df6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.468318 16215 consensus_queue.cc:1048] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.469035 15938 raft_consensus.cc:1275] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Refusing update from remote peer 6dae5090ab1b4af98c4edeae63cf9df6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.470616 16214 consensus_queue.cc:1048] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:28.472949 16012 raft_consensus.cc:1275] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.477910 16180 consensus_queue.cc:1048] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.488539 16090 raft_consensus.cc:1275] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 6dae5090ab1b4af98c4edeae63cf9df6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.490070 16215 consensus_queue.cc:1048] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.499179 16090 raft_consensus.cc:1275] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.500507 16180 consensus_queue.cc:1048] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.508783 16012 raft_consensus.cc:1275] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.510263 16216 consensus_queue.cc:1048] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:28.547902 16012 raft_consensus.cc:1275] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.549175 16216 consensus_queue.cc:1048] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.556756 16090 raft_consensus.cc:1275] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.558527 16216 consensus_queue.cc:1048] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.716082 16012 raft_consensus.cc:1275] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Refusing update from remote peer d2d4a09985a34e668f02fa94cc8d43d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.718163 16209 consensus_queue.cc:1048] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:28.730597 15938 raft_consensus.cc:1275] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Refusing update from remote peer d2d4a09985a34e668f02fa94cc8d43d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:28.732924 16218 consensus_queue.cc:1048] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:30.788039 15839 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51228:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:30.790944 15839 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:30.845880 15930 tablet_service.cc:1511] Processing CreateTablet for tablet 6abfeb76247d44ea9fd4937b5423a401 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:30.847297 15998 tablet_service.cc:1511] Processing CreateTablet for tablet 6abfeb76247d44ea9fd4937b5423a401 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:30.847906 15930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6abfeb76247d44ea9fd4937b5423a401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.848552 16076 tablet_service.cc:1511] Processing CreateTablet for tablet 6abfeb76247d44ea9fd4937b5423a401 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:30.850199 16076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6abfeb76247d44ea9fd4937b5423a401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.851373 16000 tablet_service.cc:1511] Processing CreateTablet for tablet 14623ca4f24c446c888867b1226fa5c1 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:30.849002 15998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6abfeb76247d44ea9fd4937b5423a401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.854359 15924 tablet_service.cc:1511] Processing CreateTablet for tablet 9b602481f82b4c0e9961f10cc17c1a5a (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:30.855259 16000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14623ca4f24c446c888867b1226fa5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.855039 16002 tablet_service.cc:1511] Processing CreateTablet for tablet 9b602481f82b4c0e9961f10cc17c1a5a (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:30.855814 15924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b602481f82b4c0e9961f10cc17c1a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.856398 16002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b602481f82b4c0e9961f10cc17c1a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.859005 16078 tablet_service.cc:1511] Processing CreateTablet for tablet 14623ca4f24c446c888867b1226fa5c1 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:30.860443 16078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14623ca4f24c446c888867b1226fa5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.851789 15926 tablet_service.cc:1511] Processing CreateTablet for tablet 14623ca4f24c446c888867b1226fa5c1 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:30.863034 15926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14623ca4f24c446c888867b1226fa5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.873175 16079 tablet_service.cc:1511] Processing CreateTablet for tablet 9b602481f82b4c0e9961f10cc17c1a5a (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:30.874675 16079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b602481f82b4c0e9961f10cc17c1a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.874464 15929 tablet_service.cc:1511] Processing CreateTablet for tablet 7fca753abd7841a688bd3d4c299f9cb6 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:30.875864 15929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fca753abd7841a688bd3d4c299f9cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.875613 16005 tablet_service.cc:1511] Processing CreateTablet for tablet 7fca753abd7841a688bd3d4c299f9cb6 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:30.876911 16005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fca753abd7841a688bd3d4c299f9cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.888015 16074 tablet_service.cc:1511] Processing CreateTablet for tablet 7fca753abd7841a688bd3d4c299f9cb6 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:30.889488 16074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fca753abd7841a688bd3d4c299f9cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.889822 15923 tablet_service.cc:1511] Processing CreateTablet for tablet faca4b87c1d94e479c457ec765be8bb3 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:30.890444 16004 tablet_service.cc:1511] Processing CreateTablet for tablet faca4b87c1d94e479c457ec765be8bb3 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:30.891139 15923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faca4b87c1d94e479c457ec765be8bb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.891716 16004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faca4b87c1d94e479c457ec765be8bb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.912680 16077 tablet_service.cc:1511] Processing CreateTablet for tablet faca4b87c1d94e479c457ec765be8bb3 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:30.914135 16077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faca4b87c1d94e479c457ec765be8bb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.929396 15928 tablet_service.cc:1511] Processing CreateTablet for tablet e05ce5a3a20b464a8ff62fe6fa1a9fbb (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:30.931085 15928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05ce5a3a20b464a8ff62fe6fa1a9fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.942129 16231 tablet_bootstrap.cc:492] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:30.952454 16231 tablet_bootstrap.cc:654] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.958699 16232 tablet_bootstrap.cc:492] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:30.960971 15998 tablet_service.cc:1511] Processing CreateTablet for tablet e05ce5a3a20b464a8ff62fe6fa1a9fbb (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:30.962105 16079 tablet_service.cc:1511] Processing CreateTablet for tablet e05ce5a3a20b464a8ff62fe6fa1a9fbb (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:30.963477 16079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05ce5a3a20b464a8ff62fe6fa1a9fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.964296 15925 tablet_service.cc:1511] Processing CreateTablet for tablet 10407fb45dc842e682ef7cb7dd5adaae (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:30.965705 15925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10407fb45dc842e682ef7cb7dd5adaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.969522 15998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05ce5a3a20b464a8ff62fe6fa1a9fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:30.985111 16232 tablet_bootstrap.cc:654] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.999187 16005 tablet_service.cc:1511] Processing CreateTablet for tablet 10407fb45dc842e682ef7cb7dd5adaae (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:30.999354 15930 tablet_service.cc:1511] Processing CreateTablet for tablet 7a75f5fd856645eb970947088b2d26d9 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:31.000612 16005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10407fb45dc842e682ef7cb7dd5adaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:31.001036 15930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a75f5fd856645eb970947088b2d26d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:31.002883 16002 tablet_service.cc:1511] Processing CreateTablet for tablet 7a75f5fd856645eb970947088b2d26d9 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:31.004293 16002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a75f5fd856645eb970947088b2d26d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:31.009706 16231 tablet_bootstrap.cc:492] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:31.010387 16231 ts_tablet_manager.cc:1403] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.007s
I20260709 12:18:31.011437 16075 tablet_service.cc:1511] Processing CreateTablet for tablet 7a75f5fd856645eb970947088b2d26d9 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:31.013144 16075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a75f5fd856645eb970947088b2d26d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:31.013079 15925 tablet_service.cc:1511] Processing CreateTablet for tablet fdbf97432c454b6abddbaa380e7738f1 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:31.013700 16231 raft_consensus.cc:359] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.018224 16231 raft_consensus.cc:385] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.018779 16231 raft_consensus.cc:740] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.019717 16231 consensus_queue.cc:260] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.022697 16076 tablet_service.cc:1511] Processing CreateTablet for tablet 10407fb45dc842e682ef7cb7dd5adaae (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:31.024339 16076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10407fb45dc842e682ef7cb7dd5adaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:31.028261 16234 tablet_bootstrap.cc:492] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:31.035430 16231 ts_tablet_manager.cc:1434] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.004s
I20260709 12:18:31.038653 15925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbf97432c454b6abddbaa380e7738f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:31.042999 16234 tablet_bootstrap.cc:654] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.044107 16232 tablet_bootstrap.cc:492] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:31.045480 16232 ts_tablet_manager.cc:1403] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.087s	user 0.008s	sys 0.011s
I20260709 12:18:31.049057 16232 raft_consensus.cc:359] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.044436 16078 tablet_service.cc:1511] Processing CreateTablet for tablet fdbf97432c454b6abddbaa380e7738f1 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:31.050800 16078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbf97432c454b6abddbaa380e7738f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:31.051776 16231 tablet_bootstrap.cc:492] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:31.054070 16232 raft_consensus.cc:385] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.054553 16232 raft_consensus.cc:740] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.055516 16232 consensus_queue.cc:260] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.058303 16232 ts_tablet_manager.cc:1434] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:18:31.062947 15998 tablet_service.cc:1511] Processing CreateTablet for tablet fdbf97432c454b6abddbaa380e7738f1 (DEFAULT_TABLE table=soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:31.074163 16232 tablet_bootstrap.cc:492] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:31.074820 15998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbf97432c454b6abddbaa380e7738f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:31.080869 16232 tablet_bootstrap.cc:654] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.093739 16231 tablet_bootstrap.cc:654] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.107698 16234 tablet_bootstrap.cc:492] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:31.108908 16234 ts_tablet_manager.cc:1403] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.081s	user 0.024s	sys 0.041s
I20260709 12:18:31.110682 16232 tablet_bootstrap.cc:492] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:31.111320 16232 ts_tablet_manager.cc:1403] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.011s
I20260709 12:18:31.111828 16234 raft_consensus.cc:359] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.112604 16234 raft_consensus.cc:385] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.112881 16234 raft_consensus.cc:740] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.113605 16234 consensus_queue.cc:260] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.115046 16232 raft_consensus.cc:359] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.115878 16232 raft_consensus.cc:385] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.116160 16234 ts_tablet_manager.cc:1434] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:18:31.117305 16234 tablet_bootstrap.cc:492] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:31.116221 16232 raft_consensus.cc:740] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.119540 16231 tablet_bootstrap.cc:492] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:31.120198 16231 ts_tablet_manager.cc:1403] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.003s
I20260709 12:18:31.120160 16232 consensus_queue.cc:260] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.123864 16234 tablet_bootstrap.cc:654] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.123787 16231 raft_consensus.cc:359] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.124646 16231 raft_consensus.cc:385] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.125020 16231 raft_consensus.cc:740] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.126168 16232 ts_tablet_manager.cc:1434] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:18:31.125955 16231 consensus_queue.cc:260] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.127278 16232 tablet_bootstrap.cc:492] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:31.136252 16232 tablet_bootstrap.cc:654] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.144819 16231 ts_tablet_manager.cc:1434] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:18:31.146304 16231 tablet_bootstrap.cc:492] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:31.148567 16218 raft_consensus.cc:493] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.149214 16218 raft_consensus.cc:515] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.152969 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abfeb76247d44ea9fd4937b5423a401" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:31.153262 16231 tablet_bootstrap.cc:654] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.153538 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abfeb76247d44ea9fd4937b5423a401" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:31.154160 16012 raft_consensus.cc:2468] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:31.155869 16055 leader_election.cc:304] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:31.157055 16218 leader_election.cc:290] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.157809 16218 raft_consensus.cc:2804] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:18:31.158218 16054 leader_election.cc:343] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.158910 16234 tablet_bootstrap.cc:492] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:31.159389 16232 tablet_bootstrap.cc:492] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:31.159464 16234 ts_tablet_manager.cc:1403] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.024s
I20260709 12:18:31.160036 16232 ts_tablet_manager.cc:1403] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.006s
I20260709 12:18:31.158236 16218 raft_consensus.cc:493] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.161329 16218 raft_consensus.cc:3060] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.163794 16232 raft_consensus.cc:359] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.164680 16232 raft_consensus.cc:385] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.163789 16234 raft_consensus.cc:359] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.165124 16232 raft_consensus.cc:740] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.165314 16234 raft_consensus.cc:385] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.165805 16234 raft_consensus.cc:740] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.166051 16232 consensus_queue.cc:260] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.168529 16232 ts_tablet_manager.cc:1434] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:31.169932 16232 tablet_bootstrap.cc:492] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:31.173803 16218 raft_consensus.cc:515] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.176318 16232 tablet_bootstrap.cc:654] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.176834 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abfeb76247d44ea9fd4937b5423a401" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
W20260709 12:18:31.178418 16054 leader_election.cc:343] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.166819 16234 consensus_queue.cc:260] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.180047 16218 leader_election.cc:290] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.181703 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abfeb76247d44ea9fd4937b5423a401" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:31.182384 16012 raft_consensus.cc:3060] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.183244 16231 tablet_bootstrap.cc:492] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:31.183434 16234 ts_tablet_manager.cc:1434] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.006s
I20260709 12:18:31.183799 16231 ts_tablet_manager.cc:1403] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.010s
I20260709 12:18:31.184625 16234 tablet_bootstrap.cc:492] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:31.190373 16231 raft_consensus.cc:359] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.191962 16232 tablet_bootstrap.cc:492] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:31.192657 16232 ts_tablet_manager.cc:1403] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 12:18:31.193238 16234 tablet_bootstrap.cc:654] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.195824 16232 raft_consensus.cc:359] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.196717 16232 raft_consensus.cc:385] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.197060 16232 raft_consensus.cc:740] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.198208 16232 consensus_queue.cc:260] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.200837 16232 ts_tablet_manager.cc:1434] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:18:31.201267 16231 raft_consensus.cc:385] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.201682 16231 raft_consensus.cc:740] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.202625 16231 consensus_queue.cc:260] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.205694 16231 ts_tablet_manager.cc:1434] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:18:31.206974 16231 tablet_bootstrap.cc:492] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:31.209007 16012 raft_consensus.cc:2468] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:31.210726 16055 leader_election.cc:304] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:31.212385 16218 raft_consensus.cc:2804] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.213152 16218 raft_consensus.cc:697] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:31.211253 16232 tablet_bootstrap.cc:492] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:31.214157 16218 consensus_queue.cc:237] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.217357 16231 tablet_bootstrap.cc:654] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.222373 16232 tablet_bootstrap.cc:654] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.226851 16234 tablet_bootstrap.cc:492] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:31.227619 16234 ts_tablet_manager.cc:1403] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.014s
I20260709 12:18:31.228979 16231 tablet_bootstrap.cc:492] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:31.229588 16231 ts_tablet_manager.cc:1403] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.001s
I20260709 12:18:31.229926 16232 tablet_bootstrap.cc:492] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:31.230489 16232 ts_tablet_manager.cc:1403] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:18:31.230816 16234 raft_consensus.cc:359] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.231621 16234 raft_consensus.cc:385] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.231949 16234 raft_consensus.cc:740] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.232713 16231 raft_consensus.cc:359] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.232856 16234 consensus_queue.cc:260] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.233577 16231 raft_consensus.cc:385] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.233451 16232 raft_consensus.cc:359] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.234309 16232 raft_consensus.cc:385] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.234285 16231 raft_consensus.cc:740] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.234795 16232 raft_consensus.cc:740] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.234712 15838 catalog_manager.cc:5697] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:31.235765 16232 consensus_queue.cc:260] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.238000 16234 ts_tablet_manager.cc:1434] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:18:31.235523 16231 consensus_queue.cc:260] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.238507 16232 ts_tablet_manager.cc:1434] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:18:31.239061 16234 tablet_bootstrap.cc:492] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:31.239624 16232 tablet_bootstrap.cc:492] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:31.240658 16231 ts_tablet_manager.cc:1434] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:18:31.241808 16231 tablet_bootstrap.cc:492] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:31.246259 16234 tablet_bootstrap.cc:654] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.246816 16232 tablet_bootstrap.cc:654] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.248638 16231 tablet_bootstrap.cc:654] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.251410 16215 raft_consensus.cc:493] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.252076 16215 raft_consensus.cc:515] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.257064 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faca4b87c1d94e479c457ec765be8bb3" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
W20260709 12:18:31.259959 15887 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:31.260371 16087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faca4b87c1d94e479c457ec765be8bb3" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:31.261219 16087 raft_consensus.cc:2468] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 0.
I20260709 12:18:31.263015 15982 leader_election.cc:304] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:31.265028 16216 raft_consensus.cc:493] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.265690 16216 raft_consensus.cc:515] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.268189 16216 leader_election.cc:290] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
W20260709 12:18:31.269340 15980 leader_election.cc:343] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.270115 16215 leader_election.cc:290] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:31.270653 16215 raft_consensus.cc:493] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.271116 16215 raft_consensus.cc:515] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.274369 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14623ca4f24c446c888867b1226fa5c1" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:31.275135 15938 raft_consensus.cc:2468] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 0.
I20260709 12:18:31.276706 15980 leader_election.cc:304] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:31.269364 16087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14623ca4f24c446c888867b1226fa5c1" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
W20260709 12:18:31.280645 15907 leader_election.cc:343] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.284670 16218 raft_consensus.cc:493] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.285550 16218 raft_consensus.cc:515] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.287940 16218 leader_election.cc:290] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.288718 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ce5a3a20b464a8ff62fe6fa1a9fbb" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:31.289392 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ce5a3a20b464a8ff62fe6fa1a9fbb" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
W20260709 12:18:31.290076 16054 leader_election.cc:343] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:31.291021 16055 leader_election.cc:343] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.291462 16055 leader_election.cc:304] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6
I20260709 12:18:31.292569 16218 raft_consensus.cc:2749] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:31.318790 16215 leader_election.cc:290] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:31.319587 16215 raft_consensus.cc:2804] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.319942 16215 raft_consensus.cc:493] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.320263 16215 raft_consensus.cc:3060] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.339406 16252 raft_consensus.cc:2804] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.340049 16252 raft_consensus.cc:493] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.340384 16252 raft_consensus.cc:3060] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:31.342267 15982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.67:38847, user_credentials={real_user=slave}} blocked reactor thread for 79475.2us
I20260709 12:18:31.344437 16087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14623ca4f24c446c888867b1226fa5c1" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:31.350814 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14623ca4f24c446c888867b1226fa5c1" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
W20260709 12:18:31.351796 15982 leader_election.cc:343] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.358218 16215 raft_consensus.cc:515] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.361563 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faca4b87c1d94e479c457ec765be8bb3" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
W20260709 12:18:31.363030 15980 leader_election.cc:343] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.369021 16234 tablet_bootstrap.cc:492] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:31.369807 16234 ts_tablet_manager.cc:1403] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.131s	user 0.068s	sys 0.048s
I20260709 12:18:31.369820 16232 tablet_bootstrap.cc:492] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:31.370560 16252 raft_consensus.cc:515] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.371634 16232 ts_tablet_manager.cc:1403] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.132s	user 0.043s	sys 0.075s
I20260709 12:18:31.371934 16012 raft_consensus.cc:2393] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 260d4aab0b964b578f642abfc831dd60 in current term 1: Already voted for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in this term.
I20260709 12:18:31.372219 16087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faca4b87c1d94e479c457ec765be8bb3" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:31.370527 16231 tablet_bootstrap.cc:492] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:31.372834 16234 raft_consensus.cc:359] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.370893 16215 leader_election.cc:290] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:31.372857 16087 raft_consensus.cc:3060] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.373790 16234 raft_consensus.cc:385] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.374035 15906 leader_election.cc:304] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60; no voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:31.374887 16216 raft_consensus.cc:3060] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.375243 16232 raft_consensus.cc:359] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.376016 16232 raft_consensus.cc:385] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.376165 16220 raft_consensus.cc:493] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.376372 16232 raft_consensus.cc:740] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.374210 16234 raft_consensus.cc:740] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.377955 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14623ca4f24c446c888867b1226fa5c1" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:31.379094 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14623ca4f24c446c888867b1226fa5c1" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:31.378886 16232 consensus_queue.cc:260] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.380103 16090 raft_consensus.cc:3060] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.381943 16232 ts_tablet_manager.cc:1434] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:18:31.373675 16231 ts_tablet_manager.cc:1403] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.132s	user 0.049s	sys 0.060s
I20260709 12:18:31.376726 16220 raft_consensus.cc:515] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.383941 16234 consensus_queue.cc:260] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.377537 16252 leader_election.cc:290] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:31.383268 16232 tablet_bootstrap.cc:492] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:31.386941 16089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abfeb76247d44ea9fd4937b5423a401" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:31.387531 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abfeb76247d44ea9fd4937b5423a401" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:31.388356 16012 raft_consensus.cc:2393] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 260d4aab0b964b578f642abfc831dd60 in current term 1: Already voted for candidate d2d4a09985a34e668f02fa94cc8d43d1 in this term.
I20260709 12:18:31.389611 15906 leader_election.cc:304] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60; no voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:31.386351 16231 raft_consensus.cc:359] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.391186 16231 raft_consensus.cc:385] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.391481 16231 raft_consensus.cc:740] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.392258 16231 consensus_queue.cc:260] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.394165 16090 raft_consensus.cc:2468] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 1.
I20260709 12:18:31.398196 16232 tablet_bootstrap.cc:654] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.398525 16231 ts_tablet_manager.cc:1434] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:18:31.402455 16231 tablet_bootstrap.cc:492] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:31.401259 16220 leader_election.cc:290] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:31.408491 16220 raft_consensus.cc:3060] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.409098 16231 tablet_bootstrap.cc:654] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.411644 15982 leader_election.cc:304] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:31.412572 16252 raft_consensus.cc:2804] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.413084 16252 raft_consensus.cc:697] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Becoming Leader. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:31.413914 16252 consensus_queue.cc:237] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.419812 16087 raft_consensus.cc:2468] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 1.
I20260709 12:18:31.421324 15982 leader_election.cc:304] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:31.422322 16215 raft_consensus.cc:2804] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.422838 16215 raft_consensus.cc:697] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Becoming Leader. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:31.423729 16215 consensus_queue.cc:237] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.425844 16231 tablet_bootstrap.cc:492] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:31.426391 16231 ts_tablet_manager.cc:1403] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.009s
I20260709 12:18:31.436956 16231 raft_consensus.cc:359] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.437785 16231 raft_consensus.cc:385] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.438095 16231 raft_consensus.cc:740] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.439131 16216 raft_consensus.cc:2749] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:31.438911 16231 consensus_queue.cc:260] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.441622 16231 ts_tablet_manager.cc:1434] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:18:31.449251 16231 tablet_bootstrap.cc:492] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:31.455964 16231 tablet_bootstrap.cc:654] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.461198 15938 raft_consensus.cc:2468] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 1.
I20260709 12:18:31.464362 16218 raft_consensus.cc:493] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.464903 16218 raft_consensus.cc:515] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.467068 16218 leader_election.cc:290] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.469237 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b602481f82b4c0e9961f10cc17c1a5a" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:31.470098 16012 raft_consensus.cc:2468] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:31.471449 16055 leader_election.cc:304] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:31.472537 16218 raft_consensus.cc:2804] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.473002 16218 raft_consensus.cc:493] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.473426 16218 raft_consensus.cc:3060] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.476063 15836 catalog_manager.cc:5697] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:31.479095 15906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.78.66:37877, user_credentials={real_user=slave}} blocked reactor thread for 89583.6us
I20260709 12:18:31.483748 15836 catalog_manager.cc:5697] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:31.485354 16220 raft_consensus.cc:2749] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:31.484395 16218 raft_consensus.cc:515] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.487576 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b602481f82b4c0e9961f10cc17c1a5a" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
W20260709 12:18:31.488718 16054 leader_election.cc:343] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.489972 16234 ts_tablet_manager.cc:1434] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.120s	user 0.015s	sys 0.036s
I20260709 12:18:31.490072 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b602481f82b4c0e9961f10cc17c1a5a" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:31.490739 16012 raft_consensus.cc:3060] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.490898 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b602481f82b4c0e9961f10cc17c1a5a" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:31.492210 16234 tablet_bootstrap.cc:492] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:31.498940 16234 tablet_bootstrap.cc:654] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.499367 16232 tablet_bootstrap.cc:492] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:31.499971 16232 ts_tablet_manager.cc:1403] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.117s	user 0.022s	sys 0.028s
W20260709 12:18:31.502121 16054 leader_election.cc:343] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.503393 16232 raft_consensus.cc:359] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.504245 16232 raft_consensus.cc:385] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.504554 16232 raft_consensus.cc:740] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.506179 16012 raft_consensus.cc:2468] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:31.507133 16218 leader_election.cc:290] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.508813 16055 leader_election.cc:304] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:31.510164 16218 raft_consensus.cc:2804] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.511070 16218 raft_consensus.cc:697] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:31.511968 16218 consensus_queue.cc:237] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.505391 16232 consensus_queue.cc:260] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.518644 16232 ts_tablet_manager.cc:1434] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:18:31.519795 16232 tablet_bootstrap.cc:492] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:31.532922 16234 tablet_bootstrap.cc:492] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:31.533499 16234 ts_tablet_manager.cc:1403] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.042s	user 0.028s	sys 0.010s
I20260709 12:18:31.535249 16232 tablet_bootstrap.cc:654] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.536711 16234 raft_consensus.cc:359] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.537477 16234 raft_consensus.cc:385] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.537031 15838 catalog_manager.cc:5697] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:31.537806 16234 raft_consensus.cc:740] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.538573 16234 consensus_queue.cc:260] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.540863 16234 ts_tablet_manager.cc:1434] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:31.541854 16234 tablet_bootstrap.cc:492] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:31.547086 16220 raft_consensus.cc:493] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.547729 16220 raft_consensus.cc:515] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.548643 16234 tablet_bootstrap.cc:654] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.550206 16218 raft_consensus.cc:493] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.550721 16218 raft_consensus.cc:515] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.551424 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faca4b87c1d94e479c457ec765be8bb3" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:31.552301 16090 raft_consensus.cc:2393] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 260d4aab0b964b578f642abfc831dd60 in current term 1: Already voted for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in this term.
I20260709 12:18:31.552949 16218 leader_election.cc:290] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.554956 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fca753abd7841a688bd3d4c299f9cb6" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:31.555693 15938 raft_consensus.cc:2468] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:31.555837 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faca4b87c1d94e479c457ec765be8bb3" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:31.556401 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fca753abd7841a688bd3d4c299f9cb6" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:31.557045 16054 leader_election.cc:304] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:31.558399 16218 raft_consensus.cc:2804] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.557096 16013 raft_consensus.cc:2468] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:31.560876 16220 leader_election.cc:290] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:31.557621 15906 leader_election.cc:304] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60; no voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:31.561857 16218 raft_consensus.cc:493] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.562219 16218 raft_consensus.cc:3060] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.562783 16234 tablet_bootstrap.cc:492] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:31.563284 16234 ts_tablet_manager.cc:1403] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:18:31.564814 16220 raft_consensus.cc:3060] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.566953 16231 tablet_bootstrap.cc:492] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:31.567525 16231 ts_tablet_manager.cc:1403] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.119s	user 0.023s	sys 0.030s
I20260709 12:18:31.569568 16234 raft_consensus.cc:359] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.570528 16234 raft_consensus.cc:385] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.570808 16234 raft_consensus.cc:740] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.571645 16234 consensus_queue.cc:260] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.569690 16218 raft_consensus.cc:515] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.574031 16234 ts_tablet_manager.cc:1434] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 12:18:31.574788 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fca753abd7841a688bd3d4c299f9cb6" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:31.575328 15938 raft_consensus.cc:3060] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.576017 16231 raft_consensus.cc:359] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.576545 16231 raft_consensus.cc:385] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.576728 16231 raft_consensus.cc:740] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.575455 16234 tablet_bootstrap.cc:492] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:31.578099 16231 consensus_queue.cc:260] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.580717 16231 ts_tablet_manager.cc:1434] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:18:31.581733 16231 tablet_bootstrap.cc:492] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:31.582139 15938 raft_consensus.cc:2468] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:31.583309 16054 leader_election.cc:304] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:31.584224 16241 raft_consensus.cc:2804] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.584297 16234 tablet_bootstrap.cc:654] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.588160 16231 tablet_bootstrap.cc:654] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.591913 16232 tablet_bootstrap.cc:492] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:31.592338 16232 ts_tablet_manager.cc:1403] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.005s
I20260709 12:18:31.599599 16241 raft_consensus.cc:697] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:31.600618 16241 consensus_queue.cc:237] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.602679 16220 raft_consensus.cc:2749] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:31.605924 16234 tablet_bootstrap.cc:492] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:31.606482 16234 ts_tablet_manager.cc:1403] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.011s
I20260709 12:18:31.607877 16218 leader_election.cc:290] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.597344 16232 raft_consensus.cc:359] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.609958 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fca753abd7841a688bd3d4c299f9cb6" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:31.610198 16232 raft_consensus.cc:385] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.610508 16232 raft_consensus.cc:740] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.610601 16013 raft_consensus.cc:3060] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.609543 16234 raft_consensus.cc:359] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.611908 16234 raft_consensus.cc:385] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.612205 16234 raft_consensus.cc:740] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.612880 16234 consensus_queue.cc:260] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.611204 16232 consensus_queue.cc:260] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.615834 16234 ts_tablet_manager.cc:1434] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:31.616061 16232 ts_tablet_manager.cc:1434] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:18:31.617022 16232 tablet_bootstrap.cc:492] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1: Bootstrap starting.
I20260709 12:18:31.617969 16234 tablet_bootstrap.cc:492] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:31.618321 16013 raft_consensus.cc:2468] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:31.622550 16231 tablet_bootstrap.cc:492] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:31.623096 16231 ts_tablet_manager.cc:1403] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.003s
I20260709 12:18:31.624208 16232 tablet_bootstrap.cc:654] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.623770 15838 catalog_manager.cc:5697] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:31.626005 16231 raft_consensus.cc:359] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.626657 16218 raft_consensus.cc:493] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.626700 16231 raft_consensus.cc:385] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.627236 16231 raft_consensus.cc:740] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.629015 16234 tablet_bootstrap.cc:654] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.627287 16218 raft_consensus.cc:515] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.627914 16231 consensus_queue.cc:260] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.630735 16218 leader_election.cc:290] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.633858 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:31.635222 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
W20260709 12:18:31.635293 16054 leader_election.cc:343] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:31.640398 16055 leader_election.cc:343] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.640947 16055 leader_election.cc:304] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6
I20260709 12:18:31.642386 16265 raft_consensus.cc:2749] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:31.644835 16231 ts_tablet_manager.cc:1434] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:18:31.645964 16231 tablet_bootstrap.cc:492] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6: Bootstrap starting.
I20260709 12:18:31.646844 16265 consensus_queue.cc:1048] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:31.656960 16265 consensus_queue.cc:1048] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:31.666162 16231 tablet_bootstrap.cc:654] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.671440 16232 tablet_bootstrap.cc:492] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1: No bootstrap required, opened a new log
I20260709 12:18:31.673282 16232 ts_tablet_manager.cc:1403] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.000s
I20260709 12:18:31.676067 16232 raft_consensus.cc:359] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.678913 16232 raft_consensus.cc:385] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.679569 16232 raft_consensus.cc:740] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.680636 16232 consensus_queue.cc:260] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.681092 16234 tablet_bootstrap.cc:492] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:31.682735 16234 ts_tablet_manager.cc:1403] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.065s	user 0.028s	sys 0.020s
I20260709 12:18:31.692838 16234 raft_consensus.cc:359] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.694123 16218 raft_consensus.cc:493] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.694788 16218 raft_consensus.cc:515] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.697254 16218 leader_election.cc:290] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.697088 16232 ts_tablet_manager.cc:1434] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:18:31.698232 15940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a75f5fd856645eb970947088b2d26d9" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:31.699821 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a75f5fd856645eb970947088b2d26d9" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:31.700645 16013 raft_consensus.cc:2468] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:31.701951 16055 leader_election.cc:304] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:31.694193 16234 raft_consensus.cc:385] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.705829 16234 raft_consensus.cc:740] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.706086 16218 raft_consensus.cc:2804] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.706915 16218 raft_consensus.cc:493] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.706611 16234 consensus_queue.cc:260] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.707710 15940 raft_consensus.cc:2468] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:31.712882 16234 ts_tablet_manager.cc:1434] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:18:31.713863 16234 tablet_bootstrap.cc:492] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60: Bootstrap starting.
I20260709 12:18:31.707353 16218 raft_consensus.cc:3060] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.719875 16234 tablet_bootstrap.cc:654] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.720332 16265 raft_consensus.cc:493] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.722028 16265 raft_consensus.cc:515] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.725548 16231 tablet_bootstrap.cc:492] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6: No bootstrap required, opened a new log
I20260709 12:18:31.726181 16231 ts_tablet_manager.cc:1403] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent bootstrapping tablet: real 0.080s	user 0.035s	sys 0.017s
I20260709 12:18:31.726217 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10407fb45dc842e682ef7cb7dd5adaae" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:31.726411 15940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10407fb45dc842e682ef7cb7dd5adaae" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:31.727046 16013 raft_consensus.cc:2468] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:31.727068 15940 raft_consensus.cc:2468] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 0.
I20260709 12:18:31.729276 16054 leader_election.cc:304] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:31.729254 16231 raft_consensus.cc:359] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.730227 16231 raft_consensus.cc:385] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.730517 16231 raft_consensus.cc:740] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.731241 16231 consensus_queue.cc:260] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.730628 16268 raft_consensus.cc:2804] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.732739 16268 raft_consensus.cc:493] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.733479 16268 raft_consensus.cc:3060] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.733629 16231 ts_tablet_manager.cc:1434] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:18:31.735615 16218 raft_consensus.cc:515] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.740679 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a75f5fd856645eb970947088b2d26d9" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:31.741442 16013 raft_consensus.cc:3060] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.746217 15940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a75f5fd856645eb970947088b2d26d9" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:31.746681 16215 raft_consensus.cc:493] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.747071 15940 raft_consensus.cc:3060] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.747375 16215 raft_consensus.cc:515] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.750365 16215 leader_election.cc:290] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:31.750660 15939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:31.751672 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:31.752307 16090 raft_consensus.cc:2468] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 0.
I20260709 12:18:31.753608 15982 leader_election.cc:304] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:31.754755 16215 raft_consensus.cc:2804] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:18:31.755062 15980 leader_election.cc:343] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.755250 16218 leader_election.cc:290] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.754931 16013 raft_consensus.cc:2468] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:31.755142 16215 raft_consensus.cc:493] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.756228 16215 raft_consensus.cc:3060] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.756989 16055 leader_election.cc:304] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:31.757865 16218 raft_consensus.cc:2804] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.758673 16218 raft_consensus.cc:697] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:31.759608 16218 consensus_queue.cc:237] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.732050 16265 leader_election.cc:290] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.768816 15940 raft_consensus.cc:2468] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:31.775089 16215 raft_consensus.cc:515] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.778160 16215 leader_election.cc:290] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:31.778129 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:31.778442 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:31.779313 16090 raft_consensus.cc:3060] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:31.779637 15980 leader_election.cc:343] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.780611 16268 raft_consensus.cc:515] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.781704 16234 tablet_bootstrap.cc:492] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60: No bootstrap required, opened a new log
I20260709 12:18:31.782250 16234 ts_tablet_manager.cc:1403] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.034s
I20260709 12:18:31.783252 15940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10407fb45dc842e682ef7cb7dd5adaae" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:31.783908 15940 raft_consensus.cc:3060] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.784993 16234 raft_consensus.cc:359] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.785674 16234 raft_consensus.cc:385] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.785934 16234 raft_consensus.cc:740] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.786531 16090 raft_consensus.cc:2468] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 1.
I20260709 12:18:31.786700 16234 consensus_queue.cc:260] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.787739 15982 leader_election.cc:304] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:31.788937 16234 ts_tablet_manager.cc:1434] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:18:31.789774 15837 catalog_manager.cc:5697] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:31.790968 16215 raft_consensus.cc:2804] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.791792 16215 raft_consensus.cc:697] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Becoming Leader. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:31.792307 15940 raft_consensus.cc:2468] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:31.792598 16215 consensus_queue.cc:237] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.793606 16268 leader_election.cc:290] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:31.794826 16054 leader_election.cc:304] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:31.796095 16265 raft_consensus.cc:2804] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.796550 16265 raft_consensus.cc:697] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:31.797317 16265 consensus_queue.cc:237] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.794857 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10407fb45dc842e682ef7cb7dd5adaae" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:31.798890 16013 raft_consensus.cc:3060] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.799547 16252 raft_consensus.cc:493] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.800051 16252 raft_consensus.cc:515] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.803951 15940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ce5a3a20b464a8ff62fe6fa1a9fbb" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60" is_pre_election: true
I20260709 12:18:31.804098 16252 leader_election.cc:290] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:31.804582 15940 raft_consensus.cc:2468] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 0.
I20260709 12:18:31.805332 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ce5a3a20b464a8ff62fe6fa1a9fbb" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:31.807554 16090 raft_consensus.cc:2468] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 0.
I20260709 12:18:31.805809 15980 leader_election.cc:304] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:31.806314 16254 raft_consensus.cc:493] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.811043 16254 raft_consensus.cc:515] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.813139 16254 leader_election.cc:290] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:31.813362 16013 raft_consensus.cc:2468] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 1.
I20260709 12:18:31.814716 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b602481f82b4c0e9961f10cc17c1a5a" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:31.815227 16215 raft_consensus.cc:2804] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.815639 16215 raft_consensus.cc:493] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.815958 16215 raft_consensus.cc:3060] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.822547 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b602481f82b4c0e9961f10cc17c1a5a" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:31.823355 16012 raft_consensus.cc:2393] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 260d4aab0b964b578f642abfc831dd60 in current term 1: Already voted for candidate d2d4a09985a34e668f02fa94cc8d43d1 in this term.
I20260709 12:18:31.824295 16215 raft_consensus.cc:515] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.824656 15906 leader_election.cc:304] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60; no voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:31.825501 16254 raft_consensus.cc:3060] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.826584 16215 leader_election.cc:290] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:31.827246 15940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ce5a3a20b464a8ff62fe6fa1a9fbb" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:31.827854 15940 raft_consensus.cc:3060] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.827497 15837 catalog_manager.cc:5697] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 1 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:31.828176 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ce5a3a20b464a8ff62fe6fa1a9fbb" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:31.828774 16090 raft_consensus.cc:3060] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.833105 16254 raft_consensus.cc:2749] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:31.835053 15940 raft_consensus.cc:2468] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 1.
I20260709 12:18:31.835582 16090 raft_consensus.cc:2468] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 1.
I20260709 12:18:31.835322 15836 catalog_manager.cc:5697] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:31.836314 15980 leader_election.cc:304] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:31.837492 16252 raft_consensus.cc:2804] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.839491 16252 raft_consensus.cc:697] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Becoming Leader. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:31.840304 16252 consensus_queue.cc:237] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:31.848199 15836 catalog_manager.cc:5697] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66). New cstate: current_term: 1 leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:31.862316 16252 consensus_queue.cc:1048] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:31.872268 16215 consensus_queue.cc:1048] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:31.897549 16215 consensus_queue.cc:1048] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:31.907608 16248 consensus_queue.cc:1048] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:32.009747 16265 consensus_queue.cc:1048] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.019486 16268 consensus_queue.cc:1048] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.033953 16090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6abfeb76247d44ea9fd4937b5423a401"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
mode: GRACEFUL
new_leader_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:42456
I20260709 12:18:32.034575 16090 raft_consensus.cc:606] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Received request to transfer leadership to TS 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:32.047602 16012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14623ca4f24c446c888867b1226fa5c1"
dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
mode: GRACEFUL
new_leader_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:49996
I20260709 12:18:32.048103 16012 raft_consensus.cc:606] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Received request to transfer leadership to TS 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:32.052642 16090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b602481f82b4c0e9961f10cc17c1a5a"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
mode: GRACEFUL
new_leader_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:42456
I20260709 12:18:32.053126 16090 raft_consensus.cc:606] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Received request to transfer leadership to TS 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:32.057296 16090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fca753abd7841a688bd3d4c299f9cb6"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
mode: GRACEFUL
new_leader_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:42456
I20260709 12:18:32.057745 16090 raft_consensus.cc:606] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Received request to transfer leadership to TS 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:32.066414 16090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10407fb45dc842e682ef7cb7dd5adaae"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
mode: GRACEFUL
new_leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
 from {username='slave'} at 127.0.0.1:42456
I20260709 12:18:32.066946 16090 raft_consensus.cc:606] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Received request to transfer leadership to TS 6dae5090ab1b4af98c4edeae63cf9df6
I20260709 12:18:32.071406 16090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a75f5fd856645eb970947088b2d26d9"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
mode: GRACEFUL
new_leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
 from {username='slave'} at 127.0.0.1:42456
I20260709 12:18:32.071856 16090 raft_consensus.cc:606] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Received request to transfer leadership to TS 6dae5090ab1b4af98c4edeae63cf9df6
I20260709 12:18:32.076109 16012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1"
dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
mode: GRACEFUL
new_leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
 from {username='slave'} at 127.0.0.1:49996
I20260709 12:18:32.076567 16012 raft_consensus.cc:606] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Received request to transfer leadership to TS d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:32.090585 16268 consensus_queue.cc:1048] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.103637 16241 consensus_queue.cc:1048] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.112030 16220 raft_consensus.cc:493] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.112524 16220 raft_consensus.cc:515] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.114624 16220 leader_election.cc:290] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:32.115454 16268 raft_consensus.cc:993] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1: : Instructing follower 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:32.115950 16268 raft_consensus.cc:1081] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Signalling peer 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:32.116264 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" is_pre_election: true
I20260709 12:18:32.116799 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" is_pre_election: true
I20260709 12:18:32.117543 16090 raft_consensus.cc:2393] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 260d4aab0b964b578f642abfc831dd60 in current term 1: Already voted for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in this term.
I20260709 12:18:32.117614 15940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b602481f82b4c0e9961f10cc17c1a5a"
dest_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:48466
I20260709 12:18:32.118314 15940 raft_consensus.cc:493] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:32.118650 15907 leader_election.cc:304] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60; no voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:32.118665 15940 raft_consensus.cc:3060] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.119817 16220 raft_consensus.cc:3060] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:32.125981 15940 raft_consensus.cc:515] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.128052 15940 leader_election.cc:290] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Requested vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:32.128089 16220 raft_consensus.cc:2749] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:32.129257 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b602481f82b4c0e9961f10cc17c1a5a" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:32.129652 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b602481f82b4c0e9961f10cc17c1a5a" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:32.129793 16013 raft_consensus.cc:3060] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.130298 16090 raft_consensus.cc:3055] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:32.130617 16090 raft_consensus.cc:740] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:32.131289 16090 consensus_queue.cc:260] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.132241 16090 raft_consensus.cc:3060] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.136014 16013 raft_consensus.cc:2468] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:32.136987 15906 leader_election.cc:304] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:32.137635 16220 raft_consensus.cc:2804] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:32.137643 16090 raft_consensus.cc:2468] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:32.138180 16220 raft_consensus.cc:697] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Becoming Leader. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:32.139003 16220 consensus_queue.cc:237] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.144937 15836 catalog_manager.cc:5697] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 reported cstate change: term changed from 1 to 2, leader changed from d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67) to 260d4aab0b964b578f642abfc831dd60 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "260d4aab0b964b578f642abfc831dd60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.185016 16248 consensus_queue.cc:1048] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.192734 16218 consensus_queue.cc:1048] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.199084 16215 consensus_queue.cc:1048] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.203522 16218 raft_consensus.cc:993] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1: : Instructing follower 6dae5090ab1b4af98c4edeae63cf9df6 to start an election
I20260709 12:18:32.204012 16218 raft_consensus.cc:1081] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Signalling peer 6dae5090ab1b4af98c4edeae63cf9df6 to start an election
I20260709 12:18:32.206367 16012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a75f5fd856645eb970947088b2d26d9"
dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
 from {username='slave'} at 127.0.0.1:51768
I20260709 12:18:32.206969 16012 raft_consensus.cc:493] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:32.207353 16012 raft_consensus.cc:3060] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.211653 16218 consensus_queue.cc:1048] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:32.214864 16248 raft_consensus.cc:993] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6: : Instructing follower d2d4a09985a34e668f02fa94cc8d43d1 to start an election
I20260709 12:18:32.215344 16248 raft_consensus.cc:1081] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Signalling peer d2d4a09985a34e668f02fa94cc8d43d1 to start an election
I20260709 12:18:32.217494 16090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:18:32.218178 16090 raft_consensus.cc:493] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:32.218583 16090 raft_consensus.cc:3060] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.220314 16012 raft_consensus.cc:515] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.221276 16013 raft_consensus.cc:1240] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Rejecting Update request from peer d2d4a09985a34e668f02fa94cc8d43d1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:32.224438 16218 consensus_queue.cc:1059] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.225243 16218 raft_consensus.cc:3055] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:32.225572 16218 raft_consensus.cc:740] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:32.225739 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a75f5fd856645eb970947088b2d26d9" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:32.226432 16218 consensus_queue.cc:260] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.227362 16218 raft_consensus.cc:3060] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.227396 16087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a75f5fd856645eb970947088b2d26d9" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:32.228077 16012 leader_election.cc:290] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 2 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:32.236755 16090 raft_consensus.cc:515] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.239427 16090 leader_election.cc:290] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 2 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:32.242195 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:32.242885 16012 raft_consensus.cc:3055] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:32.243199 16012 raft_consensus.cc:740] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:32.244074 16012 consensus_queue.cc:260] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.244536 16087 raft_consensus.cc:2468] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 2.
I20260709 12:18:32.242120 15940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbf97432c454b6abddbaa380e7738f1" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:32.245390 16012 raft_consensus.cc:3060] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.245671 15940 raft_consensus.cc:3060] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.248186 15982 leader_election.cc:304] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 260d4aab0b964b578f642abfc831dd60
I20260709 12:18:32.249423 16215 raft_consensus.cc:2804] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:32.249922 16215 raft_consensus.cc:697] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Becoming Leader. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:32.250733 16215 consensus_queue.cc:237] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.252291 15940 raft_consensus.cc:2468] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 2.
I20260709 12:18:32.253261 16054 leader_election.cc:304] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:32.254047 16218 raft_consensus.cc:2804] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:32.254431 16218 raft_consensus.cc:697] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:32.255116 16218 consensus_queue.cc:237] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.256865 16012 raft_consensus.cc:2468] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 2.
I20260709 12:18:32.259517 15837 catalog_manager.cc:5697] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 reported cstate change: term changed from 1 to 2, leader changed from d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67) to 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.262166 15836 catalog_manager.cc:5697] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 1 to 2, leader changed from 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66) to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 2 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:32.274286 16218 consensus_queue.cc:1048] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.281975 16268 raft_consensus.cc:993] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1: : Instructing follower 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:32.282464 16265 raft_consensus.cc:1081] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Signalling peer 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:32.284261 15940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6abfeb76247d44ea9fd4937b5423a401"
dest_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:48466
I20260709 12:18:32.284936 15940 raft_consensus.cc:493] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:32.285369 15940 raft_consensus.cc:3060] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.293798 16218 consensus_queue.cc:1048] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:32.293431 15940 raft_consensus.cc:515] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.298193 15940 leader_election.cc:290] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Requested vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:32.299275 16087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abfeb76247d44ea9fd4937b5423a401" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:32.299944 16087 raft_consensus.cc:3055] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:32.300275 16087 raft_consensus.cc:740] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:32.300886 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abfeb76247d44ea9fd4937b5423a401" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:32.301483 16013 raft_consensus.cc:3060] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.301085 16087 consensus_queue.cc:260] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.302511 16087 raft_consensus.cc:3060] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.303887 16265 raft_consensus.cc:993] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1: : Instructing follower 6dae5090ab1b4af98c4edeae63cf9df6 to start an election
I20260709 12:18:32.304411 16218 raft_consensus.cc:1081] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Signalling peer 6dae5090ab1b4af98c4edeae63cf9df6 to start an election
I20260709 12:18:32.306182 16012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10407fb45dc842e682ef7cb7dd5adaae"
dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
 from {username='slave'} at 127.0.0.1:51768
I20260709 12:18:32.306766 16012 raft_consensus.cc:493] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:32.307124 16012 raft_consensus.cc:3060] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.309237 16215 consensus_queue.cc:1048] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.310186 16087 raft_consensus.cc:2468] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:32.311596 15907 leader_election.cc:304] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:32.312386 16220 raft_consensus.cc:2804] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:32.312853 16220 raft_consensus.cc:697] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Becoming Leader. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:32.313750 16220 consensus_queue.cc:237] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.314081 16012 raft_consensus.cc:515] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.316380 16012 leader_election.cc:290] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 2 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:32.318349 15938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10407fb45dc842e682ef7cb7dd5adaae" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:32.319329 15938 raft_consensus.cc:3060] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.319511 16013 raft_consensus.cc:2468] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:32.321513 16087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10407fb45dc842e682ef7cb7dd5adaae" candidate_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:32.322105 16087 raft_consensus.cc:3055] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:32.322374 16087 raft_consensus.cc:740] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:32.323043 16087 consensus_queue.cc:260] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.324041 16087 raft_consensus.cc:3060] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.324572 16295 raft_consensus.cc:993] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6: : Instructing follower 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:32.325124 16295 raft_consensus.cc:1081] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Signalling peer 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:32.326954 15939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14623ca4f24c446c888867b1226fa5c1"
dest_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:48460
I20260709 12:18:32.327512 15939 raft_consensus.cc:493] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:32.327872 15939 raft_consensus.cc:3060] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.332027 16087 raft_consensus.cc:2468] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 2.
I20260709 12:18:32.333027 15982 leader_election.cc:304] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:32.333690 16295 raft_consensus.cc:2804] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:32.334162 16295 raft_consensus.cc:697] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Becoming Leader. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:32.334842 16295 consensus_queue.cc:237] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.340075 16295 consensus_queue.cc:1048] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.342533 15836 catalog_manager.cc:5697] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 reported cstate change: term changed from 1 to 2, leader changed from d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67) to 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66). New cstate: current_term: 2 leader_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.342804 15837 catalog_manager.cc:5697] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 reported cstate change: term changed from 1 to 2, leader changed from d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67) to 260d4aab0b964b578f642abfc831dd60 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "260d4aab0b964b578f642abfc831dd60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.344879 15939 raft_consensus.cc:515] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.347098 15939 leader_election.cc:290] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Requested vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:32.348281 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14623ca4f24c446c888867b1226fa5c1" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:32.348855 16090 raft_consensus.cc:3060] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.351225 16013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14623ca4f24c446c888867b1226fa5c1" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:32.351984 16013 raft_consensus.cc:3055] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:32.352325 16013 raft_consensus.cc:740] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:32.353228 16013 consensus_queue.cc:260] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.354576 16013 raft_consensus.cc:3060] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.355346 15938 raft_consensus.cc:2468] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dae5090ab1b4af98c4edeae63cf9df6 in term 2.
I20260709 12:18:32.358237 16090 raft_consensus.cc:2468] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:32.359843 15907 leader_election.cc:304] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:32.360682 16220 raft_consensus.cc:2804] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:32.361073 16220 raft_consensus.cc:697] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Becoming Leader. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:32.361783 16220 consensus_queue.cc:237] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.366174 16013 raft_consensus.cc:2468] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:32.375860 15837 catalog_manager.cc:5697] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 reported cstate change: term changed from 1 to 2, leader changed from 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66) to 260d4aab0b964b578f642abfc831dd60 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "260d4aab0b964b578f642abfc831dd60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.593855 16265 raft_consensus.cc:993] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1: : Instructing follower 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:32.594345 16218 raft_consensus.cc:1081] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Signalling peer 260d4aab0b964b578f642abfc831dd60 to start an election
I20260709 12:18:32.594815 16013 raft_consensus.cc:1275] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.595675 15938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fca753abd7841a688bd3d4c299f9cb6"
dest_uuid: "260d4aab0b964b578f642abfc831dd60"
 from {username='slave'} at 127.0.0.1:48466
I20260709 12:18:32.596302 15938 raft_consensus.cc:493] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:32.596272 16293 consensus_queue.cc:1048] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:32.596866 15938 raft_consensus.cc:3060] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.606473 15938 raft_consensus.cc:515] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.608604 15938 leader_election.cc:290] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Requested vote from peers 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877), d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67:38847)
I20260709 12:18:32.610072 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fca753abd7841a688bd3d4c299f9cb6" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:32.610658 16012 raft_consensus.cc:3060] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.614880 16087 raft_consensus.cc:1275] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.616187 16220 consensus_queue.cc:1048] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:32.616472 16090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fca753abd7841a688bd3d4c299f9cb6" candidate_uuid: "260d4aab0b964b578f642abfc831dd60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
I20260709 12:18:32.616962 16012 raft_consensus.cc:2468] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:32.617100 16090 raft_consensus.cc:3055] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:32.617453 16090 raft_consensus.cc:740] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:32.618234 16090 consensus_queue.cc:260] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.618369 15906 leader_election.cc:304] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, 6dae5090ab1b4af98c4edeae63cf9df6; no voters: 
I20260709 12:18:32.619477 16090 raft_consensus.cc:3060] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.619606 16220 raft_consensus.cc:2804] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:32.620131 16220 raft_consensus.cc:697] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Becoming Leader. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:32.620968 16220 consensus_queue.cc:237] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:32.628413 16090 raft_consensus.cc:2468] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 260d4aab0b964b578f642abfc831dd60 in term 2.
I20260709 12:18:32.629166 15837 catalog_manager.cc:5697] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 reported cstate change: term changed from 1 to 2, leader changed from d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67) to 260d4aab0b964b578f642abfc831dd60 (127.4.78.65). New cstate: current_term: 2 leader_uuid: "260d4aab0b964b578f642abfc831dd60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.656436 16012 raft_consensus.cc:1275] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Refusing update from remote peer d2d4a09985a34e668f02fa94cc8d43d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.657588 16218 consensus_queue.cc:1048] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:32.664636 15938 raft_consensus.cc:1275] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Refusing update from remote peer d2d4a09985a34e668f02fa94cc8d43d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.666303 16265 consensus_queue.cc:1048] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:32.759922 16090 raft_consensus.cc:1275] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 6dae5090ab1b4af98c4edeae63cf9df6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.761026 16215 consensus_queue.cc:1048] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:32.768447 15938 raft_consensus.cc:3060] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:32.774725 15938 raft_consensus.cc:1275] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Refusing update from remote peer 6dae5090ab1b4af98c4edeae63cf9df6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.775789 16252 consensus_queue.cc:1048] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:32.800810 16013 raft_consensus.cc:1275] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.802062 16220 consensus_queue.cc:1048] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:32.803244 16013 raft_consensus.cc:1275] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.804658 16303 consensus_queue.cc:1048] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:32.811861 16090 raft_consensus.cc:1275] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.813278 16220 consensus_queue.cc:1048] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:32.818944 16089 raft_consensus.cc:1275] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.821779 16293 consensus_queue.cc:1048] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:32.832870 15938 raft_consensus.cc:1275] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Refusing update from remote peer 6dae5090ab1b4af98c4edeae63cf9df6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.834383 16252 consensus_queue.cc:1048] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:32.842736 16090 raft_consensus.cc:1275] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 6dae5090ab1b4af98c4edeae63cf9df6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:32.845501 16248 consensus_queue.cc:1048] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:33.059494 16090 raft_consensus.cc:1275] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:33.060647 16293 consensus_queue.cc:1048] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:33.068626 16012 raft_consensus.cc:1275] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Refusing update from remote peer 260d4aab0b964b578f642abfc831dd60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:33.070452 16220 consensus_queue.cc:1048] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:35.079478 15838 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51228:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:18:35.098435 15838 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51228:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:18:35.129441  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:35.220018 16345 tablet.cc:1724] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.259229 16352 tablet.cc:1724] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.296362 16352 tablet.cc:1724] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:35.345077 16351 log.cc:927] Time spent T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:35.352403 16357 tablet.cc:1724] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.360430 16359 tablet.cc:1724] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.415393 16012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69"
dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
mode: GRACEFUL
new_leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
 from {username='slave'} at 127.0.0.1:50002
I20260709 12:18:35.418922 16012 raft_consensus.cc:606] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Received request to transfer leadership to TS d2d4a09985a34e668f02fa94cc8d43d1
W20260709 12:18:35.410105 15980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.78.65:36745, user_credentials={real_user=slave}} blocked reactor thread for 62453.7us
I20260709 12:18:35.395596 16361 tablet.cc:1724] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:35.422456 16339 log.cc:927] Time spent T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60: Append to log took a long time: real 0.070s	user 0.003s	sys 0.000s
I20260709 12:18:35.457238 16345 tablet.cc:1724] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.483850 16378 tablet.cc:1724] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.413875 16368 tablet.cc:1724] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.407044 16367 tablet.cc:1724] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.492102 16357 tablet.cc:1724] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.477722 16364 tablet.cc:1724] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.531090 16359 tablet.cc:1724] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.533357 16345 tablet.cc:1724] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.533684 16361 tablet.cc:1724] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.547679 15940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "919804186c204a3e81872852d49fea8c"
dest_uuid: "260d4aab0b964b578f642abfc831dd60"
mode: GRACEFUL
new_leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
 from {username='slave'} at 127.0.0.1:46756
I20260709 12:18:35.548096 16354 raft_consensus.cc:993] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6: : Instructing follower d2d4a09985a34e668f02fa94cc8d43d1 to start an election
I20260709 12:18:35.549434 16248 raft_consensus.cc:1081] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Signalling peer d2d4a09985a34e668f02fa94cc8d43d1 to start an election
I20260709 12:18:35.549558 15940 raft_consensus.cc:606] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Received request to transfer leadership to TS d2d4a09985a34e668f02fa94cc8d43d1
I20260709 12:18:35.551468 16083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:18:35.552029 16083 raft_consensus.cc:493] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:35.552340 16083 raft_consensus.cc:3060] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.561916  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:35.562785  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:35.566399 16377 tablet.cc:1724] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.569566 16367 tablet.cc:1724] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.574522 16379 tablet.cc:1724] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.576017 16345 tablet.cc:1724] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.583695 16083 raft_consensus.cc:515] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:35.586812 15940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:35.587049 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240639ea8cc4078824a3cea684b5d69" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:35.587507 15940 raft_consensus.cc:3060] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.587656 16012 raft_consensus.cc:3055] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:35.588150 16012 raft_consensus.cc:740] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6dae5090ab1b4af98c4edeae63cf9df6, State: Running, Role: LEADER
I20260709 12:18:35.588881 16012 consensus_queue.cc:260] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:35.590000 16012 raft_consensus.cc:3060] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.586536 16083 leader_election.cc:290] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 3 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:35.594573 15940 raft_consensus.cc:2468] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 3.
I20260709 12:18:35.606769 16012 raft_consensus.cc:2468] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 3.
I20260709 12:18:35.614068 16054 leader_election.cc:304] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 260d4aab0b964b578f642abfc831dd60, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:35.615743 16265 raft_consensus.cc:2804] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:35.616254 16265 raft_consensus.cc:697] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 3 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:35.617111 16265 consensus_queue.cc:237] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:35.567135 16357 tablet.cc:1724] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.608045 16377 tablet.cc:1724] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.619746 16379 tablet.cc:1724] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.626968 16364 tablet.cc:1724] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.629195 16368 tablet.cc:1724] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.644485 16359 tablet.cc:1724] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.648631 16379 tablet.cc:1724] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.651266 16377 tablet.cc:1724] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:35.667480 15838 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762: soft_deleted_table [id=61b19c28779c409ab82e5734b7b3a327] alter complete (version 1)
I20260709 12:18:35.676383 16371 raft_consensus.cc:993] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60: : Instructing follower d2d4a09985a34e668f02fa94cc8d43d1 to start an election
I20260709 12:18:35.676966 16371 raft_consensus.cc:1081] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Signalling peer d2d4a09985a34e668f02fa94cc8d43d1 to start an election
I20260709 12:18:35.678829 16083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "919804186c204a3e81872852d49fea8c"
dest_uuid: "d2d4a09985a34e668f02fa94cc8d43d1"
 from {username='slave'} at 127.0.0.1:42446
I20260709 12:18:35.679461 16083 raft_consensus.cc:493] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:35.679855 16083 raft_consensus.cc:3060] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.687109 16083 raft_consensus.cc:515] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:35.689199 16083 leader_election.cc:290] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 3 election: Requested vote from peers 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745), 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877)
I20260709 12:18:35.689906 15939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919804186c204a3e81872852d49fea8c" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "260d4aab0b964b578f642abfc831dd60"
I20260709 12:18:35.690618 15939 raft_consensus.cc:3055] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:35.690966 15939 raft_consensus.cc:740] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 260d4aab0b964b578f642abfc831dd60, State: Running, Role: LEADER
I20260709 12:18:35.691701 15939 consensus_queue.cc:260] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:35.690636 16012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919804186c204a3e81872852d49fea8c" candidate_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6dae5090ab1b4af98c4edeae63cf9df6"
I20260709 12:18:35.692567 16012 raft_consensus.cc:3060] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.692817 15939 raft_consensus.cc:3060] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:35.693174 15837 catalog_manager.cc:5697] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 2 to 3, leader changed from 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66) to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:35.698434 16012 raft_consensus.cc:2468] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 3.
I20260709 12:18:35.698843 15939 raft_consensus.cc:2468] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2d4a09985a34e668f02fa94cc8d43d1 in term 3.
I20260709 12:18:35.699883 16055 leader_election.cc:304] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dae5090ab1b4af98c4edeae63cf9df6, d2d4a09985a34e668f02fa94cc8d43d1; no voters: 
I20260709 12:18:35.700675 16265 raft_consensus.cc:2804] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:35.701073 16265 raft_consensus.cc:697] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 3 LEADER]: Becoming Leader. State: Replica: d2d4a09985a34e668f02fa94cc8d43d1, State: Running, Role: LEADER
I20260709 12:18:35.702008 16265 consensus_queue.cc:237] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } }
I20260709 12:18:35.711561 15837 catalog_manager.cc:5697] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 reported cstate change: term changed from 2 to 3, leader changed from 260d4aab0b964b578f642abfc831dd60 (127.4.78.65) to d2d4a09985a34e668f02fa94cc8d43d1 (127.4.78.67). New cstate: current_term: 3 leader_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2d4a09985a34e668f02fa94cc8d43d1" member_type: VOTER last_known_addr { host: "127.4.78.67" port: 38847 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:36.098734 15939 raft_consensus.cc:1275] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 3 FOLLOWER]: Refusing update from remote peer d2d4a09985a34e668f02fa94cc8d43d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:36.099869 16265 consensus_queue.cc:1048] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:36.114914 16012 raft_consensus.cc:1275] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 3 FOLLOWER]: Refusing update from remote peer d2d4a09985a34e668f02fa94cc8d43d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:36.116641 16265 consensus_queue.cc:1048] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:36.169808 16012 raft_consensus.cc:1275] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 3 FOLLOWER]: Refusing update from remote peer d2d4a09985a34e668f02fa94cc8d43d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:36.171233 16355 consensus_queue.cc:1048] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dae5090ab1b4af98c4edeae63cf9df6" member_type: VOTER last_known_addr { host: "127.4.78.66" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:36.182683 15939 raft_consensus.cc:1275] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 3 FOLLOWER]: Refusing update from remote peer d2d4a09985a34e668f02fa94cc8d43d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:36.184010 16355 consensus_queue.cc:1048] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "260d4aab0b964b578f642abfc831dd60" member_type: VOTER last_known_addr { host: "127.4.78.65" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:36.563935  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:36.570031  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:36.570422  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:37.571349  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:37.576299  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:37.576766  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:38.577907  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:38.582870  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:38.583340  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:39.584744  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:39.591715  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:39.592139  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:40.593151  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:40.597944  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:40.598289  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:41.599128  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:41.604024  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:41.604631  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:42.605635  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:42.610535  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:42.610900  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:43.611773  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:43.616732  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:43.617106  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:44.617998  4409 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:44.623255  4409 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:44.623646  4409 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:45.677248  4409 tablet_server.cc:179] TabletServer@127.4.78.65:0 shutting down...
W20260709 12:18:45.705415 16054 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 12:18:45.709182 16054 consensus_peers.cc:597] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 -> Peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Couldn't send request to peer 260d4aab0b964b578f642abfc831dd60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:45.721586  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:45.722541  4409 tablet_replica.cc:333] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.723537  4409 raft_consensus.cc:2243] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.724213  4409 raft_consensus.cc:2272] T fdbf97432c454b6abddbaa380e7738f1 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.727051  4409 tablet_replica.cc:333] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.727661  4409 raft_consensus.cc:2243] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.728216  4409 raft_consensus.cc:2272] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.730852  4409 tablet_replica.cc:333] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.731446  4409 raft_consensus.cc:2243] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.732641  4409 raft_consensus.cc:2272] T 9b602481f82b4c0e9961f10cc17c1a5a P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.735425  4409 tablet_replica.cc:333] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.735940  4409 raft_consensus.cc:2243] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.736442  4409 raft_consensus.cc:2272] T faca4b87c1d94e479c457ec765be8bb3 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.738775  4409 tablet_replica.cc:333] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.739348  4409 raft_consensus.cc:2243] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.739781  4409 raft_consensus.cc:2272] T 7a75f5fd856645eb970947088b2d26d9 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.742723  4409 tablet_replica.cc:333] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.743474  4409 raft_consensus.cc:2243] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.744048  4409 raft_consensus.cc:2272] T 10407fb45dc842e682ef7cb7dd5adaae P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.746538  4409 tablet_replica.cc:333] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.747171  4409 raft_consensus.cc:2243] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.748090  4409 raft_consensus.cc:2272] T 6abfeb76247d44ea9fd4937b5423a401 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.751156  4409 tablet_replica.cc:333] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.751924  4409 raft_consensus.cc:2243] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.753014  4409 raft_consensus.cc:2272] T 7fca753abd7841a688bd3d4c299f9cb6 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.755437  4409 tablet_replica.cc:333] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.756029  4409 raft_consensus.cc:2243] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.756505  4409 raft_consensus.cc:2272] T 4d095f1cc36043d381261e761834d924 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.759557  4409 tablet_replica.cc:333] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.760249  4409 raft_consensus.cc:2243] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.761261  4409 raft_consensus.cc:2272] T 14623ca4f24c446c888867b1226fa5c1 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.763697  4409 tablet_replica.cc:333] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.764238  4409 raft_consensus.cc:2243] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.764685  4409 raft_consensus.cc:2272] T 5d89b0abbf8142e1a50b635107b8a769 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.767071  4409 tablet_replica.cc:333] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.767608  4409 raft_consensus.cc:2243] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.768095  4409 raft_consensus.cc:2272] T 2240639ea8cc4078824a3cea684b5d69 P 260d4aab0b964b578f642abfc831dd60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.770498  4409 tablet_replica.cc:333] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.771077  4409 raft_consensus.cc:2243] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.771565  4409 raft_consensus.cc:2272] T 9a332a1c11604255aba256e0bc4b2cbf P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.774271  4409 tablet_replica.cc:333] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.774966  4409 raft_consensus.cc:2243] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.775864  4409 raft_consensus.cc:2272] T 34f08f5134c7466a978d1b189f34bff5 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.779227  4409 tablet_replica.cc:333] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.779742  4409 raft_consensus.cc:2243] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.780563  4409 raft_consensus.cc:2272] T f5cc8a09b3ac4e91808e27698aef80ba P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.782907  4409 tablet_replica.cc:333] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.783407  4409 raft_consensus.cc:2243] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.783871  4409 raft_consensus.cc:2272] T 919804186c204a3e81872852d49fea8c P 260d4aab0b964b578f642abfc831dd60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.786325  4409 tablet_replica.cc:333] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.786826  4409 raft_consensus.cc:2243] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.787803  4409 raft_consensus.cc:2272] T 615c065b41924e9083551a8d5c2a02d2 P 260d4aab0b964b578f642abfc831dd60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.790897  4409 tablet_replica.cc:333] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60: stopping tablet replica
I20260709 12:18:45.791381  4409 raft_consensus.cc:2243] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.791930  4409 raft_consensus.cc:2272] T 761fa1e757fb4690abc0bfc7951dc1d1 P 260d4aab0b964b578f642abfc831dd60 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:45.792091 15980 consensus_peers.cc:597] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 -> Peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Couldn't send request to peer 260d4aab0b964b578f642abfc831dd60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:45.836189  4409 tablet_server.cc:196] TabletServer@127.4.78.65:0 shutdown complete.
W20260709 12:18:45.844291 15980 consensus_peers.cc:597] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 -> Peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Couldn't send request to peer 260d4aab0b964b578f642abfc831dd60. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:45.870827 15980 consensus_peers.cc:597] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 -> Peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Couldn't send request to peer 260d4aab0b964b578f642abfc831dd60. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:45.877785 16054 consensus_peers.cc:597] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 -> Peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Couldn't send request to peer 260d4aab0b964b578f642abfc831dd60. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:45.887035  4409 tablet_server.cc:179] TabletServer@127.4.78.66:0 shutting down...
W20260709 12:18:45.901471 16054 consensus_peers.cc:597] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 -> Peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Couldn't send request to peer 260d4aab0b964b578f642abfc831dd60. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:45.908013 15980 consensus_peers.cc:597] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 -> Peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Couldn't send request to peer 260d4aab0b964b578f642abfc831dd60. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:45.924263  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:45.925344  4409 tablet_replica.cc:333] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.926254  4409 raft_consensus.cc:2243] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.926848  4409 raft_consensus.cc:2272] T fdbf97432c454b6abddbaa380e7738f1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.929355  4409 tablet_replica.cc:333] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.930018  4409 raft_consensus.cc:2243] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.930902  4409 raft_consensus.cc:2272] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.933184  4409 tablet_replica.cc:333] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.933724  4409 raft_consensus.cc:2243] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.934314  4409 raft_consensus.cc:2272] T 9b602481f82b4c0e9961f10cc17c1a5a P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.936430  4409 tablet_replica.cc:333] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.936975  4409 raft_consensus.cc:2243] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.937417  4409 raft_consensus.cc:2272] T 2240639ea8cc4078824a3cea684b5d69 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.939649  4409 tablet_replica.cc:333] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.940176  4409 raft_consensus.cc:2243] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.940649  4409 raft_consensus.cc:2272] T 9a332a1c11604255aba256e0bc4b2cbf P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.943430  4409 tablet_replica.cc:333] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.944151  4409 raft_consensus.cc:2243] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.945219  4409 raft_consensus.cc:2272] T 761fa1e757fb4690abc0bfc7951dc1d1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.947639  4409 tablet_replica.cc:333] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.948213  4409 raft_consensus.cc:2243] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.948712  4409 raft_consensus.cc:2272] T 34f08f5134c7466a978d1b189f34bff5 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.950971  4409 tablet_replica.cc:333] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.951484  4409 raft_consensus.cc:2243] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.951974  4409 raft_consensus.cc:2272] T f5cc8a09b3ac4e91808e27698aef80ba P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.954526  4409 tablet_replica.cc:333] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.955112  4409 raft_consensus.cc:2243] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.955963  4409 raft_consensus.cc:2272] T 4d095f1cc36043d381261e761834d924 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.958281  4409 tablet_replica.cc:333] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.958833  4409 raft_consensus.cc:2243] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.959712  4409 raft_consensus.cc:2272] T faca4b87c1d94e479c457ec765be8bb3 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.961886  4409 tablet_replica.cc:333] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.962426  4409 raft_consensus.cc:2243] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.962885  4409 raft_consensus.cc:2272] T 919804186c204a3e81872852d49fea8c P 6dae5090ab1b4af98c4edeae63cf9df6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.965029  4409 tablet_replica.cc:333] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.965564  4409 raft_consensus.cc:2243] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.966041  4409 raft_consensus.cc:2272] T 615c065b41924e9083551a8d5c2a02d2 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.968314  4409 tablet_replica.cc:333] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.968914  4409 raft_consensus.cc:2243] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.969830  4409 raft_consensus.cc:2272] T 7a75f5fd856645eb970947088b2d26d9 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.972132  4409 tablet_replica.cc:333] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.972654  4409 raft_consensus.cc:2243] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.973536  4409 raft_consensus.cc:2272] T 10407fb45dc842e682ef7cb7dd5adaae P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.975912  4409 tablet_replica.cc:333] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.976440  4409 raft_consensus.cc:2243] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.976954  4409 raft_consensus.cc:2272] T 7fca753abd7841a688bd3d4c299f9cb6 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.979116  4409 tablet_replica.cc:333] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.979642  4409 raft_consensus.cc:2243] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.980134  4409 raft_consensus.cc:2272] T 6abfeb76247d44ea9fd4937b5423a401 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.982419  4409 tablet_replica.cc:333] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.982920  4409 raft_consensus.cc:2243] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.983395  4409 raft_consensus.cc:2272] T 14623ca4f24c446c888867b1226fa5c1 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.985618  4409 tablet_replica.cc:333] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6: stopping tablet replica
I20260709 12:18:45.986109  4409 raft_consensus.cc:2243] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:45.986917  4409 raft_consensus.cc:2272] T 5d89b0abbf8142e1a50b635107b8a769 P 6dae5090ab1b4af98c4edeae63cf9df6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:45.995240 16054 consensus_peers.cc:597] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 -> Peer 260d4aab0b964b578f642abfc831dd60 (127.4.78.65:36745): Couldn't send request to peer 260d4aab0b964b578f642abfc831dd60. Status: Network error: Client connection negotiation failed: client connection to 127.4.78.65:36745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:46.012194 16055 consensus_peers.cc:597] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 -> Peer 6dae5090ab1b4af98c4edeae63cf9df6 (127.4.78.66:37877): Couldn't send request to peer 6dae5090ab1b4af98c4edeae63cf9df6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:46.031482  4409 tablet_server.cc:196] TabletServer@127.4.78.66:0 shutdown complete.
I20260709 12:18:46.068598  4409 tablet_server.cc:179] TabletServer@127.4.78.67:0 shutting down...
I20260709 12:18:46.096545  4409 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:46.097268  4409 tablet_replica.cc:333] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.098038  4409 raft_consensus.cc:2243] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.098927  4409 raft_consensus.cc:2272] T fdbf97432c454b6abddbaa380e7738f1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.101137  4409 tablet_replica.cc:333] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.101783  4409 raft_consensus.cc:2243] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.102298  4409 raft_consensus.cc:2272] T e05ce5a3a20b464a8ff62fe6fa1a9fbb P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.104404  4409 tablet_replica.cc:333] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.105019  4409 raft_consensus.cc:2243] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.105510  4409 raft_consensus.cc:2272] T faca4b87c1d94e479c457ec765be8bb3 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.107674  4409 tablet_replica.cc:333] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.108204  4409 raft_consensus.cc:2243] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.108723  4409 raft_consensus.cc:2272] T 9b602481f82b4c0e9961f10cc17c1a5a P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.110991  4409 tablet_replica.cc:333] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.111722  4409 raft_consensus.cc:2243] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.112998  4409 raft_consensus.cc:2272] T 2240639ea8cc4078824a3cea684b5d69 P d2d4a09985a34e668f02fa94cc8d43d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.115715  4409 tablet_replica.cc:333] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.116379  4409 raft_consensus.cc:2243] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.117141  4409 raft_consensus.cc:2272] T 9a332a1c11604255aba256e0bc4b2cbf P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.119333  4409 tablet_replica.cc:333] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.119850  4409 raft_consensus.cc:2243] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.120275  4409 raft_consensus.cc:2272] T 34f08f5134c7466a978d1b189f34bff5 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.122382  4409 tablet_replica.cc:333] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.122946  4409 raft_consensus.cc:2243] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.123359  4409 raft_consensus.cc:2272] T f5cc8a09b3ac4e91808e27698aef80ba P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.125407  4409 tablet_replica.cc:333] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.126150  4409 raft_consensus.cc:2243] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.126613  4409 raft_consensus.cc:2272] T 4d095f1cc36043d381261e761834d924 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.128734  4409 tablet_replica.cc:333] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.129240  4409 raft_consensus.cc:2243] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.130095  4409 raft_consensus.cc:2272] T 919804186c204a3e81872852d49fea8c P d2d4a09985a34e668f02fa94cc8d43d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.132087  4409 tablet_replica.cc:333] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.132593  4409 raft_consensus.cc:2243] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.133009  4409 raft_consensus.cc:2272] T 615c065b41924e9083551a8d5c2a02d2 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.135087  4409 tablet_replica.cc:333] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.135625  4409 raft_consensus.cc:2243] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.136075  4409 raft_consensus.cc:2272] T 761fa1e757fb4690abc0bfc7951dc1d1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.138188  4409 tablet_replica.cc:333] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.138733  4409 raft_consensus.cc:2243] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.139194  4409 raft_consensus.cc:2272] T 10407fb45dc842e682ef7cb7dd5adaae P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.141407  4409 tablet_replica.cc:333] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.142019  4409 raft_consensus.cc:2243] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.142558  4409 raft_consensus.cc:2272] T 7a75f5fd856645eb970947088b2d26d9 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.144820  4409 tablet_replica.cc:333] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.145368  4409 raft_consensus.cc:2243] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.145925  4409 raft_consensus.cc:2272] T 7fca753abd7841a688bd3d4c299f9cb6 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.148057  4409 tablet_replica.cc:333] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.148558  4409 raft_consensus.cc:2243] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.149063  4409 raft_consensus.cc:2272] T 6abfeb76247d44ea9fd4937b5423a401 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.151114  4409 tablet_replica.cc:333] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.151571  4409 raft_consensus.cc:2243] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.152024  4409 raft_consensus.cc:2272] T 14623ca4f24c446c888867b1226fa5c1 P d2d4a09985a34e668f02fa94cc8d43d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.154093  4409 tablet_replica.cc:333] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1: stopping tablet replica
I20260709 12:18:46.154585  4409 raft_consensus.cc:2243] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.155014  4409 raft_consensus.cc:2272] T 5d89b0abbf8142e1a50b635107b8a769 P d2d4a09985a34e668f02fa94cc8d43d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.196873  4409 tablet_server.cc:196] TabletServer@127.4.78.67:0 shutdown complete.
I20260709 12:18:46.233112  4409 master.cc:562] Master@127.4.78.126:41023 shutting down...
I20260709 12:18:46.253746  4409 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.254371  4409 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.254702  4409 tablet_replica.cc:333] T 00000000000000000000000000000000 P 82a1e439ac334de3adcee3539c4c2762: stopping tablet replica
I20260709 12:18:46.274849  4409 master.cc:584] Master@127.4.78.126:41023 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20235 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41123 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (421069 ms total)
[  PASSED  ] 8 tests.
I20260709 12:18:46.330480  4409 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2249 messages since previous log ~31 seconds ago
I20260709 12:18:46.330722  4409 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2249 messages since previous log ~31 seconds ago
I20260709 12:18:46.330891  4409 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2247 messages since previous log ~32 seconds ago
I20260709 12:18:46.331089  4409 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:18:46.331262  4409 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:18:46.331460  4409 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 3 messages since previous log ~195 seconds ago
I20260709 12:18:46.331650  4409 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 3 messages since previous log ~244 seconds ago
I20260709 12:18:46.331815  4409 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~220 seconds ago
I20260709 12:18:46.332046  4409 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 12:18:46.332331  4409 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
